Compare commits

Home / Compare fa2ff259 .. 681eb871

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.911-53.914=-0.002
σ0.365-0.365=-0.000
min53.784-53.779=0.005
max54.951-54.954=-0.002
mean416.100-416.000=0.100
σ0.316-0.000=0.316
min416.000
max417.000-416.000=1.000
mean0.135-0.138=-0.003
σ0.005-0.003=0.002
min0.129-0.135=-0.006
max0.141-0.143=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.007-0.007=-0.001
min43.128-43.131=-0.004
max43.154-43.150=0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.117=0.006
σ0.005-0.003=0.002
min0.118-0.114=0.003
max0.134-0.126=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.818-991.809=0.009
σ1.258-1.257=0.002
min991.231-991.248=-0.017
max997.108-997.098=0.010
mean1071.300-1063.300=8.000
σ312.702-321.847=-9.145
min617.000-568.000=49.000
max1643.000-1636.000=7.000
mean1.517-1.543=-0.026
σ0.057-0.096=-0.039
min1.444-1.397=0.046
max1.640-1.741=-0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.412=0.001
σ0.012-0.010=0.002
min285.393-285.395=-0.002
max285.423-285.421=0.001
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean0.372-0.378=-0.006
σ0.007-0.007=-0.000
min0.368-0.374=-0.006
max0.384-0.390=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.343-1285.373=-0.030
σ0.069-0.124=-0.056
min1285.308-1285.314=-0.007
max1285.466-1285.596=-0.130
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean1.886-1.916=-0.030
σ0.080-0.115=-0.035
min1.825-1.804=0.020
max2.020-2.080=-0.060
iters=5
new-facts=6402
prior-facts=1
mean1807.725-1807.689=0.036
σ6.983-6.998=-0.016
min1804.337-1804.337=-0.000
max1820.201-1820.194=0.006
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean4.309-4.115=0.194
σ0.355-0.234=0.121
min4.003-3.856=0.148
max4.892-4.439=0.453
iters=5
new-facts=6402
prior-facts=6402
mean2070.192-2070.190=0.002
σ0.007-0.007=-0.000
min2070.182-2070.180=0.002
max2070.199-2070.200=-0.000
mean1863.800-1838.200=25.600
σ196.516-188.355=8.161
min1643.000-1636.000=7.000
max2091.000-2082.000=9.000
mean4.510-4.477=0.033
σ0.070-0.109=-0.039
min4.455-4.406=0.050
max4.623-4.670=-0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.193=0.035
σ0.288-0.361=-0.073
min1.034-0.913=0.121
max1.726-1.760=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.789-436.786=0.004
σ572.359-572.363=-0.004
min150.600-150.601=-0.001
max1295.327-1295.330=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean0.528-0.535=-0.007
σ0.539-0.552=-0.013
min0.246-0.254=-0.007
max1.336-1.363=-0.027
policies=20
mean1506.263-1506.265=-0.002
σ0.238-0.252=-0.013
min1506.120-1506.105=0.015
max1506.620-1506.641=-0.021
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean2.519-2.535=-0.017
σ0.020-0.040=-0.020
min2.507-2.507=0.000
max2.549-2.591=-0.042
policies=200
mean15070.383-15070.386=-0.003
σ0.040-0.040=0.000
min15070.340-15070.341=-0.001
max15070.431-15070.434=-0.003
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean25.480-25.370=0.110
σ0.199-0.123=0.076
min25.309-25.247=0.062
max25.702-25.504=0.199