Compare commits

Home / Compare f885f919 .. 3f37f9c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.965-35.965=-0.001
σ0.107-0.104=0.002
min35.923-35.923=0.000
max36.269-36.262=0.007
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.076-0.075=0.001
σ0.005-0.004=0.000
min0.071-0.069=0.002
max0.083-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.202-26.202=-0.000
σ0.005-0.004=0.001
min26.196-26.194=0.002
max26.208-26.209=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.062-0.061=0.000
σ0.003-0.003=-0.000
min0.060-0.060=0.001
max0.069-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.614-1756.613=0.001
σ0.368-0.369=-0.001
min1756.041-1756.040=0.001
max1757.210-1757.209=0.001
mean1638.950-1635.950=3.000
σ629.593-641.512=-11.919
min640.000-644.000=-4.000
max2837.000-2876.000=-39.000
mean2.432-2.414=0.018
σ0.196-0.167=0.029
min2.284-2.266=0.017
max2.966-2.901=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.693-277.668=0.025
σ0.005-0.008=-0.003
min277.686-277.657=0.029
max277.698-277.677=0.021
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean0.409-0.409=-0.000
σ0.008-0.006=0.002
min0.401-0.402=-0.001
max0.418-0.417=0.002
iters=5
new-facts=1
prior-facts=6402
mean2176.663-2176.661=0.002
σ0.008-0.008=0.001
min2176.649-2176.651=-0.001
max2176.671-2176.671=0.000
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean2.854-2.965=-0.111
σ0.113-0.107=0.006
min2.765-2.776=-0.010
max3.042-3.035=0.007
iters=5
new-facts=6402
prior-facts=1
mean5046.315-5046.203=0.112
σ0.948-1.018=-0.069
min5045.796-5045.308=0.488
max5048.004-5047.943=0.061
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean8.667-8.731=-0.064
σ0.642-0.762=-0.119
min8.136-8.062=0.074
max9.754-9.586=0.168
iters=5
new-facts=6402
prior-facts=6402
mean5183.614-5183.679=-0.065
σ0.207-0.094=0.113
min5183.266-5183.575=-0.309
max5183.784-5183.790=-0.007
mean3237.600-3313.000=-75.400
σ417.728-360.987=56.741
min2837.000-2876.000=-39.000
max3829.000-3667.000=162.000
mean8.882-8.992=-0.110
σ0.302-0.389=-0.087
min8.652-8.678=-0.026
max9.359-9.663=-0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-1.055=-0.015
σ0.146-0.130=0.017
min0.947-0.935=0.012
max1.284-1.252=0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.904-463.909=-0.006
σ573.080-573.078=0.002
min177.358-177.362=-0.003
max1323.523-1323.526=-0.002
mean77.750
σ7.500
min74.000
max89.000
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean0.438-0.433=0.005
σ0.301-0.304=-0.002
min0.285-0.277=0.008
max0.890-0.888=0.002
policies=20
mean1773.866-1773.879=-0.013
σ0.329-0.330=-0.001
min1773.653-1773.666=-0.013
max1774.354-1774.369=-0.015
mean740.000
σ0.000
min740.000
max740.000
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean2.824-2.814=0.010
σ0.005-0.016=-0.011
min2.818-2.790=0.028
max2.830-2.827=0.003
policies=200
mean17744.837-17745.091=-0.253
σ0.508-0.480=0.028
min17744.478-17744.772=-0.294
max17745.591-17745.804=-0.213
mean7400.000
σ0.000
min7400.000
max7400.000
mean2837.000-2876.000=-39.000
σ0.000
min2837.000-2876.000=-39.000
max2837.000-2876.000=-39.000
mean28.127-28.025=0.102
σ0.530-0.480=0.050
min27.570-27.535=0.035
max28.720-28.466=0.254