Compare commits

Home / Compare 860e2726 .. 55a142a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.968=-0.001
σ0.107-0.107=0.000
min35.919-35.921=-0.001
max36.269-36.270=-0.001
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.075-0.077=-0.002
σ0.005-0.003=0.002
min0.070-0.074=-0.005
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.004=-0.001
min26.202-26.202=0.001
max26.213-26.215=-0.002
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.058-0.062=-0.004
σ0.002-0.002=-0.000
min0.056-0.060=-0.004
max0.064-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.331-1755.330=0.001
σ0.370-0.369=0.001
min1754.758-1754.757=0.001
max1755.923-1755.922=0.001
mean1656.900-1651.700=5.200
σ623.022-618.100=4.923
min684.000-673.000=11.000
max2751.000-2685.000=66.000
mean2.353-2.361=-0.008
σ0.088-0.103=-0.015
min2.159-2.235=-0.076
max2.554-2.651=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.506-279.508=-0.002
σ0.005-0.007=-0.001
min279.498-279.500=-0.002
max279.511-279.518=-0.007
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean0.409-0.415=-0.006
σ0.007-0.010=-0.003
min0.404-0.406=-0.002
max0.421-0.431=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2173.715-2173.700=0.015
σ0.024-0.015=0.009
min2173.692-2173.685=0.007
max2173.754-2173.720=0.034
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean2.956-2.979=-0.023
σ0.154-0.151=0.003
min2.776-2.758=0.018
max3.135-3.106=0.029
iters=5
new-facts=6402
prior-facts=1
mean5053.215-5053.105=0.110
σ1.064-0.444=0.620
min5052.176-5052.809=-0.633
max5055.009-5053.889=1.120
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean9.243-9.199=0.043
σ0.234-0.200=0.034
min8.957-8.868=0.089
max9.596-9.388=0.208
iters=5
new-facts=6402
prior-facts=6402
mean5185.920-5185.991=-0.071
σ0.208-0.088=0.120
min5185.576-5185.922=-0.345
max5186.091-5186.089=0.002
mean3285.200-3279.200=6.000
σ394.485-419.380=-24.895
min2751.000-2685.000=66.000
max3656.000-3664.000=-8.000
mean8.904-9.042=-0.138
σ0.204-0.453=-0.249
min8.674-8.681=-0.007
max9.230-9.823=-0.593

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.109=-0.063
σ0.049-0.226=-0.177
min0.963-0.936=0.028
max1.082-1.498=-0.416

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-465.475=0.006
σ572.653-572.656=-0.003
min179.147-179.145=0.002
max1324.460-1324.459=0.001
mean79.500
σ7.000
min76.000
max90.000
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean0.442-0.546=-0.104
σ0.300-0.532=-0.232
min0.287-0.279=0.008
max0.891-1.343=-0.452
policies=20
mean1791.718-1791.681=0.037
σ0.337-0.337=-0.000
min1791.481-1791.466=0.015
max1792.204-1792.181=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean2.863-2.806=0.058
σ0.114-0.015=0.099
min2.800-2.784=0.016
max3.035-2.817=0.217
policies=200
mean17923.374-17923.492=-0.118
σ0.440-0.514=-0.074
min17923.069-17923.191=-0.121
max17924.020-17924.260=-0.240
mean7600.000
σ0.000
min7600.000
max7600.000
mean2751.000-2685.000=66.000
σ0.000
min2751.000-2685.000=66.000
max2751.000-2685.000=66.000
mean28.257-28.282=-0.025
σ0.105-0.122=-0.017
min28.180-28.167=0.013
max28.402-28.429=-0.026