Compare commits

Home / Compare c81be9a4 .. 9cfabdc9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.002
σ0.048-0.049=-0.001
min33.947-33.939=0.008
max34.110-34.113=-0.003
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.082-0.082=0.001
σ0.005-0.004=0.001
min0.076-0.077=-0.000
max0.092-0.089=0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.001-0.002=-0.001
min23.315-23.313=0.002
max23.319-23.321=-0.001
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.064-0.063=0.001
σ0.004-0.003=0.001
min0.059-0.059=0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.364-0.364=-0.000
min1756.729-1756.728=0.001
max1757.891-1757.888=0.003
mean1660.950-1662.950=-2.000
σ621.691-628.218=-6.527
min669.000-667.000=2.000
max2591.000-2612.000=-21.000
mean2.371-2.348=0.022
σ0.139-0.088=0.050
min2.212-2.267=-0.055
max2.695-2.583=0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.438-326.439=-0.001
σ0.059-0.059=-0.000
min326.333-326.334=-0.001
max326.470-326.474=-0.003
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.426-0.425=0.001
σ0.002-0.000=0.001
min0.425-0.424=0.001
max0.429-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.607-1988.610=-0.003
σ0.016-0.010=0.006
min1988.582-1988.592=-0.010
max1988.621-1988.618=0.003
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.677-2.688=-0.011
σ0.071-0.065=0.006
min2.578-2.624=-0.046
max2.774-2.775=-0.001
iters=5
new-facts=6402
prior-facts=1
mean4813.474-4813.140=0.334
σ7.754-7.575=0.179
min4809.903-4809.395=0.508
max4827.343-4826.675=0.668
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean8.617-8.883=-0.266
σ0.606-0.446=0.160
min7.965-8.406=-0.441
max9.569-9.578=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean5001.008-5001.018=-0.010
σ0.019-0.040=-0.020
min5000.985-5000.977=0.009
max5001.025-5001.075=-0.050
mean2978.600-2998.000=-19.400
σ288.348-280.275=8.074
min2591.000-2612.000=-21.000
max3319.000-3312.000=7.000
mean9.808-9.831=-0.022
σ0.088-0.268=-0.180
min9.713-9.475=0.239
max9.928-10.176=-0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.245=-0.005
σ0.377-0.392=-0.015
min0.915-0.921=-0.005
max1.713-1.783=-0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.441=-0.005
σ574.790-574.792=-0.002
min177.035-177.039=-0.004
max1326.621-1326.629=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.556-0.559=-0.004
σ0.561-0.562=-0.000
min0.272-0.274=-0.002
max1.398-1.402=-0.004
policies=20
mean1770.742-1770.758=-0.015
σ0.345-0.358=-0.013
min1770.519-1770.533=-0.013
max1771.255-1771.290=-0.035
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.725-2.735=-0.010
σ0.011-0.017=-0.005
min2.714-2.721=-0.007
max2.737-2.759=-0.022
policies=200
mean17714.794-17714.858=-0.064
σ0.622-0.467=0.154
min17714.356-17714.598=-0.242
max17715.712-17715.558=0.154
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean27.583-27.490=0.093
σ0.188-0.126=0.062
min27.410-27.375=0.035
max27.782-27.632=0.150