Compare commits

Home / Compare 464f0c5b .. d79a5c9b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.049-0.047=0.001
min33.955-33.945=0.009
max34.115-34.109=0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.085=-0.002
σ0.004-0.003=0.002
min0.077-0.082=-0.005
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.002=0.001
min23.314-23.313=0.001
max23.323-23.321=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.066-0.065=0.000
σ0.003-0.002=0.001
min0.064-0.064=-0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.302=-0.002
σ0.364-0.364=0.001
min1756.727-1756.727=-0.001
max1757.890-1757.889=0.001
mean1646.900-1665.750=-18.850
σ624.046-627.818=-3.772
min636.000-671.000=-35.000
max2826.000-2614.000=212.000
mean2.349-2.350=-0.001
σ0.086-0.107=-0.021
min2.242-2.244=-0.002
max2.601-2.670=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.452-326.442=0.011
σ0.036-0.061=-0.025
min326.391-326.333=0.057
max326.480-326.480=0.000
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean0.424-0.441=-0.017
σ0.003-0.013=-0.009
min0.421-0.424=-0.002
max0.430-0.451=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1988.610-1988.608=0.003
σ0.011-0.013=-0.002
min1988.598-1988.594=0.004
max1988.624-1988.624=-0.000
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean2.716-2.723=-0.008
σ0.152-0.135=0.017
min2.565-2.641=-0.076
max2.951-2.963=-0.011
iters=5
new-facts=6402
prior-facts=1
mean4813.244-4813.517=-0.273
σ7.882-7.715=0.166
min4808.868-4809.904=-1.035
max4827.314-4827.317=-0.002
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean8.567-8.232=0.334
σ0.551-0.568=-0.017
min7.949-7.823=0.126
max9.269-9.209=0.060
iters=5
new-facts=6402
prior-facts=6402
mean5001.011-5000.938=0.073
σ0.026-0.181=-0.155
min5000.970-5000.616=0.354
max5001.038-5001.037=0.001
mean3061.200-2960.600=100.600
σ307.611-370.893=-63.282
min2826.000-2614.000=212.000
max3532.000-3471.000=61.000
mean9.754-9.748=0.005
σ0.331-0.218=0.112
min9.412-9.391=0.021
max10.139-9.991=0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.920-1.272=-0.352
σ0.013-0.372=-0.359
min0.912-0.939=-0.027
max0.944-1.790=-0.846

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-464.436=-0.004
σ574.766-574.790=-0.024
min177.043-177.033=0.010
max1326.581-1326.621=-0.039
mean88.250
σ8.500
min84.000
max101.000
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean0.438-0.560=-0.122
σ0.306-0.570=-0.264
min0.282-0.272=0.010
max0.897-1.414=-0.517
policies=20
mean1770.792-1770.723=0.069
σ0.356-0.365=-0.009
min1770.566-1770.485=0.081
max1771.323-1771.265=0.058
mean840.000
σ0.000
min840.000
max840.000
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean2.802-2.743=0.059
σ0.021-0.019=0.002
min2.776-2.720=0.056
max2.826-2.760=0.066
policies=200
mean17714.848-17714.746=0.101
σ0.413-0.542=-0.129
min17714.571-17714.308=0.263
max17715.462-17715.531=-0.069
mean8400.000
σ0.000
min8400.000
max8400.000
mean2826.000-2614.000=212.000
σ0.000
min2826.000-2614.000=212.000
max2826.000-2614.000=212.000
mean27.898-27.584=0.314
σ0.314-0.224=0.090
min27.612-27.336=0.277
max28.252-27.850=0.402