Compare commits

Home / Compare 1f481674 .. b55e24ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.049-0.049=-0.000
min33.955-33.951=0.003
max34.115-34.114=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.083-0.085=-0.002
σ0.004-0.003=0.002
min0.077-0.082=-0.005
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=-0.000
min23.314-23.312=0.002
max23.323-23.323=0.000
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.066-0.065=0.001
σ0.003-0.004=-0.001
min0.064-0.059=0.004
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.304=-0.003
σ0.364-0.365=-0.000
min1756.727-1756.728=-0.001
max1757.890-1757.891=-0.001
mean1646.900-1662.600=-15.700
σ624.046-620.488=3.558
min636.000-673.000=-37.000
max2826.000-2591.000=235.000
mean2.349-2.359=-0.010
σ0.086-0.103=-0.017
min2.242-2.268=-0.026
max2.601-2.714=-0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.452-326.448=0.004
σ0.036-0.042=-0.007
min326.391-326.375=0.015
max326.480-326.488=-0.008
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean0.424-0.430=-0.006
σ0.003-0.006=-0.003
min0.421-0.427=-0.005
max0.430-0.442=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.610-1988.618=-0.008
σ0.011-0.004=0.008
min1988.598-1988.613=-0.015
max1988.624-1988.622=0.002
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean2.716-2.735=-0.019
σ0.152-0.206=-0.053
min2.565-2.570=-0.006
max2.951-3.093=-0.142
iters=5
new-facts=6402
prior-facts=1
mean4813.244-4813.457=-0.214
σ7.882-7.752=0.129
min4808.868-4809.912=-1.044
max4827.314-4827.325=-0.010
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean8.567-8.610=-0.044
σ0.551-0.550=0.000
min7.949-7.847=0.102
max9.269-9.395=-0.126
iters=5
new-facts=6402
prior-facts=6402
mean5001.011-5001.010=0.001
σ0.026-0.019=0.006
min5000.970-5000.990=-0.019
max5001.038-5001.037=0.001
mean3061.200-2947.400=113.800
σ307.611-360.576=-52.965
min2826.000-2591.000=235.000
max3532.000-3423.000=109.000
mean9.754-9.647=0.106
σ0.331-0.179=0.151
min9.412-9.362=0.049
max10.139-9.811=0.327

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.920-1.257=-0.337
σ0.013-0.399=-0.386
min0.912-0.917=-0.005
max0.944-1.745=-0.802

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-464.437=-0.005
σ574.766-574.792=-0.026
min177.043-177.037=0.006
max1326.581-1326.626=-0.044
mean88.250
σ8.500
min84.000
max101.000
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean0.438-0.549=-0.111
σ0.306-0.548=-0.241
min0.282-0.272=0.010
max0.897-1.370=-0.473
policies=20
mean1770.792-1770.764=0.028
σ0.356-0.368=-0.011
min1770.566-1770.524=0.042
max1771.323-1771.310=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean2.802-2.741=0.061
σ0.021-0.008=0.013
min2.776-2.733=0.043
max2.826-2.750=0.076
policies=200
mean17714.848-17714.923=-0.075
σ0.413-0.510=-0.097
min17714.571-17714.608=-0.037
max17715.462-17715.683=-0.221
mean8400.000
σ0.000
min8400.000
max8400.000
mean2826.000-2591.000=235.000
σ0.000
min2826.000-2591.000=235.000
max2826.000-2591.000=235.000
mean27.898-27.555=0.344
σ0.314-0.100=0.214
min27.612-27.455=0.158
max28.252-27.679=0.572