Compare commits

Home / Compare 96f0ff28 .. 2edde16b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.047-0.048=-0.001
min33.952-33.948=0.003
max34.108-34.112=-0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.080-0.083=-0.003
σ0.004-0.005=-0.001
min0.076-0.077=-0.001
max0.087-0.090=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.003=-0.000
min23.313-23.313=0.000
max23.321-23.321=-0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.066-0.064=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.004
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.365=-0.000
σ0.365-0.364=0.001
min1756.787-1756.792=-0.005
max1757.954-1757.953=0.001
mean1650.800-1664.100=-13.300
σ646.850-628.600=18.250
min626.000-668.000=-42.000
max2805.000-2613.000=192.000
mean2.379-2.359=0.020
σ0.133-0.122=0.011
min2.273-2.240=0.033
max2.892-2.743=0.149

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.506-326.506=0.000
σ0.062-0.049=0.013
min326.396-326.418=-0.022
max326.550-326.532=0.018
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean0.435-0.427=0.008
σ0.009-0.003=0.006
min0.427-0.423=0.003
max0.449-0.431=0.018
iters=5
new-facts=1
prior-facts=6402
mean1988.681-1988.677=0.004
σ0.004-0.011=-0.007
min1988.675-1988.663=0.012
max1988.685-1988.688=-0.003
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean2.683-2.807=-0.124
σ0.037-0.205=-0.168
min2.626-2.574=0.052
max2.730-3.036=-0.306
iters=5
new-facts=6402
prior-facts=1
mean4813.544-4813.465=0.079
σ7.747-7.418=0.329
min4809.973-4809.963=0.010
max4827.401-4826.730=0.671
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean8.483-8.357=0.126
σ0.590-0.745=-0.155
min7.806-7.640=0.166
max9.302-9.389=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean5001.064-5001.004=0.060
σ0.041-0.143=-0.102
min5000.998-5000.751=0.247
max5001.105-5001.087=0.018
mean3035.000-2960.000=75.000
σ289.595-361.124=-71.529
min2805.000-2613.000=192.000
max3474.000-3442.000=32.000
mean9.681-9.752=-0.071
σ0.234-0.226=0.007
min9.320-9.421=-0.101
max9.923-10.059=-0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.066-1.250=-0.184
σ0.107-0.396=-0.289
min0.928-0.922=0.006
max1.228-1.815=-0.587

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.508-464.500=0.008
σ574.771-574.789=-0.018
min177.108-177.103=0.005
max1326.665-1326.684=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean0.434-0.548=-0.114
σ0.307-0.547=-0.239
min0.278-0.272=0.006
max0.895-1.368=-0.473
policies=20
mean1771.430-1771.362=0.068
σ0.366-0.356=0.010
min1771.180-1771.120=0.060
max1771.972-1771.890=0.081
mean840.000
σ0.000
min840.000
max840.000
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean2.804-2.722=0.083
σ0.020-0.016=0.004
min2.791-2.702=0.089
max2.833-2.739=0.094
policies=200
mean17721.114-17721.007=0.107
σ0.376-0.417=-0.041
min17720.890-17720.672=0.218
max17721.676-17721.617=0.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2805.000-2613.000=192.000
σ0.000
min2805.000-2613.000=192.000
max2805.000-2613.000=192.000
mean27.591-27.603=-0.012
σ0.078-0.082=-0.004
min27.479-27.497=-0.019
max27.660-27.678=-0.019