Compare commits

Home / Compare 5b7227b1 .. 71a16f38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.245=-0.002
σ0.055-0.054=0.000
min35.214-35.217=-0.003
max35.397-35.398=-0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.083-0.086=-0.003
σ0.004-0.004=0.001
min0.077-0.083=-0.006
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.001
σ0.002-0.003=-0.001
min23.766-23.764=0.002
max23.771-23.774=-0.003
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.069-0.068=0.001
σ0.003-0.002=0.001
min0.067-0.066=0.001
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.486=0.000
σ0.364-0.366=-0.002
min1755.909-1755.908=0.001
max1757.073-1757.079=-0.007
mean1628.000-1650.450=-22.450
σ593.140-635.795=-42.656
min652.000-673.000=-21.000
max2426.000-2835.000=-409.000
mean2.349-2.328=0.021
σ0.102-0.075=0.027
min2.225-2.176=0.050
max2.659-2.464=0.195

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.697-324.699=-0.002
σ0.057-0.055=0.002
min324.596-324.602=-0.006
max324.727-324.732=-0.005
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean0.428-0.427=0.001
σ0.009-0.007=0.002
min0.422-0.424=-0.001
max0.443-0.440=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.258-1985.263=-0.004
σ0.011-0.015=-0.003
min1985.244-1985.246=-0.002
max1985.268-1985.275=-0.007
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean2.632-2.658=-0.026
σ0.117-0.078=0.040
min2.538-2.555=-0.017
max2.830-2.735=0.095
iters=5
new-facts=6402
prior-facts=1
mean4808.820-4808.876=-0.056
σ7.759-7.678=0.080
min4804.911-4805.389=-0.478
max4822.691-4822.611=0.080
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean8.502-9.027=-0.525
σ0.626-0.227=0.399
min7.930-8.801=-0.871
max9.395-9.382=0.014
iters=5
new-facts=6402
prior-facts=6402
mean4996.462-4996.392=0.071
σ0.009-0.148=-0.139
min4996.452-4996.128=0.324
max4996.471-4996.478=-0.007
mean2914.000-3054.000=-140.000
σ412.991-300.140=112.851
min2456.000-2835.000=-379.000
max3477.000-3521.000=-44.000
mean8.547-8.513=0.034
σ0.136-0.138=-0.002
min8.422-8.383=0.038
max8.776-8.743=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.586-0.947=0.639
σ0.124-0.055=0.069
min1.483-0.917=0.566
max1.794-1.044=0.750

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.969=-0.021
σ574.249-574.245=0.003
min175.816-175.840=-0.025
max1324.320-1324.337=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean0.551-0.427=0.123
σ0.553-0.293=0.260
min0.271-0.277=-0.006
max1.381-0.867=0.513
policies=20
mean1758.515-1758.698=-0.183
σ0.344-0.329=0.015
min1758.260-1758.506=-0.246
max1759.022-1759.190=-0.169
mean820.000
σ0.000
min820.000
max820.000
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean2.710-2.791=-0.081
σ0.005-0.009=-0.003
min2.704-2.781=-0.077
max2.717-2.801=-0.084
policies=200
mean17592.315-17593.282=-0.966
σ0.456-0.510=-0.053
min17591.948-17592.557=-0.608
max17592.980-17593.699=-0.719
mean8200.000
σ0.000
min8200.000
max8200.000
mean2426.000-2835.000=-409.000
σ0.000
min2426.000-2835.000=-409.000
max2426.000-2835.000=-409.000
mean27.478-27.986=-0.509
σ0.134-0.420=-0.286
min27.320-27.630=-0.310
max27.624-28.562=-0.938