Compare commits

Home / Compare e8f4dad0 .. 47d4e5ba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.050=-0.002
min33.951-33.945=0.006
max34.110-34.117=-0.007
mean412.300-413.000=-0.700
σ0.483-0.000=0.483
min412.000-413.000=-1.000
max413.000
mean0.081-0.085=-0.004
σ0.005-0.003=0.002
min0.077-0.081=-0.005
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.004=-0.000
min23.313-23.313=0.000
max23.323-23.324=-0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.066-0.065=0.001
σ0.003-0.003=-0.000
min0.063-0.060=0.004
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.429=0.002
σ0.363-0.364=-0.001
min1756.855-1756.857=-0.002
max1758.019-1758.018=0.001
mean1662.500-1656.500=6.000
σ627.746-634.778=-7.033
min668.000-619.000=49.000
max2611.000-2669.000=-58.000
mean2.350-2.382=-0.032
σ0.110-0.120=-0.010
min2.235-2.273=-0.038
max2.696-2.816=-0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.572-326.579=-0.007
σ0.051-0.033=0.018
min326.482-326.520=-0.038
max326.606-326.602=0.005
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean0.424-0.426=-0.002
σ0.003-0.001=0.002
min0.422-0.425=-0.003
max0.430-0.428=0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.729-1988.725=0.004
σ0.023-0.020=0.003
min1988.691-1988.701=-0.010
max1988.749-1988.746=0.003
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean2.664-2.766=-0.102
σ0.075-0.266=-0.191
min2.580-2.618=-0.038
max2.783-3.238=-0.455
iters=5
new-facts=6402
prior-facts=1
mean4813.586-4813.590=-0.005
σ7.724-7.725=-0.001
min4810.031-4810.024=0.007
max4827.402-4827.408=-0.006
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean8.754-8.522=0.232
σ0.364-0.582=-0.218
min8.227-7.929=0.298
max9.111-9.303=-0.192
iters=5
new-facts=6402
prior-facts=6402
mean5001.140-5001.136=0.003
σ0.030-0.031=-0.002
min5001.103-5001.110=-0.007
max5001.178-5001.187=-0.008
mean2971.200-2967.400=3.800
σ278.424-246.679=31.746
min2611.000-2669.000=-58.000
max3312.000-3299.000=13.000
mean9.792-9.533=0.259
σ0.182-0.641=-0.459
min9.518-8.531=0.987
max10.014-10.284=-0.269

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-0.990=0.227
σ0.353-0.109=0.244
min0.915-0.906=0.009
max1.679-1.157=0.522

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.568=-0.004
σ574.777-574.771=0.006
min177.171-177.179=-0.008
max1326.729-1326.725=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean0.544-0.539=0.005
σ0.541-0.530=0.011
min0.271-0.272=-0.000
max1.356-1.334=0.022
policies=20
mean1772.012-1772.049=-0.037
σ0.350-0.351=-0.001
min1771.779-1771.828=-0.049
max1772.531-1772.573=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean2.718-2.730=-0.012
σ0.014-0.012=0.002
min2.699-2.720=-0.021
max2.730-2.744=-0.014
policies=200
mean17727.365-17727.299=0.066
σ0.465-0.507=-0.043
min17727.108-17726.985=0.122
max17728.061-17728.055=0.006
mean8400.000
σ0.000
min8400.000
max8400.000
mean2611.000-2669.000=-58.000
σ0.000
min2611.000-2669.000=-58.000
max2611.000-2669.000=-58.000
mean27.418-27.533=-0.115
σ0.101-0.125=-0.023
min27.286-27.425=-0.139
max27.506-27.662=-0.156