Compare commits

Home / Compare 79a5153b .. 4f2a2c85

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.000
σ0.047-0.047=-0.000
min33.952-33.948=0.004
max34.110-34.109=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.083-0.083=-0.000
σ0.005-0.005=0.000
min0.077-0.076=0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.003-0.002=0.001
min23.312-23.314=-0.002
max23.322-23.320=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.066=-0.001
σ0.002-0.003=-0.001
min0.063-0.064=-0.001
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.429=-0.000
σ0.364-0.364=0.001
min1756.856-1756.855=0.001
max1758.021-1758.018=0.003
mean1644.850-1648.350=-3.500
σ646.670-647.233=-0.563
min619.000-622.000=-3.000
max2800.000-2802.000=-2.000
mean2.364-2.386=-0.023
σ0.063-0.126=-0.062
min2.278-2.155=0.123
max2.458-2.772=-0.314

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.581-326.575=0.007
σ0.031-0.048=-0.016
min326.526-326.491=0.035
max326.600-326.611=-0.011
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean0.425-0.427=-0.002
σ0.004-0.004=0.000
min0.421-0.424=-0.002
max0.430-0.433=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.730-1988.735=-0.005
σ0.016-0.013=0.003
min1988.713-1988.720=-0.007
max1988.750-1988.753=-0.003
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean2.734-2.761=-0.026
σ0.125-0.111=0.015
min2.643-2.651=-0.008
max2.948-2.907=0.041
iters=5
new-facts=6402
prior-facts=1
mean4813.577-4813.617=-0.041
σ7.724-7.700=0.023
min4810.056-4810.037=0.018
max4827.393-4827.391=0.002
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean8.717-8.322=0.395
σ0.240-0.546=-0.306
min8.424-7.770=0.654
max9.020-9.197=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean5001.080-5001.141=-0.062
σ0.144-0.025=0.119
min5000.828-5001.106=-0.278
max5001.184-5001.173=0.011
mean2989.800-3003.600=-13.800
σ202.680-263.925=-61.245
min2800.000-2802.000=-2.000
max3294.000-3408.000=-114.000
mean9.903-9.702=0.201
σ0.348-0.300=0.048
min9.426-9.306=0.120
max10.371-10.004=0.367

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.064=-0.035
σ0.125-0.103=0.022
min0.915-0.927=-0.012
max1.221-1.217=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.570-464.572=-0.003
σ574.768-574.770=-0.003
min177.176-177.176=-0.000
max1326.721-1326.728=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean0.439-0.433=0.006
σ0.304-0.304=0.000
min0.283-0.280=0.003
max0.896-0.890=0.006
policies=20
mean1772.080-1772.074=0.005
σ0.351-0.372=-0.020
min1771.824-1771.824=0.000
max1772.599-1772.626=-0.028
mean840.000
σ0.000
min840.000
max840.000
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean2.793-2.787=0.006
σ0.009-0.006=0.004
min2.779-2.779=0.000
max2.799-2.792=0.006
policies=200
mean17727.526-17727.505=0.022
σ0.292-0.439=-0.147
min17727.329-17727.165=0.165
max17727.956-17728.137=-0.181
mean8400.000
σ0.000
min8400.000
max8400.000
mean2800.000-2802.000=-2.000
σ0.000
min2800.000-2802.000=-2.000
max2800.000-2802.000=-2.000
mean27.485-27.564=-0.079
σ0.094-0.061=0.033
min27.349-27.510=-0.161
max27.548-27.617=-0.070