Compare commits

Home / Compare d7f77afa .. c1ebbdfa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.000
σ0.047-0.050=-0.003
min33.948-33.950=-0.002
max34.109-34.119=-0.010
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.083-0.083=0.000
σ0.005-0.005=-0.000
min0.076-0.075=0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.002-0.003=-0.001
min23.314-23.314=0.000
max23.320-23.323=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.065=0.001
σ0.003-0.003=-0.000
min0.064-0.063=0.001
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.427=0.002
σ0.364-0.365=-0.001
min1756.855-1756.852=0.003
max1758.018-1758.019=-0.001
mean1648.350-1651.200=-2.850
σ647.233-624.362=22.871
min622.000-676.000=-54.000
max2802.000-2590.000=212.000
mean2.386-2.373=0.014
σ0.126-0.116=0.009
min2.155-2.220=-0.065
max2.772-2.674=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.563=0.012
σ0.048-0.065=-0.018
min326.491-326.448=0.043
max326.611-326.604=0.007
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean0.427-0.426=0.001
σ0.004-0.010=-0.006
min0.424-0.420=0.003
max0.433-0.444=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.735-1988.706=0.029
σ0.013-0.041=-0.028
min1988.720-1988.648=0.071
max1988.753-1988.748=0.004
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean2.761-2.668=0.093
σ0.111-0.060=0.051
min2.651-2.615=0.035
max2.907-2.764=0.143
iters=5
new-facts=6402
prior-facts=1
mean4813.617-4813.507=0.110
σ7.700-7.764=-0.064
min4810.037-4809.700=0.338
max4827.391-4827.390=0.001
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean8.322-8.441=-0.119
σ0.546-0.533=0.013
min7.770-7.708=0.062
max9.197-9.107=0.090
iters=5
new-facts=6402
prior-facts=6402
mean5001.141-5001.128=0.014
σ0.025-0.014=0.010
min5001.106-5001.113=-0.007
max5001.173-5001.146=0.027
mean3003.600-2921.000=82.600
σ263.925-253.447=10.478
min2802.000-2590.000=212.000
max3408.000-3266.000=142.000
mean9.702-9.471=0.230
σ0.300-0.642=-0.342
min9.306-8.343=0.962
max10.004-9.848=0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.246=-0.182
σ0.103-0.395=-0.292
min0.927-0.917=0.010
max1.217-1.784=-0.568

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.572-464.566=0.006
σ574.770-574.790=-0.020
min177.176-177.163=0.013
max1326.728-1326.751=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean0.433-0.556=-0.123
σ0.304-0.569=-0.265
min0.280-0.269=0.011
max0.890-1.409=-0.519
policies=20
mean1772.074-1772.014=0.061
σ0.372-0.345=0.027
min1771.824-1771.779=0.045
max1772.626-1772.525=0.102
mean840.000
σ0.000
min840.000
max840.000
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean2.787-2.702=0.085
σ0.006-0.012=-0.007
min2.779-2.687=0.092
max2.792-2.714=0.078
policies=200
mean17727.505-17727.458=0.046
σ0.439-0.477=-0.038
min17727.165-17727.185=-0.020
max17728.137-17728.173=-0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2802.000-2590.000=212.000
σ0.000
min2802.000-2590.000=212.000
max2802.000-2590.000=212.000
mean27.564-27.467=0.098
σ0.061-0.153=-0.092
min27.510-27.302=0.208
max27.617-27.661=-0.044