Compare commits

Home / Compare 12952c82 .. d5d7ad8c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.050=-0.002
min33.952-33.951=0.001
max34.111-34.117=-0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.085-0.084=0.000
σ0.003-0.003=0.001
min0.082-0.082=-0.001
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.003=-0.001
min23.313-23.312=0.001
max23.320-23.322=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.000
σ0.003-0.003=-0.000
min0.061-0.060=0.001
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.494=-0.001
σ0.364-0.364=-0.000
min1756.921-1756.921=0.001
max1758.084-1758.081=0.003
mean1653.150-1650.350=2.800
σ636.810-625.022=11.789
min637.000-674.000=-37.000
max2824.000-2592.000=232.000
mean2.392-2.377=0.015
σ0.137-0.109=0.028
min2.231-2.264=-0.033
max2.838-2.660=0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.644-326.628=0.016
σ0.046-0.062=-0.016
min326.563-326.518=0.045
max326.679-326.671=0.008
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean0.428-0.427=0.001
σ0.005-0.004=0.001
min0.423-0.423=-0.000
max0.435-0.434=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.791-1988.800=-0.010
σ0.020-0.006=0.014
min1988.773-1988.791=-0.019
max1988.819-1988.806=0.013
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean2.775-2.706=0.069
σ0.150-0.086=0.065
min2.595-2.605=-0.010
max2.925-2.798=0.128
iters=5
new-facts=6402
prior-facts=1
mean4813.536-4813.312=0.224
σ7.793-7.965=-0.171
min4809.569-4809.025=0.544
max4827.468-4827.536=-0.068
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean8.677-8.915=-0.239
σ0.623-0.428=0.195
min7.866-8.477=-0.610
max9.298-9.580=-0.282
iters=5
new-facts=6402
prior-facts=6402
mean5001.213-5001.200=0.013
σ0.033-0.021=0.011
min5001.183-5001.175=0.007
max5001.261-5001.222=0.039
mean3016.000-2968.200=47.800
σ261.583-282.466=-20.884
min2824.000-2592.000=232.000
max3423.000-3310.000=113.000
mean9.916-9.690=0.226
σ0.162-0.126=0.036
min9.777-9.519=0.258
max10.142-9.843=0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.202=-0.218
σ0.137-0.386=-0.248
min0.918-0.915=0.003
max1.230-1.849=-0.619

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.628=0.008
σ574.772-574.785=-0.013
min177.239-177.232=0.007
max1326.794-1326.806=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean0.436-0.557=-0.121
σ0.307-0.569=-0.262
min0.279-0.269=0.011
max0.897-1.411=-0.514
policies=20
mean1772.719-1772.655=0.064
σ0.372-0.364=0.008
min1772.461-1772.405=0.055
max1773.267-1773.195=0.072
mean840.000
σ0.000
min840.000
max840.000
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean2.808-2.744=0.064
σ0.004-0.007=-0.003
min2.802-2.737=0.066
max2.812-2.752=0.060
policies=200
mean17734.136-17733.961=0.175
σ0.452-0.425=0.027
min17733.817-17733.577=0.240
max17734.805-17734.563=0.243
mean8400.000
σ0.000
min8400.000
max8400.000
mean2824.000-2592.000=232.000
σ0.000
min2824.000-2592.000=232.000
max2824.000-2592.000=232.000
mean28.060-27.579=0.481
σ0.367-0.167=0.200
min27.715-27.384=0.331
max28.457-27.737=0.720