Compare commits

Home / Compare 0820bbb3 .. e84b90a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.768=0.000
σ0.047-0.049=-0.001
min30.726-30.727=-0.001
max30.900-30.902=-0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.077-0.076=0.000
σ0.004-0.004=-0.000
min0.071-0.071=0.001
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.003-0.003=-0.000
min21.056-21.057=-0.001
max21.064-21.064=-0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.062=0.001
σ0.002-0.004=-0.001
min0.058-0.058=-0.000
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.419=-0.000
σ0.360-0.364=-0.003
min1750.852-1750.847=0.005
max1751.995-1752.001=-0.006
mean1661.150-1661.800=-0.650
σ636.569-628.022=8.547
min625.000-685.000=-60.000
max2792.000-2774.000=18.000
mean2.832-2.778=0.054
σ0.122-0.133=-0.012
min2.562-2.461=0.101
max2.987-2.988=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.190-282.191=-0.001
σ0.007-0.010=-0.002
min282.180-282.177=0.003
max282.201-282.203=-0.003
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean0.398-0.398=-0.000
σ0.004-0.003=0.000
min0.394-0.396=-0.002
max0.404-0.404=0.000
iters=5
new-facts=1
prior-facts=6402
mean2174.704-2174.714=-0.009
σ0.013-0.010=0.003
min2174.691-2174.704=-0.014
max2174.719-2174.728=-0.009
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean2.852-2.997=-0.146
σ0.095-0.200=-0.105
min2.764-2.734=0.030
max2.991-3.208=-0.217
iters=5
new-facts=6402
prior-facts=1
mean5054.566-5054.419=0.147
σ0.935-1.036=-0.100
min5054.121-5053.638=0.483
max5056.238-5056.236=0.003
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean8.937-8.927=0.010
σ0.514-0.542=-0.028
min8.272-8.050=0.222
max9.502-9.434=0.067
iters=5
new-facts=6402
prior-facts=6402
mean5185.656-5185.670=-0.014
σ0.073-0.077=-0.005
min5185.592-5185.596=-0.004
max5185.751-5185.774=-0.023
mean3272.800-3237.400=35.400
σ427.400-356.173=71.227
min2792.000-2774.000=18.000
max3857.000-3707.000=150.000
mean9.910-9.723=0.187
σ0.380-0.629=-0.249
min9.523-8.698=0.826
max10.530-10.269=0.261

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.028=0.016
σ0.180-0.132=0.047
min0.922-0.934=-0.012
max1.347-1.242=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.570-463.574=-0.004
σ572.651-572.652=-0.001
min177.241-177.237=0.004
max1322.546-1322.552=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean0.438-0.442=-0.004
σ0.308-0.303=0.005
min0.280-0.289=-0.009
max0.899-0.896=0.003
policies=20
mean1772.675-1772.669=0.006
σ0.335-0.324=0.011
min1772.449-1772.425=0.024
max1773.169-1773.143=0.026
mean760.000
σ0.000
min760.000
max760.000
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean2.815-2.818=-0.003
σ0.124-0.100=0.025
min2.721-2.732=-0.011
max2.994-2.957=0.036
policies=200
mean17732.869-17732.915=-0.046
σ0.475-0.527=-0.051
min17732.578-17732.400=0.178
max17733.577-17733.645=-0.067
mean7600.000
σ0.000
min7600.000
max7600.000
mean2792.000-2774.000=18.000
σ0.000
min2792.000-2774.000=18.000
max2792.000-2774.000=18.000
mean27.623-27.706=-0.083
σ0.113-0.145=-0.032
min27.504-27.534=-0.030
max27.734-27.888=-0.153