Compare commits

Home / Compare c17ca60b .. 34b285f7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.769=-0.000
σ0.048-0.045=0.002
min30.732-30.729=0.003
max30.901-30.894=0.008
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.076-0.076=0.001
σ0.004-0.004=0.000
min0.072-0.071=0.001
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.003-0.002=0.001
min21.053-21.057=-0.004
max21.064-21.063=0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.061=0.002
σ0.001-0.003=-0.002
min0.063-0.058=0.005
max0.065-0.066=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.418=0.002
σ0.362-0.359=0.003
min1750.848-1750.851=-0.003
max1752.000-1751.981=0.018
mean1664.300-1659.900=4.400
σ640.220-629.175=11.045
min678.000-684.000=-6.000
max2695.000-2666.000=29.000
mean2.880-2.827=0.054
σ0.121-0.140=-0.019
min2.594-2.479=0.114
max3.024-3.070=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.191-282.192=-0.001
σ0.008-0.011=-0.003
min282.183-282.181=0.001
max282.200-282.207=-0.007
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean0.399-0.406=-0.007
σ0.003-0.011=-0.008
min0.397-0.395=0.003
max0.405-0.418=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2174.719-2174.724=-0.004
σ0.011-0.007=0.004
min2174.706-2174.713=-0.007
max2174.736-2174.729=0.007
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean3.053-3.053=-0.001
σ0.217-0.265=-0.048
min2.763-2.792=-0.029
max3.241-3.455=-0.213
iters=5
new-facts=6402
prior-facts=1
mean5054.545-5054.544=0.001
σ0.942-0.952=-0.010
min5054.070-5054.013=0.057
max5056.228-5056.238=-0.010
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean8.819-9.013=-0.194
σ0.589-0.422=0.167
min8.046-8.389=-0.343
max9.475-9.453=0.021
iters=5
new-facts=6402
prior-facts=6402
mean5185.608-5185.680=-0.072
σ0.208-0.078=0.130
min5185.266-5185.610=-0.344
max5185.783-5185.776=0.007
mean3219.200-3230.200=-11.000
σ374.444-388.540=-14.096
min2695.000-2690.000=5.000
max3687.000-3720.000=-33.000
mean9.985-10.061=-0.076
σ0.335-0.167=0.168
min9.592-9.840=-0.248
max10.423-10.293=0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.162=-0.050
σ0.180-0.202=-0.022
min0.943-0.941=0.002
max1.341-1.452=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.577-463.574=0.004
σ572.661-572.670=-0.010
min177.239-177.235=0.003
max1322.568-1322.579=-0.011
mean79.750
σ7.500
min76.000
max91.000
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean0.557-0.550=0.007
σ0.558-0.544=0.013
min0.276-0.275=0.001
max1.393-1.366=0.027
policies=20
mean1772.632-1772.628=0.004
σ0.334-0.334=-0.000
min1772.413-1772.405=0.008
max1773.128-1773.125=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean2.746-2.744=0.002
σ0.009-0.011=-0.001
min2.736-2.735=0.001
max2.754-2.759=-0.005
policies=200
mean17732.848-17733.035=-0.187
σ0.389-0.471=-0.083
min17732.559-17732.783=-0.224
max17733.419-17733.742=-0.323
mean7600.000
σ0.000
min7600.000
max7600.000
mean2695.000-2666.000=29.000
σ0.000
min2695.000-2666.000=29.000
max2695.000-2666.000=29.000
mean27.765-27.784=-0.019
σ0.216-0.155=0.061
min27.607-27.643=-0.036
max28.071-27.923=0.149