Compare commits

Home / Compare 2fb0724b .. 61cd2eeb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.726-36.726=0.000
σ0.684-0.680=0.005
min35.927-35.930=-0.002
max37.526-37.519=0.007
mean4026.000-4009.000=17.000
σ0.000
min4026.000-4009.000=17.000
max4026.000-4009.000=17.000
mean0.075-0.075=-0.000
σ0.001-0.001=-0.000
min0.074-0.074=-0.000
max0.076-0.077=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.585-26.585=-0.001
σ0.603-0.605=-0.002
min26.205-26.204=0.000
max27.461-27.469=-0.007
mean4026.000-4009.000=17.000
σ0.000
min4026.000-4009.000=17.000
max4026.000-4009.000=17.000
mean0.060-0.060=-0.000
σ0.001-0.001=-0.000
min0.059-0.059=-0.000
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.357=0.001
σ0.372-0.373=-0.001
min1755.791-1755.784=0.007
max1756.962-1756.956=0.006
mean1661.800-1675.650=-13.850
σ629.575-625.014=4.561
min612.000-666.000=-54.000
max2644.000-2608.000=36.000
mean2.276-2.261=0.015
σ0.173-0.152=0.021
min2.116-2.131=-0.015
max2.762-2.744=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.678-278.676=0.002
σ0.014-0.014=-0.000
min278.664-278.662=0.002
max278.700-278.699=0.001
mean2644.000-2608.000=36.000
σ0.000
min2644.000-2608.000=36.000
max2644.000-2608.000=36.000
mean0.418-0.419=-0.001
σ0.001-0.001=-0.000
min0.417-0.417=-0.000
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.855-2268.844=0.011
σ0.006-0.016=-0.010
min2268.850-2268.818=0.032
max2268.861-2268.856=0.005
mean2644.000-2608.000=36.000
σ0.000
min2644.000-2608.000=36.000
max2644.000-2608.000=36.000
mean2.913-2.928=-0.015
σ0.074-0.100=-0.026
min2.852-2.831=0.021
max3.039-3.096=-0.057
iters=5
new-facts=6402
prior-facts=1
mean4952.341-4952.172=0.169
σ0.773-1.050=-0.277
min4951.947-4951.191=0.756
max4953.721-4953.964=-0.243
mean2644.000-2608.000=36.000
σ0.000
min2644.000-2608.000=36.000
max2644.000-2608.000=36.000
mean7.934-8.289=-0.355
σ0.201-0.501=-0.300
min7.702-7.761=-0.059
max8.148-8.813=-0.665
iters=5
new-facts=6402
prior-facts=6402
mean5166.980-5167.054=-0.074
σ0.156-0.011=0.145
min5166.702-5167.045=-0.343
max5167.065-5167.072=-0.008
mean3408.200-3348.600=59.600
σ460.388-460.383=0.005
min2819.000-2793.000=26.000
max4026.000-4009.000=17.000
mean9.263-9.393=-0.130
σ0.287-0.319=-0.032
min8.985-8.990=-0.005
max9.673-9.788=-0.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-1.049=-0.016
σ0.146-0.125=0.021
min0.939-0.936=0.004
max1.278-1.242=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.252-460.251=0.001
σ572.608-572.608=0.000
min173.944-173.943=0.001
max1319.164-1319.163=0.001
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.564-0.581=-0.017
σ0.583-0.603=-0.019
min0.256-0.273=-0.017
max1.439-1.485=-0.046
policies=20
mean1739.983-1739.975=0.008
σ0.321-0.342=-0.022
min1739.750-1739.732=0.019
max1740.454-1740.478=-0.024
mean760.000
σ0.000
min760.000
max760.000
mean447.500-445.750=1.750
σ9.950-9.605=0.345
min437.000-436.000=1.000
max456.000-454.000=2.000
mean2.651-2.673=-0.022
σ0.014-0.040=-0.027
min2.635-2.634=0.000
max2.664-2.729=-0.065
policies=200
mean17409.287-17409.230=0.056
σ0.125-0.156=-0.030
min17409.154-17409.063=0.090
max17409.445-17409.409=0.036
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.000-492.750=-0.750
σ2.944-3.594=-0.650
min489.000-488.000=1.000
max495.000-496.000=-1.000
mean26.894-26.965=-0.071
σ0.091-0.115=-0.024
min26.783-26.862=-0.079
max27.004-27.095=-0.092