Compare commits

Home / Compare 0270eed9 .. e9b6d8b9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.983-35.977=0.007
σ0.103-0.098=0.005
min35.935-35.934=0.001
max36.276-36.255=0.021
mean3815.000-4068.000=-253.000
σ0.000
min3815.000-4068.000=-253.000
max3815.000-4068.000=-253.000
mean0.075-0.075=0.000
σ0.003-0.000=0.002
min0.072-0.075=-0.003
max0.080-0.076=0.004
cache=y
dps=1
iters=10
policies=100
mean26.210-26.208=0.002
σ0.004-0.004=-0.000
min26.205-26.200=0.005
max26.215-26.214=0.002
mean3815.000-4068.000=-253.000
σ0.000
min3815.000-4068.000=-253.000
max3815.000-4068.000=-253.000
mean0.058-0.060=-0.002
σ0.003-0.001=0.002
min0.055-0.059=-0.004
max0.062-0.061=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.368=0.001
σ0.373-0.373=-0.000
min1755.799-1755.796=0.004
max1756.969-1756.966=0.002
mean1658.550-1659.100=-0.550
σ625.379-627.644=-2.265
min617.000-616.000=1.000
max2667.000-2631.000=36.000
mean2.292-2.300=-0.008
σ0.172-0.147=0.025
min2.142-2.172=-0.031
max2.740-2.797=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.699-278.697=0.002
σ0.014-0.007=0.006
min278.687-278.691=-0.003
max278.718-278.708=0.011
mean2667.000-2631.000=36.000
σ0.000
min2667.000-2631.000=36.000
max2667.000-2631.000=36.000
mean0.417-0.420=-0.003
σ0.001-0.001=-0.000
min0.416-0.419=-0.003
max0.418-0.422=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.856-2268.870=-0.014
σ0.021-0.006=0.016
min2268.833-2268.865=-0.032
max2268.877-2268.879=-0.002
mean2667.000-2631.000=36.000
σ0.000
min2667.000-2631.000=36.000
max2667.000-2631.000=36.000
mean3.153-2.957=0.197
σ0.185-0.084=0.101
min2.880-2.903=-0.024
max3.338-3.105=0.232
iters=5
new-facts=6402
prior-facts=1
mean4952.183-4952.348=-0.165
σ0.775-0.785=-0.009
min4951.752-4951.893=-0.141
max4953.565-4953.747=-0.182
mean2667.000-2631.000=36.000
σ0.000
min2667.000-2631.000=36.000
max2667.000-2631.000=36.000
mean8.000-7.902=0.098
σ0.249-0.273=-0.024
min7.632-7.558=0.074
max8.248-8.309=-0.061
iters=5
new-facts=6402
prior-facts=6402
mean5166.918-5167.012=-0.094
σ0.011-0.164=-0.153
min5166.908-5166.722=0.186
max5166.934-5167.116=-0.182
mean3358.600-3427.400=-68.800
σ447.942-493.681=-45.739
min2920.000-2762.000=158.000
max3815.000-4068.000=-253.000
mean9.185-9.693=-0.508
σ0.274-0.532=-0.258
min9.006-9.183=-0.177
max9.639-10.560=-0.921

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.596-1.054=0.541
σ0.369-0.282=0.087
min1.153-0.911=0.241
max1.891-1.559=0.333

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.262-460.259=0.003
σ572.607-572.609=-0.002
min173.958-173.950=0.008
max1319.173-1319.173=0.001
mean79.500
σ7.000
min76.000
max90.000
mean438.000-435.000=3.000
σ0.000
min438.000-435.000=3.000
max438.000-435.000=3.000
mean0.548-0.548=0.000
σ0.547-0.548=-0.001
min0.272-0.270=0.003
max1.369-1.369=-0.001
policies=20
mean1740.078-1740.051=0.027
σ0.336-0.331=0.005
min1739.830-1739.815=0.015
max1740.569-1740.538=0.032
mean760.000
σ0.000
min760.000
max760.000
mean449.000-445.500=3.500
σ10.520-9.950=0.570
min438.000-435.000=3.000
max458.000-454.000=4.000
mean2.668-2.654=0.014
σ0.010-0.011=-0.001
min2.655-2.643=0.012
max2.677-2.665=0.012
policies=200
mean17410.060-17409.955=0.105
σ0.063-0.058=0.005
min17410.005-17409.904=0.101
max17410.151-17410.027=0.124
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.000-487.750=6.250
σ3.742-1.708=2.034
min489.000-486.000=3.000
max498.000-490.000=8.000
mean26.984-26.918=0.066
σ0.032-0.106=-0.074
min26.964-26.804=0.161
max27.031-27.017=0.014