Compare commits

Home / Compare a967b5c6 .. c17ca60b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.001
σ0.045-0.048=-0.003
min30.729-30.734=-0.005
max30.894-30.904=-0.010
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.076-0.078=-0.002
σ0.004-0.003=0.001
min0.071-0.075=-0.004
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=0.000
min21.057-21.058=-0.000
max21.063-21.064=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.061-0.064=-0.003
σ0.003-0.003=-0.000
min0.058-0.062=-0.004
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.419=-0.001
σ0.359-0.361=-0.002
min1750.851-1750.856=-0.005
max1751.981-1751.999=-0.018
mean1659.900-1645.050=14.850
σ629.175-618.732=10.443
min684.000-680.000=4.000
max2666.000-2636.000=30.000
mean2.827-2.784=0.043
σ0.140-0.269=-0.129
min2.479-2.280=0.199
max3.070-3.205=-0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.192-282.192=0.000
σ0.011-0.006=0.004
min282.181-282.186=-0.004
max282.207-282.199=0.008
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean0.406-0.399=0.007
σ0.011-0.004=0.007
min0.395-0.396=-0.002
max0.418-0.406=0.013
iters=5
new-facts=1
prior-facts=6402
mean2174.724-2174.718=0.006
σ0.007-0.008=-0.001
min2174.713-2174.709=0.004
max2174.729-2174.728=0.001
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean3.053-2.907=0.146
σ0.265-0.187=0.078
min2.792-2.775=0.017
max3.455-3.220=0.235
iters=5
new-facts=6402
prior-facts=1
mean5054.544-5054.604=-0.059
σ0.952-0.910=0.042
min5054.013-5054.112=-0.100
max5056.238-5056.226=0.012
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean9.013-8.442=0.571
σ0.422-0.526=-0.104
min8.389-8.074=0.314
max9.453-9.366=0.088
iters=5
new-facts=6402
prior-facts=6402
mean5185.680-5185.675=0.005
σ0.078-0.085=-0.007
min5185.610-5185.595=0.015
max5185.776-5185.781=-0.005
mean3230.200-3218.600=11.600
σ388.540-468.504=-79.964
min2690.000-2636.000=54.000
max3720.000-3808.000=-88.000
mean10.061-10.177=-0.116
σ0.167-0.373=-0.206
min9.840-9.927=-0.087
max10.293-10.803=-0.510

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.232=-0.070
σ0.202-0.414=-0.212
min0.941-0.947=-0.006
max1.452-1.939=-0.487

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.572=0.002
σ572.670-572.665=0.006
min177.235-177.235=0.000
max1322.579-1322.569=0.010
mean79.750
σ7.500
min76.000
max91.000
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean0.550-0.542=0.008
σ0.544-0.523=0.022
min0.275-0.275=0.000
max1.366-1.326=0.040
policies=20
mean1772.628-1772.621=0.007
σ0.334-0.332=0.002
min1772.405-1772.395=0.010
max1773.125-1773.114=0.011
mean760.000
σ0.000
min760.000
max760.000
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean2.744-2.747=-0.003
σ0.011-0.012=-0.001
min2.735-2.734=0.001
max2.759-2.758=0.001
policies=200
mean17733.035-17732.909=0.126
σ0.471-0.423=0.048
min17732.783-17732.597=0.186
max17733.742-17733.527=0.215
mean7600.000
σ0.000
min7600.000
max7600.000
mean2666.000-2636.000=30.000
σ0.000
min2666.000-2636.000=30.000
max2666.000-2636.000=30.000
mean27.784-27.732=0.052
σ0.155-0.179=-0.024
min27.643-27.571=0.072
max27.923-27.890=0.033