Compare commits

Home / Compare 7613cf6c .. b5ff26dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.965-35.966=-0.000
σ0.102-0.103=-0.001
min35.921-35.922=-0.001
max36.253-36.258=-0.005
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.078-0.077=0.000
σ0.004-0.004=0.000
min0.074-0.075=-0.001
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.005=-0.002
min26.203-26.201=0.002
max26.215-26.217=-0.002
mean417.900-412.000=5.900
σ0.316-0.000=0.316
min417.000-412.000=5.000
max418.000-412.000=6.000
mean0.060-0.061=-0.002
σ0.004-0.002=0.001
min0.057-0.060=-0.003
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.307=-0.002
σ0.368-0.369=-0.001
min1755.731-1755.731=-0.000
max1756.899-1756.901=-0.003
mean1661.250-1656.200=5.050
σ631.010-627.619=3.391
min615.000-609.000=6.000
max2731.000-2642.000=89.000
mean2.375-2.364=0.012
σ0.135-0.175=-0.040
min2.222-2.244=-0.022
max2.813-3.058=-0.246

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.825-278.826=-0.002
σ0.003-0.004=-0.001
min278.820-278.821=-0.001
max278.827-278.832=-0.004
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean0.410-0.409=0.001
σ0.004-0.005=-0.002
min0.406-0.405=0.001
max0.416-0.417=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.887-2268.892=-0.006
σ0.007-0.013=-0.007
min2268.878-2268.877=0.000
max2268.893-2268.914=-0.021
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean2.929-2.995=-0.066
σ0.077-0.111=-0.034
min2.856-2.871=-0.016
max3.032-3.114=-0.082
iters=5
new-facts=6402
prior-facts=1
mean4954.006-4954.264=-0.258
σ0.960-0.804=0.156
min4953.209-4953.813=-0.605
max4955.635-4955.697=-0.061
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean8.004-7.922=0.082
σ0.165-0.137=0.028
min7.843-7.828=0.015
max8.272-8.161=0.111
iters=5
new-facts=6402
prior-facts=6402
mean5168.727-5168.795=-0.068
σ0.207-0.076=0.131
min5168.378-5168.733=-0.355
max5168.885-5168.881=0.004
mean3462.000-3394.600=67.400
σ447.513-491.430=-43.917
min2888.000-2821.000=67.000
max4112.000-4126.000=-14.000
mean9.149-9.273=-0.124
σ0.187-0.280=-0.093
min8.986-8.908=0.079
max9.395-9.668=-0.273

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.157=-0.131
σ0.134-0.403=-0.269
min0.935-0.941=-0.006
max1.247-1.872=-0.625

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.351-460.350=0.002
σ572.651-572.654=-0.003
min174.019-174.013=0.006
max1319.328-1319.331=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean0.551-0.530=0.021
σ0.562-0.509=0.054
min0.254-0.268=-0.014
max1.394-1.293=0.102
policies=20
mean1740.425-1740.425=0.000
σ0.317-0.319=-0.002
min1740.238-1740.227=0.010
max1740.899-1740.901=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean2.690-2.666=0.024
σ0.015-0.015=0.000
min2.672-2.648=0.025
max2.708-2.680=0.028
policies=200
mean17411.277-17411.411=-0.134
σ0.432-0.497=-0.065
min17410.950-17411.077=-0.127
max17411.913-17412.147=-0.234
mean7600.000
σ0.000
min7600.000
max7600.000
mean2731.000-2642.000=89.000
σ0.000
min2731.000-2642.000=89.000
max2731.000-2642.000=89.000
mean26.954-26.930=0.025
σ0.065-0.142=-0.077
min26.886-26.775=0.111
max27.020-27.114=-0.094