Compare commits

Home / Compare 67e4f2ca .. f1e4f74d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.018
σ0.054-0.054=0.000
min35.238-35.221=0.017
max35.415-35.396=0.019
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.084-0.084=0.000
σ0.005-0.004=0.001
min0.078-0.076=0.002
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=-0.000
min23.766-23.765=0.000
max23.775-23.776=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.066=-0.002
σ0.002-0.005=-0.003
min0.061-0.062=-0.000
max0.067-0.075=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.468-1756.365=0.104
σ0.368-0.365=0.003
min1755.896-1755.788=0.108
max1757.064-1756.957=0.106
mean1656.550-1653.900=2.650
σ637.000-631.668=5.332
min677.000-622.000=55.000
max2843.000-2755.000=88.000
mean2.325-2.354=-0.029
σ0.107-0.106=0.001
min2.131-2.243=-0.112
max2.583-2.613=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.690-324.581=0.108
σ0.051-0.052=-0.000
min324.599-324.489=0.110
max324.720-324.611=0.109
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean0.424-0.424=0.000
σ0.003-0.008=-0.005
min0.421-0.419=0.002
max0.429-0.438=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.257-1985.143=0.114
σ0.005-0.018=-0.012
min1985.251-1985.112=0.139
max1985.263-1985.156=0.107
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean2.581-2.582=-0.001
σ0.074-0.096=-0.023
min2.494-2.429=0.065
max2.671-2.693=-0.022
iters=5
new-facts=6402
prior-facts=1
mean4808.873-4808.642=0.231
σ7.625-7.720=-0.095
min4805.391-4804.703=0.688
max4822.513-4822.443=0.070
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean9.066-9.033=0.033
σ0.348-0.424=-0.076
min8.518-8.624=-0.106
max9.473-9.728=-0.256
iters=5
new-facts=6402
prior-facts=6402
mean4996.398-4996.350=0.048
σ0.140-0.022=0.118
min4996.150-4996.325=-0.174
max4996.477-4996.380=0.097
mean3051.600-3028.000=23.600
σ191.680-256.654=-64.974
min2843.000-2755.000=88.000
max3330.000-3378.000=-48.000
mean8.661-8.751=-0.090
σ0.192-0.226=-0.034
min8.472-8.531=-0.059
max8.889-9.125=-0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-0.977=0.059
σ0.164-0.069=0.095
min0.913-0.918=-0.005
max1.230-1.054=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.976=-0.025
σ574.253-574.254=-0.001
min175.816-175.838=-0.022
max1324.331-1324.357=-0.027
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean0.435-0.434=0.000
σ0.300-0.304=-0.004
min0.282-0.280=0.002
max0.885-0.890=-0.005
policies=20
mean1758.489-1758.715=-0.226
σ0.351-0.350=0.001
min1758.234-1758.480=-0.246
max1759.004-1759.233=-0.230
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean2.797-2.777=0.020
σ0.019-0.018=0.001
min2.774-2.756=0.018
max2.819-2.797=0.023
policies=200
mean17591.085-17592.328=-1.244
σ0.662-0.548=0.114
min17590.274-17591.975=-1.701
max17591.638-17593.136=-1.498
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2755.000=88.000
σ0.000
min2843.000-2755.000=88.000
max2843.000-2755.000=88.000
mean27.941-27.486=0.455
σ0.288-0.083=0.205
min27.672-27.367=0.304
max28.294-27.562=0.732