Compare commits

Home / Compare ea9d4a96 .. d702da38

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=-0.000
σ0.054-0.055=-0.001
min35.238-35.233=0.004
max35.415-35.418=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.086-0.083=0.003
σ0.004-0.004=-0.001
min0.083-0.077=0.006
max0.093-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.771-23.769=0.001
σ0.003-0.003=-0.000
min23.767-23.765=0.003
max23.777-23.775=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.067-0.068=-0.002
σ0.005-0.003=0.001
min0.061-0.066=-0.005
max0.075-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.001
σ0.365-0.366=-0.001
min1755.911-1755.913=-0.002
max1757.077-1757.074=0.003
mean1655.350-1629.500=25.850
σ626.637-591.061=35.576
min629.000-644.000=-15.000
max2751.000-2425.000=326.000
mean2.359-2.342=0.017
σ0.123-0.092=0.031
min2.251-2.199=0.052
max2.807-2.622=0.185

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.717-324.703=0.014
σ0.025-0.059=-0.034
min324.674-324.600=0.074
max324.732-324.743=-0.011
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean0.424-0.432=-0.008
σ0.001-0.008=-0.006
min0.422-0.426=-0.004
max0.425-0.444=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.268-1985.256=0.012
σ0.006-0.021=-0.015
min1985.263-1985.229=0.033
max1985.279-1985.280=-0.001
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean2.600-2.578=0.022
σ0.061-0.069=-0.008
min2.550-2.486=0.064
max2.702-2.668=0.033
iters=5
new-facts=6402
prior-facts=1
mean4808.896-4808.866=0.030
σ7.656-7.702=-0.047
min4805.419-4805.356=0.063
max4822.590-4822.644=-0.054
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean9.045-8.933=0.111
σ0.204-0.128=0.076
min8.802-8.816=-0.013
max9.232-9.086=0.146
iters=5
new-facts=6402
prior-facts=6402
mean4996.399-4996.472=-0.073
σ0.161-0.017=0.144
min4996.113-4996.451=-0.338
max4996.496-4996.489=0.007
mean3006.200-3003.000=3.200
σ250.417-313.334=-62.917
min2751.000-2599.000=152.000
max3357.000-3404.000=-47.000
mean8.728-8.593=0.135
σ0.233-0.111=0.122
min8.494-8.482=0.012
max9.042-8.713=0.329

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-1.631=-0.661
σ0.066-0.112=-0.046
min0.911-1.466=-0.555
max1.046-1.776=-0.730

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.945=0.031
σ574.253-574.246=0.007
min175.839-175.817=0.021
max1324.355-1324.314=0.041
mean86.250
σ8.500
min82.000
max99.000
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean0.431-0.545=-0.115
σ0.299-0.534=-0.235
min0.279-0.277=0.002
max0.879-1.347=-0.467
policies=20
mean1758.665-1758.505=0.160
σ0.311-0.352=-0.040
min1758.458-1758.252=0.206
max1759.126-1759.024=0.103
mean820.000
σ0.000
min820.000
max820.000
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean2.833-2.718=0.115
σ0.071-0.010=0.061
min2.790-2.712=0.079
max2.938-2.732=0.206
policies=200
mean17592.386-17592.513=-0.127
σ0.601-0.504=0.097
min17591.940-17592.231=-0.290
max17593.267-17593.266=0.001
mean8200.000
σ0.000
min8200.000
max8200.000
mean2751.000-2425.000=326.000
σ0.000
min2751.000-2425.000=326.000
max2751.000-2425.000=326.000
mean27.373-27.532=-0.159
σ0.114-0.069=0.045
min27.273-27.439=-0.165
max27.485-27.592=-0.107