Compare commits

Home / Compare 4cfb85a4 .. 561d1ea9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=0.000
σ0.054-0.055=-0.001
min35.220-35.217=0.003
max35.397-35.401=-0.004
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.086-0.082=0.003
σ0.004-0.005=-0.001
min0.083-0.076=0.007
max0.092-0.089=0.004
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.003-0.004=-0.002
min23.765-23.764=0.001
max23.773-23.778=-0.005
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.068-0.066=0.002
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.362=0.000
σ0.365-0.365=0.000
min1755.787-1755.787=0.000
max1756.948-1756.954=-0.006
mean1644.400-1651.800=-7.400
σ632.355-638.585=-6.230
min619.000-630.000=-11.000
max2824.000-2830.000=-6.000
mean2.352-2.337=0.015
σ0.065-0.078=-0.014
min2.281-2.254=0.027
max2.458-2.530=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588-324.589=-0.001
σ0.043-0.041=0.002
min324.512-324.517=-0.005
max324.617-324.615=0.002
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean0.423-0.423=0.000
σ0.001-0.001=-0.000
min0.422-0.422=0.000
max0.425-0.425=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.137-1985.144=-0.007
σ0.020-0.005=0.015
min1985.106-1985.138=-0.032
max1985.152-1985.150=0.002
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean2.697-2.592=0.104
σ0.242-0.050=0.192
min2.502-2.540=-0.037
max3.112-2.646=0.466
iters=5
new-facts=6402
prior-facts=1
mean4808.752-4808.740=0.012
σ7.696-7.676=0.020
min4805.204-4805.235=-0.031
max4822.517-4822.470=0.047
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean8.936-8.873=0.063
σ0.389-0.228=0.161
min8.529-8.504=0.025
max9.452-9.098=0.354
iters=5
new-facts=6402
prior-facts=6402
mean4996.274-4996.273=0.002
σ0.156-0.177=-0.022
min4995.997-4995.956=0.040
max4996.360-4996.365=-0.005
mean3041.600-3048.600=-7.000
σ291.512-187.848=103.664
min2824.000-2830.000=-6.000
max3495.000-3312.000=183.000
mean8.495-8.642=-0.147
σ0.109-0.209=-0.100
min8.429-8.400=0.029
max8.685-8.834=-0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-0.928=0.077
σ0.087-0.011=0.076
min0.914-0.921=-0.007
max1.113-0.947=0.167

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.968=0.004
σ574.251-574.247=0.004
min175.836-175.837=-0.001
max1324.348-1324.338=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean0.429-0.432=-0.004
σ0.292-0.299=-0.007
min0.282-0.280=0.002
max0.867-0.881=-0.014
policies=20
mean1758.690-1758.720=-0.030
σ0.351-0.338=0.013
min1758.451-1758.503=-0.052
max1759.211-1759.224=-0.013
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean2.799-2.789=0.011
σ0.012-0.013=-0.001
min2.785-2.769=0.017
max2.812-2.798=0.014
policies=200
mean17593.315-17593.304=0.011
σ0.684-0.702=-0.019
min17592.382-17592.334=0.047
max17593.889-17593.850=0.039
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2830.000=-6.000
σ0.000
min2824.000-2830.000=-6.000
max2824.000-2830.000=-6.000
mean27.918-27.975=-0.057
σ0.343-0.454=-0.110
min27.556-27.575=-0.019
max28.275-28.491=-0.217