Compare commits

Home / Compare 793c0b37 .. 4c962aa3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.054-0.053=0.000
min35.238-35.237=0.001
max35.415-35.415=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=-0.000
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.001
σ0.003-0.002=0.001
min23.765-23.766=-0.001
max23.773-23.774=-0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.068-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.065=0.001
max0.075-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.484=0.001
σ0.365-0.364=0.001
min1755.911-1755.914=-0.003
max1757.076-1757.071=0.005
mean1648.650-1647.500=1.150
σ643.392-642.368=1.024
min623.000-669.000=-46.000
max2841.000-2728.000=113.000
mean2.376-2.406=-0.030
σ0.139-0.147=-0.008
min2.263-2.233=0.030
max2.853-2.792=0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.683-324.695=-0.013
σ0.044-0.050=-0.006
min324.604-324.609=-0.005
max324.710-324.732=-0.021
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean0.428-0.427=0.001
σ0.009-0.006=0.004
min0.422-0.423=-0.001
max0.445-0.437=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.247=0.018
σ0.017-0.019=-0.003
min1985.237-1985.221=0.016
max1985.282-1985.266=0.016
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean2.650-2.661=-0.011
σ0.171-0.147=0.024
min2.477-2.560=-0.083
max2.862-2.898=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4808.892-4808.868=0.023
σ7.701-7.636=0.065
min4805.342-4805.365=-0.023
max4822.667-4822.528=0.140
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean8.978-8.648=0.330
σ0.343-0.206=0.137
min8.436-8.430=0.006
max9.321-8.870=0.450
iters=5
new-facts=6402
prior-facts=6402
mean4996.472-4996.466=0.005
σ0.021-0.015=0.006
min4996.452-4996.449=0.003
max4996.496-4996.482=0.014
mean3006.200-3030.800=-24.600
σ186.315-355.549=-169.234
min2841.000-2728.000=113.000
max3295.000-3556.000=-261.000
mean8.648-8.633=0.015
σ0.133-0.209=-0.076
min8.496-8.459=0.038
max8.797-8.951=-0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.032=-0.038
σ0.188-0.129=0.059
min0.905-0.914=-0.009
max1.330-1.229=0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.966=0.010
σ574.252-574.280=-0.028
min175.836-175.818=0.018
max1324.354-1324.386=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean0.432-0.556=-0.124
σ0.302-0.567=-0.265
min0.277-0.271=0.006
max0.885-1.407=-0.522
policies=20
mean1758.718-1758.534=0.184
σ0.350-0.336=0.014
min1758.479-1758.311=0.168
max1759.236-1759.031=0.205
mean820.000
σ0.000
min820.000
max820.000
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean2.805-2.712=0.094
σ0.024-0.016=0.008
min2.782-2.692=0.090
max2.830-2.731=0.099
policies=200
mean17593.314-17592.470=0.844
σ0.667-0.409=0.258
min17592.519-17592.198=0.322
max17593.922-17593.075=0.847
mean8200.000
σ0.000
min8200.000
max8200.000
mean2841.000-2728.000=113.000
σ0.000
min2841.000-2728.000=113.000
max2841.000-2728.000=113.000
mean27.884-27.539=0.346
σ0.331-0.348=-0.017
min27.493-27.262=0.230
max28.223-28.023=0.199