Compare commits

Home / Compare 59e3210d .. 71c89d37

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.055-0.055=0.000
min35.229-35.233=-0.004
max35.418-35.417=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.084=0.001
σ0.004-0.003=0.000
min0.083-0.081=0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.768-23.768=-0.000
σ0.004-0.003=0.001
min23.765-23.763=0.002
max23.776-23.771=0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.066=-0.004
σ0.003-0.004=-0.001
min0.060-0.061=-0.000
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.471=-0.000
σ0.364-0.365=-0.000
min1755.894-1755.896=-0.002
max1757.055-1757.055=-0.001
mean1655.300-1658.700=-3.400
σ636.142-641.986=-5.844
min677.000-629.000=48.000
max2841.000-2779.000=62.000
mean2.327-2.346=-0.020
σ0.102-0.127=-0.026
min2.093-2.219=-0.126
max2.515-2.773=-0.258

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.690=0.008
σ0.043-0.051=-0.008
min324.622-324.601=0.021
max324.728-324.726=0.002
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean0.427-0.426=0.002
σ0.007-0.001=0.006
min0.424-0.424=-0.000
max0.439-0.427=0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.255-1985.251=0.004
σ0.012-0.015=-0.003
min1985.238-1985.230=0.008
max1985.271-1985.263=0.008
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean2.610-2.610=0.000
σ0.080-0.087=-0.007
min2.561-2.518=0.043
max2.749-2.723=0.025
iters=5
new-facts=6402
prior-facts=1
mean4808.890-4808.859=0.031
σ7.644-7.670=-0.026
min4805.409-4805.377=0.032
max4822.563-4822.579=-0.016
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean8.792-9.008=-0.216
σ0.440-0.215=0.225
min8.088-8.843=-0.756
max9.285-9.361=-0.076
iters=5
new-facts=6402
prior-facts=6402
mean4996.456-4996.461=-0.005
σ0.015-0.015=-0.001
min4996.436-4996.448=-0.012
max4996.472-4996.484=-0.012
mean3029.200-3017.200=12.000
σ261.110-303.488=-42.378
min2841.000-2779.000=62.000
max3429.000-3484.000=-55.000
mean8.575-8.605=-0.030
σ0.170-0.157=0.013
min8.441-8.476=-0.035
max8.870-8.862=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.968=0.005
σ0.075-0.071=0.004
min0.899-0.907=-0.009
max1.056-1.046=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.940-462.953=-0.013
σ574.256-574.251=0.005
min175.806-175.819=-0.013
max1324.324-1324.330=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean0.434-0.431=0.003
σ0.306-0.297=0.009
min0.278-0.281=-0.003
max0.892-0.876=0.016
policies=20
mean1758.460-1758.485=-0.025
σ0.368-0.346=0.022
min1758.202-1758.257=-0.055
max1759.003-1758.998=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean2.811-2.796=0.015
σ0.044-0.005=0.039
min2.758-2.790=-0.031
max2.862-2.800=0.062
policies=200
mean17590.954-17590.241=0.712
σ0.559-0.410=0.149
min17590.222-17589.975=0.248
max17591.436-17590.848=0.589
mean8200.000
σ0.000
min8200.000
max8200.000
mean2841.000-2779.000=62.000
σ0.000
min2841.000-2779.000=62.000
max2841.000-2779.000=62.000
mean27.937-27.506=0.431
σ0.358-0.118=0.240
min27.558-27.334=0.224
max28.323-27.602=0.721