Compare commits

Home / Compare a3c8bce6 .. fe4ee43b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.246-35.244=0.001
σ0.054-0.055=-0.001
min35.221-35.217=0.004
max35.397-35.399=-0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.086-0.086=0.000
σ0.005-0.004=0.001
min0.082-0.082=0.000
max0.096-0.095=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.004-0.004=0.001
min23.760-23.764=-0.004
max23.775-23.776=-0.001
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.066-0.069=-0.002
σ0.004-0.004=0.001
min0.061-0.066=-0.006
max0.074-0.077=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.415-1756.364=-37.949
σ169.612-0.367=169.245
min997.815-1755.787=-757.972
max1756.946-1756.958=-0.011
mean1633.350-1641.150=-7.800
σ612.477-632.387=-19.910
min626.000-624.000=2.000
max2461.000-2837.000=-376.000
mean2.288-2.334=-0.046
σ0.182-0.091=0.091
min1.590-2.232=-0.641
max2.568-2.561=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.583-324.557=0.026
σ0.054-0.050=0.004
min324.487-324.468=0.018
max324.610-324.591=0.019
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean0.428-0.430=-0.002
σ0.007-0.008=-0.001
min0.423-0.422=0.001
max0.440-0.441=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.146-1985.133=0.013
σ0.008-0.018=-0.009
min1985.135-1985.110=0.025
max1985.153-1985.153=-0.000
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean2.592-2.607=-0.015
σ0.102-0.085=0.017
min2.456-2.541=-0.085
max2.721-2.720=0.001
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.739=0.009
σ7.725-7.640=0.085
min4805.264-4805.290=-0.026
max4822.566-4822.404=0.162
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean8.965-9.009=-0.044
σ0.339-0.121=0.218
min8.456-8.802=-0.346
max9.374-9.123=0.251
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.204=0.143
σ0.021-0.179=-0.159
min4996.326-4996.000=0.326
max4996.371-4996.362=0.009
mean3003.200-3058.000=-54.800
σ271.020-233.711=37.308
min2609.000-2837.000=-228.000
max3336.000-3398.000=-62.000
mean8.664-8.665=-0.001
σ0.141-0.170=-0.029
min8.472-8.491=-0.019
max8.794-8.931=-0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.601-0.970=0.631
σ0.163-0.067=0.095
min1.378-0.908=0.470
max1.799-1.044=0.755

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.976=-0.029
σ574.249-574.253=-0.004
min175.818-175.839=-0.020
max1324.320-1324.355=-0.035
mean86.250
σ8.500
min82.000
max99.000
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean0.567-0.425=0.141
σ0.585-0.284=0.301
min0.272-0.278=-0.006
max1.444-0.852=0.593
policies=20
mean1758.493-1758.716=-0.223
σ0.338-0.351=-0.013
min1758.254-1758.486=-0.232
max1758.992-1759.238=-0.246
mean820.000
σ0.000
min820.000
max820.000
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean2.695-2.778=-0.083
σ0.010-0.004=0.006
min2.686-2.773=-0.088
max2.705-2.782=-0.077
policies=200
mean17592.362-17593.348=-0.986
σ0.362-0.700=-0.338
min17592.123-17592.370=-0.247
max17592.900-17593.879=-0.980
mean8200.000
σ0.000
min8200.000
max8200.000
mean2461.000-2837.000=-376.000
σ0.000
min2461.000-2837.000=-376.000
max2461.000-2837.000=-376.000
mean27.377-27.929=-0.552
σ0.124-0.340=-0.216
min27.205-27.501=-0.296
max27.491-28.327=-0.836