Compare commits

Home / Compare 426f4898 .. 212ecdfc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.246-35.244=0.002
σ0.054-0.055=-0.001
min35.221-35.215=0.006
max35.397-35.398=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.086-0.086=0.000
σ0.005-0.004=0.001
min0.082-0.082=-0.000
max0.096-0.094=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.004-0.003=0.001
min23.760-23.765=-0.005
max23.775-23.774=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.066=0.000
σ0.004-0.003=0.002
min0.061-0.061=-0.000
max0.074-0.070=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.415-1756.364=-37.949
σ169.612-0.365=169.247
min997.815-1755.788=-757.973
max1756.946-1756.948=-0.002
mean1633.350-1647.300=-13.950
σ612.477-633.513=-21.036
min626.000-628.000=-2.000
max2461.000-2826.000=-365.000
mean2.288-2.342=-0.054
σ0.182-0.076=0.106
min1.590-2.255=-0.664
max2.568-2.570=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.583-324.587=-0.004
σ0.054-0.046=0.008
min324.487-324.506=-0.019
max324.610-324.614=-0.004
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean0.428-0.430=-0.002
σ0.007-0.008=-0.001
min0.423-0.422=0.001
max0.440-0.443=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.146-1985.141=0.005
σ0.008-0.016=-0.008
min1985.135-1985.123=0.011
max1985.153-1985.159=-0.006
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean2.592-2.796=-0.204
σ0.102-0.308=-0.205
min2.456-2.574=-0.119
max2.721-3.327=-0.606
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.653=0.095
σ7.725-7.688=0.037
min4805.264-4804.903=0.361
max4822.566-4822.400=0.166
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean8.965-8.664=0.301
σ0.339-0.504=-0.165
min8.456-7.880=0.576
max9.374-9.154=0.220
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.349=-0.002
σ0.021-0.024=-0.003
min4996.326-4996.318=0.008
max4996.371-4996.374=-0.003
mean3003.200-3049.200=-46.000
σ271.020-301.212=-30.192
min2609.000-2826.000=-217.000
max3336.000-3529.000=-193.000
mean8.664-8.620=0.044
σ0.141-0.166=-0.025
min8.472-8.463=0.009
max8.794-8.868=-0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.601-1.009=0.592
σ0.163-0.136=0.027
min1.378-0.912=0.466
max1.799-1.235=0.563

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.971=-0.024
σ574.249-574.252=-0.003
min175.818-175.839=-0.021
max1324.320-1324.349=-0.029
mean86.250
σ8.500
min82.000
max99.000
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean0.567-0.437=0.130
σ0.585-0.300=0.285
min0.272-0.283=-0.011
max1.444-0.887=0.557
policies=20
mean1758.493-1758.709=-0.216
σ0.338-0.346=-0.008
min1758.254-1758.476=-0.222
max1758.992-1759.221=-0.229
mean820.000
σ0.000
min820.000
max820.000
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean2.695-2.787=-0.092
σ0.010-0.003=0.006
min2.686-2.783=-0.098
max2.705-2.790=-0.085
policies=200
mean17592.362-17593.102=-0.740
σ0.362-0.766=-0.404
min17592.123-17592.133=-0.010
max17592.900-17593.859=-0.959
mean8200.000
σ0.000
min8200.000
max8200.000
mean2461.000-2826.000=-365.000
σ0.000
min2461.000-2826.000=-365.000
max2461.000-2826.000=-365.000
mean27.377-27.801=-0.424
σ0.124-0.411=-0.287
min27.205-27.369=-0.164
max27.491-28.257=-0.766