Compare commits

Home / Compare e034dc24 .. 0057696c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.571-35.283=0.289
σ0.053-0.053=-0.000
min35.546-35.256=0.291
max35.721-35.433=0.288
mean414.400-416.000=-1.600
σ0.516-0.000=0.516
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.083-0.083=0.000
σ0.004-0.005=-0.001
min0.077-0.077=-0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.002-23.785=0.217
σ0.004-0.003=0.001
min23.994-23.782=0.212
max24.007-23.790=0.217
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.069=-0.003
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.075-0.077=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.504-1756.489=0.015
σ0.365-0.366=-0.001
min1755.930-1755.916=0.014
max1757.097-1757.073=0.025
mean1660.300-1655.000=5.300
σ647.619-637.947=9.672
min621.000-628.000=-7.000
max2809.000-2786.000=23.000
mean2.368-2.321=0.047
σ0.118-0.103=0.015
min2.218-2.097=0.121
max2.714-2.579=0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.742-324.712=0.031
σ0.038-0.055=-0.017
min324.675-324.614=0.061
max324.771-324.744=0.027
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean0.425-0.430=-0.005
σ0.002-0.011=-0.009
min0.424-0.421=0.002
max0.429-0.443=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.293-1985.265=0.028
σ0.018-0.012=0.006
min1985.272-1985.247=0.025
max1985.314-1985.276=0.038
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean2.598-2.543=0.056
σ0.100-0.076=0.024
min2.532-2.438=0.094
max2.767-2.651=0.116
iters=5
new-facts=6402
prior-facts=1
mean4808.826-4808.785=0.041
σ7.757-7.785=-0.028
min4804.826-4804.799=0.027
max4822.690-4822.701=-0.011
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean8.677-8.779=-0.102
σ0.465-0.640=-0.174
min8.058-7.716=0.342
max9.281-9.429=-0.148
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.468=0.026
σ0.026-0.020=0.006
min4996.459-4996.445=0.015
max4996.522-4996.489=0.033
mean3063.200-3063.000=0.200
σ322.759-246.631=76.127
min2809.000-2786.000=23.000
max3557.000-3419.000=138.000
mean8.561-8.714=-0.153
σ0.159-0.208=-0.049
min8.435-8.479=-0.044
max8.782-8.945=-0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.970=0.003
σ0.063-0.067=-0.004
min0.913-0.914=-0.001
max1.043-1.044=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.951=0.021
σ574.255-574.250=0.005
min175.836-175.818=0.018
max1324.355-1324.326=0.029
mean86.250
σ8.500
min82.000
max99.000
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean0.432-0.430=0.003
σ0.294-0.298=-0.004
min0.280-0.277=0.003
max0.873-0.876=-0.004
policies=20
mean1758.749-1758.621=0.128
σ0.347-0.416=-0.069
min1758.507-1758.338=0.169
max1759.261-1759.238=0.023
mean820.000
σ0.000
min820.000
max820.000
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean2.802-2.823=-0.021
σ0.005-0.061=-0.057
min2.797-2.786=0.011
max2.807-2.914=-0.107
policies=200
mean17594.103-17592.670=1.432
σ0.609-0.418=0.192
min17593.776-17592.439=1.337
max17595.016-17593.296=1.720
mean8200.000
σ0.000
min8200.000
max8200.000
mean2809.000-2786.000=23.000
σ0.000
min2809.000-2786.000=23.000
max2809.000-2786.000=23.000
mean27.546-27.317=0.229
σ0.123-0.101=0.021
min27.405-27.167=0.238
max27.704-27.389=0.315