Compare commits

Home / Compare 71c89d37 .. ce1a3ebc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=-0.000
σ0.055-0.055=0.000
min35.236-35.229=0.008
max35.420-35.418=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.084-0.085=-0.001
σ0.005-0.004=0.002
min0.076-0.083=-0.007
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.768=0.002
σ0.004-0.004=0.001
min23.763-23.765=-0.002
max23.778-23.776=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.069-0.062=0.006
σ0.003-0.003=0.001
min0.066-0.060=0.006
max0.076-0.068=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.470-1756.471=-0.000
σ0.364-0.364=-0.000
min1755.897-1755.894=0.003
max1757.053-1757.055=-0.002
mean1653.950-1655.300=-1.350
σ638.736-636.142=2.595
min625.000-677.000=-52.000
max2749.000-2841.000=-92.000
mean2.346-2.327=0.019
σ0.120-0.102=0.018
min2.240-2.093=0.147
max2.775-2.515=0.260

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.699=0.001
σ0.029-0.043=-0.014
min324.648-324.622=0.026
max324.721-324.728=-0.007
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean0.428-0.427=0.000
σ0.007-0.007=0.000
min0.422-0.424=-0.002
max0.439-0.439=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.242-1985.255=-0.013
σ0.031-0.012=0.020
min1985.187-1985.238=-0.052
max1985.263-1985.271=-0.008
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean2.584-2.610=-0.026
σ0.082-0.080=0.001
min2.466-2.561=-0.095
max2.663-2.749=-0.085
iters=5
new-facts=6402
prior-facts=1
mean4808.852-4808.890=-0.038
σ7.739-7.644=0.095
min4805.366-4805.409=-0.043
max4822.696-4822.563=0.133
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean8.914-8.792=0.122
σ0.243-0.440=-0.197
min8.787-8.088=0.699
max9.347-9.285=0.062
iters=5
new-facts=6402
prior-facts=6402
mean4996.452-4996.456=-0.003
σ0.015-0.015=0.000
min4996.439-4996.436=0.003
max4996.471-4996.472=-0.001
mean2975.200-3029.200=-54.000
σ212.110-261.110=-48.999
min2749.000-2841.000=-92.000
max3241.000-3429.000=-188.000
mean8.721-8.575=0.146
σ0.153-0.170=-0.017
min8.464-8.441=0.024
max8.849-8.870=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-0.973=0.117
σ0.227-0.075=0.151
min0.915-0.899=0.016
max1.471-1.056=0.416

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.936-462.940=-0.004
σ574.254-574.256=-0.002
min175.798-175.806=-0.008
max1324.317-1324.324=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean0.473-0.434=0.040
σ0.380-0.306=0.074
min0.282-0.278=0.004
max1.043-0.892=0.151
policies=20
mean1758.317-1758.460=-0.143
σ0.361-0.368=-0.007
min1758.071-1758.202=-0.131
max1758.851-1759.003=-0.152
mean820.000
σ0.000
min820.000
max820.000
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean2.827-2.811=0.016
σ0.069-0.044=0.025
min2.782-2.758=0.024
max2.931-2.862=0.069
policies=200
mean17590.213-17590.954=-0.741
σ0.479-0.559=-0.080
min17589.971-17590.222=-0.251
max17590.931-17591.436=-0.506
mean8200.000
σ0.000
min8200.000
max8200.000
mean2749.000-2841.000=-92.000
σ0.000
min2749.000-2841.000=-92.000
max2749.000-2841.000=-92.000
mean27.440-27.937=-0.498
σ0.099-0.358=-0.259
min27.313-27.558=-0.246
max27.551-28.323=-0.772