Compare commits

Home / Compare 8de8ac8c .. ca9fd64f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.354
σ0.056-0.055=0.001
min35.589-35.239=0.350
max35.775-35.419=0.356
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.086-0.083=0.003
σ0.003-0.006=-0.002
min0.083-0.076=0.007
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-23.770=0.276
σ0.004-0.002=0.002
min24.041-23.766=0.275
max24.055-23.773=0.281
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.066=-0.002
σ0.005-0.005=0.001
min0.061-0.062=-0.001
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.470=0.021
σ0.365-0.365=-0.001
min1755.916-1755.894=0.022
max1757.078-1757.061=0.017
mean1651.250-1650.700=0.550
σ645.108-640.346=4.762
min648.000-627.000=21.000
max2839.000-2833.000=6.000
mean2.331-2.341=-0.010
σ0.062-0.071=-0.009
min2.255-2.251=0.004
max2.480-2.463=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.703=0.059
σ0.043-0.030=0.014
min324.691-324.651=0.041
max324.798-324.724=0.074
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean0.420-0.423=-0.003
σ0.010-0.002=0.009
min0.415-0.421=-0.007
max0.438-0.426=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.330-1985.248=0.081
σ0.004-0.014=-0.010
min1985.325-1985.230=0.094
max1985.334-1985.264=0.070
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean2.601-2.614=-0.013
σ0.058-0.119=-0.060
min2.522-2.513=0.009
max2.661-2.785=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4809.024-4808.877=0.147
σ7.706-7.649=0.057
min4804.974-4805.340=-0.367
max4822.794-4822.559=0.235
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean8.763-8.640=0.123
σ0.818-0.546=0.272
min7.684-7.710=-0.026
max9.963-9.081=0.882
iters=5
new-facts=6402
prior-facts=6402
mean4996.630-4996.438=0.192
σ0.025-0.016=0.009
min4996.589-4996.417=0.172
max4996.651-4996.460=0.191
mean3048.400-3060.800=-12.400
σ188.558-298.361=-109.802
min2839.000-2833.000=6.000
max3320.000-3519.000=-199.000
mean8.628-8.472=0.157
σ0.132-0.125=0.007
min8.483-8.350=0.133
max8.788-8.675=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-0.967=0.035
σ0.191-0.144=0.047
min0.913-0.888=0.025
max1.345-1.224=0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-462.951=0.264
σ574.767-574.254=0.513
min175.820-175.818=0.002
max1325.366-1324.332=1.034
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean0.432-0.433=-0.001
σ0.301-0.303=-0.002
min0.278-0.282=-0.004
max0.884-0.887=-0.004
policies=20
mean1758.532-1758.486=0.046
σ0.351-0.344=0.007
min1758.292-1758.254=0.038
max1759.051-1758.996=0.056
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean2.781-2.787=-0.006
σ0.004-0.011=-0.008
min2.778-2.777=0.001
max2.786-2.802=-0.016
policies=200
mean17592.099-17590.970=1.129
σ0.550-0.755=-0.206
min17591.798-17589.939=1.859
max17592.923-17591.677=1.246
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2833.000=6.000
σ0.000
min2839.000-2833.000=6.000
max2839.000-2833.000=6.000
mean27.786-27.873=-0.088
σ0.383-0.420=-0.036
min27.375-27.494=-0.119
max28.227-28.325=-0.098