Compare commits

Home / Compare 10f692a5 .. 47e5a049

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.052-0.053=-0.002
min35.237-35.235=0.002
max35.408-35.414=-0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.080-0.082=-0.002
σ0.005-0.005=0.000
min0.076-0.077=-0.001
max0.089-0.091=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.002=0.001
min23.767-23.766=0.000
max23.776-23.774=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.069=-0.003
σ0.004-0.004=0.001
min0.062-0.066=-0.005
max0.074-0.077=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.473-1756.474=-0.001
σ0.365-0.366=-0.001
min1755.896-1755.896=-0.000
max1757.064-1757.060=0.003
mean1649.800-1625.800=24.000
σ642.173-592.023=50.150
min625.000-651.000=-26.000
max2826.000-2423.000=403.000
mean2.338-2.305=0.033
σ0.128-0.083=0.045
min2.216-2.145=0.071
max2.766-2.502=0.264

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.694-324.691=0.003
σ0.050-0.055=-0.005
min324.607-324.593=0.014
max324.737-324.732=0.004
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean0.428-0.429=-0.001
σ0.008-0.008=-0.000
min0.421-0.423=-0.002
max0.442-0.444=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.256-1985.254=0.002
σ0.006-0.015=-0.009
min1985.248-1985.228=0.020
max1985.265-1985.265=-0.001
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean2.583-2.597=-0.014
σ0.057-0.095=-0.038
min2.539-2.477=0.062
max2.651-2.706=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4808.841-4808.849=-0.008
σ7.669-7.708=-0.039
min4805.336-4805.314=0.022
max4822.560-4822.638=-0.078
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean8.775-8.817=-0.041
σ0.117-0.364=-0.248
min8.633-8.419=0.214
max8.950-9.205=-0.256
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.461=-0.002
σ0.022-0.007=0.015
min4996.435-4996.452=-0.017
max4996.483-4996.467=0.016
mean3049.400-2945.400=104.000
σ201.244-437.203=-235.958
min2826.000-2423.000=403.000
max3340.000-3524.000=-184.000
mean8.720-8.546=0.174
σ0.248-0.114=0.134
min8.435-8.410=0.025
max9.089-8.700=0.389

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.597=-0.568
σ0.127-0.217=-0.090
min0.916-1.234=-0.318
max1.226-1.754=-0.527

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.950-462.922=0.027
σ574.252-574.250=0.002
min175.817-175.793=0.024
max1324.327-1324.297=0.030
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean0.429-0.557=-0.127
σ0.292-0.564=-0.272
min0.283-0.271=0.012
max0.867-1.402=-0.536
policies=20
mean1758.489-1758.267=0.222
σ0.345-0.346=-0.001
min1758.257-1758.024=0.232
max1759.001-1758.779=0.222
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean2.781-2.709=0.072
σ0.011-0.013=-0.002
min2.765-2.694=0.071
max2.788-2.725=0.063
policies=200
mean17591.017-17590.172=0.844
σ0.847-0.555=0.291
min17589.914-17589.791=0.123
max17591.727-17590.992=0.735
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2423.000=403.000
σ0.000
min2826.000-2423.000=403.000
max2826.000-2423.000=403.000
mean27.835-27.447=0.388
σ0.385-0.091=0.294
min27.451-27.370=0.081
max28.268-27.566=0.702