Compare commits

Home / Compare 07adeea9 .. f877d942

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.264=-0.002
σ0.054-0.054=0.000
min35.237-35.239=-0.002
max35.415-35.417=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.081-0.085=-0.004
σ0.005-0.003=0.001
min0.076-0.083=-0.007
max0.089-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.002-0.003=-0.001
min23.765-23.765=-0.000
max23.774-23.776=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.069-0.067=0.002
σ0.003-0.005=-0.002
min0.067-0.063=0.004
max0.075-0.076=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.483=0.003
σ0.365-0.366=-0.000
min1755.912-1755.911=0.001
max1757.077-1757.071=0.006
mean1651.000-1659.450=-8.450
σ640.585-640.723=-0.138
min628.000-624.000=4.000
max2840.000-2772.000=68.000
mean2.329-2.341=-0.012
σ0.059-0.116=-0.057
min2.256-2.246=0.009
max2.433-2.715=-0.283

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.722=-0.016
σ0.048-0.019=0.029
min324.621-324.692=-0.071
max324.740-324.739=0.001
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean0.426-0.424=0.002
σ0.006-0.002=0.004
min0.422-0.421=0.001
max0.436-0.426=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.258=0.012
σ0.007-0.016=-0.009
min1985.259-1985.232=0.028
max1985.277-1985.272=0.005
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean2.596-2.632=-0.037
σ0.058-0.103=-0.045
min2.543-2.549=-0.006
max2.669-2.767=-0.098
iters=5
new-facts=6402
prior-facts=1
mean4808.911-4808.774=0.137
σ7.708-7.747=-0.039
min4805.357-4804.816=0.541
max4822.698-4822.622=0.076
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean8.833-8.725=0.108
σ0.627-0.401=0.225
min7.771-8.029=-0.257
max9.353-9.050=0.302
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.461=0.002
σ0.021-0.017=0.004
min4996.440-4996.443=-0.003
max4996.482-4996.480=0.002
mean3054.600-3034.600=20.000
σ201.676-232.878=-31.202
min2840.000-2772.000=68.000
max3350.000-3372.000=-22.000
mean8.706-8.779=-0.073
σ0.237-0.154=0.083
min8.475-8.568=-0.093
max9.071-8.939=0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.907=0.100
σ0.136-0.010=0.125
min0.916-0.890=0.026
max1.228-0.916=0.312

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.972=-0.003
σ574.253-574.258=-0.005
min175.836-175.838=-0.002
max1324.348-1324.359=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean0.472-0.429=0.043
σ0.382-0.290=0.092
min0.279-0.283=-0.004
max1.045-0.865=0.180
policies=20
mean1758.707-1758.720=-0.014
σ0.343-0.353=-0.010
min1758.480-1758.500=-0.020
max1759.216-1759.247=-0.031
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean2.790-2.779=0.011
σ0.015-0.011=0.004
min2.779-2.762=0.017
max2.812-2.787=0.025
policies=200
mean17593.384-17592.365=1.019
σ0.705-0.456=0.250
min17592.409-17591.961=0.449
max17593.926-17593.019=0.907
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2772.000=68.000
σ0.000
min2840.000-2772.000=68.000
max2840.000-2772.000=68.000
mean27.903-27.537=0.366
σ0.365-0.294=0.071
min27.543-27.252=0.291
max28.348-27.947=0.401