Compare commits

Home / Compare ef73513b .. b7d909fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.243=0.019
σ0.054-0.054=0.001
min35.237-35.217=0.020
max35.415-35.395=0.021
mean417.000-411.800=5.200
σ0.000-0.422=-0.422
min417.000-411.000=6.000
max417.000-412.000=5.000
mean0.081-0.082=-0.001
σ0.005-0.004=0.001
min0.076-0.077=-0.001
max0.089-0.087=0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.001
min23.765-23.764=0.001
max23.774-23.772=0.002
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.069-0.069=-0.000
σ0.003-0.004=-0.001
min0.067-0.066=0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.363=0.123
σ0.365-0.364=0.001
min1755.912-1755.792=0.120
max1757.077-1756.950=0.128
mean1651.000-1643.300=7.700
σ640.585-646.210=-5.624
min628.000-620.000=8.000
max2840.000-2726.000=114.000
mean2.329-2.386=-0.057
σ0.059-0.081=-0.022
min2.256-2.249=0.007
max2.433-2.539=-0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.588=0.118
σ0.048-0.032=0.016
min324.621-324.532=0.090
max324.740-324.605=0.134
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean0.426-0.426=-0.000
σ0.006-0.009=-0.003
min0.422-0.420=0.003
max0.436-0.441=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.151=0.119
σ0.007-0.008=-0.000
min1985.259-1985.140=0.120
max1985.277-1985.161=0.117
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean2.596-2.556=0.039
σ0.058-0.036=0.021
min2.543-2.529=0.014
max2.669-2.617=0.053
iters=5
new-facts=6402
prior-facts=1
mean4808.911-4808.649=0.262
σ7.708-7.682=0.026
min4805.357-4804.820=0.537
max4822.698-4822.384=0.314
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean8.833-8.463=0.369
σ0.627-0.435=0.192
min7.771-8.039=-0.267
max9.353-9.024=0.329
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.346=0.116
σ0.021-0.021=-0.000
min4996.440-4996.324=0.116
max4996.482-4996.375=0.107
mean3054.600-3019.400=35.200
σ201.676-218.833=-17.157
min2840.000-2726.000=114.000
max3350.000-3306.000=44.000
mean8.706-8.685=0.022
σ0.237-0.146=0.092
min8.475-8.543=-0.068
max9.071-8.886=0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.978=0.029
σ0.136-0.136=-0.001
min0.916-0.916=0.001
max1.228-1.222=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.971=-0.002
σ574.253-574.280=-0.027
min175.836-175.822=0.014
max1324.348-1324.391=-0.043
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean0.472-0.572=-0.100
σ0.382-0.596=-0.214
min0.279-0.273=0.006
max1.045-1.467=-0.422
policies=20
mean1758.707-1758.532=0.175
σ0.343-0.336=0.006
min1758.480-1758.299=0.181
max1759.216-1759.030=0.186
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean2.790-2.708=0.081
σ0.015-0.006=0.010
min2.779-2.701=0.078
max2.812-2.715=0.097
policies=200
mean17593.384-17592.377=1.007
σ0.705-0.415=0.290
min17592.409-17592.057=0.352
max17593.926-17592.986=0.939
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2726.000=114.000
σ0.000
min2840.000-2726.000=114.000
max2840.000-2726.000=114.000
mean27.903-27.425=0.478
σ0.365-0.094=0.271
min27.543-27.321=0.222
max28.348-27.510=0.838