Compare commits

Home / Compare b3100e2d .. 937778a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.001
σ0.054-0.055=-0.001
min35.217-35.219=-0.002
max35.395-35.399=-0.005
mean411.800-414.000=-2.200
σ0.422-0.000=0.422
min411.000-414.000=-3.000
max412.000-414.000=-2.000
mean0.082-0.082=0.000
σ0.004-0.006=-0.002
min0.077-0.077=0.000
max0.087-0.096=-0.008
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=-0.001
min23.764-23.764=-0.000
max23.772-23.775=-0.003
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.069-0.067=0.002
σ0.004-0.002=0.001
min0.066-0.065=0.001
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.362=0.002
σ0.364-0.366=-0.002
min1755.792-1755.788=0.004
max1756.950-1756.951=-0.002
mean1643.300-1642.850=0.450
σ646.210-632.987=13.223
min620.000-625.000=-5.000
max2726.000-2838.000=-112.000
mean2.386-2.373=0.013
σ0.081-0.080=0.001
min2.249-2.247=0.002
max2.539-2.605=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588-324.571=0.018
σ0.032-0.037=-0.005
min324.532-324.509=0.023
max324.605-324.598=0.007
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean0.426-0.431=-0.006
σ0.009-0.006=0.003
min0.420-0.422=-0.003
max0.441-0.439=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.151-1985.139=0.012
σ0.008-0.014=-0.007
min1985.140-1985.114=0.026
max1985.161-1985.150=0.011
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean2.556-2.638=-0.082
σ0.036-0.089=-0.053
min2.529-2.572=-0.043
max2.617-2.741=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4808.649-4808.787=-0.139
σ7.682-7.625=0.057
min4804.820-4805.233=-0.413
max4822.384-4822.425=-0.042
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean8.463-8.720=-0.256
σ0.435-0.591=-0.156
min8.039-7.748=0.291
max9.024-9.178=-0.154
iters=5
new-facts=6402
prior-facts=6402
mean4996.346-4996.343=0.004
σ0.021-0.016=0.006
min4996.324-4996.324=0.001
max4996.375-4996.361=0.013
mean3019.400-3061.400=-42.000
σ218.833-297.721=-78.888
min2726.000-2838.000=-112.000
max3306.000-3524.000=-218.000
mean8.685-8.518=0.167
σ0.146-0.145=0.001
min8.543-8.416=0.127
max8.886-8.772=0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.944=0.033
σ0.136-0.056=0.080
min0.916-0.910=0.005
max1.222-1.043=0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.966=0.005
σ574.280-574.248=0.032
min175.822-175.838=-0.016
max1324.391-1324.338=0.053
mean86.250
σ8.500
min82.000
max99.000
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean0.572-0.432=0.140
σ0.596-0.298=0.298
min0.273-0.279=-0.006
max1.467-0.880=0.587
policies=20
mean1758.532-1758.701=-0.170
σ0.336-0.339=-0.002
min1758.299-1758.483=-0.183
max1759.030-1759.204=-0.175
mean820.000
σ0.000
min820.000
max820.000
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean2.708-2.782=-0.073
σ0.006-0.008=-0.003
min2.701-2.770=-0.069
max2.715-2.790=-0.075
policies=200
mean17592.377-17593.207=-0.830
σ0.415-0.821=-0.406
min17592.057-17592.139=-0.082
max17592.986-17593.909=-0.923
mean8200.000
σ0.000
min8200.000
max8200.000
mean2726.000-2838.000=-112.000
σ0.000
min2726.000-2838.000=-112.000
max2726.000-2838.000=-112.000
mean27.425-27.919=-0.494
σ0.094-0.371=-0.277
min27.321-27.595=-0.274
max27.510-28.289=-0.779