Compare commits

Home / Compare 8ed2a49d .. b941f1f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.000
σ0.054-0.055=-0.000
min35.212-35.217=-0.005
max35.397-35.399=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.085-0.085=-0.000
σ0.004-0.004=-0.000
min0.079-0.082=-0.003
max0.093-0.093=0.000
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.003-0.004=-0.000
min23.764-23.765=-0.001
max23.776-23.778=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.068=-0.004
σ0.003-0.002=0.001
min0.062-0.065=-0.004
max0.071-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.364=-0.001
σ0.365-0.365=-0.000
min1755.788-1755.792=-0.004
max1756.949-1756.935=0.014
mean1658.300-1652.850=5.450
σ638.280-627.209=11.071
min630.000-667.000=-37.000
max2754.000
mean2.339-2.321=0.018
σ0.112-0.103=0.010
min2.213-2.163=0.050
max2.673-2.581=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.591-324.563=0.028
σ0.036-0.034=0.003
min324.527-324.504=0.023
max324.616-324.585=0.030
mean2754.000
σ0.000
min2754.000
max2754.000
mean0.422-0.424=-0.002
σ0.000-0.005=-0.005
min0.422-0.421=0.001
max0.423-0.433=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.138-1985.142=-0.004
σ0.013-0.016=-0.003
min1985.125-1985.117=0.008
max1985.154-1985.155=-0.001
mean2754.000
σ0.000
min2754.000
max2754.000
mean2.698-2.606=0.092
σ0.135-0.095=0.041
min2.506-2.515=-0.009
max2.844-2.721=0.123
iters=5
new-facts=6402
prior-facts=1
mean4808.637-4808.791=-0.154
σ7.738-7.760=-0.022
min4804.706-4805.263=-0.557
max4822.471-4822.672=-0.201
mean2754.000
σ0.000
min2754.000
max2754.000
mean8.686-9.236=-0.550
σ0.328-0.459=-0.130
min8.208-8.912=-0.703
max9.014-9.969=-0.955
iters=5
new-facts=6402
prior-facts=6402
mean4996.351-4996.346=0.006
σ0.012-0.014=-0.001
min4996.331-4996.329=0.002
max4996.362-4996.365=-0.003
mean3076.600-3017.600=59.000
σ282.281-234.060=48.220
min2754.000
max3357.000-3309.000=48.000
mean8.980-8.639=0.341
σ0.559-0.174=0.385
min8.519-8.438=0.081
max9.679-8.881=0.798

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.966=-0.022
σ0.060-0.066=-0.005
min0.898-0.911=-0.014
max1.048-1.042=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.964-462.972=-0.009
σ574.254-574.255=-0.001
min175.833-175.839=-0.006
max1324.345-1324.355=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2754.000
σ0.000
min2754.000
max2754.000
mean0.433-0.432=0.001
σ0.304-0.300=0.004
min0.278-0.281=-0.003
max0.888-0.881=0.007
policies=20
mean1758.680-1758.712=-0.032
σ0.307-0.347=-0.040
min1758.463-1758.475=-0.013
max1759.131-1759.227=-0.096
mean820.000
σ0.000
min820.000
max820.000
mean2754.000
σ0.000
min2754.000
max2754.000
mean2.845-2.811=0.034
σ0.077-0.066=0.012
min2.778-2.772=0.006
max2.919-2.909=0.010
policies=200
mean17592.404-17592.431=-0.028
σ0.533-0.476=0.057
min17591.957-17592.171=-0.213
max17593.176-17593.144=0.032
mean8200.000
σ0.000
min8200.000
max8200.000
mean2754.000
σ0.000
min2754.000
max2754.000
mean27.406-27.310=0.096
σ0.098-0.114=-0.016
min27.276-27.183=0.093
max27.482-27.431=0.051