Compare commits

Home / Compare f89de287 .. 84ecb6af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.001
σ0.055-0.052=0.003
min35.232-35.232=0.000
max35.419-35.409=0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.083-0.081=0.002
σ0.005-0.005=0.000
min0.077-0.076=0.000
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.003=-0.000
min23.765-23.766=-0.001
max23.774-23.774=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.066-0.063=0.003
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.365-0.364=0.000
min1755.910-1755.911=-0.001
max1757.069-1757.073=-0.004
mean1649.800-1652.050=-2.250
σ644.994-644.406=0.588
min644.000-626.000=18.000
max2843.000-2841.000=2.000
mean2.369-2.351=0.018
σ0.102-0.073=0.029
min2.263-2.256=0.006
max2.609-2.519=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.711=-0.010
σ0.054-0.040=0.014
min324.605-324.640=-0.035
max324.731-324.736=-0.005
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean0.425-0.425=-0.000
σ0.001-0.001=-0.000
min0.423-0.423=-0.000
max0.427-0.427=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.267-1985.272=-0.005
σ0.014-0.008=0.006
min1985.246-1985.261=-0.016
max1985.283-1985.283=0.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean2.697-2.622=0.075
σ0.203-0.059=0.144
min2.533-2.570=-0.037
max3.030-2.690=0.340
iters=5
new-facts=6402
prior-facts=1
mean4808.872-4808.891=-0.019
σ7.661-7.664=-0.003
min4805.331-4805.338=-0.007
max4822.575-4822.599=-0.024
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean8.889-9.057=-0.168
σ0.229-0.364=-0.136
min8.609-8.567=0.041
max9.201-9.382=-0.181
iters=5
new-facts=6402
prior-facts=6402
mean4996.385-4996.404=-0.019
σ0.171-0.141=0.029
min4996.082-4996.153=-0.071
max4996.479-4996.486=-0.007
mean3069.000-3072.600=-3.600
σ301.910-231.267=70.643
min2843.000-2841.000=2.000
max3538.000-3417.000=121.000
mean8.516-8.695=-0.178
σ0.119-0.218=-0.099
min8.416-8.445=-0.029
max8.718-8.941=-0.222

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-0.954=0.046
σ0.063-0.050=0.013
min0.920-0.919=0.001
max1.047-1.039=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.959-462.949=0.010
σ574.253-574.246=0.006
min175.818-175.822=-0.004
max1324.339-1324.319=0.020
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean0.430-0.433=-0.003
σ0.294-0.297=-0.003
min0.280-0.281=-0.001
max0.871-0.878=-0.008
policies=20
mean1758.565-1758.569=-0.003
σ0.355-0.351=0.005
min1758.322-1758.333=-0.011
max1759.092-1759.088=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean2.778-2.790=-0.012
σ0.010-0.018=-0.008
min2.769-2.768=0.002
max2.789-2.808=-0.019
policies=200
mean17592.477-17592.471=0.006
σ0.327-0.377=-0.050
min17592.216-17592.116=0.100
max17592.955-17593.002=-0.046
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean27.833-27.985=-0.152
σ0.373-0.380=-0.008
min27.441-27.527=-0.086
max28.273-28.438=-0.164