Compare commits

Home / Compare b9c1206f .. ce35b0cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.262=0.002
σ0.055-0.054=0.001
min35.239-35.237=0.002
max35.419-35.415=0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.083-0.081=0.001
σ0.006-0.005=0.001
min0.076-0.076=0.000
max0.093-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.002=0.000
min23.766-23.765=0.001
max23.773-23.774=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.069=-0.003
σ0.005-0.003=0.001
min0.062-0.067=-0.005
max0.075-0.075=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.470-1756.486=-0.016
σ0.365-0.365=0.000
min1755.894-1755.912=-0.018
max1757.061-1757.077=-0.016
mean1650.700-1651.000=-0.300
σ640.346-640.585=-0.239
min627.000-628.000=-1.000
max2833.000-2840.000=-7.000
mean2.341-2.329=0.012
σ0.071-0.059=0.012
min2.251-2.256=-0.005
max2.463-2.433=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.703-324.706=-0.003
σ0.030-0.048=-0.018
min324.651-324.621=0.029
max324.724-324.740=-0.015
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean0.423-0.426=-0.003
σ0.002-0.006=-0.004
min0.421-0.422=-0.001
max0.426-0.436=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.248-1985.270=-0.022
σ0.014-0.007=0.007
min1985.230-1985.259=-0.029
max1985.264-1985.277=-0.013
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean2.614-2.596=0.019
σ0.119-0.058=0.061
min2.513-2.543=-0.030
max2.785-2.669=0.116
iters=5
new-facts=6402
prior-facts=1
mean4808.877-4808.911=-0.034
σ7.649-7.708=-0.059
min4805.340-4805.357=-0.017
max4822.559-4822.698=-0.140
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean8.640-8.833=-0.193
σ0.546-0.627=-0.081
min7.710-7.771=-0.062
max9.081-9.353=-0.271
iters=5
new-facts=6402
prior-facts=6402
mean4996.438-4996.463=-0.025
σ0.016-0.021=-0.005
min4996.417-4996.440=-0.023
max4996.460-4996.482=-0.022
mean3060.800-3054.600=6.200
σ298.361-201.676=96.685
min2833.000-2840.000=-7.000
max3519.000-3350.000=169.000
mean8.472-8.706=-0.235
σ0.125-0.237=-0.113
min8.350-8.475=-0.125
max8.675-9.071=-0.395

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.967-1.007=-0.040
σ0.144-0.136=0.008
min0.888-0.916=-0.028
max1.224-1.228=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.969=-0.018
σ574.254-574.253=0.001
min175.818-175.836=-0.018
max1324.332-1324.348=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean0.433-0.472=-0.039
σ0.303-0.382=-0.079
min0.282-0.279=0.003
max0.887-1.045=-0.158
policies=20
mean1758.486-1758.707=-0.221
σ0.344-0.343=0.001
min1758.254-1758.480=-0.226
max1758.996-1759.216=-0.220
mean820.000
σ0.000
min820.000
max820.000
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean2.787-2.790=-0.002
σ0.011-0.015=-0.004
min2.777-2.779=-0.002
max2.802-2.812=-0.011
policies=200
mean17590.970-17593.384=-2.414
σ0.755-0.705=0.050
min17589.939-17592.409=-2.471
max17591.677-17593.926=-2.249
mean8200.000
σ0.000
min8200.000
max8200.000
mean2833.000-2840.000=-7.000
σ0.000
min2833.000-2840.000=-7.000
max2833.000-2840.000=-7.000
mean27.873-27.903=-0.030
σ0.420-0.365=0.055
min27.494-27.543=-0.049
max28.325-28.348=-0.024