Compare commits

Home / Compare f38a1908 .. bd345359

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.001
σ0.054-0.054=-0.001
min35.230-35.237=-0.007
max35.414-35.415=-0.002
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.085-0.081=0.003
σ0.004-0.005=-0.001
min0.081-0.076=0.005
max0.093-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.003-0.002=0.001
min23.764-23.765=-0.001
max23.777-23.774=0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.069-0.069=0.000
σ0.004-0.003=0.000
min0.066-0.067=-0.001
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.472-1756.486=-0.015
σ0.365-0.365=-0.000
min1755.895-1755.912=-0.016
max1757.061-1757.077=-0.016
mean1659.000-1651.000=8.000
σ647.517-640.585=6.931
min627.000-628.000=-1.000
max2812.000-2840.000=-28.000
mean2.343-2.329=0.014
σ0.108-0.059=0.049
min2.250-2.256=-0.006
max2.700-2.433=0.268

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.694-324.706=-0.011
σ0.043-0.048=-0.005
min324.619-324.621=-0.002
max324.724-324.740=-0.015
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean0.424-0.426=-0.002
σ0.004-0.006=-0.001
min0.421-0.422=-0.002
max0.431-0.436=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.244-1985.270=-0.026
σ0.015-0.007=0.008
min1985.224-1985.259=-0.035
max1985.260-1985.277=-0.017
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean2.685-2.596=0.089
σ0.126-0.058=0.068
min2.544-2.543=0.001
max2.819-2.669=0.149
iters=5
new-facts=6402
prior-facts=1
mean4808.789-4808.911=-0.121
σ7.706-7.708=-0.002
min4804.781-4805.357=-0.576
max4822.561-4822.698=-0.137
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean8.806-8.833=-0.027
σ0.629-0.627=0.003
min7.789-7.771=0.017
max9.447-9.353=0.095
iters=5
new-facts=6402
prior-facts=6402
mean4996.446-4996.463=-0.017
σ0.017-0.021=-0.004
min4996.429-4996.440=-0.011
max4996.465-4996.482=-0.017
mean3002.400-3054.600=-52.200
σ269.372-201.676=67.696
min2812.000-2840.000=-28.000
max3423.000-3350.000=73.000
mean8.542-8.706=-0.164
σ0.104-0.237=-0.134
min8.479-8.475=0.003
max8.723-9.071=-0.347

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.007=-0.007
σ0.124-0.136=-0.011
min0.917-0.916=0.001
max1.200-1.228=-0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.954-462.969=-0.015
σ574.253-574.253=0.001
min175.814-175.836=-0.022
max1324.333-1324.348=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean0.431-0.472=-0.041
σ0.301-0.382=-0.081
min0.279-0.279=-0.000
max0.882-1.045=-0.163
policies=20
mean1758.492-1758.707=-0.215
σ0.360-0.343=0.018
min1758.246-1758.480=-0.234
max1759.026-1759.216=-0.189
mean820.000
σ0.000
min820.000
max820.000
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean2.771-2.790=-0.019
σ0.012-0.015=-0.003
min2.760-2.779=-0.020
max2.783-2.812=-0.030
policies=200
mean17590.266-17593.384=-3.117
σ0.543-0.705=-0.162
min17589.788-17592.409=-2.621
max17590.867-17593.926=-3.058
mean8200.000
σ0.000
min8200.000
max8200.000
mean2812.000-2840.000=-28.000
σ0.000
min2812.000-2840.000=-28.000
max2812.000-2840.000=-28.000
mean27.465-27.903=-0.438
σ0.140-0.365=-0.225
min27.304-27.543=-0.239
max27.645-28.348=-0.703