Compare commits

Home / Compare 2e45e63a .. 4707f473

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.246-35.245=0.001
σ0.054-0.055=-0.001
min35.221-35.219=0.001
max35.397-35.399=-0.002
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.086-0.086=0.000
σ0.005-0.004=0.001
min0.082-0.082=0.001
max0.096-0.094=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.004-0.003=0.001
min23.760-23.765=-0.005
max23.775-23.774=0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.066-0.068=-0.002
σ0.004-0.003=0.002
min0.061-0.066=-0.005
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.415-1756.363=-37.947
σ169.612-0.366=169.246
min997.815-1755.787=-757.972
max1756.946-1756.953=-0.007
mean1633.350-1650.450=-17.100
σ612.477-641.089=-28.612
min626.000-652.000=-26.000
max2461.000-2832.000=-371.000
mean2.288-2.353=-0.065
σ0.182-0.098=0.083
min1.590-2.269=-0.679
max2.568-2.652=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.583-324.588=-0.005
σ0.054-0.046=0.008
min324.487-324.507=-0.021
max324.610-324.618=-0.008
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean0.428-0.424=0.004
σ0.007-0.002=0.005
min0.423-0.422=0.001
max0.440-0.427=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.146-1985.134=0.012
σ0.008-0.014=-0.006
min1985.135-1985.117=0.018
max1985.153-1985.149=0.003
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean2.592-2.597=-0.005
σ0.102-0.072=0.030
min2.456-2.530=-0.074
max2.721-2.677=0.043
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.757=-0.009
σ7.725-7.666=0.059
min4805.264-4805.215=0.049
max4822.566-4822.469=0.097
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean8.965-9.001=-0.036
σ0.339-0.304=0.035
min8.456-8.701=-0.246
max9.374-9.507=-0.133
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.345=0.002
σ0.021-0.024=-0.003
min4996.326-4996.323=0.003
max4996.371-4996.378=-0.008
mean3003.200-3071.000=-67.800
σ271.020-227.190=43.829
min2609.000-2832.000=-223.000
max3336.000-3400.000=-64.000
mean8.664-8.830=-0.166
σ0.141-0.321=-0.180
min8.472-8.541=-0.069
max8.794-9.311=-0.517

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.601-0.981=0.620
σ0.163-0.068=0.095
min1.378-0.922=0.455
max1.799-1.058=0.741

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.972=-0.026
σ574.249-574.255=-0.006
min175.818-175.835=-0.017
max1324.320-1324.355=-0.035
mean86.250
σ8.500
min82.000
max99.000
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean0.567-0.430=0.137
σ0.585-0.300=0.285
min0.272-0.277=-0.005
max1.444-0.880=0.564
policies=20
mean1758.493-1758.716=-0.223
σ0.338-0.354=-0.016
min1758.254-1758.482=-0.228
max1758.992-1759.241=-0.249
mean820.000
σ0.000
min820.000
max820.000
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean2.695-2.781=-0.087
σ0.010-0.006=0.004
min2.686-2.776=-0.090
max2.705-2.788=-0.083
policies=200
mean17592.362-17593.318=-0.956
σ0.362-0.649=-0.287
min17592.123-17592.480=-0.357
max17592.900-17593.870=-0.970
mean8200.000
σ0.000
min8200.000
max8200.000
mean2461.000-2832.000=-371.000
σ0.000
min2461.000-2832.000=-371.000
max2461.000-2832.000=-371.000
mean27.377-27.791=-0.414
σ0.124-0.366=-0.242
min27.205-27.441=-0.236
max27.491-28.162=-0.670