Compare commits

Home / Compare 79a63f2b .. 287815a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.001
σ0.054-0.051=0.003
min35.211-35.218=-0.007
max35.396-35.390=0.007
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.083-0.083=0.001
σ0.006-0.005=0.002
min0.077-0.077=0.000
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.771=-0.001
σ0.003-0.003=0.001
min23.765-23.766=-0.001
max23.776-23.777=-0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.068-0.069=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=-0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=-0.000
σ0.364-0.366=-0.002
min1755.788-1755.786=0.002
max1756.949-1756.950=-0.001
mean1643.000-1640.950=2.050
σ633.981-624.124=9.856
min627.000-641.000=-14.000
max2749.000-2834.000=-85.000
mean2.358-2.340=0.019
σ0.133-0.076=0.057
min2.065-2.266=-0.202
max2.648-2.566=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.597-324.586=0.011
σ0.007-0.048=-0.041
min324.585-324.501=0.085
max324.603-324.614=-0.010
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean0.423-0.427=-0.005
σ0.001-0.008=-0.007
min0.422-0.423=-0.002
max0.425-0.442=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.143-1985.144=-0.002
σ0.005-0.013=-0.008
min1985.135-1985.128=0.007
max1985.148-1985.161=-0.013
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean2.624-2.642=-0.017
σ0.102-0.122=-0.019
min2.541-2.558=-0.018
max2.774-2.848=-0.074
iters=5
new-facts=6402
prior-facts=1
mean4808.642-4808.798=-0.156
σ7.720-7.643=0.077
min4804.724-4805.256=-0.532
max4822.443-4822.468=-0.025
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean8.630-8.497=0.133
σ0.346-0.592=-0.246
min8.019-7.703=0.317
max8.851-9.080=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean4996.204-4996.279=-0.075
σ0.183-0.160=0.023
min4996.002-4995.996=0.006
max4996.348-4996.378=-0.029
mean3025.600-3087.000=-61.400
σ260.639-248.252=12.387
min2749.000-2834.000=-85.000
max3383.000-3330.000=53.000
mean8.633-8.884=-0.251
σ0.162-0.420=-0.258
min8.458-8.522=-0.064
max8.873-9.580=-0.707

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.942=0.002
σ0.054-0.062=-0.008
min0.911-0.895=0.015
max1.038-1.050=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.965=0.001
σ574.250-574.249=0.001
min175.838-175.836=0.003
max1324.341-1324.339=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean0.434-0.436=-0.001
σ0.292-0.298=-0.005
min0.287-0.286=0.001
max0.873-0.882=-0.009
policies=20
mean1758.708-1758.714=-0.007
σ0.322-0.339=-0.017
min1758.499-1758.496=0.003
max1759.186-1759.218=-0.033
mean820.000
σ0.000
min820.000
max820.000
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean2.806-2.784=0.022
σ0.055-0.008=0.047
min2.768-2.773=-0.005
max2.888-2.792=0.096
policies=200
mean17592.350-17593.360=-1.010
σ0.392-0.593=-0.201
min17592.101-17592.572=-0.472
max17592.930-17593.889=-0.959
mean8200.000
σ0.000
min8200.000
max8200.000
mean2749.000-2834.000=-85.000
σ0.000
min2749.000-2834.000=-85.000
max2749.000-2834.000=-85.000
mean27.422-27.789=-0.367
σ0.171-0.365=-0.195
min27.247-27.405=-0.158
max27.591-28.258=-0.667