Compare commits

Home / Compare 6e754f3b .. 49bf5a9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.001
σ0.054-0.052=0.002
min35.218-35.216=0.002
max35.397-35.391=0.006
mean412.000
σ0.000
min412.000
max412.000
mean0.082-0.084=-0.001
σ0.006-0.004=0.002
min0.077-0.077=0.000
max0.095-0.092=0.003
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.003=-0.001
min23.765-23.766=-0.001
max23.773-23.777=-0.004
mean412.000
σ0.000
min412.000
max412.000
mean0.067-0.069=-0.002
σ0.005-0.004=0.001
min0.062-0.066=-0.005
max0.075-0.077=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.362=0.003
σ0.365-0.365=-0.000
min1755.788-1755.790=-0.002
max1756.949-1756.956=-0.007
mean1646.450-1641.950=4.500
σ637.155-632.737=4.417
min624.000-625.000=-1.000
max2828.000-2837.000=-9.000
mean2.323-2.342=-0.019
σ0.081-0.083=-0.001
min2.189-2.204=-0.014
max2.510-2.554=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.584-324.580=0.004
σ0.049-0.052=-0.003
min324.499-324.489=0.011
max324.616-324.610=0.007
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean0.428-0.423=0.004
σ0.012-0.001=0.011
min0.421-0.422=-0.001
max0.449-0.425=0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.143-1985.144=-0.001
σ0.015-0.006=0.009
min1985.116-1985.137=-0.021
max1985.156-1985.151=0.004
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean2.554-2.555=-0.002
σ0.028-0.104=-0.076
min2.514-2.397=0.118
max2.579-2.667=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4808.726-4808.749=-0.023
σ7.678-7.681=-0.004
min4805.253-4805.301=-0.049
max4822.460-4822.489=-0.029
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean8.684-8.982=-0.299
σ0.521-0.098=0.423
min7.775-8.885=-1.110
max9.091-9.130=-0.039
iters=5
new-facts=6402
prior-facts=6402
mean4996.348-4996.348=0.000
σ0.018-0.020=-0.002
min4996.325-4996.322=0.003
max4996.364-4996.368=-0.005
mean3035.400-3035.600=-0.200
σ187.663-207.254=-19.591
min2828.000-2837.000=-9.000
max3302.000-3332.000=-30.000
mean8.790-8.568=0.222
σ0.479-0.183=0.296
min8.344-8.346=-0.002
max9.544-8.796=0.748

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.981=-0.009
σ0.067-0.069=-0.002
min0.913-0.921=-0.008
max1.049-1.062=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.977=-0.002
σ574.254-574.252=0.002
min175.836-175.842=-0.005
max1324.356-1324.355=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean0.467-0.431=0.036
σ0.371-0.296=0.075
min0.279-0.281=-0.002
max1.023-0.875=0.148
policies=20
mean1758.702-1758.708=-0.006
σ0.372-0.340=0.032
min1758.449-1758.484=-0.035
max1759.253-1759.212=0.041
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean2.774-2.788=-0.014
σ0.006-0.005=0.001
min2.765-2.782=-0.017
max2.778-2.793=-0.015
policies=200
mean17593.342-17593.329=0.014
σ0.644-0.681=-0.037
min17592.487-17592.405=0.082
max17593.848-17593.846=0.001
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2837.000=-9.000
σ0.000
min2828.000-2837.000=-9.000
max2828.000-2837.000=-9.000
mean27.738-27.908=-0.170
σ0.400-0.339=0.061
min27.394-27.579=-0.185
max28.233-28.308=-0.075