Compare commits

Home / Compare 8dd3ce2e .. 428200cc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.567=-0.003
σ0.044-0.044=0.001
min70.539-70.539=-0.000
max70.687-70.686=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.160-0.158=0.002
σ0.004-0.004=-0.000
min0.156-0.152=0.005
max0.167-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.003-0.004=-0.001
min21.282-21.283=-0.000
max21.292-21.294=-0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.060=0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.373=0.001
σ0.361-0.362=-0.001
min1752.809-1752.804=0.005
max1753.959-1753.957=0.002
mean1659.250-1650.700=8.550
σ634.812-640.721=-5.909
min615.000-633.000=-18.000
max2777.000-2850.000=-73.000
mean2.784-2.786=-0.002
σ0.198-0.172=0.026
min2.389-2.262=0.128
max3.185-3.022=0.164

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.751-271.752=-0.001
σ0.004-0.008=-0.004
min271.746-271.740=0.006
max271.756-271.762=-0.006
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean0.378-0.384=-0.005
σ0.004-0.005=-0.000
min0.376-0.379=-0.003
max0.386-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.169-1932.186=-0.016
σ0.012-0.014=-0.002
min1932.150-1932.169=-0.019
max1932.180-1932.205=-0.025
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean3.001-2.935=0.066
σ0.097-0.245=-0.148
min2.879-2.511=0.368
max3.131-3.146=-0.014
iters=5
new-facts=6402
prior-facts=1
mean4752.770-4752.652=0.117
σ0.990-0.746=0.243
min4751.902-4751.814=0.087
max4754.481-4753.863=0.618
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean8.727-8.720=0.008
σ0.131-0.338=-0.206
min8.521-8.432=0.089
max8.842-9.135=-0.292
iters=5
new-facts=6402
prior-facts=6402
mean4943.306-4943.237=0.069
σ0.171-0.329=-0.159
min4943.003-4942.649=0.354
max4943.397-4943.394=0.003
mean2992.000-3070.400=-78.400
σ207.776-235.755=-27.978
min2777.000-2850.000=-73.000
max3292.000-3418.000=-126.000
mean8.507-8.671=-0.163
σ0.093-0.136=-0.043
min8.403-8.552=-0.149
max8.600-8.892=-0.292

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.070=-0.074
σ0.138-0.146=-0.008
min0.930-0.945=-0.014
max1.242-1.303=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.861=-0.002
σ575.929-575.927=0.001
min179.889-179.892=-0.003
max1331.752-1331.752=-0.000
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean0.481-0.444=0.037
σ0.392-0.307=0.084
min0.280-0.289=-0.009
max1.068-0.905=0.164
policies=20
mean1799.168-1799.182=-0.014
σ0.361-0.378=-0.017
min1798.913-1798.914=-0.000
max1799.704-1799.740=-0.037
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean2.790-2.882=-0.092
σ0.011-0.005=0.005
min2.779-2.876=-0.097
max2.801-2.888=-0.087
policies=200
mean17998.512-17998.555=-0.042
σ0.490-0.515=-0.025
min17998.224-17998.267=-0.043
max17999.245-17999.326=-0.081
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2850.000=-73.000
σ0.000
min2777.000-2850.000=-73.000
max2777.000-2850.000=-73.000
mean28.094-28.563=-0.469
σ0.148-0.386=-0.238
min27.998-28.109=-0.111
max28.315-28.978=-0.663