Compare commits

Home / Compare d06b0e76 .. 3ed7791b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.563=-0.000
σ0.044-0.045=-0.001
min70.538-70.539=-0.001
max70.687-70.689=-0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.157-0.157=0.000
σ0.005-0.004=0.001
min0.151-0.150=0.001
max0.166-0.161=0.006
cache=y
dps=1
iters=10
policies=100
mean21.292-21.291=0.000
σ0.012-0.011=0.001
min21.284-21.286=-0.001
max21.324-21.322=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.062=0.001
σ0.003-0.004=-0.000
min0.058-0.059=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.375=-0.001
σ0.359-0.361=-0.001
min1752.806-1752.802=0.005
max1753.950-1753.959=-0.009
mean1658.900-1653.200=5.700
σ635.913-640.183=-4.270
min616.000-636.000=-20.000
max2805.000-2849.000=-44.000
mean2.738-2.811=-0.073
σ0.189-0.182=0.007
min2.303-2.262=0.042
max3.092-3.099=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.757=0.001
σ0.007-0.007=0.001
min271.750-271.750=-0.001
max271.766-271.768=-0.002
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean0.381-0.381=0.001
σ0.007-0.004=0.003
min0.371-0.378=-0.007
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.177=0.000
σ0.006-0.005=0.000
min1932.169-1932.170=-0.001
max1932.185-1932.184=0.002
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean3.050-3.053=-0.004
σ0.064-0.075=-0.011
min2.991-2.986=0.005
max3.123-3.171=-0.048
iters=5
new-facts=6402
prior-facts=1
mean4752.947-4752.950=-0.004
σ0.836-0.853=-0.017
min4752.349-4752.459=-0.110
max4754.419-4754.470=-0.051
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean8.160-8.267=-0.106
σ0.668-0.414=0.254
min7.663-7.835=-0.172
max9.226-8.780=0.445
iters=5
new-facts=6402
prior-facts=6402
mean4943.368-4943.304=0.064
σ0.025-0.156=-0.131
min4943.344-4943.028=0.315
max4943.398-4943.400=-0.001
mean3057.400-3070.400=-13.000
σ317.311-290.069=27.242
min2805.000-2849.000=-44.000
max3537.000-3519.000=18.000
mean8.396-8.440=-0.044
σ0.102-0.104=-0.001
min8.305-8.347=-0.041
max8.556-8.602=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.104=-0.018
σ0.111-0.171=-0.060
min0.938-0.941=-0.003
max1.243-1.340=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.862=-0.002
σ575.931-575.936=-0.004
min179.889-179.892=-0.003
max1331.756-1331.765=-0.009
mean86.250
σ8.500
min82.000
max99.000
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean0.474-0.446=0.028
σ0.393-0.303=0.090
min0.273-0.293=-0.019
max1.064-0.900=0.164
policies=20
mean1799.168-1799.192=-0.024
σ0.369-0.375=-0.006
min1798.921-1798.930=-0.009
max1799.717-1799.744=-0.027
mean820.000
σ0.000
min820.000
max820.000
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean2.783-2.866=-0.083
σ0.017-0.042=-0.025
min2.762-2.805=-0.044
max2.803-2.899=-0.096
policies=200
mean17998.409-17998.458=-0.049
σ0.585-0.386=0.199
min17998.087-17998.059=0.027
max17999.285-17998.987=0.298
mean8200.000
σ0.000
min8200.000
max8200.000
mean2805.000-2849.000=-44.000
σ0.000
min2805.000-2849.000=-44.000
max2805.000-2849.000=-44.000
mean28.095-28.509=-0.414
σ0.173-0.506=-0.333
min27.930-28.052=-0.122
max28.334-29.066=-0.731