Compare commits

Home / Compare 80275d39 .. 235fa0bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.562=0.002
σ0.045-0.046=-0.002
min70.539-70.540=-0.002
max70.689-70.692=-0.004
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.160-0.156=0.004
σ0.003-0.005=-0.002
min0.157-0.148=0.009
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.291-21.291=-0.000
σ0.009-0.011=-0.002
min21.287-21.284=0.003
max21.318-21.322=-0.004
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.376=-0.001
σ0.361-0.361=-0.000
min1752.806-1752.802=0.004
max1753.946-1753.955=-0.009
mean1662.700-1650.400=12.300
σ632.928-646.657=-13.729
min619.000-628.000=-9.000
max2764.000-2896.000=-132.000
mean2.764-2.790=-0.026
σ0.206-0.156=0.050
min2.135-2.441=-0.307
max3.069-3.034=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.758=-0.004
σ0.004-0.005=-0.001
min271.750-271.752=-0.003
max271.760-271.764=-0.005
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean0.379-0.379=-0.000
σ0.006-0.003=0.003
min0.372-0.377=-0.005
max0.385-0.384=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.182=-0.008
σ0.021-0.017=0.004
min1932.144-1932.163=-0.019
max1932.192-1932.210=-0.018
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean2.902-2.955=-0.053
σ0.264-0.144=0.120
min2.476-2.713=-0.237
max3.117-3.068=0.048
iters=5
new-facts=6402
prior-facts=1
mean4752.896-4752.915=-0.019
σ0.930-0.842=0.088
min4752.414-4752.424=-0.010
max4754.548-4754.410=0.139
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean8.568-8.566=0.002
σ0.602-0.543=0.059
min7.626-7.678=-0.052
max9.004-8.969=0.035
iters=5
new-facts=6402
prior-facts=6402
mean4943.302-4943.223=0.079
σ0.159-0.311=-0.151
min4943.019-4942.668=0.351
max4943.393-4943.396=-0.003
mean2984.600-3089.000=-104.400
σ217.604-215.743=1.861
min2764.000-2896.000=-132.000
max3314.000-3421.000=-107.000
mean8.553-8.610=-0.057
σ0.105-0.251=-0.146
min8.423-8.415=0.007
max8.667-8.890=-0.222

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.048=-0.007
σ0.113-0.131=-0.017
min0.933-0.929=0.004
max1.204-1.247=-0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.864=-0.001
σ575.937-575.925=0.012
min179.883-179.895=-0.013
max1331.769-1331.751=0.018
mean86.250
σ8.500
min82.000
max99.000
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean0.515-0.445=0.070
σ0.465-0.302=0.163
min0.281-0.291=-0.010
max1.212-0.897=0.315
policies=20
mean1799.152-1799.196=-0.044
σ0.363-0.378=-0.015
min1798.949-1798.928=0.021
max1799.696-1799.753=-0.057
mean820.000
σ0.000
min820.000
max820.000
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean2.799-2.877=-0.078
σ0.012-0.011=0.001
min2.788-2.866=-0.078
max2.814-2.887=-0.073
policies=200
mean17998.538-17998.581=-0.043
σ0.501-0.475=0.026
min17998.243-17998.310=-0.067
max17999.287-17999.293=-0.005
mean8200.000
σ0.000
min8200.000
max8200.000
mean2764.000-2896.000=-132.000
σ0.000
min2764.000-2896.000=-132.000
max2764.000-2896.000=-132.000
mean28.099-28.545=-0.447
σ0.099-0.435=-0.336
min28.016-28.021=-0.005
max28.217-28.990=-0.773