Compare commits

Home / Compare 235fa0bc .. 99cfa045

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.047-0.045=0.002
min70.542-70.539=0.003
max70.697-70.689=0.008
mean414.600-416.000=-1.400
σ0.516-0.000=0.516
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.158-0.160=-0.002
σ0.003-0.003=0.000
min0.155-0.157=-0.002
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.292-21.291=0.000
σ0.010-0.009=0.001
min21.282-21.287=-0.004
max21.320-21.318=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.063-0.063=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.375=0.001
σ0.361-0.361=0.001
min1752.800-1752.806=-0.006
max1753.957-1753.946=0.011
mean1654.500-1662.700=-8.200
σ626.699-632.928=-6.229
min633.000-619.000=14.000
max2851.000-2764.000=87.000
mean2.867-2.764=0.103
σ0.098-0.206=-0.108
min2.690-2.135=0.555
max3.171-3.069=0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.754=0.002
σ0.011-0.004=0.007
min271.737-271.750=-0.012
max271.767-271.760=0.007
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean0.383-0.379=0.004
σ0.005-0.006=-0.001
min0.376-0.372=0.004
max0.389-0.385=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.174=0.001
σ0.012-0.021=-0.009
min1932.162-1932.144=0.018
max1932.189-1932.192=-0.003
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean2.932-2.902=0.030
σ0.124-0.264=-0.140
min2.782-2.476=0.306
max3.096-3.117=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4752.874-4752.896=-0.022
σ0.912-0.930=-0.018
min4752.441-4752.414=0.027
max4754.505-4754.548=-0.043
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean8.794-8.568=0.225
σ0.153-0.602=-0.449
min8.619-7.626=0.993
max8.999-9.004=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean4943.295-4943.302=-0.008
σ0.163-0.159=0.003
min4943.004-4943.019=-0.016
max4943.374-4943.393=-0.019
mean3024.200-2984.600=39.600
σ261.296-217.604=43.693
min2851.000-2764.000=87.000
max3448.000-3314.000=134.000
mean8.394-8.553=-0.159
σ0.113-0.105=0.009
min8.250-8.423=-0.173
max8.564-8.667=-0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.097-1.041=0.056
σ0.180-0.113=0.067
min0.926-0.933=-0.007
max1.325-1.204=0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.863=0.001
σ575.933-575.937=-0.004
min179.892-179.883=0.010
max1331.763-1331.769=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean0.444-0.515=-0.071
σ0.300-0.465=-0.165
min0.293-0.281=0.013
max0.894-1.212=-0.318
policies=20
mean1799.149-1799.152=-0.003
σ0.380-0.363=0.017
min1798.888-1798.949=-0.061
max1799.711-1799.696=0.015
mean820.000
σ0.000
min820.000
max820.000
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean2.882-2.799=0.083
σ0.018-0.012=0.006
min2.862-2.788=0.074
max2.904-2.814=0.090
policies=200
mean17998.454-17998.538=-0.084
σ0.502-0.501=0.000
min17998.120-17998.243=-0.123
max17999.196-17999.287=-0.091
mean8200.000
σ0.000
min8200.000
max8200.000
mean2851.000-2764.000=87.000
σ0.000
min2851.000-2764.000=87.000
max2851.000-2764.000=87.000
mean28.558-28.099=0.459
σ0.429-0.099=0.331
min28.061-28.016=0.045
max28.989-28.217=0.772