Compare commits

Home / Compare 422f7a46 .. 624cf6cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.562=0.005
σ0.047-0.045=0.002
min70.540-70.541=-0.001
max70.698-70.689=0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.161-0.158=0.003
σ0.007-0.004=0.003
min0.157-0.152=0.004
max0.179-0.164=0.015
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.003
σ0.002-0.011=-0.008
min21.285-21.284=0.001
max21.292-21.321=-0.029
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.001
σ0.362-0.361=0.001
min1752.994-1753.000=-0.007
max1754.154-1754.153=0.001
mean1667.250-1656.400=10.850
σ628.853-626.535=2.318
min688.000-689.000=-1.000
max2695.000-2730.000=-35.000
mean2.816-2.813=0.003
σ0.185-0.193=-0.009
min2.297-2.278=0.019
max2.984-3.139=-0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.015=-0.000
σ0.006-0.007=-0.001
min272.007-272.003=0.004
max272.022-272.021=0.001
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean0.387-0.381=0.006
σ0.010-0.005=0.005
min0.377-0.377=-0.001
max0.401-0.391=0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.441-1932.434=0.007
σ0.015-0.005=0.010
min1932.416-1932.426=-0.010
max1932.456-1932.440=0.016
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean2.904-3.054=-0.150
σ0.146-0.119=0.027
min2.710-2.929=-0.220
max3.068-3.209=-0.140
iters=5
new-facts=6402
prior-facts=1
mean4753.053-4753.175=-0.122
σ0.579-0.818=-0.239
min4752.672-4752.719=-0.047
max4754.079-4754.634=-0.555
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean8.587-8.343=0.244
σ0.287-0.442=-0.155
min8.346-7.798=0.548
max9.043-8.939=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4943.633-4943.565=0.068
σ0.020-0.148=-0.127
min4943.610-4943.303=0.307
max4943.656-4943.662=-0.006
mean3010.200-3041.000=-30.800
σ265.587-250.960=14.626
min2695.000-2730.000=-35.000
max3352.000-3354.000=-2.000
mean8.529-8.891=-0.363
σ0.163-0.563=-0.400
min8.338-8.425=-0.087
max8.754-9.869=-1.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.084=0.039
σ0.150-0.109=0.041
min0.937-0.938=-0.001
max1.303-1.244=0.059

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.081=0.001
σ575.932-575.922=0.010
min185.112-185.110=0.001
max1336.980-1336.964=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean0.557-0.564=-0.007
σ0.541-0.549=-0.008
min0.286-0.286=-0.001
max1.370-1.388=-0.019
policies=20
mean1851.432-1851.411=0.021
σ0.375-0.379=-0.004
min1851.183-1851.151=0.032
max1851.987-1851.970=0.016
mean840.000
σ0.000
min840.000
max840.000
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean2.851-2.862=-0.011
σ0.011-0.007=0.003
min2.835-2.857=-0.021
max2.859-2.873=-0.015
policies=200
mean18521.023-18521.174=-0.151
σ0.575-0.501=0.074
min18520.669-18520.922=-0.253
max18521.881-18521.926=-0.045
mean8400.000
σ0.000
min8400.000
max8400.000
mean2695.000-2730.000=-35.000
σ0.000
min2695.000-2730.000=-35.000
max2695.000-2730.000=-35.000
mean28.894-28.822=0.072
σ0.099-0.049=0.049
min28.806-28.761=0.045
max28.996-28.867=0.129