Compare commits

Home / Compare 5814db5f .. 74cfc415

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.044-0.045=-0.001
min70.539-70.538=0.001
max70.687-70.689=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.160-0.157=0.002
σ0.003-0.006=-0.002
min0.157-0.148=0.009
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.002-0.003=-0.001
min21.285-21.284=0.001
max21.291-21.293=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.057=0.006
max0.071-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.360-0.361=-0.000
min1752.800-1752.799=0.001
max1753.956-1753.955=0.002
mean1658.550-1648.900=9.650
σ647.298-639.606=7.692
min638.000-634.000=4.000
max2902.000-2848.000=54.000
mean2.836-2.790=0.046
σ0.123-0.180=-0.057
min2.524-2.348=0.177
max3.001-2.986=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.110-272.113=-0.002
σ0.007-0.006=0.001
min272.101-272.103=-0.002
max272.117-272.119=-0.002
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean0.383-0.382=0.001
σ0.009-0.004=0.005
min0.375-0.379=-0.004
max0.398-0.389=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.540-1932.525=0.015
σ0.023-0.005=0.018
min1932.517-1932.517=0.000
max1932.566-1932.532=0.035
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean2.940-3.053=-0.112
σ0.274-0.117=0.157
min2.474-2.975=-0.501
max3.198-3.247=-0.049
iters=5
new-facts=6402
prior-facts=1
mean4753.158-4753.154=0.004
σ0.969-1.046=-0.077
min4752.288-4752.276=0.012
max4754.820-4754.961=-0.141
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean8.405-8.675=-0.270
σ0.520-0.666=-0.147
min7.543-7.649=-0.106
max8.830-9.406=-0.576
iters=5
new-facts=6402
prior-facts=6402
mean4943.728-4943.730=-0.002
σ0.018-0.011=0.007
min4943.705-4943.713=-0.008
max4943.754-4943.744=0.010
mean3077.200-3055.600=21.600
σ199.230-224.323=-25.093
min2902.000-2848.000=54.000
max3388.000-3390.000=-2.000
mean8.672-8.574=0.098
σ0.245-0.178=0.067
min8.387-8.440=-0.053
max8.955-8.871=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.022=0.003
σ0.143-0.138=0.005
min0.929-0.932=-0.003
max1.257-1.249=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.862=0.001
σ575.926-575.925=0.001
min179.893-179.895=-0.002
max1331.751-1331.749=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean0.444-0.443=0.002
σ0.303-0.298=0.005
min0.291-0.292=-0.001
max0.900-0.890=0.009
policies=20
mean1799.184-1799.185=-0.001
σ0.370-0.372=-0.002
min1798.937-1798.926=0.011
max1799.732-1799.732=0.000
mean820.000
σ0.000
min820.000
max820.000
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean2.860-2.886=-0.026
σ0.020-0.007=0.013
min2.831-2.876=-0.045
max2.879-2.891=-0.013
policies=200
mean17998.555-17998.426=0.129
σ0.449-0.433=0.016
min17998.262-17998.057=0.205
max17999.225-17999.043=0.182
mean8200.000
σ0.000
min8200.000
max8200.000
mean2902.000-2848.000=54.000
σ0.000
min2902.000-2848.000=54.000
max2902.000-2848.000=54.000
mean28.547-28.507=0.040
σ0.497-0.461=0.036
min28.088-28.085=0.003
max28.996-29.016=-0.021