Compare commits

Home / Compare 81bc23f4 .. 124832e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.002
σ0.044-0.047=-0.002
min70.536-70.538=-0.002
max70.687-70.694=-0.007
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.158-0.161=-0.003
σ0.004-0.003=0.001
min0.153-0.158=-0.005
max0.167-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.292=-0.004
σ0.002-0.012=-0.010
min21.285-21.285=-0.001
max21.291-21.325=-0.034
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.065=-0.000
σ0.002-0.003=-0.000
min0.062-0.062=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.376=-0.001
σ0.360-0.362=-0.002
min1752.801-1752.805=-0.004
max1753.959-1753.965=-0.006
mean1661.100-1662.850=-1.750
σ637.988-637.456=0.532
min685.000-620.000=65.000
max2765.000-2813.000=-48.000
mean2.822-2.697=0.125
σ0.116-0.221=-0.105
min2.561-2.155=0.406
max3.126-2.958=0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.752=0.003
σ0.008-0.006=0.002
min271.743-271.747=-0.003
max271.766-271.760=0.007
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean0.385-0.385=0.001
σ0.011-0.005=0.007
min0.379-0.380=-0.001
max0.405-0.391=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.171-1932.174=-0.003
σ0.004-0.008=-0.004
min1932.165-1932.164=0.001
max1932.176-1932.180=-0.004
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean3.026-2.954=0.072
σ0.060-0.140=-0.080
min2.983-2.712=0.271
max3.115-3.050=0.065
iters=5
new-facts=6402
prior-facts=1
mean4752.838-4752.940=-0.102
σ1.022-0.893=0.129
min4751.959-4752.385=-0.427
max4754.596-4754.528=0.068
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean8.411-8.310=0.101
σ0.484-0.539=-0.056
min7.980-7.680=0.300
max9.173-9.045=0.128
iters=5
new-facts=6402
prior-facts=6402
mean4943.380-4943.300=0.080
σ0.017-0.155=-0.137
min4943.364-4943.026=0.338
max4943.401-4943.402=-0.001
mean3044.600-3065.800=-21.200
σ242.451-320.763=-78.313
min2765.000-2813.000=-48.000
max3382.000-3553.000=-171.000
mean8.601-8.589=0.012
σ0.237-0.380=-0.143
min8.361-8.302=0.059
max8.894-9.242=-0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.002=0.041
σ0.128-0.139=-0.011
min0.925-0.933=-0.008
max1.237-1.251=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.868=-0.004
σ575.922-575.938=-0.016
min179.895-179.890=0.005
max1331.746-1331.774=-0.028
mean86.250
σ8.500
min82.000
max99.000
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean0.470-0.463=0.007
σ0.255-0.359=-0.103
min0.289-0.281=0.008
max0.832-1.001=-0.168
policies=20
mean1799.177-1799.177=-0.000
σ0.345-0.382=-0.037
min1798.921-1798.919=0.002
max1799.686-1799.745=-0.059
mean820.000
σ0.000
min820.000
max820.000
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean2.804-2.838=-0.034
σ0.018-0.071=-0.053
min2.785-2.779=0.006
max2.823-2.941=-0.118
policies=200
mean17998.407-17998.469=-0.063
σ0.604-0.423=0.181
min17998.033-17998.236=-0.203
max17999.308-17999.103=0.204
mean8200.000
σ0.000
min8200.000
max8200.000
mean2765.000-2813.000=-48.000
σ0.000
min2765.000-2813.000=-48.000
max2765.000-2813.000=-48.000
mean28.146-28.271=-0.125
σ0.100-0.169=-0.070
min28.084-28.047=0.037
max28.294-28.424=-0.130