Compare commits

Home / Compare 0fc1582b .. b02dc253

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.044-0.047=-0.003
min70.542-70.535=0.007
max70.687-70.697=-0.010
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.159-0.161=-0.002
σ0.004-0.003=0.001
min0.152-0.158=-0.006
max0.166-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.004-0.003=0.000
min21.282-21.282=-0.000
max21.295-21.292=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.003=0.000
min0.059-0.060=-0.001
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1715.468=37.906
σ0.360-169.652=-169.291
min1752.804-994.700=758.105
max1753.957-1753.948=0.009
mean1652.450-1610.900=41.550
σ646.078-619.692=26.386
min631.000-621.000=10.000
max2896.000-2696.000=200.000
mean2.853-2.781=0.072
σ0.122-0.288=-0.166
min2.517-1.705=0.812
max3.008-3.163=-0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-271.752=0.008
σ0.005-0.006=-0.001
min271.754-271.745=0.008
max271.766-271.760=0.006
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean0.380-0.378=0.002
σ0.005-0.006=-0.001
min0.377-0.371=0.006
max0.390-0.388=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.177=-0.001
σ0.011-0.018=-0.007
min1932.159-1932.151=0.008
max1932.190-1932.196=-0.006
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean3.013-2.921=0.092
σ0.156-0.126=0.030
min2.798-2.744=0.054
max3.185-3.059=0.126
iters=5
new-facts=6402
prior-facts=1
mean4752.941-4752.920=0.021
σ0.892-0.903=-0.011
min4752.409-4752.413=-0.005
max4754.528-4754.525=0.002
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean8.360-8.445=-0.085
σ0.495-0.536=-0.041
min7.752-7.646=0.106
max8.995-8.995=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean4943.384-4943.373=0.011
σ0.018-0.016=0.002
min4943.362-4943.354=0.008
max4943.403-4943.391=0.012
mean3064.800-2956.000=108.800
σ252.006-309.121=-57.114
min2896.000-2696.000=200.000
max3460.000-3427.000=33.000
mean8.497-8.378=0.119
σ0.133-0.060=0.073
min8.381-8.309=0.072
max8.710-8.430=0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.119-1.020=0.099
σ0.123-0.138=-0.014
min1.055-0.930=0.125
max1.339-1.244=0.095

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.870=-0.007
σ575.933-575.950=-0.017
min179.894-179.890=0.004
max1331.763-1331.795=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean0.443-0.562=-0.119
σ0.302-0.556=-0.254
min0.286-0.283=0.003
max0.897-1.397=-0.500
policies=20
mean1799.193-1799.143=0.050
σ0.378-0.370=0.008
min1798.924-1798.917=0.007
max1799.749-1799.695=0.054
mean820.000
σ0.000
min820.000
max820.000
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean2.897-2.794=0.103
σ0.025-0.013=0.012
min2.879-2.786=0.093
max2.932-2.814=0.119
policies=200
mean17998.539-17998.495=0.044
σ0.462-0.444=0.018
min17998.272-17998.221=0.050
max17999.229-17999.159=0.070
mean8200.000
σ0.000
min8200.000
max8200.000
mean2896.000-2696.000=200.000
σ0.000
min2896.000-2696.000=200.000
max2896.000-2696.000=200.000
mean28.541-28.102=0.439
σ0.596-0.077=0.519
min27.987-28.028=-0.041
max29.244-28.190=1.054