Compare commits

Home / Compare 32940fdd .. 812d173a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.563=-0.002
σ0.048-0.045=0.003
min70.532-70.537=-0.005
max70.695-70.690=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.156-0.161=-0.004
σ0.004-0.004=0.001
min0.150-0.157=-0.007
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.003-0.003=-0.000
min21.283-21.283=0.001
max21.291-21.292=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.064=-0.001
σ0.002-0.002=0.000
min0.058-0.063=-0.004
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.361-0.362=-0.001
min1752.801-1752.804=-0.002
max1753.956-1753.958=-0.003
mean1662.500-1661.250=1.250
σ637.331-638.835=-1.504
min621.000-610.000=11.000
max2814.000
mean2.748-2.765=-0.017
σ0.187-0.146=0.041
min2.364-2.286=0.078
max3.082-2.944=0.139

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.756=-0.003
σ0.005-0.006=-0.001
min271.745-271.749=-0.004
max271.756-271.761=-0.005
mean2814.000
σ0.000
min2814.000
max2814.000
mean0.381-0.384=-0.003
σ0.005-0.004=0.001
min0.378-0.381=-0.003
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.181-1932.177=0.004
σ0.015-0.009=0.006
min1932.167-1932.164=0.003
max1932.206-1932.187=0.020
mean2814.000
σ0.000
min2814.000
max2814.000
mean2.923-2.944=-0.020
σ0.124-0.071=0.053
min2.753-2.866=-0.113
max3.058-3.023=0.035
iters=5
new-facts=6402
prior-facts=1
mean4752.904-4752.772=0.132
σ0.906-0.581=0.324
min4752.393-4752.446=-0.053
max4754.517-4753.807=0.711
mean2814.000
σ0.000
min2814.000
max2814.000
mean8.643-8.561=0.082
σ0.332-0.333=-0.001
min8.192-8.166=0.026
max8.998-8.912=0.086
iters=5
new-facts=6402
prior-facts=6402
mean4943.156-4943.300=-0.144
σ0.314-0.164=0.150
min4942.651-4943.007=-0.356
max4943.378-4943.384=-0.006
mean3032.400-3002.600=29.800
σ223.237-203.337=19.900
min2814.000
max3342.000-3305.000=37.000
mean8.596-8.745=-0.148
σ0.200-0.247=-0.047
min8.417-8.480=-0.063
max8.915-9.059=-0.144

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.082-1.024=0.058
σ0.150-0.136=0.014
min0.930-0.935=-0.005
max1.257-1.248=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.866-467.864=0.002
σ575.937-575.927=0.010
min179.884-179.888=-0.004
max1331.771-1331.754=0.017
mean86.250
σ8.500
min82.000
max99.000
mean2814.000
σ0.000
min2814.000
max2814.000
mean0.476-0.480=-0.003
σ0.382-0.395=-0.013
min0.282-0.281=0.000
max1.049-1.072=-0.023
policies=20
mean1799.176-1799.178=-0.002
σ0.376-0.364=0.013
min1798.911-1798.928=-0.017
max1799.734-1799.719=0.015
mean820.000
σ0.000
min820.000
max820.000
mean2814.000
σ0.000
min2814.000
max2814.000
mean2.818-2.807=0.010
σ0.026-0.016=0.010
min2.793-2.787=0.006
max2.847-2.820=0.027
policies=200
mean17998.510-17998.374=0.135
σ0.505-0.603=-0.098
min17998.213-17998.053=0.160
max17999.265-17999.279=-0.013
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000
σ0.000
min2814.000
max2814.000
mean28.242-28.206=0.036
σ0.146-0.138=0.008
min28.090-28.078=0.012
max28.440-28.397=0.043