Compare commits

Home / Compare 99058caa .. 6de69f74

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.563=0.000
σ0.045-0.046=-0.000
min70.537-70.537=-0.000
max70.690-70.691=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.159=0.002
σ0.004-0.003=0.001
min0.157-0.156=0.001
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.003=-0.000
min21.283-21.284=-0.002
max21.292-21.292=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.062=0.002
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.070-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=0.000
σ0.362-0.362=0.000
min1752.804-1752.809=-0.005
max1753.958-1753.957=0.002
mean1661.250-1650.000=11.250
σ638.835-640.124=-1.289
min610.000-651.000=-41.000
max2814.000-2846.000=-32.000
mean2.765-2.860=-0.095
σ0.146-0.180=-0.034
min2.286-2.581=-0.295
max2.944-3.493=-0.550

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.757=-0.002
σ0.006-0.005=0.000
min271.749-271.751=-0.002
max271.761-271.764=-0.003
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean0.384-0.380=0.004
σ0.004-0.006=-0.002
min0.381-0.375=0.006
max0.392-0.391=0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.176=0.001
σ0.009-0.006=0.003
min1932.164-1932.167=-0.004
max1932.187-1932.182=0.004
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean2.944-3.065=-0.121
σ0.071-0.104=-0.033
min2.866-2.968=-0.102
max3.023-3.197=-0.174
iters=5
new-facts=6402
prior-facts=1
mean4752.772-4752.944=-0.172
σ0.581-0.896=-0.314
min4752.446-4752.375=0.071
max4753.807-4754.536=-0.730
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean8.561-8.383=0.178
σ0.333-0.379=-0.045
min8.166-8.048=0.118
max8.912-9.034=-0.122
iters=5
new-facts=6402
prior-facts=6402
mean4943.300-4943.376=-0.076
σ0.164-0.021=0.143
min4943.007-4943.346=-0.340
max4943.384-4943.396=-0.011
mean3002.600-3061.600=-59.000
σ203.337-231.380=-28.044
min2814.000-2846.000=-32.000
max3305.000-3404.000=-99.000
mean8.745-8.699=0.046
σ0.247-0.176=0.071
min8.480-8.486=-0.006
max9.059-8.968=0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.191=-0.167
σ0.136-0.223=-0.087
min0.935-0.946=-0.011
max1.248-1.478=-0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.863=0.001
σ575.927-575.939=-0.012
min179.888-179.889=-0.001
max1331.754-1331.771=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean0.480-0.445=0.035
σ0.395-0.313=0.082
min0.281-0.286=-0.005
max1.072-0.914=0.158
policies=20
mean1799.178-1799.185=-0.007
σ0.364-0.373=-0.009
min1798.928-1798.932=-0.004
max1799.719-1799.735=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean2.807-2.861=-0.054
σ0.016-0.008=0.008
min2.787-2.855=-0.068
max2.820-2.873=-0.053
policies=200
mean17998.374-17998.560=-0.185
σ0.603-0.486=0.117
min17998.053-17998.221=-0.168
max17999.279-17999.281=-0.003
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000-2846.000=-32.000
σ0.000
min2814.000-2846.000=-32.000
max2814.000-2846.000=-32.000
mean28.206-28.493=-0.287
σ0.138-0.409=-0.271
min28.078-28.156=-0.078
max28.397-28.994=-0.597