Compare commits

Home / Compare b9e49ec5 .. 6430f6b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.562=0.001
σ0.047-0.047=0.000
min70.541-70.540=0.001
max70.697-70.694=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.163-0.159=0.004
σ0.004-0.004=0.000
min0.158-0.155=0.004
max0.170-0.165=0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.003
σ0.002-0.011=-0.009
min21.286-21.284=0.002
max21.293-21.322=-0.029
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.065=-0.002
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.376=-0.002
σ0.359-0.362=-0.002
min1752.804-1752.802=0.003
max1753.965-1753.957=0.007
mean1660.650-1655.200=5.450
σ637.131-638.192=-1.060
min618.000-620.000=-2.000
max2803.000-2765.000=38.000
mean2.746-2.779=-0.033
σ0.243-0.201=0.043
min2.158-2.272=-0.114
max2.989-3.127=-0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.751=0.003
σ0.007-0.006=0.001
min271.747-271.745=0.002
max271.763-271.760=0.004
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean0.383-0.380=0.003
σ0.006-0.005=0.000
min0.379-0.375=0.004
max0.393-0.389=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.185-1932.168=0.017
σ0.014-0.016=-0.002
min1932.172-1932.143=0.030
max1932.208-1932.185=0.023
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean2.945-3.018=-0.073
σ0.306-0.075=0.231
min2.434-2.907=-0.473
max3.221-3.103=0.119
iters=5
new-facts=6402
prior-facts=1
mean4752.723-4752.721=0.001
σ0.675-1.090=-0.415
min4752.132-4751.522=0.610
max4753.876-4754.506=-0.630
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean8.356-8.273=0.082
σ0.528-0.440=0.088
min7.668-7.700=-0.032
max9.045-8.936=0.109
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.296=0.081
σ0.020-0.145=-0.125
min4943.356-4943.037=0.319
max4943.400-4943.377=0.023
mean3044.200-3053.400=-9.200
σ250.165-345.642=-95.477
min2803.000-2765.000=38.000
max3402.000-3569.000=-167.000
mean8.546-8.421=0.125
σ0.100-0.146=-0.046
min8.427-8.231=0.196
max8.655-8.601=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.108-1.086=0.023
σ0.247-0.158=0.089
min0.934-0.930=0.004
max1.533-1.283=0.250

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.856-467.862=-0.006
σ575.934-575.933=0.001
min179.881-179.889=-0.008
max1331.757-1331.761=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean0.482-0.575=-0.093
σ0.398-0.585=-0.187
min0.282-0.280=0.002
max1.079-1.453=-0.373
policies=20
mean1799.150-1799.166=-0.016
σ0.366-0.354=0.012
min1798.938-1798.954=-0.016
max1799.697-1799.696=0.001
mean820.000
σ0.000
min820.000
max820.000
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean2.807-2.799=0.009
σ0.012-0.019=-0.008
min2.790-2.782=0.008
max2.815-2.822=-0.007
policies=200
mean17998.514-17998.451=0.063
σ0.519-0.379=0.140
min17998.223-17998.216=0.006
max17999.291-17999.015=0.277
mean8200.000
σ0.000
min8200.000
max8200.000
mean2803.000-2765.000=38.000
σ0.000
min2803.000-2765.000=38.000
max2803.000-2765.000=38.000
mean28.331-28.250=0.081
σ0.089-0.296=-0.207
min28.244-28.072=0.172
max28.418-28.693=-0.274