Compare commits

Home / Compare 40b7c94d .. 0db0ad2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.563=0.003
σ0.047-0.045=0.002
min70.541-70.539=0.002
max70.696-70.689=0.006
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.159-0.159=0.001
σ0.004-0.005=-0.002
min0.155-0.149=0.006
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.000
σ0.004-0.003=0.001
min21.283-21.283=-0.000
max21.297-21.291=0.006
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.064=-0.001
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.000
σ0.362-0.361=0.002
min1752.803-1752.805=-0.001
max1753.981-1753.979=0.002
mean1658.850-1667.900=-9.050
σ632.132-642.581=-10.448
min617.000-620.000=-3.000
max2777.000-2826.000=-49.000
mean2.799-2.809=-0.010
σ0.140-0.139=0.000
min2.556-2.397=0.159
max3.178-2.973=0.206

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.753=0.002
σ0.005-0.007=-0.002
min271.749-271.743=0.006
max271.760-271.761=-0.000
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean0.383-0.382=0.001
σ0.007-0.005=0.002
min0.378-0.378=-0.000
max0.393-0.390=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.178-1932.177=0.001
σ0.014-0.006=0.007
min1932.157-1932.169=-0.011
max1932.194-1932.186=0.008
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean2.886-3.060=-0.174
σ0.191-0.073=0.118
min2.575-3.004=-0.428
max3.073-3.140=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4752.807-4752.907=-0.100
σ0.996-0.854=0.142
min4752.100-4752.423=-0.323
max4754.566-4754.425=0.141
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean8.503-8.486=0.017
σ0.549-0.517=0.032
min7.652-7.627=0.026
max9.127-8.936=0.191
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.375=0.001
σ0.018-0.014=0.004
min4943.351-4943.361=-0.011
max4943.399-4943.391=0.008
mean2994.400-3059.400=-65.000
σ210.559-232.136=-21.577
min2777.000-2826.000=-49.000
max3304.000-3392.000=-88.000
mean8.559-8.559=0.000
σ0.085-0.278=-0.193
min8.457-8.341=0.116
max8.634-9.034=-0.400

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.027=0.013
σ0.185-0.132=0.053
min0.920-0.941=-0.021
max1.354-1.244=0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.858=0.000
σ575.936-575.925=0.010
min179.889-179.888=0.001
max1331.761-1331.746=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean0.477-0.445=0.032
σ0.397-0.303=0.094
min0.275-0.292=-0.017
max1.071-0.899=0.173
policies=20
mean1799.170-1799.161=0.009
σ0.372-0.356=0.015
min1798.920-1798.912=0.009
max1799.723-1799.687=0.037
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean2.788-2.882=-0.094
σ0.021-0.129=-0.107
min2.772-2.783=-0.011
max2.818-3.063=-0.245
policies=200
mean17998.484-17998.408=0.076
σ0.423-0.433=-0.010
min17998.258-17998.007=0.251
max17999.119-17999.023=0.096
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2826.000=-49.000
σ0.000
min2777.000-2826.000=-49.000
max2777.000-2826.000=-49.000
mean28.115-28.129=-0.013
σ0.172-0.168=0.004
min27.994-28.003=-0.009
max28.368-28.373=-0.005