Compare commits

Home / Compare 99cfa045 .. c632a201

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.002
σ0.046-0.047=-0.001
min70.542-70.542=-0.001
max70.693-70.697=-0.004
mean413.900-414.600=-0.700
σ0.316-0.516=-0.200
min413.000-414.000=-1.000
max414.000-415.000=-1.000
mean0.158-0.158=-0.000
σ0.006-0.003=0.003
min0.150-0.155=-0.005
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.292-21.292=-0.000
σ0.010-0.010=-0.000
min21.286-21.282=0.003
max21.320-21.320=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.064=-0.003
σ0.003-0.002=0.001
min0.058-0.063=-0.004
max0.067-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.376=-0.001
σ0.361-0.361=-0.001
min1752.809-1752.800=0.010
max1753.940-1753.957=-0.017
mean1666.250-1654.500=11.750
σ632.560-626.699=5.861
min686.000-633.000=53.000
max2812.000-2851.000=-39.000
mean2.742-2.867=-0.125
σ0.206-0.098=0.109
min2.270-2.690=-0.420
max3.053-3.171=-0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.756=-0.004
σ0.005-0.011=-0.006
min271.747-271.737=0.010
max271.759-271.767=-0.007
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean0.378-0.383=-0.004
σ0.008-0.005=0.003
min0.368-0.376=-0.008
max0.391-0.389=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.175=0.005
σ0.016-0.012=0.004
min1932.160-1932.162=-0.002
max1932.194-1932.189=0.005
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean2.969-2.932=0.037
σ0.128-0.124=0.004
min2.767-2.782=-0.015
max3.090-3.096=-0.007
iters=5
new-facts=6402
prior-facts=1
mean4752.659-4752.874=-0.215
σ1.078-0.912=0.167
min4751.892-4752.441=-0.549
max4754.530-4754.505=0.025
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean8.665-8.794=-0.128
σ0.364-0.153=0.211
min8.100-8.619=-0.519
max9.015-8.999=0.016
iters=5
new-facts=6402
prior-facts=6402
mean4943.375-4943.295=0.080
σ0.021-0.163=-0.142
min4943.349-4943.004=0.346
max4943.399-4943.374=0.025
mean3019.200-3024.200=-5.000
σ277.497-261.296=16.201
min2812.000-2851.000=-39.000
max3455.000-3448.000=7.000
mean8.453-8.394=0.060
σ0.130-0.113=0.016
min8.352-8.250=0.102
max8.668-8.564=0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.097=-0.030
σ0.167-0.180=-0.013
min0.935-0.926=0.010
max1.346-1.325=0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.856-467.864=-0.007
σ575.927-575.933=-0.006
min179.889-179.892=-0.004
max1331.747-1331.763=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean0.435-0.444=-0.010
σ0.301-0.300=0.001
min0.275-0.293=-0.019
max0.886-0.894=-0.009
policies=20
mean1799.161-1799.149=0.012
σ0.325-0.380=-0.056
min1798.933-1798.888=0.045
max1799.637-1799.711=-0.074
mean820.000
σ0.000
min820.000
max820.000
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean2.830-2.882=-0.052
σ0.103-0.018=0.085
min2.768-2.862=-0.094
max2.984-2.904=0.080
policies=200
mean17998.521-17998.454=0.067
σ0.517-0.502=0.015
min17998.253-17998.120=0.133
max17999.297-17999.196=0.101
mean8200.000
σ0.000
min8200.000
max8200.000
mean2812.000-2851.000=-39.000
σ0.000
min2812.000-2851.000=-39.000
max2812.000-2851.000=-39.000
mean28.013-28.558=-0.545
σ0.133-0.429=-0.296
min27.876-28.061=-0.185
max28.191-28.989=-0.798