Compare commits

Home / Compare ef12b033 .. 53e50adb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.003
σ0.046-0.045=0.001
min70.543-70.537=0.005
max70.693-70.690=0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.160-0.161=-0.001
σ0.004-0.004=0.001
min0.155-0.154=0.001
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.001
σ0.003-0.003=0.000
min21.284-21.282=0.002
max21.293-21.291=0.002
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.063-0.065=-0.003
σ0.004-0.002=0.001
min0.059-0.064=-0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.567=-0.000
σ0.360-0.360=-0.000
min1752.999-1753.005=-0.006
max1754.140-1754.154=-0.014
mean1645.250-1656.800=-11.550
σ630.569-632.774=-2.205
min630.000-642.000=-12.000
max2851.000-2846.000=5.000
mean2.775-2.857=-0.082
σ0.167-0.151=0.016
min2.344-2.660=-0.315
max3.010-3.352=-0.342

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-272.017=-0.002
σ0.006-0.008=-0.002
min272.007-272.007=-0.000
max272.023-272.028=-0.005
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean0.385-0.387=-0.002
σ0.008-0.016=-0.008
min0.380-0.362=0.018
max0.399-0.402=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.444-1932.438=0.006
σ0.010-0.010=-0.000
min1932.433-1932.425=0.008
max1932.456-1932.453=0.003
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean2.936-3.043=-0.108
σ0.178-0.104=0.074
min2.623-2.977=-0.354
max3.064-3.224=-0.160
iters=5
new-facts=6402
prior-facts=1
mean4753.172-4753.151=0.021
σ0.839-0.849=-0.010
min4752.713-4752.694=0.019
max4754.665-4754.664=0.001
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean8.484-8.628=-0.144
σ0.452-0.252=0.199
min7.818-8.347=-0.529
max8.997-8.910=0.086
iters=5
new-facts=6402
prior-facts=6402
mean4943.628-4943.635=-0.007
σ0.026-0.017=0.009
min4943.595-4943.622=-0.027
max4943.657-4943.660=-0.003
mean3072.000-3101.800=-29.800
σ226.112-269.998=-43.886
min2851.000-2846.000=5.000
max3404.000-3383.000=21.000
mean8.613-8.689=-0.076
σ0.233-0.230=0.003
min8.416-8.425=-0.009
max9.017-9.027=-0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-1.012=0.091
σ0.234-0.123=0.111
min0.938-0.926=0.012
max1.449-1.205=0.244

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.080=0.001
σ575.927-575.914=0.013
min185.114-185.117=-0.003
max1336.972-1336.951=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean0.487-0.490=-0.004
σ0.374-0.376=-0.002
min0.297-0.299=-0.002
max1.048-1.054=-0.006
policies=20
mean1851.451-1851.445=0.005
σ0.375-0.374=0.001
min1851.167-1851.161=0.006
max1851.995-1851.989=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean2.952-2.960=-0.008
σ0.009-0.012=-0.002
min2.942-2.947=-0.004
max2.960-2.973=-0.012
policies=200
mean18521.211-18521.106=0.105
σ0.460-0.534=-0.074
min18520.904-18520.789=0.115
max18521.896-18521.901=-0.005
mean8400.000
σ0.000
min8400.000
max8400.000
mean2851.000-2846.000=5.000
σ0.000
min2851.000-2846.000=5.000
max2851.000-2846.000=5.000
mean29.104-29.388=-0.284
σ0.432-0.443=-0.011
min28.806-28.964=-0.157
max29.729-29.803=-0.075