Compare commits

Home / Compare 476bd1c6 .. bb8762bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.047-0.046=0.000
min70.538-70.542=-0.004
max70.694-70.692=0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.159-0.159=-0.000
σ0.003-0.003=-0.000
min0.157-0.156=0.001
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.290-21.291=-0.000
σ0.010-0.011=-0.001
min21.284-21.283=0.001
max21.318-21.322=-0.004
mean412.000
σ0.000
min412.000
max412.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.376=-0.001
σ0.362-0.360=0.002
min1752.803-1752.803=0.000
max1753.976-1753.960=0.016
mean1658.250-1647.550=10.700
σ636.227-641.129=-4.902
min683.000-630.000=53.000
max2782.000-2873.000=-91.000
mean2.832-2.873=-0.041
σ0.163-0.092=0.071
min2.462-2.714=-0.252
max3.184-3.028=0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.760=-0.004
σ0.008-0.010=-0.002
min271.746-271.751=-0.005
max271.767-271.776=-0.009
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean0.381-0.382=-0.001
σ0.007-0.007=-0.000
min0.372-0.375=-0.003
max0.391-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.175=-0.003
σ0.017-0.002=0.015
min1932.149-1932.173=-0.024
max1932.190-1932.177=0.013
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean2.973-3.063=-0.090
σ0.118-0.115=0.003
min2.800-2.963=-0.163
max3.113-3.229=-0.116
iters=5
new-facts=6402
prior-facts=1
mean4752.875-4752.819=0.056
σ0.924-0.905=0.019
min4752.413-4752.136=0.277
max4754.526-4754.409=0.117
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean8.882-8.346=0.536
σ0.310-0.445=-0.136
min8.444-7.611=0.833
max9.215-8.823=0.392
iters=5
new-facts=6402
prior-facts=6402
mean4943.304-4943.243=0.060
σ0.168-0.191=-0.023
min4943.004-4943.024=-0.020
max4943.399-4943.395=0.005
mean3004.000-3054.400=-50.400
σ288.147-185.461=102.686
min2782.000-2873.000=-91.000
max3460.000-3324.000=136.000
mean8.384-8.490=-0.106
σ0.073-0.106=-0.033
min8.326-8.365=-0.039
max8.504-8.632=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-1.073=0.002
σ0.175-0.112=0.063
min0.935-0.929=0.005
max1.364-1.243=0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-467.858=-0.001
σ575.928-575.927=0.001
min179.884-179.882=0.002
max1331.749-1331.748=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean0.475-0.446=0.029
σ0.391-0.305=0.085
min0.279-0.292=-0.013
max1.061-0.904=0.157
policies=20
mean1799.136-1799.168=-0.032
σ0.379-0.385=-0.007
min1798.849-1798.895=-0.046
max1799.694-1799.734=-0.041
mean820.000
σ0.000
min820.000
max820.000
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean2.793-2.889=-0.096
σ0.016-0.050=-0.033
min2.769-2.843=-0.073
max2.807-2.959=-0.152
policies=200
mean17998.424-17998.489=-0.066
σ0.528-0.491=0.037
min17998.036-17998.186=-0.150
max17999.196-17999.222=-0.026
mean8200.000
σ0.000
min8200.000
max8200.000
mean2782.000-2873.000=-91.000
σ0.000
min2782.000-2873.000=-91.000
max2782.000-2873.000=-91.000
mean28.066-28.437=-0.371
σ0.094-0.469=-0.375
min27.970-28.023=-0.053
max28.193-29.029=-0.836