Compare commits

Home / Compare a2af9936 .. 036d0a5b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.005
σ0.045-0.046=-0.000
min70.542-70.542=0.000
max70.693-70.691=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.160-0.160=0.000
σ0.003-0.003=0.001
min0.156-0.157=-0.000
max0.166-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.003
σ0.004-0.010=-0.006
min21.282-21.284=-0.002
max21.294-21.318=-0.023
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.062=0.004
σ0.002-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=-0.000
σ0.362-0.361=0.001
min1752.804-1752.805=-0.001
max1753.976-1753.968=0.008
mean1650.350-1662.100=-11.750
σ647.345-630.582=16.763
min632.000-680.000=-48.000
max2896.000-2662.000=234.000
mean2.765-2.810=-0.045
σ0.144-0.201=-0.058
min2.492-2.271=0.220
max2.961-3.032=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.753=0.004
σ0.004-0.005=-0.001
min271.752-271.748=0.004
max271.763-271.761=0.002
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean0.382-0.385=-0.003
σ0.005-0.012=-0.007
min0.377-0.376=0.001
max0.390-0.404=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.189=-0.009
σ0.011-0.013=-0.002
min1932.163-1932.176=-0.013
max1932.193-1932.210=-0.017
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean2.938-2.861=0.077
σ0.181-0.282=-0.101
min2.629-2.453=0.176
max3.107-3.099=0.009
iters=5
new-facts=6402
prior-facts=1
mean4752.928-4752.923=0.006
σ0.840-0.882=-0.042
min4752.430-4752.467=-0.037
max4754.422-4754.493=-0.071
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean8.404-8.505=-0.101
σ0.460-0.483=-0.023
min7.666-7.645=0.021
max8.938-8.761=0.176
iters=5
new-facts=6402
prior-facts=6402
mean4943.302-4943.377=-0.075
σ0.182-0.012=0.170
min4942.978-4943.363=-0.385
max4943.395-4943.392=0.002
mean3079.000-2971.000=108.000
σ200.821-252.600=-51.780
min2896.000-2662.000=234.000
max3383.000-3315.000=68.000
mean8.577-8.548=0.029
σ0.112-0.141=-0.029
min8.463-8.410=0.053
max8.701-8.781=-0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.120-1.118=0.002
σ0.199-0.267=-0.068
min0.928-0.927=0.001
max1.363-1.515=-0.152

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.861-467.863=4.998
σ575.925-575.948=-0.023
min184.886-179.884=5.002
max1336.749-1331.785=4.963
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean0.488-0.569=-0.081
σ0.378-0.569=-0.191
min0.298-0.283=0.015
max1.055-1.423=-0.368
policies=20
mean1849.223-1799.127=50.096
σ0.372-0.365=0.007
min1848.942-1798.897=50.045
max1849.763-1799.671=50.092
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean2.950-2.795=0.155
σ0.013-0.014=-0.001
min2.936-2.777=0.159
max2.966-2.809=0.157
policies=200
mean18498.664-17998.402=500.262
σ0.539-0.464=0.075
min18498.192-17998.088=500.103
max18499.424-17999.087=500.336
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2896.000-2662.000=234.000
σ0.000
min2896.000-2662.000=234.000
max2896.000-2662.000=234.000
mean29.181-28.131=1.050
σ0.501-0.113=0.388
min28.745-28.036=0.709
max29.662-28.284=1.378