Compare commits

Home / Compare deb85f4e .. 383b75c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.780=0.002
σ0.045-0.044=0.001
min70.752-70.750=0.002
max70.906-70.902=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.160-0.157=0.004
σ0.004-0.005=-0.001
min0.156-0.149=0.008
max0.169-0.166=0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.003=-0.000
min21.488-21.488=0.000
max21.496-21.497=-0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.061-0.065=-0.005
σ0.002-0.002=-0.000
min0.059-0.062=-0.003
max0.067-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.001
σ0.361-0.363=-0.002
min1753.526-1753.528=-0.002
max1754.678-1754.676=0.001
mean1665.950-1670.250=-4.300
σ631.207-638.892=-7.686
min675.000-672.000=3.000
max2705.000-2734.000=-29.000
mean2.852-2.822=0.030
σ0.137-0.177=-0.040
min2.566-2.264=0.302
max3.137-3.032=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.928-271.956=-0.028
σ0.006-0.007=-0.001
min271.920-271.947=-0.027
max271.935-271.966=-0.031
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean0.378-0.385=-0.007
σ0.001-0.007=-0.006
min0.376-0.381=-0.005
max0.380-0.398=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1932.331=-0.007
σ0.006-0.013=-0.007
min1932.317-1932.313=0.004
max1932.332-1932.347=-0.016
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean3.060-2.946=0.114
σ0.065-0.286=-0.221
min3.005-2.449=0.557
max3.152-3.173=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4752.988-4752.979=0.009
σ0.923-1.009=-0.086
min4752.150-4752.048=0.101
max4754.569-4754.701=-0.132
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean8.386-8.621=-0.235
σ0.466-0.369=0.097
min7.608-8.013=-0.406
max8.848-8.926=-0.077
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.556=-0.067
σ0.172-0.014=0.158
min4943.182-4943.537=-0.355
max4943.578-4943.570=0.008
mean3007.400-3041.200=-33.800
σ241.663-224.355=17.307
min2705.000-2734.000=-29.000
max3291.000-3328.000=-37.000
mean8.537-8.486=0.051
σ0.154-0.126=0.028
min8.385-8.338=0.047
max8.722-8.631=0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.056=0.037
σ0.225-0.132=0.093
min0.931-0.938=-0.007
max1.417-1.262=0.155

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.659-468.666=-0.007
σ574.936-574.934=0.002
min181.187-181.190=-0.003
max1331.063-1331.067=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean0.560-0.585=-0.025
σ0.539-0.588=-0.048
min0.287-0.287=-0.000
max1.369-1.466=-0.098
policies=20
mean1812.187-1812.213=-0.026
σ0.392-0.388=0.004
min1811.930-1811.945=-0.015
max1812.767-1812.785=-0.018
mean840.000
σ0.000
min840.000
max840.000
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean2.832-2.843=-0.011
σ0.013-0.021=-0.008
min2.821-2.817=0.004
max2.851-2.863=-0.012
policies=200
mean18129.035-18129.228=-0.194
σ0.441-0.437=0.004
min18128.727-18128.941=-0.214
max18129.668-18129.880=-0.211
mean8400.000
σ0.000
min8400.000
max8400.000
mean2705.000-2734.000=-29.000
σ0.000
min2705.000-2734.000=-29.000
max2705.000-2734.000=-29.000
mean28.497-28.664=-0.167
σ0.058-0.042=0.016
min28.435-28.618=-0.184
max28.548-28.718=-0.170