Compare commits

Home / Compare 650f34be .. c4d96b97

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.564=0.002
σ0.047-0.045=0.002
min70.535-70.542=-0.007
max70.696-70.691=0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.160-0.161=-0.001
σ0.004-0.004=0.000
min0.155-0.157=-0.002
max0.167-0.169=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.291=-0.002
σ0.002-0.012=-0.009
min21.284-21.283=0.001
max21.293-21.323=-0.031
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.064=-0.001
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=0.000
σ0.359-0.360=-0.000
min1752.999-1752.997=0.002
max1754.141-1754.148=-0.007
mean1653.300-1666.050=-12.750
σ642.857-643.523=-0.667
min628.000-690.000=-62.000
max2885.000-2762.000=123.000
mean2.840-2.842=-0.002
σ0.113-0.133=-0.019
min2.594-2.474=0.121
max3.024-3.012=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.991-272.017=-0.026
σ0.003-0.008=-0.005
min271.989-272.006=-0.018
max271.995-272.026=-0.030
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean0.395-0.388=0.006
σ0.004-0.012=-0.008
min0.391-0.375=0.016
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.427-1932.442=-0.015
σ0.007-0.005=0.002
min1932.418-1932.438=-0.020
max1932.435-1932.451=-0.015
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean2.982-2.919=0.063
σ0.080-0.077=0.003
min2.904-2.826=0.078
max3.099-2.987=0.112
iters=5
new-facts=6402
prior-facts=1
mean4753.046-4753.051=-0.005
σ0.619-0.923=-0.304
min4752.680-4752.277=0.403
max4754.143-4754.652=-0.509
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean8.494-8.544=-0.049
σ0.449-0.311=0.138
min7.908-8.274=-0.366
max9.036-9.045=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean4943.632-4943.633=-0.001
σ0.022-0.014=0.008
min4943.611-4943.619=-0.008
max4943.660-4943.651=0.009
mean3040.200-3031.600=8.600
σ183.072-239.479=-56.408
min2885.000-2762.000=123.000
max3333.000-3336.000=-3.000
mean8.510-8.848=-0.339
σ0.096-0.588=-0.492
min8.374-8.409=-0.035
max8.643-9.865=-1.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.014=0.012
σ0.141-0.126=0.015
min0.933-0.928=0.005
max1.256-1.219=0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.092=-0.012
σ575.913-575.937=-0.024
min185.115-185.118=-0.003
max1336.951-1336.998=-0.048
mean88.250
σ8.500
min84.000
max101.000
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean0.486-0.560=-0.074
σ0.376-0.541=-0.165
min0.295-0.287=0.008
max1.049-1.371=-0.321
policies=20
mean1851.471-1851.441=0.030
σ0.364-0.383=-0.019
min1851.205-1851.181=0.024
max1852.002-1852.007=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean2.946-2.864=0.081
σ0.010-0.010=-0.000
min2.933-2.854=0.078
max2.955-2.874=0.081
policies=200
mean18521.196-18521.054=0.142
σ0.479-0.568=-0.089
min18520.896-18520.715=0.181
max18521.911-18521.904=0.006
mean8400.000
σ0.000
min8400.000
max8400.000
mean2885.000-2762.000=123.000
σ0.000
min2885.000-2762.000=123.000
max2885.000-2762.000=123.000
mean29.226-28.788=0.438
σ0.480-0.108=0.371
min28.811-28.674=0.138
max29.724-28.916=0.808