Compare commits

Home / Compare 8e7f5d6b .. 6f555844

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.045-0.049=-0.004
min70.362-70.357=0.005
max70.516-70.525=-0.009
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.158=0.002
σ0.004-0.006=-0.003
min0.156-0.149=0.007
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.003=-0.001
min21.141-21.142=-0.001
max21.147-21.149=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.064=0.000
σ0.003-0.002=0.000
min0.063-0.062=0.001
max0.071-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.391-1752.392=-0.001
σ0.364-0.361=0.003
min1751.830-1751.826=0.004
max1752.969-1752.977=-0.008
mean1648.400-1660.250=-11.850
σ628.254-634.494=-6.240
min636.000-617.000=19.000
max2849.000-2775.000=74.000
mean2.797-2.779=0.017
σ0.136-0.161=-0.024
min2.457-2.235=0.222
max3.036-2.977=0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.240-270.236=0.003
σ0.009-0.011=-0.001
min270.229-270.221=0.008
max270.254-270.250=0.004
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean0.385-0.375=0.010
σ0.010-0.004=0.006
min0.373-0.368=0.005
max0.398-0.378=0.020
iters=5
new-facts=1
prior-facts=6402
mean1930.705-1930.704=0.001
σ0.012-0.011=0.001
min1930.692-1930.692=-0.001
max1930.723-1930.717=0.006
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean2.507-2.504=0.002
σ0.066-0.120=-0.054
min2.448-2.382=0.066
max2.597-2.681=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4751.401-4751.210=0.191
σ0.911-0.733=0.178
min4750.892-4750.618=0.274
max4753.020-4752.484=0.536
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean8.590-8.529=0.061
σ0.415-0.381=0.035
min8.012-7.988=0.024
max9.019-9.052=-0.034
iters=5
new-facts=6402
prior-facts=6402
mean4941.801-4941.796=0.005
σ0.159-0.158=0.001
min4941.518-4941.516=0.002
max4941.889-4941.892=-0.003
mean3069.800-3021.400=48.400
σ233.967-237.904=-3.937
min2849.000-2775.000=74.000
max3411.000-3337.000=74.000
mean8.670-8.575=0.095
σ0.487-0.238=0.249
min8.338-8.351=-0.014
max9.515-8.860=0.655

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.012=0.042
σ0.130-0.136=-0.006
min0.938-0.913=0.026
max1.256-1.233=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.376-466.376=0.001
σ575.924-575.927=-0.003
min178.410-178.405=0.005
max1330.262-1330.266=-0.004
mean84.250
σ8.500
min80.000
max97.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean0.426-0.431=-0.005
σ0.276-0.310=-0.034
min0.286-0.255=0.030
max0.840-0.896=-0.055
policies=20
mean1784.386-1784.351=0.035
σ0.374-0.337=0.037
min1784.124-1784.100=0.024
max1784.939-1784.848=0.091
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean2.857-2.843=0.015
σ0.005-0.104=-0.099
min2.852-2.763=0.089
max2.862-2.986=-0.124
policies=200
mean17849.912-17849.856=0.055
σ0.490-0.507=-0.017
min17849.611-17849.488=0.123
max17850.645-17850.607=0.038
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean28.344-27.914=0.430
σ0.513-0.132=0.381
min27.776-27.818=-0.042
max28.817-28.109=0.708