Compare commits

Home / Compare 0f702960 .. da59a517

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.381=0.007
σ0.049-0.047=0.002
min70.358-70.353=0.005
max70.523-70.511=0.012
mean411.600-412.000=-0.400
σ0.516-0.000=0.516
min411.000-412.000=-1.000
max412.000
mean0.160-0.159=0.001
σ0.007-0.003=0.004
min0.151-0.155=-0.004
max0.174-0.165=0.009
cache=y
dps=1
iters=10
policies=100
mean21.146-21.144=0.002
σ0.002-0.003=-0.001
min21.142-21.140=0.002
max21.149-21.147=0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.063-0.062=0.001
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.385=0.008
σ0.360-0.361=-0.001
min1751.823-1751.820=0.003
max1752.976-1752.969=0.007
mean1651.650-1651.950=-0.300
σ617.301-625.293=-7.992
min634.000-628.000=6.000
max2491.000-2768.000=-277.000
mean2.824-2.748=0.076
σ0.141-0.178=-0.037
min2.429-2.345=0.084
max2.998-2.937=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.124=0.020
σ0.006-0.004=0.002
min270.139-270.120=0.019
max270.151-270.130=0.021
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean0.381-0.374=0.008
σ0.006-0.003=0.003
min0.374-0.371=0.002
max0.390-0.379=0.011
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.593=0.015
σ0.004-0.010=-0.006
min1930.605-1930.579=0.026
max1930.615-1930.606=0.008
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean2.567-2.457=0.110
σ0.165-0.049=0.116
min2.444-2.387=0.058
max2.855-2.503=0.353
iters=5
new-facts=6402
prior-facts=1
mean4751.273-4751.055=0.218
σ0.958-0.865=0.093
min4750.750-4750.534=0.217
max4752.983-4752.595=0.388
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean8.849-8.647=0.202
σ0.270-0.581=-0.311
min8.565-7.639=0.926
max9.279-9.012=0.268
iters=5
new-facts=6402
prior-facts=6402
mean4941.564-4941.524=0.041
σ0.308-0.098=0.210
min4941.092-4941.422=-0.330
max4941.781-4941.631=0.150
mean3034.000
σ324.895-248.925=75.971
min2589.000-2768.000=-179.000
max3341.000-3373.000=-32.000
mean8.691-8.460=0.231
σ0.163-0.151=0.012
min8.447-8.320=0.127
max8.895-8.686=0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.750-1.018=0.732
σ0.158-0.133=0.025
min1.521-0.930=0.591
max1.893-1.235=0.658

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.358=0.005
σ575.921-575.919=0.002
min178.399-178.392=0.007
max1330.244-1330.236=0.008
mean84.000
σ8.000
min80.000
max96.000
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean0.580-0.444=0.137
σ0.587-0.306=0.282
min0.282-0.288=-0.006
max1.461-0.902=0.559
policies=20
mean1784.312-1784.247=0.065
σ0.362-0.363=-0.000
min1784.074-1784.004=0.070
max1784.850-1784.783=0.067
mean800.000
σ0.000
min800.000
max800.000
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean2.788-2.845=-0.057
σ0.010-0.095=-0.085
min2.779-2.760=0.019
max2.800-2.974=-0.174
policies=200
mean17849.880-17848.785=1.095
σ0.466-0.496=-0.030
min17849.511-17848.384=1.127
max17850.562-17849.502=1.061
mean8000.000
σ0.000
min8000.000
max8000.000
mean2491.000-2768.000=-277.000
σ0.000
min2491.000-2768.000=-277.000
max2491.000-2768.000=-277.000
mean28.082-28.006=0.076
σ0.159-0.201=-0.042
min27.882-27.831=0.051
max28.267-28.213=0.054