Compare commits

Home / Compare 3f4a2315 .. 9ee898f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.565=-0.001
σ0.047-0.046=0.001
min70.536-70.539=-0.004
max70.695-70.691=0.004
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.157-0.156=0.001
σ0.005-0.006=-0.000
min0.149-0.147=0.002
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.003-0.002=0.001
min21.284-21.285=-0.000
max21.294-21.291=0.003
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.065-0.064=0.001
σ0.003-0.002=0.000
min0.063-0.063=0.000
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.570=-0.396
σ0.361-0.360=0.001
min1752.606-1752.999=-0.394
max1753.760-1754.147=-0.387
mean1670.900-1660.450=10.450
σ630.998-643.360=-12.362
min669.000-685.000=-16.000
max2776.000-2757.000=19.000
mean2.873-2.835=0.038
σ0.093-0.107=-0.014
min2.631-2.628=0.003
max3.050-3.002=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.619-272.017=-0.398
σ0.008-0.004=0.004
min271.609-272.012=-0.403
max271.628-272.021=-0.393
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean0.372-0.390=-0.018
σ0.006-0.009=-0.004
min0.369-0.379=-0.011
max0.382-0.403=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.049-1932.436=-0.387
σ0.013-0.019=-0.006
min1932.039-1932.412=-0.373
max1932.069-1932.462=-0.393
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean2.917-2.910=0.006
σ0.267-0.293=-0.026
min2.455-2.392=0.062
max3.113-3.103=0.010
iters=5
new-facts=6402
prior-facts=1
mean4752.541-4753.027=-0.486
σ0.663-0.615=0.048
min4751.941-4752.677=-0.736
max4753.677-4754.124=-0.447
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean8.429-8.752=-0.323
σ0.543-0.188=0.355
min7.563-8.576=-1.013
max8.957-9.041=-0.085
iters=5
new-facts=6402
prior-facts=6402
mean4943.168-4943.634=-0.467
σ0.149-0.019=0.130
min4942.902-4943.617=-0.715
max4943.256-4943.658=-0.402
mean3007.800-2987.000=20.800
σ229.352-218.754=10.597
min2776.000-2757.000=19.000
max3339.000-3303.000=36.000
mean8.556-8.523=0.033
σ0.256-0.114=0.143
min8.389-8.376=0.013
max9.002-8.648=0.355

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087-1.074=0.013
σ0.270-0.225=0.045
min0.933-0.944=-0.012
max1.559-1.465=0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.315-473.112=-0.797
σ575.926-575.947=-0.020
min184.347-185.131=-0.783
max1336.205-1337.032=-0.827
mean88.250
σ8.500
min84.000
max101.000
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean0.526-0.561=-0.035
σ0.362-0.542=-0.181
min0.289-0.289=0.000
max1.056-1.375=-0.319
policies=20
mean1843.818-1851.647=-7.830
σ0.372-0.380=-0.008
min1843.576-1851.386=-7.810
max1844.366-1852.209=-7.843
mean840.000
σ0.000
min840.000
max840.000
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean2.867-2.866=0.002
σ0.032-0.015=0.017
min2.830-2.845=-0.016
max2.897-2.881=0.016
policies=200
mean18444.531-18523.510=-78.979
σ0.572-0.544=0.028
min18444.170-18523.122=-78.951
max18445.378-18524.306=-78.928
mean8400.000
σ0.000
min8400.000
max8400.000
mean2776.000-2757.000=19.000
σ0.000
min2776.000-2757.000=19.000
max2776.000-2757.000=19.000
mean28.955-28.861=0.093
σ0.108-0.084=0.025
min28.867-28.764=0.103
max29.091-28.935=0.156