Compare commits

Home / Compare 0023652c .. b46de35e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.479-34.479=-0.000
σ0.373-0.370=0.002
min34.346-34.340=0.006
max35.539-35.533=0.007
mean414.000
σ0.000
min414.000
max414.000
mean0.084-0.085=-0.001
σ0.003-0.003=-0.001
min0.082-0.082=-0.000
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean22.808-22.809=-0.001
σ0.003-0.003=-0.000
min22.803-22.802=0.001
max22.812-22.813=-0.002
mean415.000-414.000=1.000
σ1.054-0.000=1.054
min414.000
max416.000-414.000=2.000
mean0.064-0.066=-0.002
σ0.004-0.002=0.001
min0.059-0.064=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1733.273-1733.275=-0.003
σ1.034-1.034=-0.001
min1732.455-1732.461=-0.006
max1737.415-1737.420=-0.005
mean1643.650-1663.900=-20.250
σ621.825-647.772=-25.947
min677.000-649.000=28.000
max2837.000-2832.000=5.000
mean2.532-2.571=-0.039
σ0.263-0.323=-0.059
min2.245-2.253=-0.009
max2.988-3.183=-0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean292.429-292.422=0.007
σ0.013-0.022=-0.010
min292.407-292.383=0.023
max292.441-292.438=0.003
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean0.398-0.398=-0.000
σ0.002-0.001=0.001
min0.395-0.397=-0.002
max0.401-0.399=0.002
iters=5
new-facts=1
prior-facts=6402
mean1952.972-1952.958=0.014
σ0.019-0.021=-0.002
min1952.939-1952.933=0.005
max1952.988-1952.981=0.007
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean2.633-2.617=0.016
σ0.088-0.095=-0.007
min2.561-2.531=0.030
max2.743-2.763=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4778.878-4778.919=-0.041
σ7.634-7.621=0.013
min4775.302-4775.299=0.003
max4792.531-4792.550=-0.018
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean8.684-8.499=0.185
σ0.453-0.543=-0.091
min7.979-7.905=0.074
max9.234-9.137=0.097
iters=5
new-facts=6402
prior-facts=6402
mean4966.373-4966.443=-0.070
σ0.208-0.094=0.114
min4966.030-4966.371=-0.341
max4966.543-4966.546=-0.003
mean3038.600-3003.800=34.800
σ204.071-191.224=12.846
min2837.000-2832.000=5.000
max3317.000-3297.000=20.000
mean8.596-8.532=0.065
σ0.254-0.126=0.127
min8.369-8.355=0.014
max9.008-8.697=0.312

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.968-0.993=-0.025
σ0.140-0.138=0.002
min0.899-0.903=-0.004
max1.218-1.221=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean435.890-435.895=-0.005
σ572.824-572.820=0.004
min149.476-149.470=0.006
max1295.126-1295.125=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean0.407-0.405=0.002
σ0.305-0.292=0.013
min0.244-0.256=-0.012
max0.864-0.842=0.021
policies=20
mean1494.986-1494.986=-0.001
σ0.258-0.254=0.004
min1494.804-1494.815=-0.011
max1495.366-1495.361=0.005
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean2.577-2.576=0.001
σ0.005-0.008=-0.003
min2.570-2.568=0.003
max2.581-2.587=-0.006
policies=200
mean14957.163-14957.054=0.110
σ0.426-0.464=-0.039
min14956.911-14956.658=0.253
max14957.800-14957.704=0.096
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2832.000=5.000
σ0.000
min2837.000-2832.000=5.000
max2837.000-2832.000=5.000
mean25.558-25.562=-0.003
σ0.449-0.448=0.001
min25.162-25.138=0.024
max26.030-25.998=0.032