Compare commits

Home / Compare d8bae745 .. cdef4cee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.566=-0.003
σ0.045-0.044=0.001
min70.537-70.542=-0.005
max70.690-70.687=0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.161-0.161=0.000
σ0.003-0.004=-0.001
min0.158-0.154=0.005
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.002-0.003=-0.000
min21.285-21.282=0.003
max21.292-21.291=0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.066-0.061=0.005
σ0.002-0.004=-0.001
min0.064-0.058=0.006
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.172-1753.176=-0.004
σ0.360-0.360=-0.000
min1752.601-1752.608=-0.007
max1753.754-1753.760=-0.006
mean1666.900-1660.950=5.950
σ625.657-625.614=0.043
min673.000-669.000=4.000
max2677.000-2673.000=4.000
mean2.807-2.892=-0.085
σ0.196-0.163=0.033
min2.191-2.561=-0.369
max3.043-3.135=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.621-271.618=0.003
σ0.007-0.007=-0.000
min271.614-271.608=0.007
max271.633-271.626=0.006
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean0.386-0.384=0.002
σ0.007-0.007=-0.000
min0.381-0.379=0.002
max0.394-0.396=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.049-1932.044=0.005
σ0.009-0.010=-0.001
min1932.036-1932.031=0.005
max1932.062-1932.057=0.005
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean3.069-3.013=0.056
σ0.083-0.148=-0.066
min2.990-2.815=0.175
max3.160-3.204=-0.043
iters=5
new-facts=6402
prior-facts=1
mean4752.851-4752.849=0.003
σ0.819-0.834=-0.015
min4752.401-4752.368=0.032
max4754.314-4754.337=-0.023
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean7.970-7.962=0.008
σ0.369-0.426=-0.057
min7.668-7.723=-0.054
max8.608-8.715=-0.108
iters=5
new-facts=6402
prior-facts=6402
mean4943.098-4943.238=-0.140
σ0.328-0.009=0.319
min4942.511-4943.225=-0.714
max4943.261-4943.249=0.013
mean2969.800-3010.800=-41.000
σ316.721-384.584=-67.863
min2677.000-2673.000=4.000
max3426.000-3562.000=-136.000
mean8.574-8.452=0.121
σ0.138-0.114=0.025
min8.399-8.348=0.051
max8.735-8.603=0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.145=0.031
σ0.318-0.245=0.073
min0.931-0.934=-0.003
max1.693-1.520=0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.294-472.295=-0.001
σ575.937-575.938=-0.001
min184.319-184.323=-0.004
max1336.199-1336.202=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean0.588-0.573=0.015
σ0.607-0.569=0.039
min0.281-0.286=-0.005
max1.500-1.426=0.074
policies=20
mean1843.527-1843.545=-0.018
σ0.378-0.373=0.006
min1843.264-1843.294=-0.030
max1844.085-1844.096=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean2.896-2.896=-0.000
σ0.054-0.034=0.020
min2.862-2.855=0.007
max2.976-2.929=0.046
policies=200
mean18442.196-18442.099=0.097
σ0.519-0.444=0.074
min18441.821-18441.822=-0.001
max18442.963-18442.759=0.204
mean8400.000
σ0.000
min8400.000
max8400.000
mean2677.000-2673.000=4.000
σ0.000
min2677.000-2673.000=4.000
max2677.000-2673.000=4.000
mean29.054-29.024=0.030
σ0.167-0.124=0.042
min28.899-28.856=0.043
max29.236-29.121=0.116