Compare commits

Home / Compare b017af50 .. 1fc41354

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.567=-0.003
σ0.046-0.045=0.001
min70.540-70.541=-0.001
max70.691-70.690=0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.161-0.160=0.001
σ0.003-0.003=-0.000
min0.157-0.154=0.003
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.002-0.003=-0.000
min21.284-21.285=-0.001
max21.292-21.292=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.002
min0.058-0.063=-0.005
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.568=-0.000
σ0.364-0.361=0.003
min1753.001-1752.997=0.004
max1754.150-1754.152=-0.002
mean1645.600-1658.550=-12.950
σ623.103-647.667=-24.563
min698.000-627.000=71.000
max2842.000-2908.000=-66.000
mean2.865-2.759=0.106
σ0.115-0.166=-0.052
min2.660-2.371=0.289
max3.199-3.009=0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.018=0.001
σ0.008-0.005=0.003
min272.010-272.013=-0.002
max272.030-272.025=0.005
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean0.390-0.388=0.002
σ0.008-0.010=-0.001
min0.380-0.378=0.002
max0.397-0.400=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.437=0.001
σ0.007-0.010=-0.002
min1932.426-1932.421=0.006
max1932.447-1932.446=0.001
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean3.033-3.000=0.033
σ0.077-0.078=-0.002
min2.935-2.938=-0.002
max3.125-3.135=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4753.057-4753.054=0.002
σ0.951-0.955=-0.004
min4752.152-4752.087=0.065
max4754.672-4754.653=0.019
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean8.502-8.499=0.004
σ0.516-0.587=-0.071
min7.644-7.607=0.037
max8.947-9.121=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.417=0.141
σ0.148-0.309=-0.161
min4943.294-4942.938=0.355
max4943.645-4943.662=-0.018
mean3062.000-3099.600=-37.600
σ214.564-212.359=2.205
min2842.000-2908.000=-66.000
max3332.000-3424.000=-92.000
mean8.577-8.617=-0.041
σ0.124-0.223=-0.100
min8.481-8.394=0.087
max8.785-8.951=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.085=-0.071
σ0.127-0.178=-0.051
min0.926-0.912=0.014
max1.215-1.288=-0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.084-473.085=-0.001
σ575.915-575.921=-0.005
min185.120-185.115=0.004
max1336.957-1336.966=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean0.489-0.451=0.038
σ0.375-0.303=0.071
min0.300-0.298=0.002
max1.051-0.906=0.145
policies=20
mean1851.475-1851.468=0.007
σ0.395-0.378=0.016
min1851.173-1851.190=-0.017
max1852.043-1852.019=0.024
mean840.000
σ0.000
min840.000
max840.000
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean2.963-2.943=0.020
σ0.005-0.002=0.003
min2.956-2.941=0.015
max2.966-2.945=0.021
policies=200
mean18521.159-18521.128=0.031
σ0.422-0.521=-0.100
min18520.791-18520.716=0.074
max18521.764-18521.891=-0.127
mean8400.000
σ0.000
min8400.000
max8400.000
mean2842.000-2908.000=-66.000
σ0.000
min2842.000-2908.000=-66.000
max2842.000-2908.000=-66.000
mean29.159-29.231=-0.072
σ0.590-0.510=0.080
min28.783-28.759=0.024
max30.038-29.749=0.289