Compare commits

Home / Compare 73fb7b1c .. dd6adf4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.001
σ0.046-0.048=-0.003
min70.540-70.537=0.003
max70.691-70.700=-0.009
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.158-0.160=-0.003
σ0.004-0.002=0.002
min0.150-0.157=-0.007
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.001
σ0.003-0.003=-0.001
min21.283-21.283=0.001
max21.291-21.294=-0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.058-0.063=-0.005
max0.065-0.070=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.374=0.002
σ0.361-0.361=0.001
min1752.806-1752.805=0.000
max1753.954-1753.962=-0.008
mean1650.850-1655.050=-4.200
σ644.170-646.161=-1.991
min633.000
max2887.000-2900.000=-13.000
mean2.776-2.740=0.035
σ0.210-0.189=0.022
min2.256-2.305=-0.050
max2.995-3.004=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.757=-0.002
σ0.006-0.007=-0.001
min271.745-271.748=-0.003
max271.760-271.764=-0.004
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean0.385-0.383=0.002
σ0.006-0.004=0.002
min0.382-0.379=0.003
max0.395-0.389=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.182=-0.001
σ0.012-0.015=-0.003
min1932.161-1932.166=-0.005
max1932.190-1932.204=-0.015
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean3.024-3.153=-0.129
σ0.126-0.175=-0.049
min2.884-2.991=-0.107
max3.190-3.404=-0.214
iters=5
new-facts=6402
prior-facts=1
mean4752.817-4752.964=-0.147
σ0.921-0.873=0.049
min4752.125-4752.421=-0.296
max4754.438-4754.516=-0.078
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean8.456-8.238=0.218
σ0.412-0.458=-0.046
min7.764-7.710=0.054
max8.857-8.912=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean4943.375-4943.238=0.137
σ0.011-0.203=-0.193
min4943.361-4942.995=0.366
max4943.387-4943.406=-0.018
mean3085.600-3059.600=26.000
σ213.458-241.098=-27.640
min2887.000-2900.000=-13.000
max3402.000-3443.000=-41.000
mean8.516-8.458=0.058
σ0.098-0.124=-0.025
min8.404-8.302=0.102
max8.647-8.616=0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.026=0.004
σ0.138-0.135=0.002
min0.940-0.936=0.004
max1.256-1.246=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.855-472.855=-0.001
σ575.916-575.923=-0.007
min184.888-184.893=-0.005
max1336.728-1336.740=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean0.449-0.453=-0.004
σ0.303-0.305=-0.003
min0.290-0.297=-0.007
max0.903-0.911=-0.008
policies=20
mean1849.203-1849.234=-0.031
σ0.369-0.369=0.000
min1848.930-1848.963=-0.033
max1849.741-1849.769=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean2.943-2.952=-0.009
σ0.007-0.004=0.004
min2.933-2.948=-0.015
max2.950-2.957=-0.007
policies=200
mean18498.742-18498.742=0.001
σ0.509-0.327=0.182
min18498.432-18498.495=-0.063
max18499.503-18499.221=0.282
mean8400.000
σ0.000
min8400.000
max8400.000
mean2887.000-2900.000=-13.000
σ0.000
min2887.000-2900.000=-13.000
max2887.000-2900.000=-13.000
mean29.268-29.260=0.008
σ0.441-0.457=-0.016
min28.856-28.856=-0.001
max29.769-29.758=0.010