Compare commits

Home / Compare 5407b83f .. 31428e8f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.046-0.045=0.000
min70.537-70.537=0.000
max70.691-70.690=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.159-0.159=-0.000
σ0.003-0.003=-0.000
min0.156-0.154=0.001
max0.164-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.286=0.001
σ0.003-0.002=0.001
min21.284-21.283=0.001
max21.292-21.291=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.062-0.060=0.002
σ0.004-0.003=0.001
min0.058-0.058=-0.000
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.377=-0.003
σ0.362-0.361=0.001
min1752.809-1752.803=0.005
max1753.957-1753.956=0.000
mean1650.000-1663.300=-13.300
σ640.124-633.864=6.260
min651.000-616.000=35.000
max2846.000-2766.000=80.000
mean2.860-2.801=0.059
σ0.180-0.168=0.013
min2.581-2.265=0.316
max3.493-3.064=0.429

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.753=0.005
σ0.005-0.005=0.001
min271.751-271.747=0.003
max271.764-271.760=0.004
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean0.380-0.378=0.002
σ0.006-0.002=0.004
min0.375-0.375=0.000
max0.391-0.381=0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.179=-0.002
σ0.006-0.011=-0.005
min1932.167-1932.165=0.002
max1932.182-1932.196=-0.013
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean3.065-2.982=0.083
σ0.104-0.186=-0.082
min2.968-2.764=0.204
max3.197-3.266=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4752.944-4752.913=0.031
σ0.896-0.849=0.047
min4752.375-4752.414=-0.038
max4754.536-4754.421=0.116
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean8.383-8.441=-0.058
σ0.379-0.518=-0.140
min8.048-7.610=0.437
max9.034-8.947=0.088
iters=5
new-facts=6402
prior-facts=6402
mean4943.376-4943.381=-0.005
σ0.021-0.015=0.007
min4943.346-4943.361=-0.015
max4943.396-4943.396=-0.001
mean3061.600-3046.600=15.000
σ231.380-242.591=-11.211
min2846.000-2766.000=80.000
max3404.000-3395.000=9.000
mean8.699-8.807=-0.108
σ0.176-0.254=-0.079
min8.486-8.468=0.018
max8.968-9.181=-0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-0.995=0.196
σ0.223-0.136=0.087
min0.946-0.931=0.014
max1.478-1.239=0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.857=0.006
σ575.939-575.928=0.011
min179.889-179.888=0.000
max1331.771-1331.749=0.022
mean86.250
σ8.500
min82.000
max99.000
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean0.445-0.440=0.005
σ0.313-0.307=0.005
min0.286-0.281=0.005
max0.914-0.901=0.014
policies=20
mean1799.185-1799.131=0.055
σ0.373-0.253=0.120
min1798.932-1798.936=-0.004
max1799.735-1799.501=0.234
mean820.000
σ0.000
min820.000
max820.000
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean2.861-2.864=-0.003
σ0.008-0.082=-0.074
min2.855-2.796=0.059
max2.873-2.979=-0.106
policies=200
mean17998.560-17998.244=0.315
σ0.486-0.918=-0.431
min17998.221-17997.061=1.160
max17999.281-17999.301=-0.020
mean8200.000
σ0.000
min8200.000
max8200.000
mean2846.000-2766.000=80.000
σ0.000
min2846.000-2766.000=80.000
max2846.000-2766.000=80.000
mean28.493-28.264=0.228
σ0.409-0.107=0.302
min28.156-28.175=-0.019
max28.994-28.417=0.577