Compare commits

Home / Compare 62fe6bb7 .. b93cc339

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.053-0.054=-0.002
min70.748-70.751=-0.004
max70.929-70.935=-0.007
mean414.000-424.800=-10.800
σ0.000-0.422=-0.422
min414.000-424.000=-10.000
max414.000-425.000=-11.000
mean0.160-0.160=0.001
σ0.004-0.003=0.000
min0.157-0.156=0.001
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.003=0.000
min21.489-21.490=-0.000
max21.497-21.497=0.000
mean414.000-425.000=-11.000
σ0.000
min414.000-425.000=-11.000
max414.000-425.000=-11.000
mean0.064-0.065=-0.001
σ0.003-0.003=-0.000
min0.060-0.060=-0.001
max0.072-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.881=0.001
σ0.360-0.360=-0.000
min1751.310-1751.315=-0.005
max1752.480-1752.472=0.008
mean1635.700-1663.050=-27.350
σ628.846-626.759=2.087
min619.000-687.000=-68.000
max2766.000-2665.000=101.000
mean2.807-2.825=-0.018
σ0.210-0.114=0.096
min2.129-2.509=-0.380
max3.093-3.017=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.378-269.379=-0.001
σ0.009-0.006=0.004
min269.368-269.371=-0.003
max269.391-269.387=0.004
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean0.378-0.375=0.003
σ0.005-0.005=0.000
min0.374-0.371=0.003
max0.386-0.383=0.004
iters=5
new-facts=1
prior-facts=6402
mean1929.741-1929.749=-0.009
σ0.023-0.003=0.019
min1929.722-1929.746=-0.025
max1929.769-1929.754=0.015
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean3.043-3.086=-0.043
σ0.218-0.091=0.127
min2.726-3.013=-0.286
max3.288-3.189=0.099
iters=5
new-facts=6402
prior-facts=1
mean4750.534-4750.376=0.158
σ0.845-1.037=-0.192
min4750.064-4749.480=0.584
max4752.041-4752.171=-0.130
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean8.339-8.656=-0.317
σ0.419-0.503=-0.084
min7.791-7.820=-0.029
max8.812-9.066=-0.254
iters=5
new-facts=6402
prior-facts=6402
mean4940.982-4940.985=-0.004
σ0.014-0.012=0.002
min4940.963-4940.972=-0.009
max4940.998-4940.999=-0.001
mean3027.200-3025.800=1.400
σ323.413-296.361=27.052
min2766.000-2665.000=101.000
max3520.000-3418.000=102.000
mean8.399-8.564=-0.165
σ0.115-0.140=-0.026
min8.312-8.329=-0.017
max8.597-8.696=-0.099

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.213=-0.196
σ0.125-0.381=-0.256
min0.926-0.937=-0.011
max1.214-1.847=-0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.723-462.695=0.028
σ574.975-574.933=0.042
min175.227-175.224=0.003
max1325.186-1325.095=0.091
mean86.250
σ8.500
min82.000
max99.000
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean0.597-0.550=0.047
σ0.637-0.553=0.084
min0.275-0.269=0.006
max1.553-1.380=0.173
policies=20
mean1752.522-1752.508=0.014
σ0.356-0.354=0.002
min1752.300-1752.291=0.010
max1753.055-1753.037=0.018
mean820.000
σ0.000
min820.000
max820.000
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean2.728-2.735=-0.007
σ0.015-0.014=0.000
min2.712-2.716=-0.005
max2.741-2.751=-0.011
policies=200
mean17532.324-17532.329=-0.005
σ0.370-0.519=-0.149
min17532.116-17532.040=0.076
max17532.878-17533.107=-0.230
mean8200.000
σ0.000
min8200.000
max8200.000
mean2766.000-2665.000=101.000
σ0.000
min2766.000-2665.000=101.000
max2766.000-2665.000=101.000
mean27.530-27.405=0.125
σ0.153-0.099=0.054
min27.409-27.327=0.082
max27.754-27.550=0.204