Compare commits

Home / Compare 05c7415b .. 11e5ce46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.048-0.047=0.002
min70.749-70.750=-0.001
max70.913-70.911=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.158-0.161=-0.003
σ0.005-0.004=0.001
min0.151-0.157=-0.006
max0.165-0.170=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.002=-0.000
min21.489-21.488=0.001
max21.495-21.497=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.066=-0.000
σ0.002-0.003=-0.001
min0.064-0.064=-0.000
max0.071-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.094=0.001
σ0.360-0.358=0.002
min1753.530-1753.531=-0.002
max1754.680-1754.679=0.001
mean1653.900-1657.300=-3.400
σ626.856-629.371=-2.514
min625.000-628.000=-3.000
max2771.000-2746.000=25.000
mean2.846-2.853=-0.008
σ0.140-0.144=-0.004
min2.529-2.428=0.100
max3.052-3.131=-0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.598=-0.000
σ0.007-0.005=0.002
min271.589-271.592=-0.003
max271.604-271.603=0.001
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean0.384-0.381=0.004
σ0.004-0.004=0.000
min0.380-0.378=0.002
max0.390-0.387=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.001-1932.000=0.002
σ0.016-0.008=0.007
min1931.975-1931.988=-0.013
max1932.013-1932.008=0.005
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean2.583-2.532=0.051
σ0.075-0.077=-0.002
min2.509-2.454=0.055
max2.669-2.636=0.033
iters=5
new-facts=6402
prior-facts=1
mean4752.665-4752.694=-0.029
σ1.010-0.950=0.061
min4751.816-4752.225=-0.409
max4754.409-4754.392=0.017
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean8.256-8.847=-0.591
σ0.588-0.204=0.384
min7.639-8.551=-0.912
max9.118-9.059=0.060
iters=5
new-facts=6402
prior-facts=6402
mean4943.203-4943.210=-0.007
σ0.018-0.017=0.000
min4943.182-4943.193=-0.011
max4943.222-4943.236=-0.015
mean3023.000-2985.800=37.200
σ297.190-219.503=77.687
min2771.000-2746.000=25.000
max3461.000-3300.000=161.000
mean8.439-8.561=-0.122
σ0.081-0.076=0.005
min8.384-8.469=-0.085
max8.581-8.661=-0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-0.996=0.073
σ0.239-0.138=0.101
min0.931-0.927=0.004
max1.485-1.243=0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.664=0.001
σ574.938-574.936=0.002
min181.190-181.188=0.002
max1331.072-1331.068=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean0.450-0.562=-0.112
σ0.304-0.538=-0.234
min0.295-0.285=0.009
max0.906-1.369=-0.464
policies=20
mean1812.233-1812.202=0.031
σ0.367-0.386=-0.019
min1811.956-1811.933=0.023
max1812.757-1812.771=-0.014
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean2.899-2.839=0.060
σ0.126-0.014=0.111
min2.826-2.826=-0.000
max3.087-2.859=0.228
policies=200
mean18129.230-18129.127=0.103
σ0.444-0.468=-0.024
min18128.871-18128.820=0.051
max18129.876-18129.823=0.052
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean28.626-28.686=-0.059
σ0.048-0.056=-0.008
min28.558-28.615=-0.057
max28.669-28.752=-0.083