Compare commits

Home / Compare d4deef6c .. bdff656a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.566=-0.003
σ0.045-0.044=0.001
min70.539-70.542=-0.003
max70.689-70.688=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.158-0.160=-0.002
σ0.006-0.003=0.003
min0.150-0.157=-0.007
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.000
σ0.003-0.003=0.000
min21.283-21.282=0.001
max21.291
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.065=-0.004
σ0.003-0.003=0.001
min0.058-0.063=-0.005
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.360-0.362=-0.002
min1752.797-1752.802=-0.005
max1753.948-1753.959=-0.011
mean1650.850-1655.950=-5.100
σ645.894-647.000=-1.107
min633.000-636.000=-3.000
max2893.000-2901.000=-8.000
mean2.822-2.822=-0.000
σ0.141-0.143=-0.001
min2.516-2.496=0.020
max3.025-3.080=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.760=-0.002
σ0.005-0.008=-0.003
min271.750-271.751=-0.001
max271.764-271.768=-0.005
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean0.384-0.387=-0.003
σ0.009-0.013=-0.005
min0.379-0.376=0.002
max0.399-0.408=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.185=-0.011
σ0.012-0.013=-0.001
min1932.156-1932.170=-0.014
max1932.185-1932.204=-0.020
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean3.014-2.929=0.085
σ0.058-0.198=-0.139
min2.952-2.599=0.353
max3.104-3.129=-0.026
iters=5
new-facts=6402
prior-facts=1
mean4752.890-4752.955=-0.064
σ0.919-0.893=0.026
min4752.430-4752.420=0.010
max4754.533-4754.543=-0.009
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean8.682-8.376=0.306
σ0.247-0.408=-0.161
min8.298-7.969=0.329
max8.905-8.942=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean4943.370-4943.304=0.065
σ0.006-0.158=-0.151
min4943.360-4943.023=0.337
max4943.375-4943.394=-0.019
mean3033.800-3065.800=-32.000
σ168.265-175.421=-7.156
min2893.000-2901.000=-8.000
max3305.000-3323.000=-18.000
mean8.516-8.538=-0.022
σ0.085-0.114=-0.029
min8.428-8.399=0.029
max8.631-8.651=-0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.990-1.032=-0.042
σ0.143-0.150=-0.007
min0.916-0.935=-0.019
max1.246-1.278=-0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.865=-0.001
σ575.923-575.925=-0.002
min179.896-179.896=0.000
max1331.748-1331.752=-0.005
mean86.250
σ8.500
min82.000
max99.000
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean0.445-0.445=-0.000
σ0.301-0.306=-0.005
min0.294-0.289=0.005
max0.897-0.904=-0.008
policies=20
mean1799.171-1799.205=-0.033
σ0.358-0.382=-0.024
min1798.938-1798.936=0.001
max1799.704-1799.767=-0.063
mean820.000
σ0.000
min820.000
max820.000
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean2.869-2.900=-0.032
σ0.011-0.002=0.009
min2.858-2.898=-0.041
max2.884-2.903=-0.019
policies=200
mean17998.456-17998.465=-0.009
σ0.578-0.561=0.017
min17998.049-17998.117=-0.068
max17999.302-17999.303=-0.001
mean8200.000
σ0.000
min8200.000
max8200.000
mean2893.000-2901.000=-8.000
σ0.000
min2893.000-2901.000=-8.000
max2893.000-2901.000=-8.000
mean28.530-28.675=-0.145
σ0.381-0.479=-0.098
min28.126-28.152=-0.026
max28.964-29.132=-0.168