Compare commits

Home / Compare b02dc253 .. af15387d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.004
σ0.045-0.044=0.001
min70.536-70.542=-0.006
max70.691-70.687=0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.159-0.159=0.000
σ0.005-0.004=0.002
min0.152-0.152=-0.000
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.286-21.287=-0.001
σ0.004-0.004=-0.000
min21.281-21.282=-0.002
max21.293-21.295=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.375=0.002
σ0.361-0.360=0.001
min1752.805-1752.804=0.001
max1753.960-1753.957=0.003
mean1660.750-1652.450=8.300
σ635.984-646.078=-10.094
min687.000-631.000=56.000
max2766.000-2896.000=-130.000
mean2.853-2.853=0.001
σ0.165-0.122=0.043
min2.283-2.517=-0.234
max3.190-3.008=0.182

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.751-271.759=-0.008
σ0.006-0.005=0.001
min271.745-271.754=-0.008
max271.761-271.766=-0.005
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean0.379-0.380=-0.001
σ0.005-0.005=-0.000
min0.377-0.377=-0.001
max0.388-0.390=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.176=-0.004
σ0.017-0.011=0.006
min1932.146-1932.159=-0.013
max1932.190-1932.190=0.001
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean3.011-3.013=-0.001
σ0.092-0.156=-0.064
min2.871-2.798=0.073
max3.119-3.185=-0.066
iters=5
new-facts=6402
prior-facts=1
mean4752.928-4752.941=-0.013
σ0.899-0.892=0.007
min4752.423-4752.409=0.014
max4754.526-4754.528=-0.001
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean8.416-8.360=0.056
σ0.514-0.495=0.019
min7.621-7.752=-0.131
max8.926-8.995=-0.068
iters=5
new-facts=6402
prior-facts=6402
mean4943.306-4943.384=-0.078
σ0.174-0.018=0.157
min4942.994-4943.362=-0.368
max4943.391-4943.403=-0.012
mean2986.600-3064.800=-78.200
σ218.209-252.006=-33.797
min2766.000-2896.000=-130.000
max3301.000-3460.000=-159.000
mean8.530-8.497=0.034
σ0.071-0.133=-0.062
min8.445-8.381=0.064
max8.629-8.710=-0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.119=-0.099
σ0.143-0.123=0.020
min0.926-1.055=-0.129
max1.252-1.339=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.863=-0.002
σ575.926-575.933=-0.007
min179.891-179.894=-0.003
max1331.749-1331.763=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean0.480-0.443=0.036
σ0.397-0.302=0.095
min0.278-0.286=-0.007
max1.075-0.897=0.179
policies=20
mean1799.167-1799.193=-0.026
σ0.355-0.378=-0.024
min1798.965-1798.924=0.041
max1799.698-1799.749=-0.051
mean820.000
σ0.000
min820.000
max820.000
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean2.776-2.897=-0.121
σ0.027-0.025=0.002
min2.754-2.879=-0.124
max2.814-2.932=-0.119
policies=200
mean17998.477-17998.539=-0.062
σ0.396-0.462=-0.066
min17998.218-17998.272=-0.054
max17999.063-17999.229=-0.166
mean8200.000
σ0.000
min8200.000
max8200.000
mean2766.000-2896.000=-130.000
σ0.000
min2766.000-2896.000=-130.000
max2766.000-2896.000=-130.000
mean28.177-28.541=-0.364
σ0.140-0.596=-0.456
min28.058-27.987=0.072
max28.331-29.244=-0.912