Compare commits

Home / Compare 09c7a9c6 .. 55fa54d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.568=-0.001
σ0.046-0.046=-0.000
min70.543-70.541=0.002
max70.694-70.694=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.156-0.162=-0.006
σ0.004-0.004=0.000
min0.149-0.157=-0.008
max0.163-0.170=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.000
σ0.003-0.003=-0.000
min21.282-21.283=-0.001
max21.291-21.291=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.000
min0.062-0.058=0.004
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.371-1753.375=-0.004
σ0.364-0.359=0.005
min1752.804-1752.806=-0.002
max1753.974-1753.953=0.021
mean1663.250-1670.500=-7.250
σ631.421-646.104=-14.683
min685.000-620.000=65.000
max2809.000-2712.000=97.000
mean2.781-2.858=-0.077
σ0.190-0.207=-0.017
min2.367-2.294=0.074
max3.141-3.127=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.756=-0.002
σ0.004-0.006=-0.002
min271.749-271.749=0.000
max271.760-271.764=-0.004
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean0.383-0.381=0.001
σ0.005-0.005=0.000
min0.379-0.376=0.002
max0.392-0.389=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.175=0.002
σ0.004-0.014=-0.009
min1932.172-1932.155=0.017
max1932.182-1932.192=-0.009
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean3.059-2.981=0.078
σ0.162-0.172=-0.010
min2.929-2.709=0.220
max3.336-3.165=0.171
iters=5
new-facts=6402
prior-facts=1
mean4752.942-4752.796=0.146
σ0.885-1.019=-0.134
min4752.413-4751.943=0.470
max4754.509-4754.556=-0.047
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean8.226-8.572=-0.346
σ0.666-0.587=0.079
min7.653-7.628=0.025
max8.980-9.168=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.301=0.076
σ0.024-0.155=-0.131
min4943.342-4943.024=0.318
max4943.401-4943.384=0.017
mean3043.200-2968.600=74.600
σ285.528-302.531=-17.003
min2809.000-2712.000=97.000
max3472.000-3417.000=55.000
mean8.437-8.454=-0.017
σ0.127-0.138=-0.011
min8.326-8.332=-0.006
max8.648-8.684=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.138=-0.088
σ0.130-0.165=-0.034
min0.934-0.932=0.002
max1.253-1.353=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.860=-0.002
σ575.938-575.947=-0.010
min179.884-179.884=-0.000
max1331.766-1331.781=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean0.470-0.566=-0.096
σ0.376-0.566=-0.190
min0.281-0.281=-0.000
max1.034-1.415=-0.382
policies=20
mean1799.194-1799.131=0.063
σ0.370-0.374=-0.004
min1798.925-1798.889=0.036
max1799.740-1799.687=0.054
mean820.000
σ0.000
min820.000
max820.000
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean2.852-2.800=0.051
σ0.062-0.015=0.047
min2.790-2.785=0.005
max2.918-2.818=0.100
policies=200
mean17998.525-17998.391=0.134
σ0.477-0.550=-0.073
min17998.237-17998.038=0.199
max17999.236-17999.198=0.038
mean8200.000
σ0.000
min8200.000
max8200.000
mean2809.000-2712.000=97.000
σ0.000
min2809.000-2712.000=97.000
max2809.000-2712.000=97.000
mean28.222-28.094=0.128
σ0.086-0.067=0.020
min28.151-28.035=0.116
max28.339-28.171=0.168