Compare commits

Home / Compare dae739a2 .. 6b63b231

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.562=0.006
σ0.046-0.048=-0.002
min70.542-70.532=0.010
max70.693-70.695=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.161-0.153=0.008
σ0.004-0.004=-0.000
min0.156-0.148=0.008
max0.167-0.157=0.009
cache=y
dps=1
iters=10
policies=100
mean21.288-21.291=-0.002
σ0.002-0.013=-0.010
min21.285-21.282=0.003
max21.291-21.326=-0.035
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.000
min0.064-0.063=0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=0.000
σ0.361-0.359=0.002
min1752.996-1752.999=-0.003
max1754.153-1754.155=-0.002
mean1670.750-1654.450=16.300
σ647.020-647.363=-0.343
min690.000-642.000=48.000
max2778.000-2897.000=-119.000
mean2.793-2.817=-0.024
σ0.190-0.150=0.041
min2.262-2.462=-0.200
max3.007-3.008=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.016=-0.002
σ0.008-0.007=0.001
min272.000-272.008=-0.008
max272.019-272.026=-0.007
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean0.388-0.389=-0.000
σ0.009-0.007=0.001
min0.378-0.381=-0.003
max0.396-0.397=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.441-1932.434=0.007
σ0.009-0.013=-0.004
min1932.429-1932.415=0.014
max1932.453-1932.450=0.003
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean2.956-3.012=-0.056
σ0.013-0.096=-0.083
min2.940-2.880=0.060
max2.971-3.117=-0.146
iters=5
new-facts=6402
prior-facts=1
mean4753.193-4753.056=0.137
σ0.833-0.939=-0.106
min4752.760-4752.144=0.617
max4754.680-4754.643=0.038
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean8.434-8.458=-0.023
σ0.167-0.546=-0.379
min8.143-7.606=0.537
max8.534-8.977=-0.443
iters=5
new-facts=6402
prior-facts=6402
mean4943.630-4943.494=0.136
σ0.025-0.200=-0.175
min4943.596-4943.270=0.326
max4943.657-4943.660=-0.003
mean3025.200-3069.800=-44.600
σ230.480-180.124=50.356
min2778.000-2897.000=-119.000
max3332.000-3327.000=5.000
mean8.563-8.692=-0.129
σ0.155-0.348=-0.193
min8.390-8.381=0.009
max8.795-9.259=-0.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.025=0.023
σ0.126-0.139=-0.013
min0.934-0.934=0.000
max1.244-1.254=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.093-473.081=0.012
σ575.949-575.916=0.033
min185.109-185.112=-0.002
max1337.016-1336.954=0.062
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean0.561-0.488=0.073
σ0.548-0.377=0.171
min0.283-0.296=-0.012
max1.383-1.054=0.330
policies=20
mean1851.434-1851.459=-0.025
σ0.371-0.363=0.008
min1851.183-1851.182=0.001
max1851.984-1851.988=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean2.843-2.935=-0.092
σ0.011-0.006=0.005
min2.833-2.928=-0.095
max2.856-2.942=-0.086
policies=200
mean18521.124-18521.239=-0.116
σ0.497-0.398=0.099
min18520.859-18520.958=-0.099
max18521.869-18521.830=0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2897.000=-119.000
σ0.000
min2778.000-2897.000=-119.000
max2778.000-2897.000=-119.000
mean28.782-29.256=-0.474
σ0.080-0.592=-0.512
min28.695-28.733=-0.038
max28.889-29.962=-1.074