Compare commits

Home / Compare bf3df1d4 .. a6a6b191

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.566=0.000
σ0.044-0.045=-0.000
min70.538-70.535=0.002
max70.686-70.687=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.158-0.160=-0.001
σ0.004-0.004=0.001
min0.152-0.154=-0.002
max0.165-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.001
σ0.003-0.004=-0.001
min21.283-21.281=0.001
max21.292-21.291=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.062=0.000
max0.074-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.359-0.360=-0.001
min1752.798-1752.806=-0.008
max1753.946-1753.952=-0.005
mean1644.350-1652.150=-7.800
σ634.942-642.420=-7.478
min624.000-637.000=-13.000
max2857.000-2882.000=-25.000
mean2.773-2.837=-0.064
σ0.194-0.168=0.025
min2.394-2.431=-0.038
max3.046-3.033=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.760-271.756=0.004
σ0.009-0.007=0.002
min271.753-271.747=0.005
max271.775-271.765=0.010
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean0.385-0.382=0.003
σ0.010-0.003=0.006
min0.378-0.380=-0.002
max0.400-0.388=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.174=-0.000
σ0.006-0.017=-0.011
min1932.167-1932.152=0.016
max1932.183-1932.192=-0.008
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean3.035-2.950=0.085
σ0.094-0.132=-0.038
min2.958-2.733=0.225
max3.182-3.070=0.112
iters=5
new-facts=6402
prior-facts=1
mean4752.906-4752.870=0.036
σ0.922-0.909=0.013
min4752.414-4752.438=-0.024
max4754.543-4754.496=0.046
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean8.583-8.800=-0.217
σ0.530-0.148=0.382
min7.796-8.582=-0.786
max8.997-8.927=0.070
iters=5
new-facts=6402
prior-facts=6402
mean4943.303-4943.232=0.071
σ0.152-0.188=-0.036
min4943.033-4943.017=0.016
max4943.391-4943.388=0.003
mean3053.000-3036.200=16.800
σ193.271-243.847=-50.576
min2857.000-2882.000=-25.000
max3303.000-3440.000=-137.000
mean8.533-8.497=0.035
σ0.116-0.083=0.033
min8.406-8.385=0.020
max8.714-8.613=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.103=-0.082
σ0.138-0.083=0.055
min0.929-1.048=-0.119
max1.245-1.249=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.868=-0.004
σ575.933-575.936=-0.003
min179.891-179.887=0.004
max1331.763-1331.772=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean0.448-0.442=0.005
σ0.301-0.303=-0.002
min0.296-0.287=0.009
max0.900-0.897=0.002
policies=20
mean1799.207-1799.191=0.015
σ0.393-0.385=0.008
min1798.937-1798.917=0.020
max1799.787-1799.756=0.031
mean820.000
σ0.000
min820.000
max820.000
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean2.926-2.875=0.051
σ0.063-0.008=0.054
min2.888-2.863=0.025
max3.020-2.881=0.138
policies=200
mean17998.539-17998.502=0.037
σ0.457-0.362=0.095
min17998.284-17998.238=0.046
max17999.223-17999.029=0.193
mean8200.000
σ0.000
min8200.000
max8200.000
mean2857.000-2882.000=-25.000
σ0.000
min2857.000-2882.000=-25.000
max2857.000-2882.000=-25.000
mean28.528-28.519=0.010
σ0.381-0.437=-0.056
min28.194-28.152=0.042
max29.067-29.037=0.030