Compare commits

Home / Compare 5300bca4 .. 694d2c7e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.047-0.048=-0.001
min70.750-70.754=-0.004
max70.912-70.915=-0.003
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.160-0.153=0.006
σ0.004-0.003=0.001
min0.157-0.150=0.006
max0.167-0.159=0.008
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.003=-0.000
min21.486-21.489=-0.002
max21.496-21.498=-0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.060-0.064=-0.004
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.002
σ0.360-0.359=0.000
min1753.528-1753.531=-0.003
max1754.678-1754.674=0.004
mean1658.050-1656.450=1.600
σ632.502-630.543=1.959
min624.000-627.000=-3.000
max2759.000-2773.000=-14.000
mean2.865-2.816=0.049
σ0.110-0.143=-0.033
min2.628-2.383=0.245
max3.124-3.125=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.600=-0.000
σ0.004-0.003=0.001
min271.593-271.596=-0.002
max271.603-271.604=-0.001
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean0.387-0.385=0.002
σ0.005-0.004=0.001
min0.382-0.382=-0.000
max0.394-0.390=0.005
iters=5
new-facts=1
prior-facts=6402
mean1931.991-1931.983=0.008
σ0.018-0.025=-0.007
min1931.960-1931.950=0.011
max1932.003-1932.011=-0.008
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean2.480-2.523=-0.043
σ0.106-0.105=0.001
min2.350-2.376=-0.026
max2.609-2.646=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4752.589-4752.593=-0.004
σ1.006-0.688=0.318
min4751.751-4752.242=-0.492
max4754.339-4753.822=0.517
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean8.809-8.786=0.022
σ0.198-0.253=-0.056
min8.591-8.486=0.106
max9.039-9.029=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4943.064-4943.135=-0.071
σ0.185-0.152=0.033
min4942.858-4942.864=-0.006
max4943.213-4943.216=-0.003
mean3019.600-3025.800=-6.200
σ232.175-231.467=0.708
min2759.000-2773.000=-14.000
max3322.000-3329.000=-7.000
mean8.683-8.544=0.140
σ0.237-0.141=0.096
min8.390-8.406=-0.016
max8.993-8.762=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.992-1.015=-0.023
σ0.143-0.138=0.005
min0.927-0.921=0.005
max1.248-1.247=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.638-468.639=-0.000
σ574.939-574.923=0.017
min181.166-181.168=-0.002
max1331.047-1331.023=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean0.556-0.449=0.107
σ0.521-0.305=0.217
min0.286-0.296=-0.010
max1.338-0.906=0.432
policies=20
mean1811.905-1811.981=-0.076
σ0.317-0.367=-0.050
min1811.675-1811.714=-0.039
max1812.370-1812.516=-0.146
mean840.000
σ0.000
min840.000
max840.000
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean2.846-2.919=-0.073
σ0.019-0.133=-0.114
min2.824-2.829=-0.005
max2.863-3.113=-0.249
policies=200
mean18126.650-18126.481=0.169
σ0.636-0.556=0.080
min18125.926-18126.053=-0.127
max18127.463-18127.281=0.183
mean8400.000
σ0.000
min8400.000
max8400.000
mean2759.000-2773.000=-14.000
σ0.000
min2759.000-2773.000=-14.000
max2759.000-2773.000=-14.000
mean28.695-28.683=0.012
σ0.094-0.198=-0.104
min28.578-28.547=0.031
max28.799-28.971=-0.172