Compare commits

Home / Compare d584b5e5 .. 8d3e2709

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.392=0.000
σ0.044-0.045=-0.000
min70.370-70.370=0.000
max70.517-70.516=0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.159-0.159=0.000
σ0.005-0.006=-0.001
min0.152-0.149=0.003
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.148-21.147=0.001
σ0.010-0.013=-0.003
min21.140-21.138=0.002
max21.175-21.181=-0.006
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.001
min0.062-0.057=0.005
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.363-0.358=0.004
min1751.827-1751.826=0.001
max1752.981-1752.957=0.024
mean1658.400-1641.650=16.750
σ631.125-616.934=14.191
min626.000-634.000=-8.000
max2757.000-2479.000=278.000
mean2.818-2.843=-0.025
σ0.129-0.091=0.038
min2.328-2.648=-0.320
max2.945-3.045=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.241=-0.003
σ0.008-0.010=-0.001
min270.228-270.229=-0.001
max270.249-270.254=-0.005
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean0.383-0.384=-0.000
σ0.008-0.011=-0.003
min0.378-0.371=0.008
max0.397-0.397=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.702-1930.705=-0.004
σ0.009-0.005=0.003
min1930.689-1930.699=-0.010
max1930.711-1930.712=-0.001
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean2.506-2.532=-0.026
σ0.075-0.052=0.023
min2.454-2.479=-0.026
max2.638-2.604=0.034
iters=5
new-facts=6402
prior-facts=1
mean4751.398-4751.229=0.170
σ0.865-0.977=-0.112
min4750.877-4750.464=0.413
max4752.934-4752.875=0.059
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean8.561-8.239=0.322
σ0.503-0.239=0.263
min7.775-7.863=-0.088
max9.102-8.514=0.588
iters=5
new-facts=6402
prior-facts=6402
mean4941.726-4941.729=-0.003
σ0.197-0.199=-0.002
min4941.506-4941.500=0.007
max4941.895-4941.898=-0.003
mean3010.000-2978.400=31.600
σ235.963-265.903=-29.940
min2757.000-2643.000=114.000
max3318.000-3335.000=-17.000
mean8.611-8.559=0.052
σ0.239-0.088=0.151
min8.387-8.437=-0.050
max8.933-8.654=0.279

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.829=-0.751
σ0.116-0.064=0.052
min0.934-1.741=-0.807
max1.258-1.906=-0.648

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.758-466.748=0.010
σ575.942-575.931=0.011
min178.780-178.781=-0.001
max1330.671-1330.645=0.026
mean86.250
σ8.500
min82.000
max99.000
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean0.552-0.568=-0.016
σ0.539-0.572=-0.033
min0.282-0.281=0.001
max1.360-1.426=-0.066
policies=20
mean1788.095-1788.106=-0.011
σ0.352-0.371=-0.020
min1787.885-1787.875=0.010
max1788.621-1788.660=-0.039
mean820.000
σ0.000
min820.000
max820.000
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean2.792-2.797=-0.005
σ0.023-0.021=0.002
min2.774-2.774=0.000
max2.825-2.825=0.000
policies=200
mean17888.074-17888.048=0.027
σ0.614-0.583=0.030
min17887.667-17887.723=-0.056
max17888.980-17888.922=0.059
mean8200.000
σ0.000
min8200.000
max8200.000
mean2757.000-2479.000=278.000
σ0.000
min2757.000-2479.000=278.000
max2757.000-2479.000=278.000
mean28.105-28.118=-0.013
σ0.154-0.041=0.113
min27.978-28.058=-0.079
max28.327-28.152=0.176