Compare commits

Home / Compare 51bfdb7d .. 7abec54e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.390=0.000
σ0.048-0.046=0.002
min70.363-70.362=0.001
max70.523-70.518=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.155-0.159=-0.003
σ0.004-0.005=-0.002
min0.150-0.154=-0.004
max0.158-0.171=-0.013
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.002=-0.000
min21.140-21.140=0.001
max21.147-21.149=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.001
min0.058-0.062=-0.004
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.395=0.001
σ0.362-0.363=-0.001
min1751.828-1751.833=-0.005
max1752.981-1752.981=-0.000
mean1661.100-1660.950=0.150
σ638.056-636.659=1.397
min622.000-627.000=-5.000
max2814.000-2772.000=42.000
mean2.795-2.850=-0.055
σ0.175-0.171=0.004
min2.393-2.275=0.118
max2.988-3.129=-0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.138-270.142=-0.004
σ0.008-0.007=0.001
min270.128-270.131=-0.003
max270.148-270.151=-0.003
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean0.376-0.378=-0.002
σ0.003-0.002=0.001
min0.370-0.374=-0.004
max0.378-0.380=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.602-1930.600=0.002
σ0.017-0.020=-0.003
min1930.577-1930.573=0.004
max1930.620-1930.624=-0.004
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean2.534-2.561=-0.027
σ0.158-0.152=0.006
min2.379-2.461=-0.082
max2.783-2.829=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4751.078-4751.316=-0.238
σ1.159-0.926=0.233
min4749.743-4750.804=-1.061
max4752.938-4752.962=-0.024
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean8.524-8.517=0.007
σ0.541-0.556=-0.015
min7.658-7.579=0.080
max9.018-8.979=0.038
iters=5
new-facts=6402
prior-facts=6402
mean4941.774-4941.705=0.069
σ0.015-0.166=-0.151
min4941.757-4941.410=0.347
max4941.791-4941.797=-0.006
mean3002.800-3008.200=-5.400
σ205.025-219.449=-14.424
min2814.000-2772.000=42.000
max3310.000-3305.000=5.000
mean8.418-8.448=-0.030
σ0.107-0.138=-0.031
min8.314-8.329=-0.015
max8.568-8.677=-0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.029=-0.001
σ0.139-0.133=0.006
min0.934-0.935=-0.001
max1.256-1.241=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.370-466.377=-0.007
σ575.931-575.927=0.004
min178.402-178.406=-0.005
max1330.267-1330.267=0.000
mean84.000
σ8.000
min80.000
max96.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean0.444-0.440=0.004
σ0.303-0.305=-0.002
min0.289-0.285=0.005
max0.898-0.898=0.000
policies=20
mean1784.347-1784.316=0.031
σ0.335-0.292=0.043
min1784.114-1784.126=-0.012
max1784.828-1784.747=0.081
mean800.000
σ0.000
min800.000
max800.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean2.862-2.836=0.027
σ0.105-0.089=0.016
min2.760-2.757=0.003
max3.008-2.958=0.050
policies=200
mean17849.766-17849.418=0.348
σ0.591-1.047=-0.456
min17849.354-17848.092=1.261
max17850.633-17850.652=-0.019
mean8000.000
σ0.000
min8000.000
max8000.000
mean2814.000-2772.000=42.000
σ0.000
min2814.000-2772.000=42.000
max2814.000-2772.000=42.000
mean27.792-27.895=-0.103
σ0.151-0.097=0.054
min27.690-27.818=-0.128
max28.016-28.025=-0.009