Compare commits

Home / Compare b19de8a6 .. 4dbc9702

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.704-70.699=0.005
σ0.044-0.045=-0.001
min70.677-70.673=0.005
max70.825-70.822=0.003
mean416.400-419.000=-2.600
σ0.516-0.000=0.516
min416.000-419.000=-3.000
max417.000-419.000=-2.000
mean0.172-0.158=0.014
σ0.011-0.006=0.005
min0.157-0.149=0.008
max0.185-0.166=0.019
cache=y
dps=1
iters=10
policies=100
mean21.421-21.421=-0.001
σ0.003-0.003=-0.001
min21.415-21.417=-0.002
max21.423-21.426=-0.003
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.066-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.457=0.003
σ0.361-0.358=0.002
min1753.887-1753.895=-0.008
max1755.040-1755.021=0.020
mean1646.350-1646.950=-0.600
σ627.215-626.475=0.740
min627.000-631.000=-4.000
max2854.000-2853.000=1.000
mean2.820-2.814=0.006
σ0.123-0.103=0.020
min2.517-2.577=-0.060
max3.044-2.988=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.000-278.999=0.001
σ0.009-0.009=-0.000
min278.991-278.991=-0.000
max279.013-279.012=0.002
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean0.387-0.382=0.005
σ0.006-0.001=0.006
min0.380-0.381=-0.001
max0.396-0.382=0.013
iters=5
new-facts=1
prior-facts=6402
mean1939.430-1939.424=0.005
σ0.021-0.024=-0.003
min1939.395-1939.392=0.003
max1939.450-1939.452=-0.002
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean2.557-2.565=-0.008
σ0.110-0.133=-0.024
min2.473-2.454=0.018
max2.748-2.795=-0.047
iters=5
new-facts=6402
prior-facts=1
mean4760.208-4760.188=0.020
σ0.878-0.890=-0.012
min4759.688-4759.682=0.006
max4761.770-4761.770=0.000
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean8.369-8.342=0.027
σ0.394-0.536=-0.142
min7.827-7.718=0.109
max8.931-9.002=-0.071
iters=5
new-facts=6402
prior-facts=6402
mean4950.479-4950.631=-0.152
σ0.313-0.011=0.302
min4949.920-4950.619=-0.699
max4950.641-4950.643=-0.001
mean3087.200-3078.000=9.200
σ307.362-304.587=2.775
min2854.000-2853.000=1.000
max3559.000-3550.000=9.000
mean8.438-8.469=-0.031
σ0.157-0.139=0.018
min8.272-8.382=-0.109
max8.693-8.714=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.086=-0.058
σ0.144-0.270=-0.126
min0.930-0.933=-0.003
max1.259-1.558=-0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.078-473.061=0.017
σ575.910-575.910=-0.000
min185.114-185.099=0.015
max1336.943-1336.926=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean0.487-0.486=0.001
σ0.374-0.379=-0.005
min0.297-0.291=0.006
max1.048-1.055=-0.006
policies=20
mean1851.399-1851.283=0.116
σ0.371-0.379=-0.008
min1851.131-1850.995=0.136
max1851.940-1851.835=0.105
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean2.956-2.944=0.012
σ0.010-0.010=0.000
min2.947-2.931=0.016
max2.965-2.952=0.013
policies=200
mean18519.623-18519.481=0.142
σ0.721-0.458=0.263
min18518.893-18519.074=-0.181
max18520.443-18520.130=0.313
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2853.000=1.000
σ0.000
min2854.000-2853.000=1.000
max2854.000-2853.000=1.000
mean29.107-29.055=0.052
σ0.491-0.566=-0.075
min28.784-28.704=0.080
max29.830-29.898=-0.068