Compare commits

Home / Compare 1ef10a5e .. 5b072685

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.046-0.046=0.000
min70.537-70.536=0.001
max70.693-70.693=0.000
mean416.900-414.000=2.900
σ0.316-0.000=0.316
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.159-0.157=0.002
σ0.004-0.006=-0.001
min0.153-0.149=0.004
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.002-0.004=-0.002
min21.285-21.283=0.002
max21.291-21.293=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.064-0.064=0.000
σ0.003-0.002=0.001
min0.063-0.062=0.000
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.570=-0.003
σ0.359-0.360=-0.001
min1752.995-1753.007=-0.012
max1754.133-1754.157=-0.023
mean1669.650-1652.750=16.900
σ644.481-643.098=1.384
min692.000-622.000=70.000
max2767.000-2884.000=-117.000
mean2.775-2.848=-0.073
σ0.181-0.120=0.060
min2.249-2.477=-0.228
max2.980-3.013=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-272.013=0.002
σ0.005-0.007=-0.003
min272.011-272.004=0.007
max272.022-272.020=0.002
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean0.389-0.385=0.004
σ0.013-0.010=0.003
min0.372-0.378=-0.006
max0.404-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.430-1932.439=-0.010
σ0.014-0.010=0.003
min1932.410-1932.428=-0.018
max1932.442-1932.450=-0.008
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean3.009-2.895=0.114
σ0.043-0.159=-0.115
min2.959-2.667=0.292
max3.066-3.021=0.046
iters=5
new-facts=6402
prior-facts=1
mean4753.193-4753.231=-0.038
σ0.857-0.809=0.048
min4752.755-4752.796=-0.041
max4754.723-4754.675=0.048
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean8.354-7.996=0.358
σ0.344-0.391=-0.047
min7.845-7.642=0.202
max8.774-8.587=0.187
iters=5
new-facts=6402
prior-facts=6402
mean4943.632-4943.627=0.005
σ0.013-0.019=-0.006
min4943.619-4943.608=0.011
max4943.650-4943.649=0.000
mean3036.000-3081.000=-45.000
σ228.980-281.237=-52.256
min2767.000-2884.000=-117.000
max3309.000-3530.000=-221.000
mean8.606-8.465=0.141
σ0.195-0.096=0.099
min8.404-8.383=0.020
max8.871-8.624=0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.071=-0.043
σ0.092-0.224=-0.132
min0.927-0.940=-0.013
max1.144-1.457=-0.313

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.112-473.113=-0.001
σ575.938-575.925=0.013
min185.139-185.138=0.001
max1337.019-1337.001=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean0.551-0.451=0.101
σ0.520-0.302=0.218
min0.290-0.296=-0.006
max1.331-0.903=0.428
policies=20
mean1851.618-1851.711=-0.093
σ0.305-0.371=-0.065
min1851.386-1851.413=-0.026
max1852.064-1852.241=-0.177
mean840.000
σ0.000
min840.000
max840.000
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean2.885-2.975=-0.090
σ0.014-0.034=-0.020
min2.865-2.948=-0.083
max2.894-3.024=-0.130
policies=200
mean18523.448-18523.499=-0.051
σ0.480-0.527=-0.047
min18523.131-18523.153=-0.022
max18524.159-18524.275=-0.116
mean8400.000
σ0.000
min8400.000
max8400.000
mean2767.000-2884.000=-117.000
σ0.000
min2767.000-2884.000=-117.000
max2767.000-2884.000=-117.000
mean28.829-29.209=-0.380
σ0.112-0.502=-0.390
min28.733-28.756=-0.023
max28.987-29.761=-0.775