Compare commits

Home / Compare 7c23ef8b .. f6e45937

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.563=-0.001
σ0.045-0.045=-0.000
min70.535-70.536=-0.001
max70.688-70.689=-0.001
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.157-0.157=-0.001
σ0.005-0.004=0.002
min0.149-0.149=-0.000
max0.166-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.290=-0.004
σ0.003-0.010=-0.007
min21.281-21.281=0.000
max21.294-21.319=-0.025
mean415.700-419.000=-3.300
σ0.483-0.000=0.483
min415.000-419.000=-4.000
max416.000-419.000=-3.000
mean0.064-0.062=0.001
σ0.004-0.004=-0.000
min0.058-0.058=-0.000
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.374=0.002
σ0.361-0.363=-0.001
min1752.804-1752.809=-0.004
max1753.960-1753.959=0.000
mean1651.600-1666.150=-14.550
σ642.206-634.250=7.957
min633.000-623.000=10.000
max2882.000-2784.000=98.000
mean2.847-2.772=0.075
σ0.126-0.189=-0.064
min2.550-2.295=0.255
max3.036-3.055=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.733-271.754=-0.020
σ0.006-0.007=-0.001
min271.724-271.747=-0.023
max271.741-271.763=-0.022
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean0.385-0.382=0.003
σ0.011-0.006=0.006
min0.372-0.378=-0.006
max0.398-0.392=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.178=-0.003
σ0.002-0.006=-0.004
min1932.172-1932.170=0.002
max1932.177-1932.184=-0.006
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean3.014-3.090=-0.076
σ0.043-0.091=-0.048
min2.969-2.946=0.023
max3.080-3.191=-0.111
iters=5
new-facts=6402
prior-facts=1
mean4752.964-4752.950=0.014
σ0.830-0.890=-0.060
min4752.506-4752.393=0.114
max4754.441-4754.532=-0.091
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean8.059-8.266=-0.207
σ0.455-0.539=-0.085
min7.686-7.647=0.040
max8.612-9.050=-0.439
iters=5
new-facts=6402
prior-facts=6402
mean4943.370-4943.308=0.062
σ0.027-0.150=-0.123
min4943.339-4943.043=0.296
max4943.405-4943.405=0.000
mean3090.800-3026.400=64.400
σ289.974-299.538=-9.564
min2882.000-2784.000=98.000
max3542.000-3475.000=67.000
mean8.463-8.521=-0.058
σ0.098-0.156=-0.058
min8.377-8.378=-0.001
max8.630-8.703=-0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.001=0.029
σ0.139-0.140=-0.001
min0.938-0.933=0.004
max1.253-1.252=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.859=0.004
σ575.923-575.925=-0.002
min179.893-179.887=0.006
max1331.748-1331.746=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean0.445-0.475=-0.030
σ0.311-0.390=-0.079
min0.286-0.276=0.010
max0.912-1.060=-0.148
policies=20
mean1799.177-1799.142=0.035
σ0.349-0.356=-0.008
min1798.938-1798.898=0.040
max1799.693-1799.672=0.021
mean820.000
σ0.000
min820.000
max820.000
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean2.915-2.794=0.121
σ0.032-0.031=0.001
min2.881-2.750=0.132
max2.944-2.822=0.123
policies=200
mean17998.430-17998.411=0.019
σ0.546-0.619=-0.073
min17998.093-17997.986=0.107
max17999.243-17999.329=-0.086
mean8200.000
σ0.000
min8200.000
max8200.000
mean2882.000-2784.000=98.000
σ0.000
min2882.000-2784.000=98.000
max2882.000-2784.000=98.000
mean28.501-28.221=0.280
σ0.446-0.150=0.295
min28.110-28.073=0.036
max29.024-28.382=0.641