Compare commits

Home / Compare 812d173a .. bf4b6c96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.561=0.003
σ0.046-0.048=-0.002
min70.542-70.532=0.010
max70.693-70.695=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.162-0.156=0.006
σ0.003-0.004=-0.001
min0.159-0.150=0.009
max0.167-0.162=0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.003-0.003=0.000
min21.283-21.283=-0.000
max21.292-21.291=0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.000
σ0.003-0.002=0.001
min0.059-0.058=0.001
max0.071-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.362-0.361=0.001
min1752.809-1752.801=0.007
max1753.958-1753.956=0.002
mean1664.900-1662.500=2.400
σ637.008-637.331=-0.324
min621.000
max2808.000-2814.000=-6.000
mean2.801-2.748=0.053
σ0.135-0.187=-0.052
min2.544-2.364=0.180
max3.084-3.082=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.753=0.002
σ0.005-0.005=-0.000
min271.750-271.745=0.005
max271.762-271.756=0.006
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean0.381-0.381=0.000
σ0.004-0.005=-0.002
min0.378-0.378=-0.001
max0.387-0.391=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.186-1932.181=0.005
σ0.009-0.015=-0.006
min1932.177-1932.167=0.010
max1932.201-1932.206=-0.005
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean2.932-2.923=0.009
σ0.133-0.124=0.009
min2.725-2.753=-0.028
max3.084-3.058=0.026
iters=5
new-facts=6402
prior-facts=1
mean4752.909-4752.904=0.005
σ0.951-0.906=0.045
min4752.393-4752.393=0.001
max4754.599-4754.517=0.082
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean8.669-8.643=0.026
σ0.525-0.332=0.193
min8.014-8.192=-0.178
max9.252-8.998=0.254
iters=5
new-facts=6402
prior-facts=6402
mean4943.378-4943.156=0.222
σ0.015-0.314=-0.299
min4943.362-4942.651=0.710
max4943.395-4943.378=0.016
mean3007.200-3032.400=-25.200
σ204.051-223.237=-19.186
min2808.000-2814.000=-6.000
max3312.000-3342.000=-30.000
mean8.540-8.596=-0.057
σ0.101-0.200=-0.099
min8.427-8.417=0.010
max8.647-8.915=-0.268

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.097-1.082=0.014
σ0.278-0.150=0.128
min0.940-0.930=0.010
max1.585-1.257=0.328

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.866=-0.008
σ575.924-575.937=-0.013
min179.887-179.884=0.002
max1331.743-1331.771=-0.028
mean86.250
σ8.500
min82.000
max99.000
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean0.478-0.476=0.002
σ0.391-0.382=0.009
min0.278-0.282=-0.004
max1.065-1.049=0.016
policies=20
mean1799.141-1799.176=-0.035
σ0.365-0.376=-0.012
min1798.870-1798.911=-0.040
max1799.680-1799.734=-0.054
mean820.000
σ0.000
min820.000
max820.000
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean2.798-2.818=-0.020
σ0.010-0.026=-0.016
min2.789-2.793=-0.004
max2.812-2.847=-0.035
policies=200
mean17998.490-17998.510=-0.020
σ0.559-0.505=0.054
min17998.062-17998.213=-0.151
max17999.312-17999.265=0.047
mean8200.000
σ0.000
min8200.000
max8200.000
mean2808.000-2814.000=-6.000
σ0.000
min2808.000-2814.000=-6.000
max2808.000-2814.000=-6.000
mean28.190-28.242=-0.051
σ0.138-0.146=-0.008
min28.078-28.090=-0.013
max28.390-28.440=-0.049