Compare commits

Home / Compare e072ec9b .. 34c224a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.000
σ0.369-0.368=0.001
min53.790-53.784=0.005
max54.963-54.960=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.137-0.136=0.000
σ0.004-0.005=-0.000
min0.131-0.131=0.001
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.005-0.007=-0.002
min43.135-43.131=0.004
max43.149-43.149=-0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.120=0.002
σ0.003-0.003=0.000
min0.118-0.114=0.004
max0.127-0.122=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.141-992.138=0.003
σ1.185-1.187=-0.001
min991.584-991.601=-0.017
max997.110-997.117=-0.007
mean1066.800-1064.050=2.750
σ319.935-319.269=0.666
min599.000-597.000=2.000
max1641.000-1637.000=4.000
mean1.524-1.529=-0.006
σ0.083-0.096=-0.013
min1.396-1.420=-0.023
max1.736-1.799=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.720-285.719=0.001
σ0.011-0.012=-0.001
min285.701-285.703=-0.002
max285.731-285.732=-0.001
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.380-0.379=0.001
σ0.006-0.006=0.000
min0.375-0.375=0.000
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.786-1285.798=-0.012
σ0.086-0.089=-0.003
min1285.635-1285.639=-0.004
max1285.844-1285.844=0.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean1.901-1.843=0.058
σ0.126-0.039=0.086
min1.789-1.805=-0.016
max2.087-1.906=0.181
iters=5
new-facts=6402
prior-facts=1
mean1696.110-1694.607=1.503
σ6.847-6.866=-0.019
min1692.938-1691.375=1.563
max1708.355-1706.882=1.473
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.919-3.171=-0.253
σ0.242-0.270=-0.028
min2.584-2.778=-0.193
max3.233-3.417=-0.184
iters=5
new-facts=6402
prior-facts=6402
mean1958.710-1957.110=1.601
σ0.008-0.062=-0.053
min1958.702-1957.077=1.625
max1958.720-1957.220=1.500
mean1800.400-1853.000=-52.600
σ176.606-184.688=-8.081
min1641.000-1637.000=4.000
max2050.000-2058.000=-8.000
mean3.154-3.731=-0.577
σ0.049-0.424=-0.375
min3.111-3.033=0.078
max3.229-4.091=-0.862

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.236=-0.037
σ0.275-0.344=-0.070
min0.904-0.908=-0.005
max1.632-1.806=-0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.383-437.386=-0.003
σ572.360-572.364=-0.004
min151.194-151.195=-0.001
max1295.923-1295.932=-0.009
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean0.538-0.540=-0.001
σ0.560-0.572=-0.012
min0.257-0.250=0.007
max1.378-1.397=-0.020
policies=20
mean1512.194-1512.210=-0.016
σ0.255-0.243=0.013
min1512.032-1512.054=-0.022
max1512.575-1512.572=0.003
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean2.535-2.522=0.013
σ0.016-0.016=0.000
min2.514-2.502=0.012
max2.553-2.538=0.014
policies=200
mean15129.502-15129.730=-0.229
σ0.063-0.052=0.011
min15129.408-15129.661=-0.253
max15129.541-15129.787=-0.246
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1637.000=4.000
σ0.000
min1641.000-1637.000=4.000
max1641.000-1637.000=4.000
mean25.599-25.523=0.076
σ0.147-0.147=-0.001
min25.453-25.352=0.100
max25.780-25.669=0.111