Compare commits

Home / Compare 4d279ce2 .. b56946d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.914=-0.001
σ0.367-0.366=0.002
min53.789-53.783=0.006
max54.958-54.954=0.004
mean417.200-412.000=5.200
σ0.632-0.000=0.632
min417.000-412.000=5.000
max419.000-412.000=7.000
mean0.139-0.139=0.000
σ0.004-0.004=0.000
min0.135-0.134=0.000
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=-0.000
σ0.006-0.006=0.000
min43.128-43.132=-0.004
max43.152-43.151=0.002
mean419.000-412.000=7.000
σ0.000
min419.000-412.000=7.000
max419.000-412.000=7.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.001
min0.119-0.114=0.004
max0.128-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.068-992.079=-0.011
σ1.265-1.234=0.031
min991.522-991.498=0.024
max997.395-997.264=0.131
mean1070.200-1066.650=3.550
σ322.580-317.332=5.249
min576.000-600.000=-24.000
max1637.000-1642.000=-5.000
mean1.526-1.523=0.003
σ0.084-0.055=0.028
min1.391-1.465=-0.073
max1.766-1.695=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.678-285.649=0.029
σ0.010-0.011=-0.002
min285.666-285.636=0.030
max285.689-285.661=0.028
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean0.376-0.375=0.001
σ0.002-0.001=0.001
min0.374-0.374=0.000
max0.378-0.375=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.621-1285.639=-0.018
σ0.096-0.131=-0.035
min1285.573-1285.573=-0.000
max1285.792-1285.874=-0.081
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean1.921-1.868=0.053
σ0.134-0.048=0.086
min1.812-1.814=-0.003
max2.149-1.935=0.214
iters=5
new-facts=6402
prior-facts=1
mean1807.989-1807.965=0.025
σ7.012-7.018=-0.007
min1804.608-1804.626=-0.018
max1820.517-1820.505=0.012
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean4.266-4.206=0.059
σ0.247-0.297=-0.050
min3.954-3.995=-0.041
max4.580-4.710=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean2070.466-2070.464=0.003
σ0.011-0.008=0.003
min2070.457-2070.453=0.003
max2070.486-2070.476=0.010
mean1838.200-1856.200=-18.000
σ174.996-208.471=-33.475
min1637.000-1642.000=-5.000
max2074.000-2094.000=-20.000
mean4.511-4.457=0.054
σ0.042-0.067=-0.025
min4.476-4.398=0.077
max4.570-4.565=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.249=-0.058
σ0.306-0.373=-0.067
min0.908-0.905=0.003
max1.695-1.788=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-437.382=0.004
σ572.360-572.360=-0.000
min151.201-151.196=0.004
max1295.926-1295.922=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean0.525-0.538=-0.013
σ0.538-0.562=-0.024
min0.252-0.251=0.000
max1.332-1.381=-0.049
policies=20
mean1512.214-1512.193=0.021
σ0.248-0.238=0.009
min1512.056-1512.039=0.017
max1512.583-1512.548=0.035
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean2.535-2.515=0.020
σ0.039-0.003=0.037
min2.504-2.513=-0.009
max2.590-2.519=0.071
policies=200
mean15129.704-15129.740=-0.036
σ0.040-0.033=0.007
min15129.646-15129.706=-0.061
max15129.733-15129.780=-0.047
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1642.000=-5.000
σ0.000
min1637.000-1642.000=-5.000
max1637.000-1642.000=-5.000
mean25.645-25.692=-0.047
σ0.144-0.169=-0.025
min25.514-25.528=-0.014
max25.824-25.922=-0.098