Compare commits

Home / Compare 3dd00ace .. aee3cc6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.367-0.367=0.000
min53.788-53.786=0.002
max54.960-54.958=0.002
mean414.300-413.600=0.700
σ0.483-0.516=-0.033
min414.000-413.000=1.000
max415.000-414.000=1.000
mean0.137-0.138=-0.001
σ0.005-0.004=0.001
min0.130-0.132=-0.002
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.006-0.006=0.000
min43.131-43.131=-0.001
max43.149-43.149=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.001
min0.117-0.115=0.002
max0.126-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.085-992.071=0.014
σ1.246-1.255=-0.010
min991.495-991.520=-0.025
max997.314-997.358=-0.044
mean1070.750-1059.250=11.500
σ323.017-315.544=7.473
min573.000-587.000=-14.000
max1637.000-1489.000=148.000
mean1.534-1.551=-0.017
σ0.078-0.082=-0.003
min1.424-1.410=0.014
max1.760-1.799=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.679-285.651=0.028
σ0.010-0.012=-0.001
min285.661-285.636=0.025
max285.688-285.664=0.024
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean0.377-0.381=-0.003
σ0.004-0.005=-0.001
min0.372-0.378=-0.005
max0.383-0.390=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.636-1285.643=-0.007
σ0.132-0.139=-0.007
min1285.573-1285.575=-0.002
max1285.872-1285.891=-0.019
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean1.885-1.927=-0.042
σ0.062-0.152=-0.090
min1.845-1.829=0.016
max1.994-2.195=-0.202
iters=5
new-facts=6402
prior-facts=1
mean1807.987-1807.952=0.034
σ7.007-7.023=-0.015
min1804.610-1804.583=0.027
max1820.505-1820.499=0.006
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean4.231-4.110=0.121
σ0.189-0.296=-0.107
min3.985-3.775=0.210
max4.427-4.579=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean2070.460-2070.468=-0.008
σ0.012-0.009=0.003
min2070.444-2070.460=-0.016
max2070.479-2070.484=-0.005
mean1861.600-1831.600=30.000
σ200.825-183.685=17.140
min1637.000-1606.000=31.000
max2093.000-2074.000=19.000
mean4.538-4.511=0.027
σ0.120-0.143=-0.022
min4.410-4.370=0.040
max4.689-4.737=-0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.712=-0.505
σ0.286-0.182=0.104
min0.914-1.389=-0.475
max1.636-1.835=-0.199

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.386-437.368=0.018
σ572.359-572.342=0.017
min151.199-151.193=0.007
max1295.924-1295.881=0.043
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean0.521-0.537=-0.015
σ0.523-0.558=-0.035
min0.258-0.251=0.006
max1.306-1.373=-0.067
policies=20
mean1512.210-1512.187=0.022
σ0.246-0.264=-0.018
min1512.053-1512.014=0.039
max1512.576-1512.580=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean2.527-2.545=-0.018
σ0.009-0.018=-0.008
min2.515-2.531=-0.015
max2.535-2.571=-0.036
policies=200
mean15129.638-15129.647=-0.010
σ0.161-0.142=0.019
min15129.449-15129.442=0.007
max15129.778-15129.763=0.015
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1489.000=148.000
σ0.000
min1637.000-1489.000=148.000
max1637.000-1489.000=148.000
mean25.658-25.724=-0.066
σ0.186-0.095=0.091
min25.516-25.651=-0.134
max25.909-25.860=0.049