Compare commits

Home / Compare bc82fb91 .. 1bd69a1b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.006-54.008=-0.002
σ0.367-0.366=0.001
min53.872-53.879=-0.006
max55.051-55.050=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.138-0.139=-0.000
σ0.004-0.004=0.000
min0.132-0.132=-0.000
max0.145-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.213-43.213=0.001
σ0.007-0.006=0.001
min43.204-43.204=0.000
max43.227-43.221=0.007
mean416.000-414.800=1.200
σ0.000-0.422=-0.422
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.001
min0.118-0.118=-0.001
max0.126-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.365-992.359=0.006
σ1.264-1.262=0.002
min991.784-991.806=-0.022
max997.684-997.672=0.012
mean1061.700-1067.050=-5.350
σ315.157-308.060=7.097
min601.000-665.000=-64.000
max1635.000-1593.000=42.000
mean1.546-1.520=0.026
σ0.074-0.081=-0.008
min1.462-1.402=0.060
max1.726-1.747=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.358-287.357=0.001
σ0.012-0.010=0.003
min287.339-287.341=-0.003
max287.368-287.365=0.004
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean0.379-0.373=0.007
σ0.005-0.004=0.000
min0.375-0.370=0.005
max0.386-0.380=0.005
iters=5
new-facts=1
prior-facts=6402
mean1287.326-1287.324=0.002
σ0.140-0.139=0.000
min1287.256-1287.256=0.001
max1287.575-1287.573=0.002
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean1.938-1.853=0.085
σ0.168-0.037=0.130
min1.718-1.817=-0.100
max2.107-1.916=0.192
iters=5
new-facts=6402
prior-facts=1
mean1809.645-1809.646=-0.001
σ7.027-7.019=0.008
min1806.247-1806.278=-0.031
max1822.200-1822.188=0.011
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean4.102-4.111=-0.009
σ0.223-0.255=-0.033
min3.862-3.850=0.012
max4.402-4.486=-0.084
iters=5
new-facts=6402
prior-facts=6402
mean2072.181-2072.159=0.022
σ0.051-0.017=0.034
min2072.149-2072.149=0.000
max2072.270-2072.189=0.081
mean1822.400-1850.400=-28.000
σ183.122-206.729=-23.606
min1635.000-1593.000=42.000
max2071.000-2074.000=-3.000
mean4.846-4.932=-0.086
σ0.092-0.038=0.054
min4.712-4.877=-0.164
max4.967-4.974=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.320-1.343=-0.023
σ0.350-0.368=-0.018
min0.910-0.916=-0.006
max1.776-1.717=0.059

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.409-437.412=-0.002
σ572.403-572.407=-0.004
min151.200-151.206=-0.006
max1296.013-1296.022=-0.009
mean90.250
σ8.500
min86.000
max103.000
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean0.532-0.521=0.011
σ0.552-0.540=0.012
min0.252-0.250=0.002
max1.361-1.331=0.030
policies=20
mean1512.317-1512.316=0.000
σ0.257-0.234=0.023
min1512.146-1512.159=-0.012
max1512.700-1512.665=0.035
mean860.000
σ0.000
min860.000
max860.000
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean2.541-2.512=0.029
σ0.007-0.006=0.001
min2.534-2.505=0.029
max2.550-2.519=0.030
policies=200
mean15130.878-15130.840=0.038
σ0.049-0.073=-0.024
min15130.824-15130.748=0.076
max15130.932-15130.915=0.016
mean8600.000
σ0.000
min8600.000
max8600.000
mean1635.000-1593.000=42.000
σ0.000
min1635.000-1593.000=42.000
max1635.000-1593.000=42.000
mean25.525-25.569=-0.044
σ0.140-0.087=0.054
min25.453-25.490=-0.038
max25.736-25.662=0.074