Compare commits

Home / Compare 7378bd34 .. 39fef913

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.000
σ0.053-0.053=0.000
min35.219-35.218=0.001
max35.395-35.394=0.001
mean412.900-413.000=-0.100
σ0.316-0.000=0.316
min412.000-413.000=-1.000
max413.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.001
min0.082-0.076=0.007
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.002=0.001
min23.764-23.766=-0.002
max23.775-23.774=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.069=-0.004
σ0.002-0.004=-0.002
min0.062-0.066=-0.004
max0.068-0.076=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=-0.001
σ0.365-0.365=0.000
min1755.787-1755.790=-0.004
max1756.949-1756.954=-0.004
mean1656.050-1645.800=10.250
σ639.478-637.153=2.325
min676.000-627.000=49.000
max2845.000-2749.000=96.000
mean2.324-2.352=-0.028
σ0.079-0.111=-0.033
min2.246-2.240=0.006
max2.515-2.602=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.581=-0.001
σ0.051-0.053=-0.002
min324.490-324.488=0.002
max324.612-324.618=-0.006
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean0.423-0.423=0.000
σ0.001-0.001=-0.000
min0.421-0.421=0.000
max0.424-0.424=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.148-1985.142=0.006
σ0.012-0.019=-0.007
min1985.132-1985.110=0.022
max1985.164-1985.159=0.005
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean2.590-2.612=-0.021
σ0.053-0.121=-0.068
min2.539-2.501=0.038
max2.658-2.786=-0.128
iters=5
new-facts=6402
prior-facts=1
mean4808.455-4808.761=-0.306
σ7.839-7.653=0.186
min4804.354-4805.239=-0.885
max4822.453-4822.450=0.002
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean8.672-8.686=-0.014
σ0.852-0.548=0.304
min7.655-7.726=-0.071
max9.873-9.054=0.819
iters=5
new-facts=6402
prior-facts=6402
mean4996.272-4996.206=0.066
σ0.149-0.201=-0.052
min4996.008-4995.978=0.030
max4996.366-4996.368=-0.002
mean3049.000-3026.400=22.600
σ215.781-213.754=2.027
min2845.000-2749.000=96.000
max3363.000-3314.000=49.000
mean8.640-8.608=0.032
σ0.242-0.147=0.095
min8.397-8.452=-0.055
max9.011-8.780=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-0.989=-0.011
σ0.069-0.141=-0.071
min0.915-0.909=0.005
max1.054-1.239=-0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.970=0.001
σ574.256-574.250=0.006
min175.837-175.837=0.000
max1324.355-1324.345=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean0.430-0.429=0.001
σ0.294-0.297=-0.003
min0.282-0.279=0.003
max0.872-0.875=-0.003
policies=20
mean1758.714-1758.704=0.011
σ0.350-0.332=0.018
min1758.474-1758.477=-0.003
max1759.232-1759.195=0.037
mean820.000
σ0.000
min820.000
max820.000
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean2.800-2.819=-0.019
σ0.038-0.072=-0.034
min2.776-2.781=-0.005
max2.857-2.927=-0.070
policies=200
mean17593.364-17592.430=0.934
σ0.505-0.502=0.002
min17592.733-17592.134=0.600
max17593.812-17593.182=0.631
mean8200.000
σ0.000
min8200.000
max8200.000
mean2845.000-2749.000=96.000
σ0.000
min2845.000-2749.000=96.000
max2845.000-2749.000=96.000
mean27.868-27.303=0.565
σ0.397-0.117=0.279
min27.396-27.179=0.217
max28.276-27.430=0.846