Compare commits

Home / Compare d79a5c9b .. 490c3709

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.001
σ0.050-0.049=0.002
min33.950-33.955=-0.005
max34.119-34.115=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.083-0.083=-0.000
σ0.005-0.004=0.001
min0.075-0.077=-0.002
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.001
σ0.003-0.003=-0.000
min23.314-23.314=-0.000
max23.323-23.323=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.066=-0.000
σ0.003-0.003=0.000
min0.063-0.064=-0.001
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.427-1757.301=0.126
σ0.365-0.364=0.000
min1756.852-1756.727=0.126
max1758.019-1757.890=0.129
mean1651.200-1646.900=4.300
σ624.362-624.046=0.316
min676.000-636.000=40.000
max2590.000-2826.000=-236.000
mean2.373-2.349=0.024
σ0.116-0.086=0.030
min2.220-2.242=-0.022
max2.674-2.601=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.563-326.452=0.111
σ0.065-0.036=0.030
min326.448-326.391=0.057
max326.604-326.480=0.124
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean0.426-0.424=0.002
σ0.010-0.003=0.007
min0.420-0.421=-0.001
max0.444-0.430=0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.706-1988.610=0.095
σ0.041-0.011=0.030
min1988.648-1988.598=0.051
max1988.748-1988.624=0.124
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean2.668-2.716=-0.048
σ0.060-0.152=-0.092
min2.615-2.565=0.051
max2.764-2.951=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4813.507-4813.244=0.264
σ7.764-7.882=-0.118
min4809.700-4808.868=0.831
max4827.390-4827.314=0.075
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean8.441-8.567=-0.126
σ0.533-0.551=-0.017
min7.708-7.949=-0.241
max9.107-9.269=-0.163
iters=5
new-facts=6402
prior-facts=6402
mean5001.128-5001.011=0.117
σ0.014-0.026=-0.011
min5001.113-5000.970=0.142
max5001.146-5001.038=0.108
mean2921.000-3061.200=-140.200
σ253.447-307.611=-54.164
min2590.000-2826.000=-236.000
max3266.000-3532.000=-266.000
mean9.471-9.754=-0.282
σ0.642-0.331=0.311
min8.343-9.412=-1.068
max9.848-10.139=-0.290

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-0.920=0.326
σ0.395-0.013=0.381
min0.917-0.912=0.005
max1.784-0.944=0.841

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.432=0.134
σ574.790-574.766=0.024
min177.163-177.043=0.121
max1326.751-1326.581=0.170
mean88.250
σ8.500
min84.000
max101.000
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean0.556-0.438=0.118
σ0.569-0.306=0.262
min0.269-0.282=-0.013
max1.409-0.897=0.512
policies=20
mean1772.014-1770.792=1.221
σ0.345-0.356=-0.012
min1771.779-1770.566=1.213
max1772.525-1771.323=1.202
mean840.000
σ0.000
min840.000
max840.000
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean2.702-2.802=-0.100
σ0.012-0.021=-0.008
min2.687-2.776=-0.089
max2.714-2.826=-0.112
policies=200
mean17727.458-17714.848=12.611
σ0.477-0.413=0.064
min17727.185-17714.571=12.613
max17728.173-17715.462=12.711
mean8400.000
σ0.000
min8400.000
max8400.000
mean2590.000-2826.000=-236.000
σ0.000
min2590.000-2826.000=-236.000
max2590.000-2826.000=-236.000
mean27.467-27.898=-0.432
σ0.153-0.314=-0.161
min27.302-27.612=-0.310
max27.661-28.252=-0.591