Compare commits

Home / Compare 97a39069 .. 222c7b4f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.000
σ0.047-0.047=0.001
min30.726-30.731=-0.005
max30.899-30.897=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.074-0.078=-0.004
σ0.004-0.003=0.001
min0.070-0.076=-0.006
max0.080-0.084=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.002-0.002=0.000
min21.057-21.058=-0.001
max21.064-21.063=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.061-0.063=-0.002
σ0.003-0.002=0.001
min0.057-0.062=-0.004
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.419=0.001
σ0.360-0.360=0.000
min1750.851-1750.851=-0.000
max1752.005-1752.006=-0.001
mean1650.450-1659.400=-8.950
σ624.593-634.800=-10.207
min680.000-693.000=-13.000
max2652.000-2772.000=-120.000
mean2.837-2.794=0.044
σ0.127-0.169=-0.042
min2.528-2.344=0.184
max3.081-3.054=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.730-275.756=-0.025
σ0.009-0.008=0.001
min275.721-275.743=-0.022
max275.744-275.765=-0.021
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean0.402-0.403=-0.001
σ0.008-0.007=0.001
min0.397-0.396=0.001
max0.415-0.412=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2009.771=158.503
σ0.021-354.429=-354.407
min2168.254-1375.750=792.504
max2168.300-2168.295=0.005
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean2.970-2.619=0.351
σ0.134-0.306=-0.172
min2.757-2.073=0.684
max3.090-2.777=0.313
iters=5
new-facts=6402
prior-facts=1
mean5048.100-5048.157=-0.058
σ0.917-0.974=-0.057
min5047.515-5047.547=-0.032
max5049.709-5049.886=-0.177
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean8.980-8.637=0.343
σ0.557-0.756=-0.199
min8.163-7.812=0.351
max9.597-9.744=-0.147
iters=5
new-facts=6402
prior-facts=6402
mean5179.097-5179.230=-0.133
σ0.341-0.081=0.260
min5178.501-5179.153=-0.652
max5179.328-5179.319=0.009
mean3225.600-3225.200=0.400
σ369.873-401.426=-31.552
min2697.000-2772.000=-75.000
max3678.000-3783.000=-105.000
mean9.951-9.758=0.193
σ0.198-0.317=-0.119
min9.610-9.457=0.152
max10.118-10.265=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.068=0.059
σ0.272-0.128=0.143
min0.936-0.955=-0.019
max1.542-1.269=0.274

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.570=0.006
σ572.674-572.654=0.021
min177.236-177.238=-0.003
max1322.587-1322.551=0.037
mean79.750
σ7.500
min76.000
max91.000
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean0.548-0.440=0.108
σ0.532-0.300=0.232
min0.276-0.284=-0.007
max1.345-0.889=0.456
policies=20
mean1772.616-1772.692=-0.076
σ0.332-0.350=-0.018
min1772.400-1772.449=-0.049
max1773.109-1773.207=-0.098
mean760.000
σ0.000
min760.000
max760.000
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean2.754-2.839=-0.085
σ0.020-0.115=-0.095
min2.731-2.749=-0.019
max2.779-3.004=-0.225
policies=200
mean17732.916-17732.977=-0.061
σ0.425-0.385=0.040
min17732.550-17732.709=-0.159
max17733.521-17733.548=-0.027
mean7600.000
σ0.000
min7600.000
max7600.000
mean2652.000-2772.000=-120.000
σ0.000
min2652.000-2772.000=-120.000
max2652.000-2772.000=-120.000
mean27.743-27.802=-0.059
σ0.089-0.109=-0.020
min27.649-27.683=-0.034
max27.847-27.928=-0.081