Compare commits

Home / Compare 5aed75b2 .. 30bc0730

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.001
σ0.048-0.048=-0.001
min30.732-30.727=0.005
max30.901-30.901=0.000
mean412.000-416.200=-4.200
σ0.000-0.422=-0.422
min412.000-416.000=-4.000
max412.000-417.000=-5.000
mean0.076-0.078=-0.002
σ0.005-0.004=0.001
min0.070-0.076=-0.006
max0.082-0.086=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.003-0.002=0.001
min21.054-21.058=-0.004
max21.064-21.064=0.000
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.061-0.064=-0.003
σ0.004-0.003=0.002
min0.057-0.062=-0.005
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.416-1751.418=-0.002
σ0.362-0.362=-0.000
min1750.849-1750.849=-0.001
max1751.998-1752.008=-0.010
mean1676.600-1668.350=8.250
σ622.308-639.480=-17.172
min666.000-682.000=-16.000
max2645.000-2697.000=-52.000
mean2.786-2.833=-0.047
σ0.152-0.148=0.004
min2.377-2.308=0.069
max2.964-3.022=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.760-275.757=0.002
σ0.012-0.012=0.000
min275.747-275.745=0.002
max275.775-275.770=0.005
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean0.399-0.403=-0.004
σ0.005-0.011=-0.005
min0.394-0.395=-0.001
max0.407-0.418=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2168.293-2168.267=0.026
σ0.004-0.012=-0.007
min2168.288-2168.254=0.035
max2168.299-2168.285=0.014
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean2.922-2.961=-0.039
σ0.094-0.157=-0.063
min2.761-2.786=-0.025
max2.993-3.128=-0.135
iters=5
new-facts=6402
prior-facts=1
mean5047.978-5048.120=-0.142
σ1.009-0.940=0.069
min5047.209-5047.532=-0.323
max5049.747-5049.791=-0.043
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean8.877-8.800=0.077
σ0.511-0.522=-0.011
min8.028-8.050=-0.023
max9.354-9.336=0.019
iters=5
new-facts=6402
prior-facts=6402
mean5179.152-5179.231=-0.079
σ0.212-0.070=0.142
min5178.791-5179.165=-0.374
max5179.316-5179.310=0.006
mean3230.200-3267.200=-37.000
σ396.287-374.673=21.615
min2692.000-2736.000=-44.000
max3739.000-3717.000=22.000
mean9.517-9.953=-0.435
σ0.723-0.342=0.381
min8.718-9.598=-0.880
max10.352-10.487=-0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.185-1.208=-0.023
σ0.278-0.181=0.096
min0.942-1.078=-0.136
max1.547-1.475=0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.575-463.572=0.004
σ572.674-572.665=0.008
min177.235-177.235=-0.000
max1322.586-1322.569=0.016
mean79.750
σ7.500
min76.000
max91.000
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean0.548-0.547=0.000
σ0.545-0.542=0.003
min0.272-0.274=-0.001
max1.366-1.361=0.005
policies=20
mean1772.620-1772.625=-0.006
σ0.332-0.329=0.003
min1772.403-1772.402=0.001
max1773.114-1773.113=0.001
mean760.000
σ0.000
min760.000
max760.000
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean2.749-2.747=0.002
σ0.017-0.017=0.000
min2.731-2.724=0.008
max2.771-2.760=0.011
policies=200
mean17732.873-17733.037=-0.164
σ0.605-0.494=0.111
min17732.484-17732.774=-0.290
max17733.773-17733.779=-0.005
mean7600.000
σ0.000
min7600.000
max7600.000
mean2645.000-2697.000=-52.000
σ0.000
min2645.000-2697.000=-52.000
max2645.000-2697.000=-52.000
mean27.655-27.628=0.026
σ0.127-0.148=-0.021
min27.545-27.491=0.055
max27.815-27.834=-0.018