Compare commits

Home / Compare bfb7fe61 .. 8d8d8684

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.000
σ0.048-0.046=0.001
min30.727-30.731=-0.003
max30.901-30.896=0.004
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.078-0.076=0.001
σ0.003-0.003=-0.000
min0.075-0.070=0.005
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.000
σ0.003-0.002=0.000
min21.056-21.058=-0.001
max21.063-21.064=-0.001
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.063-0.062=0.001
σ0.002-0.004=-0.002
min0.061-0.056=0.005
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.419=0.002
σ0.361-0.361=0.000
min1750.859-1750.853=0.006
max1752.004-1752.006=-0.002
mean1655.050-1656.300=-1.250
σ630.220-646.090=-15.870
min624.000-641.000=-17.000
max2676.000-2848.000=-172.000
mean2.902-2.831=0.070
σ0.117-0.198=-0.081
min2.643-2.310=0.334
max3.110-3.223=-0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.726=0.032
σ0.009-0.002=0.007
min275.747-275.723=0.024
max275.769-275.728=0.040
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean0.390-0.396=-0.007
σ0.003-0.009=-0.005
min0.387-0.387=0.000
max0.396-0.406=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.288=-0.002
σ0.006-0.009=-0.002
min2168.276-2168.278=-0.002
max2168.293-2168.301=-0.008
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean2.988-2.929=0.059
σ0.123-0.157=-0.034
min2.804-2.744=0.060
max3.132-3.079=0.053
iters=5
new-facts=6402
prior-facts=1
mean5047.876-5048.000=-0.125
σ1.138-0.683=0.455
min5047.002-5047.541=-0.540
max5049.812-5049.210=0.603
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean9.040-8.916=0.124
σ0.664-0.639=0.024
min7.923-8.052=-0.129
max9.540-9.699=-0.159
iters=5
new-facts=6402
prior-facts=6402
mean5179.245-5179.020=0.225
σ0.080-0.158=-0.079
min5179.174-5178.835=0.339
max5179.344-5179.199=0.145
mean3233.200-3253.600=-20.400
σ395.369-343.871=51.498
min2695.000-2848.000=-153.000
max3740.000-3735.000=5.000
mean10.085-9.628=0.457
σ0.114-0.759=-0.644
min9.956-8.737=1.219
max10.242-10.413=-0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.118=0.085
σ0.321-0.243=0.078
min0.922-0.945=-0.022
max1.566-1.536=0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.574=-0.000
σ572.664-572.661=0.003
min177.237-177.234=0.003
max1322.570-1322.566=0.005
mean79.750
σ7.500
min76.000
max91.000
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean0.552-0.438=0.114
σ0.554-0.306=0.248
min0.273-0.281=-0.008
max1.383-0.897=0.486
policies=20
mean1772.642-1772.673=-0.030
σ0.332-0.343=-0.011
min1772.419-1772.415=0.004
max1773.136-1773.175=-0.039
mean760.000
σ0.000
min760.000
max760.000
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean2.761-2.831=-0.069
σ0.025-0.021=0.004
min2.743-2.800=-0.056
max2.799-2.845=-0.046
policies=200
mean17733.053-17733.084=-0.031
σ0.467-0.420=0.047
min17732.764-17732.818=-0.055
max17733.748-17733.709=0.038
mean7600.000
σ0.000
min7600.000
max7600.000
mean2676.000-2848.000=-172.000
σ0.000
min2676.000-2848.000=-172.000
max2676.000-2848.000=-172.000
mean27.740-28.137=-0.398
σ0.131-0.464=-0.333
min27.643-27.672=-0.028
max27.932-28.562=-0.630