Compare commits

Home / Compare e4406f3a .. 67c03526

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.774-35.797=-5.024
σ0.047-0.104=-0.057
min30.751-35.751=-5.000
max30.907-36.093=-5.186
mean414.000
σ0.000
min414.000
max414.000
mean0.079-0.074=0.005
σ0.003-0.002=0.001
min0.076-0.068=0.008
max0.086-0.077=0.008
cache=y
dps=1
iters=10
policies=100
mean21.059-26.065=-5.006
σ0.002-0.004=-0.002
min21.056-26.058=-5.002
max21.065-26.071=-5.007
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.060=0.005
σ0.003-0.003=0.001
min0.062-0.057=0.005
max0.072-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.233-1751.237=-0.004
σ0.362-0.361=0.001
min1750.661-1750.670=-0.009
max1751.811-1751.811=0.000
mean1660.650-1639.650=21.000
σ634.071-613.882=20.189
min680.000-628.000=52.000
max2677.000-2469.000=208.000
mean2.836-2.847=-0.011
σ0.206-0.166=0.040
min2.266-2.450=-0.183
max3.086-3.152=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.564=0.002
σ0.007-0.007=-0.000
min275.561-275.555=0.007
max275.578-275.573=0.005
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean0.391-0.393=-0.002
σ0.008-0.010=-0.002
min0.385-0.384=0.002
max0.405-0.405=0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.087-2168.086=0.001
σ0.015-0.019=-0.004
min2168.069-2168.068=0.001
max2168.103-2168.114=-0.011
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean2.914-2.835=0.079
σ0.202-0.078=0.125
min2.692-2.749=-0.056
max3.204-2.952=0.252
iters=5
new-facts=6402
prior-facts=1
mean5047.906-5047.684=0.222
σ0.904-1.157=-0.253
min5047.406-5046.329=1.078
max5049.517-5049.525=-0.008
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean8.858-8.931=-0.073
σ0.503-0.401=0.102
min8.059-8.510=-0.451
max9.286-9.464=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean5178.890-5179.042=-0.152
σ0.371-0.073=0.298
min5178.250-5178.971=-0.721
max5179.160-5179.123=0.037
mean3265.600-3134.000=131.600
σ453.607-472.701=-19.094
min2677.000-2564.000=113.000
max3875.000-3741.000=134.000
mean9.856-9.922=-0.066
σ0.492-0.356=0.136
min9.020-9.504=-0.485
max10.225-10.455=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.839=-0.626
σ0.268-0.067=0.202
min0.964-1.765=-0.801
max1.650-1.931=-0.281

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.197=0.006
σ572.664-572.654=0.010
min176.868-176.869=-0.000
max1322.199-1322.177=0.021
mean77.500
σ7.000
min74.000
max88.000
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean0.556-0.552=0.004
σ0.547-0.570=-0.022
min0.280-0.250=0.030
max1.377-1.406=-0.029
policies=20
mean1768.969-1768.947=0.022
σ0.333-0.336=-0.003
min1768.763-1768.735=0.028
max1769.467-1769.448=0.019
mean740.000
σ0.000
min740.000
max740.000
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean2.747-2.743=0.004
σ0.016-0.023=-0.007
min2.732-2.724=0.008
max2.769-2.777=-0.008
policies=200
mean17696.238-17696.137=0.102
σ0.489-0.459=0.031
min17695.992-17695.766=0.226
max17696.972-17696.804=0.168
mean7400.000
σ0.000
min7400.000
max7400.000
mean2677.000-2469.000=208.000
σ0.000
min2677.000-2469.000=208.000
max2677.000-2469.000=208.000
mean27.695-27.522=0.173
σ0.154-0.218=-0.064
min27.548-27.314=0.234
max27.866-27.717=0.149