Compare commits

Home / Compare cdc6d3eb .. 1cda39e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.801-35.992=-0.190
σ0.106-0.108=-0.002
min35.760-35.949=-0.189
max36.103-36.297=-0.194
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.074-0.076=-0.002
σ0.002-0.004=-0.001
min0.070-0.071=-0.001
max0.079-0.083=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.221=-0.156
σ0.004-0.002=0.001
min26.060-26.218=-0.158
max26.071-26.225=-0.154
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.060-0.058=0.002
σ0.003-0.003=0.000
min0.056-0.056=0.000
max0.067-0.064=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.269-1756.712=-2.443
σ0.366-0.369=-0.003
min1753.711-1756.139=-2.428
max1754.856-1757.302=-2.446
mean1636.900-1636.100=0.800
σ618.259-635.326=-17.067
min647.000-641.000=6.000
max2472.000-2844.000=-372.000
mean2.793-2.356=0.436
σ0.239-0.084=0.155
min2.278-2.266=0.012
max3.293-2.557=0.736

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.572-277.883=-2.311
σ0.009-0.009=0.000
min275.562-277.869=-2.307
max275.582-277.893=-2.312
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean0.398-0.403=-0.005
σ0.010-0.004=0.006
min0.388-0.399=-0.012
max0.409-0.408=0.001
iters=5
new-facts=1
prior-facts=6402
mean2172.833-2176.825=-3.992
σ0.019-0.020=-0.001
min2172.804-2176.797=-3.993
max2172.850-2176.841=-3.991
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean3.077-3.371=-0.295
σ0.206-0.186=0.021
min2.817-3.093=-0.276
max3.366-3.537=-0.170
iters=5
new-facts=6402
prior-facts=1
mean5050.827-5054.581=-3.754
σ0.983-1.039=-0.056
min5050.010-5053.638=-3.628
max5052.533-5056.360=-3.826
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean8.744-8.862=-0.119
σ0.455-0.417=0.038
min8.177-8.265=-0.088
max9.087-9.293=-0.206
iters=5
new-facts=6402
prior-facts=6402
mean5186.806-5192.115=-5.309
σ0.087-0.093=-0.007
min5186.735-5192.024=-5.290
max5186.927-5192.217=-5.290
mean3283.000-3309.800=-26.800
σ420.631-372.739=47.892
min2695.000-2844.000=-149.000
max3671.000-3677.000=-6.000
mean9.814-8.826=0.987
σ0.257-0.083=0.174
min9.597-8.714=0.883
max10.163-8.897=1.266

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.789-1.002=0.786
σ0.109-0.075=0.034
min1.620-0.933=0.688
max1.924-1.087=0.837

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.405-464.039=-0.635
σ573.074-573.082=-0.008
min176.867-177.493=-0.626
max1323.015-1323.662=-0.647
mean77.750
σ7.500
min74.000
max89.000
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean0.536-0.437=0.099
σ0.516-0.302=0.214
min0.275-0.281=-0.006
max1.310-0.890=0.420
policies=20
mean1768.941-1775.210=-6.269
σ0.328-0.323=0.005
min1768.736-1774.998=-6.262
max1769.429-1775.688=-6.259
mean740.000
σ0.000
min740.000
max740.000
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean2.732-2.829=-0.097
σ0.014-0.010=0.004
min2.713-2.817=-0.104
max2.743-2.838=-0.095
policies=200
mean17696.137-17758.294=-62.157
σ0.419-0.432=-0.013
min17695.799-17758.017=-62.217
max17696.748-17758.936=-62.187
mean7400.000
σ0.000
min7400.000
max7400.000
mean2472.000-2844.000=-372.000
σ0.000
min2472.000-2844.000=-372.000
max2472.000-2844.000=-372.000
mean27.785-28.150=-0.364
σ0.250-0.579=-0.329
min27.497-27.652=-0.155
max28.082-28.792=-0.710