Compare commits

Home / Compare ce7a3133 .. 186d3ebd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=0.000
σ0.048-0.049=-0.000
min33.949-33.953=-0.004
max34.112-34.113=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.081=0.002
σ0.003-0.005=-0.002
min0.077-0.076=0.000
max0.089-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.002-0.002=0.000
min23.311-23.313=-0.001
max23.320-23.319=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.065=-0.003
σ0.003-0.002=0.002
min0.059-0.063=-0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.303=0.191
σ0.365-0.364=0.001
min1756.920-1756.728=0.192
max1758.086-1757.888=0.198
mean1668.650-1648.550=20.100
σ641.898-625.322=16.577
min676.000-637.000=39.000
max2641.000-2827.000=-186.000
mean2.364-2.351=0.013
σ0.117-0.118=-0.001
min2.217-2.133=0.084
max2.648-2.636=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.640-326.449=0.190
σ0.041-0.051=-0.010
min326.568-326.359=0.208
max326.672-326.483=0.189
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean0.426-0.425=0.002
σ0.005-0.001=0.004
min0.424-0.423=0.001
max0.435-0.426=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.807-1988.607=0.200
σ0.008-0.012=-0.005
min1988.797-1988.598=0.199
max1988.818-1988.628=0.190
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean2.683-2.789=-0.106
σ0.049-0.126=-0.077
min2.639-2.626=0.013
max2.762-2.916=-0.154
iters=5
new-facts=6402
prior-facts=1
mean4813.662-4813.500=0.162
σ7.720-7.684=0.036
min4810.105-4809.954=0.150
max4827.471-4827.245=0.226
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean8.439-8.217=0.222
σ0.487-0.478=0.009
min7.854-7.756=0.098
max9.131-8.909=0.223
iters=5
new-facts=6402
prior-facts=6402
mean5001.213-5001.014=0.200
σ0.052-0.030=0.021
min5001.173-5000.977=0.196
max5001.278-5001.052=0.226
mean2995.600-3010.800=-15.200
σ395.447-253.703=141.744
min2641.000-2827.000=-186.000
max3560.000-3407.000=153.000
mean9.612-9.659=-0.046
σ0.757-0.347=0.410
min8.414-9.217=-0.803
max10.301-9.978=0.323

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-0.948=0.245
σ0.404-0.057=0.348
min0.905-0.917=-0.012
max1.893-1.048=0.845

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-464.434=0.201
σ574.778-574.769=0.009
min177.238-177.043=0.195
max1326.802-1326.587=0.215
mean88.250
σ8.500
min84.000
max101.000
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean0.562-0.435=0.127
σ0.577-0.299=0.277
min0.270-0.286=-0.015
max1.427-0.884=0.543
policies=20
mean1772.680-1770.795=1.885
σ0.356-0.360=-0.004
min1772.451-1770.548=1.903
max1773.211-1771.329=1.882
mean840.000
σ0.000
min840.000
max840.000
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean2.728-2.805=-0.077
σ0.027-0.001=0.026
min2.695-2.804=-0.109
max2.760-2.806=-0.046
policies=200
mean17734.102-17714.984=19.118
σ0.524-0.486=0.038
min17733.760-17714.641=19.119
max17734.882-17715.704=19.179
mean8400.000
σ0.000
min8400.000
max8400.000
mean2641.000-2827.000=-186.000
σ0.000
min2641.000-2827.000=-186.000
max2641.000-2827.000=-186.000
mean27.532-27.917=-0.386
σ0.160-0.404=-0.245
min27.341-27.487=-0.146
max27.729-28.384=-0.655