Compare commits

Home / Compare 830efbbb .. 00f1cd0e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.047-0.049=-0.002
min33.947-33.950=-0.004
max34.108-34.115=-0.006
mean416.000
σ0.000
min416.000
max416.000
mean0.085-0.081=0.004
σ0.003-0.005=-0.002
min0.083-0.076=0.007
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.000
min23.312-23.312=0.000
max23.321-23.324=-0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.067=-0.003
σ0.003-0.004=-0.001
min0.060-0.064=-0.004
max0.068-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1757.492=0.001
σ0.365-0.364=0.001
min1756.917-1756.919=-0.002
max1758.086-1758.083=0.003
mean1650.450-1672.950=-22.500
σ625.046-624.646=0.400
min639.000-666.000=-27.000
max2825.000-2695.000=130.000
mean2.399-2.382=0.018
σ0.133-0.112=0.021
min2.264-2.275=-0.011
max2.851-2.763=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.639-326.637=0.002
σ0.051-0.048=0.003
min326.549-326.554=-0.005
max326.676-326.676=-0.000
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean0.429-0.427=0.002
σ0.006-0.005=0.001
min0.424-0.421=0.003
max0.438-0.433=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.802=-0.003
σ0.016-0.013=0.004
min1988.783-1988.783=-0.000
max1988.820-1988.818=0.003
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean2.722-2.697=0.026
σ0.144-0.145=-0.001
min2.567-2.492=0.076
max2.953-2.896=0.057
iters=5
new-facts=6402
prior-facts=1
mean4813.678-4813.648=0.030
σ7.712-7.752=-0.040
min4810.137-4810.139=-0.002
max4827.472-4827.516=-0.043
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean8.601-8.963=-0.362
σ0.578-0.304=0.273
min7.641-8.693=-1.051
max9.100-9.417=-0.317
iters=5
new-facts=6402
prior-facts=6402
mean5001.201-5001.057=0.144
σ0.015-0.196=-0.182
min5001.186-5000.824=0.362
max5001.217-5001.209=0.009
mean2997.800-3021.200=-23.400
σ252.625-234.122=18.502
min2825.000-2695.000=130.000
max3405.000-3316.000=89.000
mean9.808-9.619=0.189
σ0.065-0.491=-0.426
min9.748-8.753=0.996
max9.909-9.952=-0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.990-1.087=-0.097
σ0.172-0.222=-0.050
min0.906-0.917=-0.011
max1.298-1.351=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.633-464.635=-0.002
σ574.769-574.782=-0.013
min177.238-177.236=0.002
max1326.786-1326.807=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean0.436-0.568=-0.132
σ0.304-0.593=-0.289
min0.283-0.268=0.015
max0.892-1.457=-0.565
policies=20
mean1772.709-1772.660=0.049
σ0.366-0.353=0.014
min1772.450-1772.426=0.024
max1773.248-1773.184=0.064
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean2.816-2.711=0.104
σ0.008-0.011=-0.003
min2.808-2.699=0.109
max2.826-2.726=0.101
policies=200
mean17734.118-17734.035=0.083
σ0.473-0.554=-0.081
min17733.766-17733.652=0.114
max17734.814-17734.855=-0.041
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2695.000=130.000
σ0.000
min2825.000-2695.000=130.000
max2825.000-2695.000=130.000
mean28.147-27.440=0.708
σ0.387-0.121=0.266
min27.769-27.299=0.470
max28.590-27.576=1.014