Compare commits

Home / Compare 91ff24e1 .. 616e23cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.049=-0.001
min33.950-33.951=-0.000
max34.112-34.116=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.081-0.083=-0.002
σ0.004-0.004=0.000
min0.075-0.075=-0.000
max0.089-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.003-0.004=-0.000
min23.311-23.313=-0.002
max23.324-23.324=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.000
σ0.001-0.002=-0.001
min0.064-0.063=0.000
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.429=0.001
σ0.365-0.365=-0.000
min1756.854-1756.857=-0.003
max1758.021-1758.026=-0.004
mean1646.850-1647.950=-1.100
σ625.007-624.114=0.893
min637.000-638.000=-1.000
max2835.000-2831.000=4.000
mean2.348-2.342=0.006
σ0.088-0.097=-0.009
min2.209-2.223=-0.014
max2.595-2.649=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.587-326.574=0.014
σ0.024-0.050=-0.026
min326.547-326.486=0.062
max326.608-326.612=-0.004
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean0.427-0.425=0.002
σ0.006-0.005=0.001
min0.422-0.422=0.001
max0.434-0.431=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.740-1988.735=0.005
σ0.015-0.021=-0.006
min1988.715-1988.701=0.014
max1988.752-1988.755=-0.004
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean2.700-2.645=0.055
σ0.159-0.100=0.059
min2.566-2.518=0.048
max2.965-2.748=0.217
iters=5
new-facts=6402
prior-facts=1
mean4813.474-4813.480=-0.005
σ7.800-7.497=0.303
min4809.583-4810.074=-0.491
max4827.421-4826.891=0.530
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean8.943-8.722=0.221
σ0.294-0.384=-0.091
min8.515-8.320=0.195
max9.228-9.244=-0.016
iters=5
new-facts=6402
prior-facts=6402
mean5001.067-5001.152=-0.086
σ0.166-0.021=0.145
min5000.770-5001.122=-0.353
max5001.153-5001.179=-0.026
mean3001.600-3030.200=-28.600
σ188.309-203.727=-15.418
min2835.000-2831.000=4.000
max3294.000-3313.000=-19.000
mean9.571-10.001=-0.429
σ0.619-0.302=0.317
min8.475-9.769=-1.294
max9.940-10.362=-0.422

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-0.947=0.080
σ0.169-0.062=0.107
min0.911-0.893=0.018
max1.310-1.052=0.258

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.572-464.564=0.009
σ574.770-574.767=0.003
min177.174-177.174=-0.000
max1326.727-1326.714=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean0.437-0.432=0.005
σ0.307-0.307=-0.000
min0.281-0.270=0.011
max0.897-0.892=0.005
policies=20
mean1772.059-1772.072=-0.013
σ0.368-0.355=0.013
min1771.808-1771.841=-0.033
max1772.603-1772.600=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean2.792-2.779=0.012
σ0.010-0.004=0.006
min2.781-2.776=0.006
max2.805-2.784=0.021
policies=200
mean17727.659-17727.544=0.115
σ0.417-0.415=0.002
min17727.360-17727.143=0.217
max17728.275-17728.116=0.159
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2831.000=4.000
σ0.000
min2835.000-2831.000=4.000
max2835.000-2831.000=4.000
mean27.863-27.893=-0.030
σ0.435-0.297=0.138
min27.470-27.605=-0.135
max28.316-28.262=0.054