Compare commits

Home / Compare 9e687504 .. 54a7e810

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.045=0.001
σ0.050-0.048=0.002
min73.024-73.023=0.001
max73.186-73.180=0.006
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.161-0.160=0.001
σ0.005-0.003=0.002
min0.153-0.157=-0.004
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean23.739-23.740=-0.001
σ0.004-0.003=0.001
min23.734-23.736=-0.002
max23.750-23.747=0.004
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.066=-0.004
σ0.003-0.003=0.000
min0.059-0.064=-0.005
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.786=0.000
σ0.360-0.360=-0.001
min1758.219-1758.212=0.007
max1759.371-1759.371=0.000
mean1637.050-1658.400=-21.350
σ625.704-628.686=-2.983
min618.000-628.000=-10.000
max2772.000-2519.000=253.000
mean2.848-2.809=0.039
σ0.173-0.110=0.063
min2.498-2.511=-0.013
max3.232-3.016=0.216

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-324.014=-0.001
σ0.059-0.055=0.004
min323.907-323.916=-0.009
max324.045-324.042=0.002
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean0.437-0.430=0.007
σ0.010-0.008=0.003
min0.427-0.425=0.002
max0.451-0.443=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.587-1984.579=0.008
σ0.021-0.015=0.006
min1984.557-1984.566=-0.009
max1984.610-1984.600=0.010
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean2.586-2.705=-0.119
σ0.094-0.269=-0.176
min2.465-2.555=-0.090
max2.718-3.182=-0.464
iters=5
new-facts=6402
prior-facts=1
mean4808.251-4808.126=0.125
σ7.784-7.560=0.223
min4804.687-4804.644=0.043
max4822.174-4821.650=0.524
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean8.905-8.853=0.052
σ0.275-0.184=0.091
min8.707-8.612=0.095
max9.362-9.048=0.314
iters=5
new-facts=6402
prior-facts=6402
mean4995.807-4995.806=0.001
σ0.019-0.021=-0.002
min4995.788-4995.784=0.004
max4995.834-4995.830=0.004
mean2991.400-2973.200=18.200
σ215.216-261.563=-46.347
min2772.000-2621.000=151.000
max3308.000-3288.000=20.000
mean8.573-8.590=-0.017
σ0.096-0.201=-0.104
min8.454-8.410=0.044
max8.697-8.899=-0.202

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.633=-0.619
σ0.151-0.178=-0.027
min0.915-1.342=-0.427
max1.266-1.795=-0.529

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.348-468.326=0.022
σ574.230-574.232=-0.002
min181.230-181.207=0.023
max1329.694-1329.675=0.019
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean0.443-0.549=-0.105
σ0.304-0.529=-0.224
min0.290-0.281=0.009
max0.900-1.342=-0.442
policies=20
mean1812.613-1812.400=0.212
σ0.392-0.386=0.006
min1812.335-1812.150=0.186
max1813.188-1812.973=0.215
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean2.888-2.806=0.082
σ0.008-0.007=0.001
min2.878-2.799=0.079
max2.896-2.815=0.081
policies=200
mean18131.618-18131.625=-0.007
σ0.531-0.509=0.022
min18131.270-18131.211=0.060
max18132.399-18132.366=0.033
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2519.000=253.000
σ0.000
min2772.000-2519.000=253.000
max2772.000-2519.000=253.000
mean28.456-28.242=0.214
σ0.111-0.084=0.027
min28.345-28.168=0.177
max28.567-28.362=0.204