Compare commits

Home / Compare 3bfc66e2 .. 59839dcf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.792-36.732=-0.940
σ0.109-0.681=-0.573
min35.737-35.936=-0.199
max36.099-37.515=-1.415
mean412.000-4110.000=-3698.000
σ0.000
min412.000-4110.000=-3698.000
max412.000-4110.000=-3698.000
mean0.073-0.075=-0.002
σ0.005-0.001=0.004
min0.068-0.075=-0.006
max0.083-0.076=0.007
cache=y
dps=1
iters=10
policies=100
mean26.065-26.587=-0.522
σ0.002-0.604=-0.602
min26.062-26.206=-0.145
max26.068-27.465=-1.397
mean412.000-4110.000=-3698.000
σ0.000
min412.000-4110.000=-3698.000
max412.000-4110.000=-3698.000
mean0.061-0.060=0.000
σ0.002-0.001=0.002
min0.059-0.060=-0.001
max0.066-0.061=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.107-1756.559=-0.452
σ0.368-0.371=-0.003
min1755.536-1755.989=-0.453
max1756.709-1757.165=-0.456
mean1658.500-1657.650=0.850
σ634.099-628.465=5.634
min665.000-614.000=51.000
max2611.000-2675.000=-64.000
mean2.830-2.498=0.332
σ0.135-0.271=-0.136
min2.526-2.090=0.437
max2.995-2.890=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.387-278.887=-1.500
σ0.005-0.012=-0.006
min277.382-278.870=-1.488
max277.394-278.898=-1.503
mean2611.000-2675.000=-64.000
σ0.000
min2611.000-2675.000=-64.000
max2611.000-2675.000=-64.000
mean0.394-0.417=-0.023
σ0.004-0.003=0.001
min0.391-0.415=-0.024
max0.401-0.421=-0.020
iters=5
new-facts=1
prior-facts=6402
mean2174.618-2269.065=-94.447
σ0.012-0.003=0.010
min2174.601-2269.061=-94.461
max2174.634-2269.067=-94.433
mean2611.000-2675.000=-64.000
σ0.000
min2611.000-2675.000=-64.000
max2611.000-2675.000=-64.000
mean2.847-3.096=-0.249
σ0.122-0.248=-0.126
min2.745-2.795=-0.050
max3.028-3.389=-0.360
iters=5
new-facts=6402
prior-facts=1
mean5052.667-4952.061=100.606
σ1.059-1.189=-0.130
min5051.768-4950.933=100.835
max5054.497-4953.926=100.571
mean2611.000-2675.000=-64.000
σ0.000
min2611.000-2675.000=-64.000
max2611.000-2675.000=-64.000
mean9.022-8.014=1.008
σ0.413-0.342=0.071
min8.521-7.647=0.875
max9.625-8.407=1.217
iters=5
new-facts=6402
prior-facts=6402
mean5188.619-5167.262=21.357
σ0.088-0.015=0.073
min5188.546-5167.252=21.294
max5188.720-5167.288=21.432
mean3206.000-3427.400=-221.400
σ494.302-471.015=23.287
min2611.000-2868.000=-257.000
max3866.000-4110.000=-244.000
mean8.699-9.363=-0.663
σ0.130-0.258=-0.128
min8.561-9.084=-0.523
max8.913-9.743=-0.830

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.397-0.995=0.402
σ0.374-0.139=0.235
min1.072-0.922=0.150
max1.893-1.243=0.650

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.219-460.627=4.592
σ572.652-572.611=0.041
min178.890-174.318=4.572
max1324.197-1319.544=4.653
mean81.750
σ7.500
min78.000
max93.000
mean2611.000-438.000=2173.000
σ0.000
min2611.000-438.000=2173.000
max2611.000-438.000=2173.000
mean0.562-0.541=0.021
σ0.554-0.544=0.011
min0.282-0.266=0.016
max1.394-1.357=0.037
policies=20
mean1789.151-1743.730=45.421
σ0.366-0.339=0.027
min1788.928-1743.496=45.431
max1789.696-1744.231=45.465
mean780.000
σ0.000
min780.000
max780.000
mean2611.000-446.250=2164.750
σ0.000-8.958=-8.958
min2611.000-438.000=2173.000
max2611.000-459.000=2152.000
mean2.810-2.673=0.138
σ0.010-0.005=0.005
min2.796-2.667=0.129
max2.818-2.679=0.139
policies=200
mean17898.238-17446.706=451.532
σ0.368-0.077=0.291
min17898.019-17446.601=451.418
max17898.787-17446.784=452.004
mean7800.000
σ0.000
min7800.000
max7800.000
mean2611.000-490.750=2120.250
σ0.000-2.217=-2.217
min2611.000-488.000=2123.000
max2611.000-493.000=2118.000
mean28.288-26.981=1.307
σ0.142-0.136=0.007
min28.127-26.816=1.311
max28.426-27.146=1.281