Compare commits

Home / Compare 3625141d .. 4e908dfe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.720
σ0.801
min35.919
max38.437
mean3992.000
σ0.000
min3992.000
max3992.000
mean0.075
σ0.001
min0.074
max0.076
cache=y
dps=1
iters=10
policies=100
mean26.712
σ0.644
min26.210
max27.463
mean3992.000
σ0.000
min3992.000
max3992.000
mean0.060
σ0.001
min0.060
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.308=0.058
σ0.374-0.367=0.007
min1755.797-1755.745=0.052
max1756.965-1756.900=0.065
mean1656.750-1659.800=-3.050
σ630.043-636.256=-6.214
min680.000-613.000=67.000
max2611.000-2689.000=-78.000
mean2.282-2.258=0.024
σ0.151-0.102=0.050
min2.148-2.146=0.001
max2.788-2.543=0.245

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.692=0.004
σ0.014-0.013=0.001
min278.684-278.677=0.007
max278.719-278.707=0.012
mean2611.000-2689.000=-78.000
σ0.000
min2611.000-2689.000=-78.000
max2611.000-2689.000=-78.000
mean0.426-0.421=0.005
σ0.013-0.000=0.013
min0.416-0.421=-0.005
max0.442-0.421=0.020
iters=5
new-facts=1
prior-facts=6402
mean2268.873-2268.842=0.030
σ0.005-0.020=-0.015
min2268.868-2268.822=0.047
max2268.881-2268.870=0.011
mean2611.000-2689.000=-78.000
σ0.000
min2611.000-2689.000=-78.000
max2611.000-2689.000=-78.000
mean2.948-3.393=-0.445
σ0.117-0.347=-0.229
min2.864-2.828=0.035
max3.151-3.781=-0.631
iters=5
new-facts=6402
prior-facts=1
mean4952.363-4956.045=-3.683
σ0.992-0.852=0.140
min4951.723-4955.643=-3.920
max4954.125-4957.569=-3.443
mean2611.000-2689.000=-78.000
σ0.000
min2611.000-2689.000=-78.000
max2611.000-2689.000=-78.000
mean8.342-8.010=0.332
σ0.677-0.215=0.462
min7.810-7.802=0.008
max9.527-8.275=1.252
iters=5
new-facts=6402
prior-facts=6402
mean5167.074-5170.763=-3.689
σ0.014-0.082=-0.068
min5167.066-5170.674=-3.609
max5167.099-5170.832=-3.733
mean3422.800-3467.800=-45.000
σ454.531-469.483=-14.952
min2809.000-2806.000=3.000
max3992.000-4018.000=-26.000
mean9.234-9.404=-0.171
σ0.255-0.312=-0.057
min8.985-9.103=-0.118
max9.615-9.810=-0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.060=0.004
σ0.122-0.123=-0.001
min0.951-0.950=0.001
max1.252-1.252=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.251=0.007
σ572.607-572.602=0.005
min173.953-173.947=0.006
max1319.169-1319.154=0.015
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.552-0.510=0.042
σ0.560-0.545=0.015
min0.267-0.236=0.031
max1.392-1.327=0.065
policies=20
mean1740.033-1739.991=0.041
σ0.331-0.328=0.003
min1739.793-1739.755=0.038
max1740.519-1740.474=0.046
mean760.000
σ0.000
min760.000
max760.000
mean445.000-447.000=-2.000
σ9.381
min435.000-437.000=-2.000
max453.000-455.000=-2.000
mean2.664-2.665=-0.001
σ0.012-0.014=-0.002
min2.647-2.651=-0.003
max2.675-2.680=-0.005
policies=200
mean17409.816-17409.223=0.593
σ0.105-0.072=0.033
min17409.659-17409.143=0.515
max17409.878-17409.293=0.585
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-491.750=-2.000
σ2.754-2.986=-0.232
min487.000-488.000=-1.000
max493.000-495.000=-2.000
mean26.978-26.943=0.035
σ0.173-0.074=0.099
min26.776-26.857=-0.081
max27.198-27.030=0.168