Compare commits

Home / Compare c924ca03 .. ed6efc82

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-36.728=-0.754
σ0.105-0.687=-0.581
min35.927-35.922=0.005
max36.273-37.531=-1.257
mean414.000-3924.000=-3510.000
σ0.000
min414.000-3924.000=-3510.000
max414.000-3924.000=-3510.000
mean0.077-0.075=0.001
σ0.004-0.001=0.003
min0.071-0.074=-0.003
max0.084-0.077=0.007
cache=y
dps=1
iters=10
policies=100
mean26.209-26.587=-0.378
σ0.005-0.606=-0.601
min26.202-26.205=-0.004
max26.218-27.465=-1.247
mean414.000-3924.000=-3510.000
σ0.000
min414.000-3924.000=-3510.000
max414.000-3924.000=-3510.000
mean0.061-0.060=0.001
σ0.002-0.001=0.002
min0.060-0.059=0.001
max0.068-0.062=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.368=1.997
σ0.372-0.373=-0.001
min1757.787-1755.800=1.987
max1758.964-1756.960=2.005
mean1660.350-1652.000=8.350
σ622.534-632.187=-9.653
min688.000-620.000=68.000
max2745.000-2594.000=151.000
mean2.412-2.324=0.088
σ0.119-0.185=-0.066
min2.300-2.145=0.155
max2.674-2.741=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-278.698=0.816
σ0.007-0.015=-0.008
min279.504-278.682=0.822
max279.520-278.721=0.799
mean2745.000-2594.000=151.000
σ0.000
min2745.000-2594.000=151.000
max2745.000-2594.000=151.000
mean0.418-0.425=-0.006
σ0.005-0.012=-0.006
min0.412-0.416=-0.004
max0.425-0.439=-0.013
iters=5
new-facts=1
prior-facts=6402
mean2178.399-2268.867=-90.469
σ0.045-0.009=0.036
min2178.345-2268.853=-90.508
max2178.450-2268.875=-90.425
mean2745.000-2594.000=151.000
σ0.000
min2745.000-2594.000=151.000
max2745.000-2594.000=151.000
mean3.386-2.985=0.401
σ0.208-0.144=0.064
min3.103-2.887=0.216
max3.650-3.240=0.410
iters=5
new-facts=6402
prior-facts=1
mean5056.384-4952.244=104.140
σ1.011-0.962=0.049
min5055.808-4951.431=104.377
max5058.181-4953.914=104.267
mean2745.000-2594.000=151.000
σ0.000
min2745.000-2594.000=151.000
max2745.000-2594.000=151.000
mean9.111-7.934=1.177
σ0.570-0.288=0.282
min8.375-7.636=0.740
max9.714-8.366=1.347
iters=5
new-facts=6402
prior-facts=6402
mean5193.742-5167.076=26.667
σ0.100-0.014=0.085
min5193.636-5167.062=26.574
max5193.852-5167.098=26.755
mean3232.800-3374.400=-141.600
σ466.038-425.087=40.950
min2745.000-2801.000=-56.000
max3873.000-3924.000=-51.000
mean8.754-9.300=-0.546
σ0.124-0.229=-0.105
min8.676-9.066=-0.390
max8.972-9.557=-0.585

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.081=-0.044
σ0.139-0.093=0.045
min0.942-0.946=-0.004
max1.262-1.209=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-460.261=5.221
σ572.659-572.607=0.052
min179.143-173.955=5.188
max1324.470-1319.172=5.298
mean79.500
σ7.000
min76.000
max90.000
mean2745.000-437.000=2308.000
σ0.000
min2745.000-437.000=2308.000
max2745.000-437.000=2308.000
mean0.497-0.550=-0.054
σ0.420-0.562=-0.142
min0.284-0.263=0.021
max1.126-1.393=-0.267
policies=20
mean1791.702-1740.066=51.635
σ0.332-0.326=0.006
min1791.498-1739.832=51.666
max1792.195-1740.545=51.650
mean760.000
σ0.000
min760.000
max760.000
mean2745.000-446.250=2298.750
σ0.000-9.032=-9.032
min2745.000-437.000=2308.000
max2745.000-454.000=2291.000
mean2.819-2.653=0.166
σ0.022-0.023=-0.000
min2.793-2.633=0.159
max2.838-2.683=0.155
policies=200
mean17923.417-17409.864=513.552
σ0.381-0.076=0.305
min17923.192-17409.774=513.418
max17923.987-17409.960=514.027
mean7600.000
σ0.000
min7600.000
max7600.000
mean2745.000-490.750=2254.250
σ0.000-4.856=-4.856
min2745.000-486.000=2259.000
max2745.000-497.000=2248.000
mean28.328-26.828=1.500
σ0.119-0.022=0.097
min28.209-26.801=1.408
max28.450-26.854=1.595