Compare commits

Home / Compare ca32ca0f .. c55169a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-73.045=-37.800
σ0.055-0.046=0.009
min35.217-73.011=-37.794
max35.401-73.173=-37.773
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.082-0.161=-0.078
σ0.005-0.003=0.002
min0.076-0.155=-0.079
max0.089-0.166=-0.077
cache=y
dps=1
iters=10
policies=100
mean23.770-23.741=0.029
σ0.004-0.004=0.001
min23.764-23.735=0.029
max23.778-23.746=0.032
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.066-0.066=0.000
σ0.005-0.003=0.002
min0.061-0.064=-0.003
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1758.786=-2.424
σ0.365-0.362=0.003
min1755.787-1758.217=-2.430
max1756.954-1759.387=-2.433
mean1651.800-1659.950=-8.150
σ638.585-625.608=12.978
min630.000-619.000=11.000
max2830.000-2844.000=-14.000
mean2.337-2.812=-0.475
σ0.078-0.229=-0.150
min2.254-2.268=-0.014
max2.530-3.114=-0.584

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.589-324.017=0.572
σ0.041-0.042=-0.001
min324.517-323.943=0.574
max324.615-324.043=0.572
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean0.423-0.430=-0.007
σ0.001-0.003=-0.002
min0.422-0.425=-0.003
max0.425-0.433=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.144-1984.581=0.564
σ0.005-0.018=-0.014
min1985.138-1984.563=0.575
max1985.150-1984.602=0.549
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean2.592-2.589=0.004
σ0.050-0.050=-0.000
min2.540-2.521=0.018
max2.646-2.653=-0.006
iters=5
new-facts=6402
prior-facts=1
mean4808.740-4808.224=0.516
σ7.676-7.787=-0.111
min4805.235-4804.699=0.535
max4822.470-4822.154=0.316
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean8.873-8.832=0.041
σ0.228-0.106=0.123
min8.504-8.738=-0.233
max9.098-9.009=0.089
iters=5
new-facts=6402
prior-facts=6402
mean4996.273-4995.800=0.473
σ0.177-0.023=0.154
min4995.956-4995.779=0.178
max4996.365-4995.830=0.535
mean3048.600-3011.200=37.400
σ187.848-242.289=-54.442
min2830.000-2844.000=-14.000
max3312.000-3401.000=-89.000
mean8.642-8.610=0.032
σ0.209-0.155=0.054
min8.400-8.458=-0.057
max8.834-8.855=-0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.928-0.989=-0.061
σ0.011-0.133=-0.122
min0.921-0.892=0.029
max0.947-1.198=-0.251

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-468.355=-5.387
σ574.247-574.227=0.020
min175.837-181.228=-5.392
max1324.338-1329.695=-5.356
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean0.432-0.442=-0.009
σ0.299-0.299=0.000
min0.280-0.289=-0.009
max0.881-0.890=-0.009
policies=20
mean1758.720-1812.640=-53.920
σ0.338-0.396=-0.058
min1758.503-1812.363=-53.860
max1759.224-1813.223=-53.999
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean2.789-2.883=-0.095
σ0.013-0.003=0.010
min2.769-2.879=-0.110
max2.798-2.887=-0.089
policies=200
mean17593.304-18132.289=-538.985
σ0.702-0.642=0.061
min17592.334-18131.496=-539.162
max17593.850-18133.041=-539.191
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2830.000-2844.000=-14.000
σ0.000
min2830.000-2844.000=-14.000
max2830.000-2844.000=-14.000
mean27.975-28.721=-0.746
σ0.454-0.308=0.146
min27.575-28.333=-0.758
max28.491-29.064=-0.572