Compare commits

Home / Compare 8117f268 .. a0646519

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-70.700=-35.437
σ0.055-0.045=0.010
min35.236-70.669=-35.433
max35.417-70.825=-35.408
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.086-0.157=-0.071
σ0.005-0.004=0.001
min0.082-0.151=-0.069
max0.097-0.161=-0.064
cache=y
dps=1
iters=10
policies=100
mean23.770-21.409=2.360
σ0.002-0.003=-0.001
min23.767-21.406=2.361
max23.773-21.414=2.359
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.068-0.065=0.003
σ0.003-0.003=0.000
min0.066-0.064=0.003
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1754.932=1.553
σ0.365-0.362=0.003
min1755.911-1754.364=1.547
max1757.079-1755.528=1.550
mean1658.850-1649.550=9.300
σ641.869-632.104=9.765
min630.000-625.000=5.000
max2780.000-2774.000=6.000
mean2.337-2.843=-0.506
σ0.105-0.194=-0.089
min2.223-2.369=-0.146
max2.649-3.163=-0.514

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-272.793=51.913
σ0.057-0.007=0.050
min324.605-272.784=51.821
max324.740-272.802=51.938
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean0.433-0.378=0.055
σ0.011-0.001=0.009
min0.424-0.376=0.048
max0.445-0.379=0.065
iters=5
new-facts=1
prior-facts=6402
mean1985.259-1933.227=52.032
σ0.019-0.017=0.002
min1985.231-1933.198=52.033
max1985.274-1933.242=52.032
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean2.662-3.150=-0.488
σ0.128-0.141=-0.013
min2.547-3.006=-0.459
max2.838-3.346=-0.508
iters=5
new-facts=6402
prior-facts=1
mean4808.765-4756.971=51.795
σ7.455-7.566=-0.111
min4805.327-4753.545=51.782
max4822.100-4770.506=51.594
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean8.928-8.504=0.424
σ0.410-0.151=0.259
min8.237-8.309=-0.072
max9.234-8.689=0.545
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4944.455=52.013
σ0.014-0.019=-0.004
min4996.453-4944.432=52.021
max4996.488-4944.481=52.007
mean3049.800-3041.000=8.800
σ330.908-325.006=5.902
min2780.000-2774.000=6.000
max3545.000-3526.000=19.000
mean8.623-8.444=0.179
σ0.187-0.103=0.084
min8.473-8.362=0.111
max8.871-8.607=0.264

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-0.982=-0.012
σ0.065-0.136=-0.072
min0.916-0.918=-0.002
max1.042-1.226=-0.184

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-468.324=-5.348
σ574.256-574.228=0.028
min175.838-181.204=-5.365
max1324.359-1329.665=-5.306
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean0.470-0.442=0.027
σ0.371-0.297=0.074
min0.283-0.292=-0.009
max1.027-0.888=0.139
policies=20
mean1758.721-1812.377=-53.656
σ0.345-0.384=-0.039
min1758.481-1812.107=-53.625
max1759.232-1812.940=-53.708
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean2.797-2.889=-0.092
σ0.017-0.014=0.004
min2.778-2.881=-0.103
max2.818-2.909=-0.091
policies=200
mean17592.377-18129.102=-536.726
σ0.545-0.430=0.116
min17592.001-18128.809=-536.808
max17593.168-18129.734=-536.566
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean27.436-28.470=-1.034
σ0.115-0.166=-0.051
min27.276-28.284=-1.008
max27.542-28.677=-1.134