Compare commits

Home / Compare 71ae7d66 .. fe8e2b03

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-70.701=-35.456
σ0.053-0.048=0.005
min35.220-70.668=-35.448
max35.396-70.834=-35.438
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.084-0.157=-0.073
σ0.003-0.003=0.000
min0.082-0.155=-0.073
max0.091-0.163=-0.072
cache=y
dps=1
iters=10
policies=100
mean23.771-21.408=2.363
σ0.003-0.003=-0.000
min23.768-21.402=2.366
max23.776-21.411=2.365
mean413.000-411.500=1.500
σ0.000-0.527=-0.527
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.068-0.061=0.008
σ0.003-0.003=-0.000
min0.066-0.059=0.007
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1754.931=1.435
σ0.366-0.361=0.005
min1755.788-1754.364=1.424
max1756.955-1755.513=1.442
mean1665.050-1663.450=1.600
σ616.724-619.541=-2.817
min676.000-621.000=55.000
max2504.000-2495.000=9.000
mean2.309-2.790=-0.480
σ0.063-0.199=-0.136
min2.242-2.256=-0.014
max2.427-2.948=-0.521

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.583-272.791=51.791
σ0.051-0.005=0.045
min324.493-272.785=51.708
max324.611-272.797=51.814
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean0.427-0.381=0.046
σ0.010-0.008=0.002
min0.422-0.377=0.045
max0.445-0.395=0.049
iters=5
new-facts=1
prior-facts=6402
mean1985.140-1933.218=51.923
σ0.011-0.005=0.006
min1985.123-1933.212=51.911
max1985.149-1933.225=51.925
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean2.670-3.020=-0.350
σ0.180-0.059=0.121
min2.550-2.979=-0.430
max2.964-3.121=-0.157
iters=5
new-facts=6402
prior-facts=1
mean4808.755-4756.865=51.890
σ7.741-7.611=0.130
min4805.244-4752.930=52.314
max4822.602-4770.467=52.135
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean8.835-8.431=0.404
σ0.683-0.417=0.266
min7.787-7.891=-0.104
max9.603-8.910=0.694
iters=5
new-facts=6402
prior-facts=6402
mean4996.343-4944.389=51.954
σ0.014-0.153=-0.140
min4996.323-4944.116=52.207
max4996.359-4944.472=51.887
mean2937.000-2979.200=-42.200
σ400.282-273.794=126.488
min2504.000-2607.000=-103.000
max3473.000-3317.000=156.000
mean8.479-8.512=-0.033
σ0.140-0.068=0.072
min8.365-8.428=-0.062
max8.721-8.581=0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.519-1.570=-0.051
σ0.260-0.257=0.003
min1.090-1.233=-0.143
max1.798-1.763=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.946-468.302=-5.356
σ574.251-574.227=0.024
min175.816-181.183=-5.367
max1324.322-1329.643=-5.321
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean0.546-0.563=-0.017
σ0.548-0.561=-0.013
min0.270-0.281=-0.011
max1.368-1.405=-0.037
policies=20
mean1758.516-1812.145=-53.628
σ0.339-0.388=-0.049
min1758.282-1811.885=-53.602
max1759.018-1812.719=-53.700
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean2.726-2.825=-0.099
σ0.029-0.012=0.017
min2.692-2.808=-0.116
max2.763-2.832=-0.069
policies=200
mean17592.324-18128.960=-536.636
σ0.452-0.549=-0.097
min17591.982-18128.504=-536.522
max17592.987-18129.754=-536.768
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2504.000-2495.000=9.000
σ0.000
min2504.000-2495.000=9.000
max2504.000-2495.000=9.000
mean27.364-28.347=-0.983
σ0.154-0.035=0.119
min27.205-28.318=-1.114
max27.528-28.392=-0.864