Compare commits

Home / Compare 5704ff4b .. 9ab56669

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.973-73.063=-19.090
σ0.368-0.053=0.315
min53.843-73.034=-19.191
max55.019-73.212=-18.194
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.145-0.161=-0.016
σ0.011-0.003=0.007
min0.136-0.154=-0.017
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean43.342-23.755=19.587
σ0.008-0.004=0.004
min43.333-23.750=19.583
max43.360-23.763=19.597
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.119-0.065=0.055
σ0.004-0.003=0.001
min0.114-0.061=0.054
max0.126-0.071=0.055

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.898-1755.818=-738.921
σ1.165-0.361=0.805
min1016.321-1755.244=-738.923
max1021.773-1756.398=-734.625
mean1061.850-1655.800=-593.950
σ322.265-631.672=-309.407
min558.000-631.000=-73.000
max1635.000-2853.000=-1218.000
mean1.538-2.830=-1.292
σ0.063-0.181=-0.118
min1.471-2.308=-0.838
max1.696-3.002=-1.307

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.925
σ0.223
min301.711
max302.460
mean2039.000
σ0.000
min2039.000
max2039.000
mean0.577
σ0.027
min0.536
max0.605

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.520-321.042=-17.522
σ0.051-0.055=-0.005
min303.446-320.943=-17.497
max303.571-321.071=-17.501
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean0.393-0.425=-0.032
σ0.001-0.004=-0.003
min0.391-0.421=-0.030
max0.394-0.431=-0.036
iters=5
new-facts=1
prior-facts=6402
mean1326.055-1981.621=-655.565
σ0.106-0.007=0.099
min1325.924-1981.609=-655.684
max1326.199-1981.627=-655.429
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean1.887-2.576=-0.689
σ0.066-0.084=-0.018
min1.815-2.455=-0.641
max1.985-2.652=-0.668
iters=5
new-facts=6402
prior-facts=1
mean1564.114-4805.235=-3241.121
σ6.920-7.735=-0.815
min1560.794-4801.734=-3240.941
max1576.487-4819.072=-3242.585
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean2.324-8.833=-6.509
σ0.261-0.130=0.132
min2.057-8.671=-6.613
max2.698-9.020=-6.323
iters=5
new-facts=6402
prior-facts=6402
mean1894.008-4992.825=-3098.817
σ0.064-0.016=0.048
min1893.895-4992.808=-3098.913
max1894.053-4992.846=-3098.793
mean1777.400-3046.200=-1268.800
σ173.357-198.291=-24.933
min1635.000-2853.000=-1218.000
max2039.000-3323.000=-1284.000
mean2.933-8.625=-5.691
σ0.093-0.110=-0.017
min2.884-8.492=-5.608
max3.098-8.757=-5.659

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.022=0.186
σ0.304-0.102=0.202
min0.910-0.924=-0.014
max1.538-1.172=0.367

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.703-462.414=-17.712
σ575.150-574.226=0.924
min157.124-175.289=-18.166
max1307.428-1323.754=-16.326
mean96.250-86.250=10.000
σ8.500
min92.000-82.000=10.000
max109.000-99.000=10.000
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean0.526-0.432=0.094
σ0.521-0.302=0.219
min0.263-0.280=-0.018
max1.308-0.885=0.423
policies=20
mean1571.541-1753.191=-181.651
σ0.330-0.377=-0.047
min1571.361-1752.945=-181.584
max1572.036-1753.753=-181.717
mean920.000-820.000=100.000
σ0.000
min920.000-820.000=100.000
max920.000-820.000=100.000
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean2.625-2.784=-0.159
σ0.018-0.005=0.013
min2.603-2.779=-0.176
max2.648-2.792=-0.144
policies=200
mean15723.364-17538.531=-1815.167
σ0.084-0.433=-0.349
min15723.302-17537.973=-1814.671
max15723.488-17538.894=-1815.406
mean9200.000-8200.000=1000.000
σ0.000
min9200.000-8200.000=1000.000
max9200.000-8200.000=1000.000
mean1635.000-2853.000=-1218.000
σ0.000
min1635.000-2853.000=-1218.000
max1635.000-2853.000=-1218.000
mean26.521-27.904=-1.383
σ0.139-0.275=-0.136
min26.362-27.596=-1.234
max26.657-28.218=-1.561