Compare commits

Home / Compare 673563a4 .. e883bbf5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.558-70.370=0.188
σ0.049-0.058=-0.010
min70.530-70.326=0.204
max70.696-70.532=0.164
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.160-0.159=0.001
σ0.004-0.004=0.000
min0.157-0.152=0.005
max0.168-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.143=0.144
σ0.003-0.002=0.001
min21.284-21.140=0.144
max21.291-21.145=0.146
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.064-0.060=0.004
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1752.197=0.978
σ0.359-0.363=-0.004
min1752.608-1751.627=0.981
max1753.754-1752.783=0.970
mean1672.700-1654.000=18.700
σ640.520-644.462=-3.942
min676.000-617.000=59.000
max2708.000-2776.000=-68.000
mean2.859-2.792=0.067
σ0.139-0.132=0.008
min2.458-2.460=-0.002
max3.183-3.148=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.615-269.929=1.685
σ0.006-0.006=0.001
min271.607-269.923=1.684
max271.621-269.938=1.683
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean0.380-0.373=0.007
σ0.000-0.006=-0.005
min0.379-0.370=0.010
max0.381-0.384=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.039-1930.393=1.646
σ0.012-0.019=-0.007
min1932.021-1930.361=1.660
max1932.055-1930.412=1.643
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean3.014-2.533=0.482
σ0.078-0.152=-0.074
min2.937-2.442=0.495
max3.108-2.802=0.306
iters=5
new-facts=6402
prior-facts=1
mean4752.799-4750.842=1.957
σ0.864-0.797=0.067
min4752.314-4750.312=2.002
max4754.338-4752.247=2.091
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean8.525-8.597=-0.072
σ0.339-0.235=0.105
min7.988-8.321=-0.333
max8.930-8.947=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4943.230-4941.333=1.897
σ0.022-0.081=-0.059
min4943.205-4941.268=1.937
max4943.259-4941.424=1.836
mean2977.200-3011.600=-34.400
σ229.933-219.228=10.705
min2708.000-2776.000=-68.000
max3304.000-3303.000=1.000
mean8.483-8.446=0.037
σ0.109-0.125=-0.016
min8.317-8.308=0.010
max8.577-8.633=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-1.108=-0.005
σ0.261-0.078=0.182
min0.933-1.063=-0.130
max1.529-1.247=0.282

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.010-465.626=6.384
σ575.354-575.197=0.157
min184.323-178.023=6.300
max1335.041-1328.422=6.619
mean88.250-81.750=6.500
σ8.500-7.500=1.000
min84.000-78.000=6.000
max101.000-93.000=8.000
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean0.557-0.443=0.113
σ0.548-0.306=0.242
min0.264-0.285=-0.020
max1.379-0.902=0.477
policies=20
mean1843.560-1780.513=63.047
σ0.375-0.337=0.038
min1843.287-1780.281=63.006
max1844.108-1781.005=63.103
mean840.000-780.000=60.000
σ0.000
min840.000-780.000=60.000
max840.000-780.000=60.000
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean2.919-2.855=0.064
σ0.039-0.082=-0.043
min2.870-2.758=0.112
max2.954-2.960=-0.005
policies=200
mean18442.147-17811.357=630.790
σ0.384-0.551=-0.167
min18441.919-17810.921=630.998
max18442.720-17812.157=630.562
mean8400.000-7800.000=600.000
σ0.000
min8400.000-7800.000=600.000
max8400.000-7800.000=600.000
mean2708.000-2776.000=-68.000
σ0.000
min2708.000-2776.000=-68.000
max2708.000-2776.000=-68.000
mean28.939-27.743=1.196
σ0.130-0.141=-0.011
min28.835-27.593=1.241
max29.118-27.931=1.187