Compare commits

Home / Compare c284d64a .. b19de8a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.562=0.137
σ0.045-0.045=0.000
min70.673-70.543=0.130
max70.822-70.689=0.133
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.158-0.158=-0.000
σ0.006-0.005=0.001
min0.149-0.150=-0.001
max0.166-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.421-21.289=0.133
σ0.003-0.003=-0.000
min21.417-21.283=0.134
max21.426-21.295=0.132
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1753.570=0.887
σ0.358-0.359=-0.001
min1753.895-1752.998=0.897
max1755.021-1754.159=0.862
mean1646.950-1655.100=-8.150
σ626.475-645.290=-18.815
min631.000-628.000=3.000
max2853.000-2900.000=-47.000
mean2.814-2.814=0.000
σ0.103-0.147=-0.044
min2.577-2.419=0.157
max2.988-2.988=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.999-277.475=1.524
σ0.009-0.005=0.004
min278.991-277.471=1.520
max279.012-277.482=1.529
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean0.382-0.393=-0.011
σ0.001-0.005=-0.004
min0.381-0.388=-0.008
max0.382-0.400=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1939.424-1937.902=1.522
σ0.024-0.011=0.013
min1939.392-1937.884=1.508
max1939.452-1937.912=1.540
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean2.565-2.969=-0.404
σ0.133-0.031=0.102
min2.454-2.926=-0.471
max2.795-2.999=-0.203
iters=5
new-facts=6402
prior-facts=1
mean4760.188-4758.610=1.577
σ0.890-0.918=-0.028
min4759.682-4758.167=1.516
max4761.770-4760.250=1.520
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean8.342-8.703=-0.361
σ0.536-0.222=0.314
min7.718-8.394=-0.677
max9.002-8.966=0.036
iters=5
new-facts=6402
prior-facts=6402
mean4950.631-4949.109=1.522
σ0.011-0.024=-0.013
min4950.619-4949.082=1.537
max4950.643-4949.137=1.505
mean3078.000-3041.000=37.000
σ304.587-169.462=135.125
min2853.000-2900.000=-47.000
max3550.000-3315.000=235.000
mean8.469-8.634=-0.166
σ0.139-0.122=0.018
min8.382-8.513=-0.131
max8.714-8.825=-0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.017=0.069
σ0.270-0.117=0.153
min0.933-0.935=-0.002
max1.558-1.202=0.356

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.061-473.080=-0.019
σ575.910-575.915=-0.005
min185.099-185.120=-0.021
max1336.926-1336.952=-0.026
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean0.486-0.488=-0.002
σ0.379-0.380=-0.001
min0.291-0.296=-0.005
max1.055-1.058=-0.003
policies=20
mean1851.283-1851.459=-0.176
σ0.379-0.378=0.001
min1850.995-1851.179=-0.184
max1851.835-1852.011=-0.177
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean2.944-2.927=0.017
σ0.010-0.018=-0.008
min2.931-2.905=0.027
max2.952-2.947=0.005
policies=200
mean18519.481-18521.195=-1.715
σ0.458-0.414=0.044
min18519.074-18520.937=-1.863
max18520.130-18521.806=-1.676
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2900.000=-47.000
σ0.000
min2853.000-2900.000=-47.000
max2853.000-2900.000=-47.000
mean29.055-29.087=-0.032
σ0.566-0.423=0.143
min28.704-28.683=0.021
max29.898-29.550=0.348