Compare commits

Home / Compare 95a31d93 .. 7ad3c29a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=0.000
σ0.059-0.059=-0.000
min70.332-70.332=0.000
max70.538-70.539=-0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.159-0.161=-0.002
σ0.005-0.004=0.002
min0.151-0.157=-0.006
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.002=0.001
min21.140-21.140=-0.001
max21.146-21.145=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.065-0.062=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.203-1752.198=0.004
σ0.362-0.359=0.003
min1751.633-1751.632=0.000
max1752.789-1752.781=0.009
mean1655.850-1634.900=20.950
σ636.016-609.444=26.572
min614.000-648.000=-34.000
max2789.000-2451.000=338.000
mean2.854-2.777=0.078
σ0.159-0.186=-0.027
min2.286-2.328=-0.043
max3.070-2.986=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.928-269.936=-0.008
σ0.005-0.006=-0.001
min269.920-269.929=-0.009
max269.934-269.944=-0.010
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean0.374-0.387=-0.013
σ0.003-0.006=-0.003
min0.372-0.383=-0.011
max0.378-0.397=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.391-1930.384=0.006
σ0.015-0.012=0.003
min1930.367-1930.371=-0.004
max1930.406-1930.398=0.007
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean2.604-2.599=0.005
σ0.131-0.174=-0.043
min2.447-2.404=0.042
max2.770-2.880=-0.109
iters=5
new-facts=6402
prior-facts=1
mean4750.876-4750.592=0.285
σ0.879-1.111=-0.232
min4750.353-4749.358=0.995
max4752.436-4752.339=0.097
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean8.436-8.126=0.310
σ0.544-0.369=0.175
min7.709-7.710=-0.001
max9.155-8.615=0.540
iters=5
new-facts=6402
prior-facts=6402
mean4941.189-4941.262=-0.073
σ0.198-0.122=0.076
min4940.914-4941.078=-0.163
max4941.406-4941.420=-0.013
mean3057.200-2990.000=67.200
σ337.248-431.032=-93.784
min2789.000-2451.000=338.000
max3565.000-3500.000=65.000
mean8.509-8.559=-0.050
σ0.135-0.129=0.006
min8.348-8.454=-0.106
max8.654-8.766=-0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.839=-0.781
σ0.127-0.135=-0.008
min0.942-1.671=-0.728
max1.252-1.994=-0.742

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.903=0.010
σ575.772-575.760=0.012
min178.025-178.021=0.004
max1329.572-1329.543=0.028
mean81.750
σ7.500
min78.000
max93.000
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean0.444-0.570=-0.126
σ0.308-0.571=-0.264
min0.288-0.282=0.006
max0.905-1.427=-0.522
policies=20
mean1780.511-1780.450=0.061
σ0.338-0.356=-0.018
min1780.270-1780.214=0.056
max1781.007-1780.978=0.028
mean780.000
σ0.000
min780.000
max780.000
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean2.847-2.779=0.068
σ0.106-0.011=0.095
min2.767-2.770=-0.004
max2.993-2.792=0.201
policies=200
mean17811.401-17811.410=-0.008
σ0.640-0.436=0.204
min17810.979-17811.037=-0.058
max17812.352-17812.039=0.313
mean7800.000
σ0.000
min7800.000
max7800.000
mean2789.000-2451.000=338.000
σ0.000
min2789.000-2451.000=338.000
max2789.000-2451.000=338.000
mean27.935-27.945=-0.010
σ0.207-0.065=0.143
min27.801-27.877=-0.077
max28.244-28.009=0.235