Compare commits

Home / Compare cbcf0983 .. 08be5977

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.375=-0.001
σ0.061-0.059=0.001
min70.334-70.342=-0.008
max70.543-70.541=0.002
mean415.600-413.000=2.600
σ0.516-0.000=0.516
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.157-0.161=-0.004
σ0.005-0.003=0.002
min0.149-0.157=-0.008
max0.162-0.165=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.145=-0.002
σ0.002-0.003=-0.001
min21.140-21.140=-0.000
max21.146-21.150=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.060-0.063=-0.004
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=-0.001
σ0.361-0.359=0.002
min1751.625-1751.632=-0.007
max1752.783-1752.773=0.010
mean1645.300-1684.950=-39.650
σ622.225-637.497=-15.272
min672.000-666.000=6.000
max2503.000-2713.000=-210.000
mean2.829-2.800=0.029
σ0.125-0.147=-0.021
min2.605-2.477=0.128
max3.123-2.996=0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.928=0.004
σ0.008-0.008=-0.001
min269.923-269.918=0.005
max269.942-269.940=0.002
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean0.373-0.372=0.001
σ0.012-0.006=0.006
min0.366-0.369=-0.002
max0.395-0.383=0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.387-1930.391=-0.004
σ0.019-0.020=-0.001
min1930.357-1930.365=-0.007
max1930.405-1930.410=-0.005
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean2.536-2.554=-0.018
σ0.055-0.162=-0.107
min2.478-2.437=0.041
max2.596-2.828=-0.232
iters=5
new-facts=6402
prior-facts=1
mean4750.833-4750.726=0.107
σ0.813-0.889=-0.076
min4750.320-4750.069=0.251
max4752.270-4752.276=-0.006
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean8.679-8.600=0.079
σ0.214-0.318=-0.104
min8.437-8.339=0.097
max8.929-8.986=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.332=-0.070
σ0.211-0.085=0.126
min4940.909-4941.258=-0.349
max4941.432-4941.425=0.006
mean2978.000-2994.000=-16.000
σ264.790-240.505=24.286
min2633.000-2713.000=-80.000
max3316.000-3318.000=-2.000
mean8.574-8.433=0.141
σ0.175-0.103=0.072
min8.446-8.317=0.130
max8.843-8.594=0.249

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.675-1.101=0.574
σ0.157-0.174=-0.018
min1.447-0.933=0.513
max1.828-1.315=0.513

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.980-465.994=-0.014
σ575.914-575.921=-0.006
min178.020-178.024=-0.004
max1329.852-1329.875=-0.023
mean81.750
σ7.500
min78.000
max93.000
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean0.562-0.563=-0.002
σ0.563-0.556=0.006
min0.276-0.275=0.001
max1.406-1.398=0.008
policies=20
mean1780.426-1780.439=-0.013
σ0.286-0.360=-0.074
min1780.215-1780.199=0.016
max1780.846-1780.972=-0.126
mean780.000
σ0.000
min780.000
max780.000
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean2.758-2.766=-0.008
σ0.027-0.018=0.009
min2.734-2.746=-0.012
max2.796-2.783=0.012
policies=200
mean17811.381-17811.439=-0.058
σ0.678-0.583=0.095
min17810.630-17811.071=-0.441
max17812.274-17812.299=-0.024
mean7800.000
σ0.000
min7800.000
max7800.000
mean2503.000-2713.000=-210.000
σ0.000
min2503.000-2713.000=-210.000
max2503.000-2713.000=-210.000
mean27.743-27.824=-0.081
σ0.222-0.137=0.085
min27.583-27.731=-0.147
max28.062-28.027=0.035