Compare commits

Home / Compare 25fbd302 .. 5d12b954

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.699=-0.002
σ0.047-0.045=0.002
min70.668-70.673=-0.005
max70.829-70.822=0.007
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.160-0.158=0.003
σ0.003-0.006=-0.003
min0.157-0.149=0.008
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.421=-0.002
σ0.003-0.003=-0.000
min21.415-21.417=-0.002
max21.424-21.426=-0.002
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.063-0.063=0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.002
σ0.361-0.358=0.003
min1753.889-1753.895=-0.006
max1755.043-1755.021=0.022
mean1657.250-1646.950=10.300
σ638.178-626.475=11.703
min623.000-631.000=-8.000
max2847.000-2853.000=-6.000
mean2.837-2.814=0.023
σ0.147-0.103=0.044
min2.356-2.577=-0.221
max3.056-2.988=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.529-278.999=-5.470
σ0.008-0.009=-0.001
min273.520-278.991=-5.471
max273.537-279.012=-5.475
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean0.385-0.382=0.003
σ0.005-0.001=0.004
min0.381-0.381=0.000
max0.394-0.382=0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.919-1939.424=-5.505
σ0.009-0.024=-0.015
min1933.908-1939.392=-5.484
max1933.931-1939.452=-5.521
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean2.949-2.565=0.384
σ0.109-0.133=-0.024
min2.755-2.454=0.300
max3.012-2.795=0.216
iters=5
new-facts=6402
prior-facts=1
mean4754.757-4760.188=-5.430
σ0.789-0.890=-0.100
min4754.344-4759.682=-5.338
max4756.168-4761.770=-5.602
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean8.012-8.342=-0.330
σ0.293-0.536=-0.243
min7.776-7.718=0.058
max8.485-9.002=-0.518
iters=5
new-facts=6402
prior-facts=6402
mean4945.140-4950.631=-5.491
σ0.014-0.011=0.004
min4945.120-4950.619=-5.498
max4945.156-4950.643=-5.487
mean3042.200-3078.000=-35.800
σ269.553-304.587=-35.035
min2847.000-2853.000=-6.000
max3456.000-3550.000=-94.000
mean8.449-8.469=-0.020
σ0.063-0.139=-0.077
min8.396-8.382=0.014
max8.534-8.714=-0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.086=-0.089
σ0.144-0.270=-0.126
min0.928-0.933=-0.005
max1.254-1.558=-0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.075-473.061=0.014
σ575.911-575.910=0.001
min185.118-185.099=0.019
max1336.941-1336.926=0.016
mean88.250
σ8.500
min84.000
max101.000
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean0.477-0.486=-0.009
σ0.356-0.379=-0.023
min0.292-0.291=0.002
max1.011-1.055=-0.043
policies=20
mean1851.428-1851.283=0.145
σ0.368-0.379=-0.011
min1851.159-1850.995=0.165
max1851.964-1851.835=0.130
mean840.000
σ0.000
min840.000
max840.000
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean2.960-2.944=0.017
σ0.008-0.010=-0.001
min2.953-2.931=0.022
max2.972-2.952=0.020
policies=200
mean18519.872-18519.481=0.392
σ0.674-0.458=0.216
min18519.124-18519.074=0.050
max18520.707-18520.130=0.577
mean8400.000
σ0.000
min8400.000
max8400.000
mean2847.000-2853.000=-6.000
σ0.000
min2847.000-2853.000=-6.000
max2847.000-2853.000=-6.000
mean29.313-29.055=0.258
σ0.455-0.566=-0.111
min28.888-28.704=0.183
max29.833-29.898=-0.065