Compare commits

Home / Compare f2e2b7c9 .. ac6290da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.563=-0.000
σ0.045-0.045=0.000
min70.541-70.538=0.002
max70.691-70.689=0.002
mean413.800-413.000=0.800
σ0.422-0.000=0.422
min413.000
max414.000-413.000=1.000
mean0.159-0.158=0.002
σ0.004-0.003=0.000
min0.155-0.152=0.003
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.292=-0.005
σ0.003-0.011=-0.008
min21.282-21.285=-0.003
max21.290-21.323=-0.032
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.064=-0.002
σ0.003-0.002=0.001
min0.059-0.062=-0.004
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.372-1753.374=-0.001
σ0.362-0.363=-0.001
min1752.805-1752.803=0.001
max1753.973-1753.958=0.015
mean1660.250-1652.550=7.700
σ637.270-644.542=-7.272
min618.000-651.000=-33.000
max2811.000-2884.000=-73.000
mean2.847-2.798=0.050
σ0.171-0.200=-0.029
min2.617-2.275=0.342
max3.376-3.087=0.289

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.760=-0.005
σ0.006-0.006=-0.000
min271.746-271.752=-0.006
max271.762-271.769=-0.007
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean0.381-0.389=-0.007
σ0.005-0.011=-0.006
min0.376-0.376=0.000
max0.388-0.400=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.188-1932.182=0.006
σ0.011-0.021=-0.010
min1932.174-1932.163=0.011
max1932.203-1932.217=-0.015
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean2.982-2.812=0.170
σ0.150-0.234=-0.084
min2.732-2.524=0.208
max3.131-3.001=0.130
iters=5
new-facts=6402
prior-facts=1
mean4752.830-4752.913=-0.083
σ0.965-0.864=0.101
min4752.214-4752.399=-0.185
max4754.530-4754.452=0.078
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean8.401-8.612=-0.211
σ0.771-0.287=0.485
min7.743-8.340=-0.598
max9.397-9.064=0.332
iters=5
new-facts=6402
prior-facts=6402
mean4943.311-4943.308=0.003
σ0.154-0.156=-0.002
min4943.038-4943.030=0.008
max4943.406-4943.396=0.010
mean3028.600-3057.400=-28.800
σ285.246-177.737=107.509
min2811.000-2884.000=-73.000
max3462.000-3305.000=157.000
mean8.460-8.646=-0.186
σ0.138-0.253=-0.115
min8.362-8.403=-0.040
max8.702-9.050=-0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.079-1.102=-0.023
σ0.182-0.184=-0.003
min0.932-0.926=0.006
max1.380-1.328=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.862=0.001
σ575.931-575.933=-0.002
min179.890-179.889=0.000
max1331.760-1331.762=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean0.484-0.446=0.038
σ0.398-0.306=0.092
min0.284-0.290=-0.007
max1.081-0.904=0.176
policies=20
mean1799.176-1799.187=-0.010
σ0.367-0.376=-0.009
min1798.912-1798.926=-0.014
max1799.720-1799.742=-0.022
mean820.000
σ0.000
min820.000
max820.000
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean2.823-2.878=-0.055
σ0.048-0.006=0.041
min2.790-2.872=-0.082
max2.894-2.885=0.009
policies=200
mean17998.393-17998.518=-0.125
σ0.599-0.458=0.140
min17997.993-17998.239=-0.246
max17999.274-17999.202=0.072
mean8200.000
σ0.000
min8200.000
max8200.000
mean2811.000-2884.000=-73.000
σ0.000
min2811.000-2884.000=-73.000
max2811.000-2884.000=-73.000
mean28.177-28.548=-0.371
σ0.243-0.515=-0.272
min28.016-28.095=-0.079
max28.535-29.065=-0.530