Compare commits

Home / Compare 08a10204 .. 206d5e93

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.567=-0.001
σ0.047-0.048=-0.001
min70.530-70.534=-0.004
max70.695-70.699=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.158-0.160=-0.002
σ0.005-0.004=0.002
min0.150-0.157=-0.007
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.003-0.002=0.001
min21.283-21.284=-0.001
max21.291-21.289=0.002
mean416.800-414.000=2.800
σ0.422-0.000=0.422
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.065-0.064=0.002
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.373=0.001
σ0.361-0.359=0.002
min1752.805-1752.805=0.001
max1753.958-1753.961=-0.002
mean1665.150-1648.400=16.750
σ635.917-641.503=-5.585
min691.000-635.000=56.000
max2768.000-2875.000=-107.000
mean2.807-2.729=0.078
σ0.197-0.263=-0.066
min2.239-2.120=0.120
max3.118-2.996=0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.758=-0.006
σ0.005-0.006=-0.000
min271.744-271.754=-0.009
max271.758-271.767=-0.010
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean0.379-0.380=-0.001
σ0.005-0.003=0.002
min0.376-0.378=-0.002
max0.388-0.386=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.195-1932.183=0.012
σ0.013-0.012=0.001
min1932.179-1932.167=0.012
max1932.210-1932.202=0.008
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean2.877-2.817=0.060
σ0.369-0.214=0.156
min2.478-2.474=0.004
max3.310-2.988=0.321
iters=5
new-facts=6402
prior-facts=1
mean4752.958-4752.758=0.201
σ0.837-1.016=-0.179
min4752.480-4751.897=0.583
max4754.448-4754.521=-0.073
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean8.181-8.745=-0.564
σ0.408-0.283=0.125
min7.743-8.286=-0.544
max8.672-9.058=-0.385
iters=5
new-facts=6402
prior-facts=6402
mean4943.375-4943.368=0.007
σ0.026-0.010=0.016
min4943.348-4943.357=-0.009
max4943.403-4943.377=0.026
mean3040.400-3041.000=-0.600
σ324.202-258.805=65.397
min2768.000-2875.000=-107.000
max3522.000-3465.000=57.000
mean8.476-8.410=0.066
σ0.121-0.041=0.080
min8.392-8.356=0.036
max8.683-8.466=0.217

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.027=0.026
σ0.280-0.139=0.142
min0.925-0.932=-0.007
max1.555-1.252=0.303

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.867=-0.003
σ575.937-575.935=0.002
min179.885-179.892=-0.007
max1331.768-1331.769=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean0.478-0.445=0.033
σ0.391-0.303=0.088
min0.278-0.290=-0.012
max1.064-0.900=0.164
policies=20
mean1799.128-1799.186=-0.058
σ0.374-0.391=-0.017
min1798.852-1798.910=-0.058
max1799.680-1799.761=-0.081
mean820.000
σ0.000
min820.000
max820.000
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean2.806-2.886=-0.079
σ0.024-0.008=0.016
min2.785-2.875=-0.090
max2.840-2.892=-0.052
policies=200
mean17998.397-17998.541=-0.144
σ0.554-0.504=0.050
min17997.998-17998.200=-0.202
max17999.203-17999.290=-0.086
mean8200.000
σ0.000
min8200.000
max8200.000
mean2768.000-2875.000=-107.000
σ0.000
min2768.000-2875.000=-107.000
max2768.000-2875.000=-107.000
mean28.209-28.517=-0.309
σ0.195-0.420=-0.225
min28.060-28.077=-0.017
max28.494-29.044=-0.551