Compare commits

Home / Compare 8c29c71d .. 26f123bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.393=0.173
σ0.048-0.043=0.004
min70.534-70.368=0.166
max70.699-70.514=0.184
mean414.000-410.200=3.800
σ0.000-0.422=-0.422
min414.000-410.000=4.000
max414.000-411.000=3.000
mean0.160-0.161=-0.001
σ0.004-0.003=0.000
min0.157-0.157=-0.000
max0.167-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.147=0.139
σ0.002-0.012=-0.010
min21.284-21.137=0.147
max21.289-21.181=0.108
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.064-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1752.697=0.676
σ0.359-0.360=-0.001
min1752.805-1752.133=0.672
max1753.961-1753.283=0.678
mean1648.400-1656.800=-8.400
σ641.503-634.611=6.891
min635.000-614.000=21.000
max2875.000-2768.000=107.000
mean2.729-2.816=-0.088
σ0.263-0.163=0.100
min2.120-2.489=-0.369
max2.996-3.182=-0.186

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-270.588=1.170
σ0.006-0.017=-0.011
min271.754-270.576=1.178
max271.767-270.618=1.149
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean0.380-0.382=-0.002
σ0.003-0.006=-0.002
min0.378-0.379=-0.001
max0.386-0.392=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.183-1931.041=1.142
σ0.012-0.006=0.007
min1932.167-1931.033=1.134
max1932.202-1931.048=1.154
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean2.817-2.962=-0.146
σ0.214-0.156=0.058
min2.474-2.697=-0.223
max2.988-3.077=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4752.758-4751.846=0.911
σ1.016-0.808=0.208
min4751.897-4751.379=0.518
max4754.521-4753.288=1.233
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean8.745-7.975=0.769
σ0.283-0.318=-0.036
min8.286-7.733=0.553
max9.058-8.531=0.526
iters=5
new-facts=6402
prior-facts=6402
mean4943.368-4942.230=1.138
σ0.010-0.023=-0.013
min4943.357-4942.205=1.152
max4943.377-4942.260=1.118
mean3041.000-3032.000=9.000
σ258.805-319.601=-60.796
min2875.000-2768.000=107.000
max3465.000-3513.000=-48.000
mean8.410-8.346=0.064
σ0.041-0.141=-0.100
min8.356-8.186=0.170
max8.466-8.562=-0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.022=0.004
σ0.139-0.139=0.000
min0.932-0.931=0.002
max1.252-1.252=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.867-467.206=0.661
σ575.935-575.926=0.009
min179.892-179.238=0.654
max1331.769-1331.094=0.675
mean86.250
σ8.500
min82.000
max99.000
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean0.445-0.446=-0.001
σ0.303-0.302=0.001
min0.290-0.292=-0.003
max0.900-0.899=0.001
policies=20
mean1799.186-1792.624=6.562
σ0.391-0.325=0.066
min1798.910-1792.382=6.528
max1799.761-1793.101=6.660
mean820.000
σ0.000
min820.000
max820.000
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean2.886-2.843=0.042
σ0.008-0.112=-0.105
min2.875-2.783=0.091
max2.892-3.011=-0.119
policies=200
mean17998.541-17932.839=65.702
σ0.504-0.438=0.066
min17998.200-17932.524=65.676
max17999.290-17933.483=65.807
mean8200.000
σ0.000
min8200.000
max8200.000
mean2875.000-2768.000=107.000
σ0.000
min2875.000-2768.000=107.000
max2875.000-2768.000=107.000
mean28.517-28.147=0.370
σ0.420-0.098=0.322
min28.077-28.076=0.001
max29.044-28.292=0.752