Compare commits

Home / Compare ca3a480e .. 2fb6b20e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.107-0.108=-0.001
min35.750-35.753=-0.003
max36.103-36.106=-0.003
mean417.900-411.200=6.700
σ0.316-0.422=-0.105
min417.000-411.000=6.000
max418.000-412.000=6.000
mean0.075-0.076=-0.001
σ0.005-0.003=0.001
min0.069-0.073=-0.004
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.000
σ0.004-0.004=-0.000
min26.060-26.061=-0.001
max26.070-26.074=-0.004
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.059-0.060=-0.001
σ0.003-0.003=-0.000
min0.056-0.057=-0.001
max0.065-0.067=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.924=-0.001
σ0.368-0.365=0.003
min1755.352-1755.351=0.001
max1756.518-1756.497=0.022
mean1637.350-1650.200=-12.850
σ608.702-648.354=-39.653
min678.000-609.000=69.000
max2546.000-2741.000=-195.000
mean2.794-2.866=-0.072
σ0.213-0.189=0.024
min2.248-2.199=0.049
max3.063-3.091=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-277.196=-0.002
σ0.006-0.006=-0.000
min277.188-277.191=-0.002
max277.201-277.206=-0.004
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean0.396-0.405=-0.009
σ0.008-0.009=-0.000
min0.391-0.400=-0.009
max0.411-0.421=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2174.431-2174.427=0.004
σ0.019-0.010=0.009
min2174.405-2174.415=-0.011
max2174.457-2174.441=0.016
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean3.046-2.808=0.239
σ0.184-0.158=0.026
min2.855-2.670=0.185
max3.323-3.007=0.315
iters=5
new-facts=6402
prior-facts=1
mean5052.612-5052.602=0.010
σ0.973-0.992=-0.019
min5052.035-5051.993=0.042
max5054.341-5054.360=-0.019
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean8.671-8.989=-0.318
σ0.590-0.629=-0.040
min7.996-8.091=-0.095
max9.530-9.619=-0.088
iters=5
new-facts=6402
prior-facts=6402
mean5188.426-5188.255=0.171
σ0.087-0.106=-0.019
min5188.354-5188.131=0.223
max5188.527-5188.366=0.161
mean3234.000-3227.400=6.600
σ367.732-463.644=-95.912
min2717.000-2741.000=-24.000
max3689.000-3874.000=-185.000
mean9.002-8.772=0.230
σ0.442-0.157=0.285
min8.713-8.648=0.066
max9.773-9.022=0.750

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.432-1.026=0.406
σ0.197-0.135=0.062
min1.214-0.937=0.277
max1.632-1.247=0.385

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.848-464.855=-0.007
σ572.648-572.648=0.001
min178.521-178.524=-0.004
max1323.820-1323.827=-0.007
mean79.500
σ7.000
min76.000
max90.000
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean0.558-0.539=0.018
σ0.558-0.517=0.041
min0.278-0.279=-0.001
max1.395-1.315=0.080
policies=20
mean1785.452-1785.479=-0.027
σ0.341-0.342=-0.000
min1785.219-1785.264=-0.045
max1785.958-1785.988=-0.029
mean760.000
σ0.000
min760.000
max760.000
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean2.786-2.790=-0.003
σ0.010-0.016=-0.006
min2.776-2.767=0.009
max2.798-2.802=-0.004
policies=200
mean17861.409-17861.553=-0.144
σ0.405-0.489=-0.083
min17861.102-17861.288=-0.186
max17862.006-17862.285=-0.279
mean7600.000
σ0.000
min7600.000
max7600.000
mean2546.000-2741.000=-195.000
σ0.000
min2546.000-2741.000=-195.000
max2546.000-2741.000=-195.000
mean28.293-28.073=0.221
σ0.100-0.146=-0.047
min28.144-27.940=0.204
max28.351-28.214=0.137