Compare commits

Home / Compare 29e7d9ea .. 807372ac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.000
σ0.053-0.053=0.000
min70.749-70.753=-0.005
max70.928-70.929=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.159-0.158=0.000
σ0.003-0.004=-0.001
min0.154-0.154=0.001
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.494-21.495=-0.000
σ0.003-0.002=0.000
min21.491-21.492=-0.001
max21.497-21.499=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.064=-0.001
σ0.003-0.003=-0.000
min0.061-0.060=0.001
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.881=0.001
σ0.362-0.360=0.002
min1751.307-1751.309=-0.002
max1752.466-1752.467=-0.001
mean1663.850-1625.550=38.300
σ636.554-598.055=38.499
min676.000-658.000=18.000
max2687.000-2422.000=265.000
mean2.887-2.836=0.051
σ0.098-0.183=-0.084
min2.723-2.145=0.578
max3.048-3.063=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.376-269.377=-0.001
σ0.008-0.005=0.003
min269.365-269.369=-0.004
max269.384-269.380=0.004
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean0.376-0.377=-0.001
σ0.004-0.004=-0.000
min0.373-0.374=-0.001
max0.382-0.383=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1929.741-1929.746=-0.005
σ0.017-0.021=-0.004
min1929.713-1929.711=0.002
max1929.759-1929.769=-0.010
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean2.973-2.962=0.011
σ0.102-0.145=-0.043
min2.796-2.765=0.031
max3.052-3.126=-0.074
iters=5
new-facts=6402
prior-facts=1
mean4750.532-4750.533=-0.002
σ0.824-0.846=-0.021
min4750.099-4750.100=-0.000
max4752.000-4752.041=-0.041
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean8.436-8.328=0.108
σ0.497-0.441=0.056
min7.589-7.571=0.019
max8.897-8.642=0.255
iters=5
new-facts=6402
prior-facts=6402
mean4940.983-4940.913=0.070
σ0.014-0.150=-0.135
min4940.969-4940.646=0.323
max4941.004-4940.998=0.006
mean2949.200-2892.800=56.400
σ305.213-383.146=-77.933
min2687.000-2422.000=265.000
max3408.000-3402.000=6.000
mean8.444-8.379=0.064
σ0.270-0.085=0.185
min8.233-8.287=-0.054
max8.917-8.458=0.459

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.870=-0.754
σ0.138-0.043=0.095
min0.937-1.817=-0.880
max1.260-1.932=-0.672

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.064-466.053=0.011
σ574.943-574.928=0.016
min178.589-178.588=0.001
max1328.479-1328.445=0.034
mean86.250
σ8.500
min82.000
max99.000
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean0.542-0.559=-0.017
σ0.529-0.559=-0.030
min0.272-0.278=-0.006
max1.335-1.397=-0.062
policies=20
mean1786.156-1786.124=0.032
σ0.370-0.366=0.004
min1785.921-1785.897=0.024
max1786.708-1786.670=0.037
mean820.000
σ0.000
min820.000
max820.000
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean2.773-2.762=0.011
σ0.006-0.007=-0.000
min2.766-2.753=0.013
max2.780-2.767=0.013
policies=200
mean17868.527-17868.542=-0.015
σ0.526-0.532=-0.007
min17868.254-17868.237=0.017
max17869.315-17869.339=-0.024
mean8200.000
σ0.000
min8200.000
max8200.000
mean2687.000-2422.000=265.000
σ0.000
min2687.000-2422.000=265.000
max2687.000-2422.000=265.000
mean27.948-27.877=0.071
σ0.199-0.014=0.185
min27.751-27.863=-0.112
max28.208-27.896=0.311