Compare commits

Home / Compare 84fe63a4 .. 5cafc0ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.568=-0.005
σ0.047-0.045=0.003
min70.542-70.541=0.001
max70.695-70.692=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.156-0.161=-0.004
σ0.006-0.003=0.002
min0.149-0.157=-0.008
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.292-21.287=0.005
σ0.011-0.002=0.009
min21.285-21.284=0.001
max21.324-21.291=0.033
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.001
min0.062-0.058=0.004
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.000
σ0.360-0.361=-0.000
min1752.811-1752.811=-0.000
max1753.962-1753.976=-0.014
mean1653.450-1663.500=-10.050
σ641.212-637.114=4.098
min652.000-621.000=31.000
max2849.000-2815.000=34.000
mean2.824-2.807=0.017
σ0.150-0.157=-0.008
min2.400-2.380=0.020
max3.104-3.100=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.754=-0.001
σ0.005-0.007=-0.001
min271.747-271.744=0.004
max271.759-271.760=-0.001
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean0.379-0.379=0.001
σ0.005-0.005=-0.001
min0.377-0.371=0.005
max0.388-0.386=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.179=-0.002
σ0.008-0.013=-0.005
min1932.168-1932.160=0.008
max1932.189-1932.189=-0.001
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean3.045-2.976=0.068
σ0.137-0.081=0.056
min2.905-2.860=0.045
max3.255-3.087=0.168
iters=5
new-facts=6402
prior-facts=1
mean4752.970-4752.903=0.066
σ0.816-0.927=-0.111
min4752.509-4752.399=0.110
max4754.423-4754.552=-0.129
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean8.040-8.592=-0.552
σ0.398-0.483=-0.085
min7.668-7.913=-0.245
max8.519-9.050=-0.531
iters=5
new-facts=6402
prior-facts=6402
mean4943.236-4943.302=-0.066
σ0.310-0.147=0.163
min4942.683-4943.039=-0.357
max4943.396-4943.389=0.007
mean3077.400-3001.000=76.400
σ261.284-203.779=57.505
min2849.000-2815.000=34.000
max3472.000-3309.000=163.000
mean8.378-8.465=-0.087
σ0.150-0.090=0.059
min8.163-8.327=-0.164
max8.562-8.547=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.001=0.044
σ0.129-0.144=-0.015
min0.927-0.931=-0.004
max1.242-1.259=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.863=-0.000
σ575.924-575.929=-0.005
min179.895-179.891=0.004
max1331.748-1331.757=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean0.446-0.466=-0.021
σ0.300-0.364=-0.064
min0.295-0.274=0.021
max0.895-1.012=-0.117
policies=20
mean1799.183-1799.171=0.012
σ0.380-0.364=0.015
min1798.905-1798.921=-0.016
max1799.740-1799.713=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean2.888-2.817=0.071
σ0.012-0.023=-0.010
min2.872-2.794=0.077
max2.900-2.837=0.062
policies=200
mean17998.532-17998.400=0.132
σ0.420-0.611=-0.190
min17998.241-17997.986=0.256
max17999.156-17999.306=-0.150
mean8200.000
σ0.000
min8200.000
max8200.000
mean2849.000-2815.000=34.000
σ0.000
min2849.000-2815.000=34.000
max2849.000-2815.000=34.000
mean28.562-28.216=0.346
σ0.498-0.158=0.340
min28.038-28.108=-0.070
max29.105-28.449=0.656