Compare commits

Home / Compare 8b6a5cbb .. 38a1d294

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.001
σ0.045-0.046=-0.001
min70.539-70.542=-0.003
max70.689-70.693=-0.005
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.157-0.162=-0.005
σ0.004-0.003=0.001
min0.150-0.159=-0.008
max0.161-0.167=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.004
σ0.011-0.003=0.008
min21.286-21.283=0.002
max21.322-21.292=0.031
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.062-0.064=-0.001
σ0.004-0.003=0.000
min0.059-0.059=0.000
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.361-0.362=-0.001
min1752.802-1752.809=-0.007
max1753.959-1753.958=0.001
mean1653.200-1664.900=-11.700
σ640.183-637.008=3.175
min636.000-621.000=15.000
max2849.000-2808.000=41.000
mean2.811-2.801=0.010
σ0.182-0.135=0.047
min2.262-2.544=-0.283
max3.099-3.084=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.755=0.002
σ0.007-0.005=0.002
min271.750-271.750=0.001
max271.768-271.762=0.006
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean0.381-0.381=-0.001
σ0.004-0.004=0.001
min0.378-0.378=0.001
max0.389-0.387=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.186=-0.009
σ0.005-0.009=-0.004
min1932.170-1932.177=-0.007
max1932.184-1932.201=-0.017
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean3.053-2.932=0.121
σ0.075-0.133=-0.058
min2.986-2.725=0.261
max3.171-3.084=0.087
iters=5
new-facts=6402
prior-facts=1
mean4752.950-4752.909=0.041
σ0.853-0.951=-0.098
min4752.459-4752.393=0.066
max4754.470-4754.599=-0.129
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean8.267-8.669=-0.402
σ0.414-0.525=-0.111
min7.835-8.014=-0.178
max8.780-9.252=-0.471
iters=5
new-facts=6402
prior-facts=6402
mean4943.304-4943.378=-0.074
σ0.156-0.015=0.141
min4943.028-4943.362=-0.333
max4943.400-4943.395=0.005
mean3070.400-3007.200=63.200
σ290.069-204.051=86.018
min2849.000-2808.000=41.000
max3519.000-3312.000=207.000
mean8.440-8.540=-0.100
σ0.104-0.101=0.003
min8.347-8.427=-0.080
max8.602-8.647=-0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.097=0.008
σ0.171-0.278=-0.107
min0.941-0.940=0.001
max1.340-1.585=-0.245

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.858=0.004
σ575.936-575.924=0.012
min179.892-179.887=0.005
max1331.765-1331.743=0.022
mean86.250
σ8.500
min82.000
max99.000
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean0.446-0.478=-0.032
σ0.303-0.391=-0.089
min0.293-0.278=0.015
max0.900-1.065=-0.165
policies=20
mean1799.192-1799.141=0.051
σ0.375-0.365=0.011
min1798.930-1798.870=0.060
max1799.744-1799.680=0.064
mean820.000
σ0.000
min820.000
max820.000
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean2.866-2.798=0.069
σ0.042-0.010=0.033
min2.805-2.789=0.017
max2.899-2.812=0.088
policies=200
mean17998.458-17998.490=-0.032
σ0.386-0.559=-0.173
min17998.059-17998.062=-0.002
max17998.987-17999.312=-0.325
mean8200.000
σ0.000
min8200.000
max8200.000
mean2849.000-2808.000=41.000
σ0.000
min2849.000-2808.000=41.000
max2849.000-2808.000=41.000
mean28.509-28.190=0.319
σ0.506-0.138=0.368
min28.052-28.078=-0.026
max29.066-28.390=0.676