Compare commits

Home / Compare ef6a0763 .. deb85f4e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.781=-0.001
σ0.044-0.047=-0.003
min70.750-70.752=-0.002
max70.902-70.911=-0.009
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.157-0.156=0.000
σ0.005-0.005=-0.000
min0.149-0.149=-0.001
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=0.000
min21.488-21.488=-0.001
max21.497-21.496=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.062-0.058=0.004
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.001
σ0.363-0.361=0.002
min1753.528-1753.529=-0.002
max1754.676-1754.683=-0.006
mean1670.250-1661.450=8.800
σ638.892-634.545=4.348
min672.000-627.000=45.000
max2734.000-2777.000=-43.000
mean2.822-2.805=0.017
σ0.177-0.181=-0.004
min2.264-2.174=0.090
max3.032-3.020=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.955=0.002
σ0.007-0.007=0.001
min271.947-271.946=0.001
max271.966-271.961=0.004
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean0.385-0.378=0.007
σ0.007-0.001=0.007
min0.381-0.377=0.004
max0.398-0.379=0.019
iters=5
new-facts=1
prior-facts=6402
mean1932.331-1932.315=0.015
σ0.013-0.011=0.002
min1932.313-1932.301=0.012
max1932.347-1932.330=0.017
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean2.946-3.051=-0.105
σ0.286-0.069=0.217
min2.449-2.980=-0.531
max3.173-3.151=0.022
iters=5
new-facts=6402
prior-facts=1
mean4752.979-4753.122=-0.143
σ1.009-0.890=0.120
min4752.048-4752.580=-0.531
max4754.701-4754.704=-0.002
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean8.621-8.419=0.202
σ0.369-0.379=-0.010
min8.013-7.964=0.049
max8.926-8.995=-0.069
iters=5
new-facts=6402
prior-facts=6402
mean4943.556-4943.557=-0.002
σ0.014-0.016=-0.002
min4943.537-4943.534=0.002
max4943.570-4943.569=0.000
mean3041.200-2992.800=48.400
σ224.355-282.718=-58.362
min2734.000-2777.000=-43.000
max3328.000-3442.000=-114.000
mean8.486-8.441=0.046
σ0.126-0.194=-0.068
min8.338-8.313=0.026
max8.631-8.783=-0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.017=0.039
σ0.132-0.135=-0.002
min0.938-0.926=0.012
max1.262-1.233=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.661=0.006
σ574.934-574.928=0.006
min181.190-181.192=-0.002
max1331.067-1331.052=0.015
mean88.250
σ8.500
min84.000
max101.000
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean0.585-0.447=0.138
σ0.588-0.299=0.289
min0.287-0.296=-0.009
max1.466-0.895=0.571
policies=20
mean1812.213-1812.247=-0.033
σ0.388-0.371=0.018
min1811.945-1811.973=-0.028
max1812.785-1812.781=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean2.843-2.926=-0.083
σ0.021-0.083=-0.062
min2.817-2.831=-0.014
max2.863-3.033=-0.170
policies=200
mean18129.228-18129.233=-0.005
σ0.437-0.526=-0.089
min18128.941-18128.884=0.057
max18129.880-18130.017=-0.137
mean8400.000
σ0.000
min8400.000
max8400.000
mean2734.000-2777.000=-43.000
σ0.000
min2734.000-2777.000=-43.000
max2734.000-2777.000=-43.000
mean28.664-28.511=0.152
σ0.042-0.065=-0.023
min28.618-28.451=0.167
max28.718-28.598=0.120