Compare commits

Home / Compare 15f9eb39 .. ef6a0763

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.047-0.044=0.003
min70.752-70.750=0.002
max70.911-70.902=0.009
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.156-0.157=-0.000
σ0.005-0.005=0.000
min0.149-0.149=0.001
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.003=-0.000
min21.488-21.488=0.001
max21.496-21.497=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.058-0.062=-0.004
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.001
σ0.361-0.363=-0.002
min1753.529-1753.528=0.002
max1754.683-1754.676=0.006
mean1661.450-1670.250=-8.800
σ634.545-638.892=-4.348
min627.000-672.000=-45.000
max2777.000-2734.000=43.000
mean2.805-2.822=-0.017
σ0.181-0.177=0.004
min2.174-2.264=-0.090
max3.020-3.032=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.956=-0.002
σ0.007-0.007=-0.001
min271.946-271.947=-0.001
max271.961-271.966=-0.004
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean0.378-0.385=-0.007
σ0.001-0.007=-0.007
min0.377-0.381=-0.004
max0.379-0.398=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1932.315-1932.331=-0.015
σ0.011-0.013=-0.002
min1932.301-1932.313=-0.012
max1932.330-1932.347=-0.017
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean3.051-2.946=0.105
σ0.069-0.286=-0.217
min2.980-2.449=0.531
max3.151-3.173=-0.022
iters=5
new-facts=6402
prior-facts=1
mean4753.122-4752.979=0.143
σ0.890-1.009=-0.120
min4752.580-4752.048=0.531
max4754.704-4754.701=0.002
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean8.419-8.621=-0.202
σ0.379-0.369=0.010
min7.964-8.013=-0.049
max8.995-8.926=0.069
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.556=0.002
σ0.016-0.014=0.002
min4943.534-4943.537=-0.002
max4943.569-4943.570=-0.000
mean2992.800-3041.200=-48.400
σ282.718-224.355=58.362
min2777.000-2734.000=43.000
max3442.000-3328.000=114.000
mean8.441-8.486=-0.046
σ0.194-0.126=0.068
min8.313-8.338=-0.026
max8.783-8.631=0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.056=-0.039
σ0.135-0.132=0.002
min0.926-0.938=-0.012
max1.233-1.262=-0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.661-468.666=-0.006
σ574.928-574.934=-0.006
min181.192-181.190=0.002
max1331.052-1331.067=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean0.447-0.585=-0.138
σ0.299-0.588=-0.289
min0.296-0.287=0.009
max0.895-1.466=-0.571
policies=20
mean1812.247-1812.213=0.033
σ0.371-0.388=-0.018
min1811.973-1811.945=0.028
max1812.781-1812.785=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean2.926-2.843=0.083
σ0.083-0.021=0.062
min2.831-2.817=0.014
max3.033-2.863=0.170
policies=200
mean18129.233-18129.228=0.005
σ0.526-0.437=0.089
min18128.884-18128.941=-0.057
max18130.017-18129.880=0.137
mean8400.000
σ0.000
min8400.000
max8400.000
mean2777.000-2734.000=43.000
σ0.000
min2777.000-2734.000=43.000
max2777.000-2734.000=43.000
mean28.511-28.664=-0.152
σ0.065-0.042=0.023
min28.451-28.618=-0.167
max28.598-28.718=-0.120