Compare commits

Home / Compare 82ffff89 .. 5c178cce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.772-70.775=-0.002
σ0.052-0.051=0.001
min70.740-70.745=-0.005
max70.917-70.915=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.162=-0.004
σ0.013-0.003=0.010
min0.122-0.156=-0.034
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.490-21.491=-0.001
σ0.002-0.002=-0.001
min21.487-21.487=0.001
max21.493-21.493=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.066=-0.002
σ0.004-0.002=0.001
min0.060-0.064=-0.004
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1755.287=-0.001
σ0.360-0.361=-0.001
min1754.720-1754.718=0.002
max1755.867-1755.869=-0.001
mean1650.900-1626.450=24.450
σ634.072-594.388=39.684
min621.000-638.000=-17.000
max2859.000-2420.000=439.000
mean2.809-2.810=-0.001
σ0.151-0.229=-0.077
min2.292-2.149=0.143
max2.974-3.139=-0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.766-272.769=-0.003
σ0.010-0.004=0.006
min272.754-272.764=-0.011
max272.781-272.773=0.008
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean0.383-0.384=-0.001
σ0.006-0.004=0.002
min0.378-0.380=-0.002
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.152-1933.151=0.002
σ0.011-0.020=-0.009
min1933.134-1933.123=0.011
max1933.163-1933.174=-0.011
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean2.978-3.080=-0.102
σ0.292-0.174=0.118
min2.513-2.954=-0.441
max3.286-3.388=-0.102
iters=5
new-facts=6402
prior-facts=1
mean4753.938-4753.824=0.114
σ0.827-0.929=-0.102
min4753.467-4752.889=0.578
max4755.413-4755.385=0.028
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean8.390-8.410=-0.021
σ0.278-0.293=-0.015
min8.071-8.105=-0.033
max8.819-8.846=-0.027
iters=5
new-facts=6402
prior-facts=6402
mean4944.379-4944.381=-0.002
σ0.019-0.023=-0.005
min4944.355-4944.354=0.000
max4944.401-4944.406=-0.005
mean3038.600-2898.600=140.000
σ263.316-392.243=-128.927
min2859.000-2420.000=439.000
max3462.000-3424.000=38.000
mean8.418-8.404=0.014
σ0.059-0.046=0.013
min8.377-8.355=0.023
max8.519-8.461=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-1.764=-0.751
σ0.141-0.127=0.014
min0.920-1.586=-0.666
max1.242-1.873=-0.630

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.834=0.006
σ574.925-574.921=0.003
min185.369-185.369=-0.000
max1335.228-1335.216=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean0.444-0.575=-0.131
σ0.300-0.580=-0.280
min0.293-0.275=0.018
max0.893-1.444=-0.551
policies=20
mean1854.017-1853.942=0.075
σ0.363-0.376=-0.014
min1853.747-1853.689=0.059
max1854.544-1854.499=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean2.936-2.867=0.069
σ0.009-0.012=-0.002
min2.927-2.858=0.069
max2.948-2.885=0.063
policies=200
mean18546.522-18546.621=-0.099
σ0.568-0.546=0.022
min18546.155-18546.233=-0.079
max18547.367-18547.410=-0.043
mean8400.000
σ0.000
min8400.000
max8400.000
mean2859.000-2420.000=439.000
σ0.000
min2859.000-2420.000=439.000
max2859.000-2420.000=439.000
mean29.272-28.779=0.493
σ0.537-0.093=0.444
min28.664-28.655=0.009
max29.797-28.864=0.933