Compare commits

Home / Compare 0a2548ce .. ef12b033

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.001
σ0.045-0.046=-0.001
min70.537-70.542=-0.005
max70.690-70.695=-0.005
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.161-0.162=-0.002
σ0.004-0.004=-0.000
min0.154-0.158=-0.004
max0.168-0.168=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.001
σ0.003-0.003=-0.000
min21.282-21.284=-0.002
max21.291-21.293=-0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.000
min0.064-0.062=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.569=-0.001
σ0.360-0.362=-0.002
min1753.005-1752.994=0.011
max1754.154-1754.168=-0.015
mean1656.800-1652.650=4.150
σ632.774-611.614=21.160
min642.000-691.000=-49.000
max2846.000-2645.000=201.000
mean2.857-2.773=0.084
σ0.151-0.216=-0.064
min2.660-2.223=0.437
max3.352-3.024=0.327

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.014=0.003
σ0.008-0.010=-0.002
min272.007-271.999=0.008
max272.028-272.024=0.004
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean0.387-0.388=-0.001
σ0.016-0.011=0.006
min0.362-0.375=-0.013
max0.402-0.397=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.440=-0.002
σ0.010-0.013=-0.003
min1932.425-1932.427=-0.002
max1932.453-1932.460=-0.007
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean3.043-2.963=0.081
σ0.104-0.137=-0.033
min2.977-2.731=0.246
max3.224-3.093=0.131
iters=5
new-facts=6402
prior-facts=1
mean4753.151-4753.156=-0.005
σ0.849-0.842=0.006
min4752.694-4752.700=-0.006
max4754.664-4754.656=0.008
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean8.628-8.404=0.223
σ0.252-0.561=-0.309
min8.347-7.617=0.731
max8.910-8.954=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean4943.635-4943.627=0.008
σ0.017-0.019=-0.002
min4943.622-4943.606=0.017
max4943.660-4943.656=0.004
mean3101.800-3011.200=90.600
σ269.998-285.681=-15.684
min2846.000-2645.000=201.000
max3383.000-3375.000=8.000
mean8.689-8.601=0.087
σ0.230-0.165=0.065
min8.425-8.375=0.050
max9.027-8.841=0.186

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.148=-0.136
σ0.123-0.256=-0.133
min0.926-0.931=-0.005
max1.205-1.543=-0.337

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.077=0.003
σ575.914-575.937=-0.023
min185.117-185.106=0.011
max1336.951-1336.983=-0.032
mean88.250
σ8.500
min84.000
max101.000
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean0.490-0.562=-0.071
σ0.376-0.550=-0.175
min0.299-0.284=0.015
max1.054-1.387=-0.333
policies=20
mean1851.445-1851.384=0.062
σ0.374-0.374=-0.001
min1851.161-1851.128=0.032
max1851.989-1851.937=0.053
mean840.000
σ0.000
min840.000
max840.000
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean2.960-2.855=0.105
σ0.012-0.013=-0.001
min2.947-2.840=0.106
max2.973-2.870=0.102
policies=200
mean18521.106-18520.933=0.172
σ0.534-0.549=-0.015
min18520.789-18520.545=0.244
max18521.901-18521.736=0.165
mean8400.000
σ0.000
min8400.000
max8400.000
mean2846.000-2645.000=201.000
σ0.000
min2846.000-2645.000=201.000
max2846.000-2645.000=201.000
mean29.388-28.880=0.508
σ0.443-0.047=0.396
min28.964-28.832=0.132
max29.803-28.939=0.864