Compare commits

Home / Compare b524b6a4 .. 41dc3dbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=-0.000
σ0.044-0.048=-0.004
min73.027-73.023=0.004
max73.169-73.182=-0.013
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.166-0.162=0.004
σ0.011-0.005=0.006
min0.150-0.156=-0.006
max0.182-0.170=0.013
cache=y
dps=1
iters=10
policies=100
mean23.739-23.741=-0.001
σ0.003-0.002=0.001
min23.735-23.737=-0.003
max23.746-23.743=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.066=-0.001
σ0.004-0.002=0.001
min0.060-0.064=-0.004
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.790-1758.788=0.002
σ0.361-0.360=0.001
min1758.212-1758.215=-0.003
max1759.375-1759.380=-0.005
mean1643.500-1659.000=-15.500
σ624.541-629.660=-5.119
min620.000-629.000=-9.000
max2772.000-2522.000=250.000
mean2.860-2.766=0.095
σ0.085-0.222=-0.137
min2.715-2.243=0.471
max3.031-3.037=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.009-324.016=-0.007
σ0.051-0.056=-0.005
min323.918-323.916=0.002
max324.039-324.044=-0.006
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean0.426-0.431=-0.005
σ0.005-0.007=-0.002
min0.424-0.425=-0.002
max0.435-0.439=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1984.595-1984.588=0.006
σ0.010-0.014=-0.004
min1984.581-1984.569=0.012
max1984.607-1984.604=0.003
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean2.594-2.648=-0.054
σ0.117-0.126=-0.009
min2.454-2.517=-0.063
max2.737-2.793=-0.056
iters=5
new-facts=6402
prior-facts=1
mean4808.239-4808.223=0.016
σ7.818-7.836=-0.018
min4804.675-4804.648=0.027
max4822.224-4822.240=-0.016
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean8.937-8.921=0.016
σ0.200-0.175=0.025
min8.591-8.769=-0.178
max9.099-9.218=-0.119
iters=5
new-facts=6402
prior-facts=6402
mean4995.811-4995.739=0.072
σ0.014-0.170=-0.156
min4995.798-4995.437=0.361
max4995.833-4995.834=-0.001
mean3029.000-2948.400=80.600
σ217.800-377.805=-160.004
min2772.000-2522.000=250.000
max3324.000-3425.000=-101.000
mean8.688-8.662=0.026
σ0.257-0.220=0.037
min8.441-8.489=-0.048
max9.113-9.020=0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.537=-0.534
σ0.138-0.178=-0.040
min0.911-1.221=-0.309
max1.230-1.642=-0.412

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.353-468.329=0.024
σ574.229-574.234=-0.005
min181.230-181.207=0.023
max1329.697-1329.680=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean0.480-0.535=-0.055
σ0.378-0.502=-0.124
min0.289-0.282=0.006
max1.046-1.288=-0.242
policies=20
mean1812.628-1812.402=0.227
σ0.387-0.396=-0.009
min1812.353-1812.129=0.223
max1813.197-1812.988=0.208
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean2.881-2.811=0.069
σ0.008-0.013=-0.004
min2.870-2.798=0.072
max2.890-2.827=0.063
policies=200
mean18131.638-18131.613=0.025
σ0.505-0.499=0.005
min18131.319-18131.312=0.007
max18132.389-18132.360=0.029
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2522.000=250.000
σ0.000
min2772.000-2522.000=250.000
max2772.000-2522.000=250.000
mean28.343-28.396=-0.053
σ0.128-0.047=0.081
min28.229-28.338=-0.109
max28.518-28.438=0.081