Compare commits

Home / Compare e347845e .. e2f8ed07

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.046=0.001
σ0.044-0.048=-0.005
min73.023-73.023=0.000
max73.169-73.182=-0.014
mean415.000-418.900=-3.900
σ0.000-0.316=-0.316
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.166-0.160=0.006
σ0.007-0.004=0.003
min0.157-0.151=0.005
max0.175-0.165=0.011
cache=y
dps=1
iters=10
policies=100
mean23.739-23.740=-0.001
σ0.003-0.003=-0.001
min23.736-23.735=0.001
max23.744-23.746=-0.001
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.064-0.059=0.005
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.789=-0.002
σ0.362-0.361=0.001
min1758.220-1758.214=0.005
max1759.374-1759.371=0.003
mean1656.950-1633.650=23.300
σ632.840-598.867=33.973
min616.000-638.000=-22.000
max2892.000-2435.000=457.000
mean2.825-2.872=-0.047
σ0.163-0.157=0.006
min2.515-2.507=0.009
max3.086-3.290=-0.204

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.019-324.014=0.004
σ0.041-0.055=-0.014
min323.946-323.917=0.029
max324.042-324.047=-0.005
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean0.426-0.427=-0.001
σ0.006-0.005=0.000
min0.422-0.425=-0.003
max0.436-0.437=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.590-1984.588=0.002
σ0.019-0.018=0.001
min1984.566-1984.571=-0.005
max1984.607-1984.610=-0.003
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean2.593-2.619=-0.026
σ0.092-0.146=-0.055
min2.497-2.474=0.023
max2.745-2.851=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4808.240-4808.123=0.118
σ7.758-7.891=-0.133
min4804.676-4804.121=0.556
max4822.117-4822.229=-0.112
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean8.737-8.923=-0.187
σ0.223-0.200=0.022
min8.422-8.697=-0.275
max8.998-9.146=-0.149
iters=5
new-facts=6402
prior-facts=6402
mean4995.738-4995.728=0.009
σ0.162-0.148=0.014
min4995.451-4995.466=-0.016
max4995.832-4995.823=0.009
mean3089.000-3000.800=88.200
σ261.532-295.688=-34.156
min2892.000-2611.000=281.000
max3486.000-3374.000=112.000
mean8.545-8.571=-0.025
σ0.209-0.171=0.038
min8.410-8.405=0.005
max8.913-8.861=0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.761=-0.789
σ0.141-0.078=0.063
min0.903-1.676=-0.773
max1.224-1.853=-0.629

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.353-468.323=0.029
σ574.230-574.229=0.002
min181.230-181.208=0.023
max1329.698-1329.667=0.032
mean88.250
σ8.500
min84.000
max101.000
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean0.441-0.555=-0.113
σ0.307-0.545=-0.238
min0.286-0.274=0.012
max0.901-1.371=-0.470
policies=20
mean1812.651-1812.422=0.229
σ0.399-0.381=0.018
min1812.370-1812.180=0.190
max1813.235-1812.987=0.248
mean840.000
σ0.000
min840.000
max840.000
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean2.870-2.818=0.052
σ0.014-0.021=-0.007
min2.849-2.796=0.053
max2.877-2.843=0.034
policies=200
mean18132.420-18131.555=0.865
σ0.883-0.412=0.471
min18131.267-18131.227=0.040
max18133.170-18132.144=1.026
mean8400.000
σ0.000
min8400.000
max8400.000
mean2892.000-2435.000=457.000
σ0.000
min2892.000-2435.000=457.000
max2892.000-2435.000=457.000
mean28.716-28.264=0.452
σ0.224-0.082=0.142
min28.487-28.165=0.322
max28.947-28.356=0.591