Compare commits

Home / Compare 024a3fdf .. 6d0afacb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.046=-0.002
σ0.048-0.046=0.002
min73.012-73.019=-0.008
max73.177-73.175=0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.159-0.163=-0.004
σ0.004-0.005=-0.001
min0.156-0.157=-0.001
max0.166-0.171=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.738-23.739=-0.001
σ0.002-0.003=-0.000
min23.733-23.735=-0.002
max23.741-23.743=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.065=-0.001
σ0.003-0.003=0.000
min0.061-0.059=0.002
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.787=0.000
σ0.363-0.360=0.003
min1758.208-1758.216=-0.008
max1759.373-1759.352=0.020
mean1654.400-1625.650=28.750
σ631.735-596.881=34.854
min616.000-639.000=-23.000
max2888.000-2413.000=475.000
mean2.775-2.774=0.001
σ0.199-0.199=-0.000
min2.305-2.296=0.009
max3.093-3.087=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.007-324.013=-0.006
σ0.052-0.061=-0.009
min323.918-323.904=0.014
max324.046-324.046=0.000
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean0.432-0.432=0.000
σ0.005-0.009=-0.004
min0.428-0.427=0.001
max0.438-0.447=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1984.586-1984.587=-0.001
σ0.025-0.021=0.004
min1984.560-1984.559=0.001
max1984.613-1984.610=0.003
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean2.670-2.662=0.007
σ0.246-0.105=0.141
min2.519-2.553=-0.034
max3.106-2.785=0.321
iters=5
new-facts=6402
prior-facts=1
mean4808.232-4808.118=0.114
σ7.824-7.507=0.317
min4804.638-4804.697=-0.059
max4822.227-4821.546=0.681
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean8.848-8.815=0.033
σ0.149-0.172=-0.023
min8.635-8.621=0.015
max9.021-9.060=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean4995.740-4995.808=-0.068
σ0.155-0.021=0.134
min4995.465-4995.783=-0.318
max4995.837-4995.829=0.009
mean3035.600-2928.000=107.600
σ174.861-411.545=-236.684
min2888.000-2413.000=475.000
max3316.000-3428.000=-112.000
mean8.644-8.645=-0.001
σ0.146-0.255=-0.109
min8.498-8.410=0.088
max8.856-9.033=-0.177

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.011-1.723=-0.712
σ0.138-0.135=0.003
min0.917-1.499=-0.582
max1.234-1.837=-0.603

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.327=0.029
σ574.229-574.229=-0.000
min181.230-181.209=0.021
max1329.698-1329.670=0.028
mean88.250
σ8.500
min84.000
max101.000
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean0.444-0.554=-0.110
σ0.301-0.540=-0.239
min0.291-0.282=0.010
max0.895-1.364=-0.469
policies=20
mean1812.637-1812.426=0.211
σ0.396-0.382=0.014
min1812.364-1812.173=0.191
max1813.219-1812.992=0.227
mean840.000
σ0.000
min840.000
max840.000
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean2.892-2.817=0.075
σ0.011-0.012=-0.001
min2.879-2.804=0.075
max2.903-2.830=0.072
policies=200
mean18132.327-18131.642=0.686
σ0.912-0.490=0.422
min18131.128-18131.347=-0.219
max18133.063-18132.375=0.688
mean8400.000
σ0.000
min8400.000
max8400.000
mean2888.000-2413.000=475.000
σ0.000
min2888.000-2413.000=475.000
max2888.000-2413.000=475.000
mean28.709-28.451=0.258
σ0.361-0.044=0.317
min28.349-28.405=-0.056
max29.105-28.495=0.610