Compare commits

Home / Compare 5bcd6ecf .. 91729bc4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=-0.000
σ0.049-0.048=0.001
min73.023-73.023=0.000
max73.183-73.182=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.158=0.003
σ0.005-0.005=-0.001
min0.155-0.151=0.005
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean23.742-23.741=0.001
σ0.003-0.003=-0.000
min23.735-23.735=0.001
max23.747-23.747=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.064=0.001
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.787=0.001
σ0.362-0.358=0.004
min1758.212-1758.212=0.000
max1759.370-1759.357=0.013
mean1642.350-1657.350=-15.000
σ626.390-632.401=-6.010
min616.000
max2772.000-2893.000=-121.000
mean2.846-2.862=-0.016
σ0.167-0.135=0.032
min2.423-2.624=-0.201
max3.030-3.137=-0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.009-324.012=-0.003
σ0.058-0.052=0.006
min323.906-323.919=-0.013
max324.043-324.044=-0.001
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean0.427-0.426=0.002
σ0.004-0.002=0.003
min0.424-0.423=0.001
max0.435-0.427=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.577-1984.572=0.004
σ0.022-0.013=0.008
min1984.551-1984.556=-0.005
max1984.603-1984.591=0.012
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean2.636-2.607=0.029
σ0.139-0.159=-0.019
min2.481-2.488=-0.007
max2.838-2.874=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4808.235-4808.123=0.112
σ7.733-7.483=0.250
min4804.730-4804.701=0.029
max4822.068-4821.509=0.559
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean8.741-8.779=-0.038
σ0.273-0.224=0.049
min8.310-8.410=-0.100
max8.970-9.017=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean4995.818-4995.667=0.151
σ0.054-0.202=-0.148
min4995.766-4995.431=0.335
max4995.910-4995.832=0.078
mean2994.800-3038.200=-43.400
σ255.509-175.565=79.943
min2772.000-2893.000=-121.000
max3398.000-3323.000=75.000
mean8.834-8.605=0.229
σ0.748-0.117=0.631
min8.468-8.504=-0.036
max10.171-8.797=1.374

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.147-1.039=0.108
σ0.221-0.149=0.072
min0.898-0.912=-0.014
max1.450-1.282=0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.357-468.352=0.005
σ574.246-574.227=0.019
min181.226-181.229=-0.003
max1329.725-1329.692=0.033
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean0.446-0.430=0.015
σ0.306-0.308=-0.003
min0.292-0.242=0.049
max0.904-0.891=0.013
policies=20
mean1812.592-1812.604=-0.012
σ0.398-0.389=0.010
min1812.328-1812.329=-0.001
max1813.178-1813.174=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean2.873-2.899=-0.027
σ0.023-0.014=0.010
min2.839-2.882=-0.042
max2.891-2.913=-0.021
policies=200
mean18131.623-18132.540=-0.918
σ0.560-0.747=-0.187
min18131.141-18131.507=-0.366
max18132.433-18133.119=-0.686
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2893.000=-121.000
σ0.000
min2772.000-2893.000=-121.000
max2772.000-2893.000=-121.000
mean28.396-28.770=-0.374
σ0.240-0.335=-0.095
min28.256-28.413=-0.157
max28.754-29.122=-0.368