Compare commits

Home / Compare af15387d .. d9c3c64e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.000
σ0.046-0.045=0.001
min70.537-70.536=0.001
max70.694-70.691=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.159=0.001
σ0.004-0.005=-0.001
min0.152-0.152=0.000
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.001
σ0.003-0.004=-0.000
min21.284-21.281=0.003
max21.294-21.293=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.376=-0.002
σ0.361-0.361=-0.000
min1752.805-1752.805=0.000
max1753.959-1753.960=-0.001
mean1638.750-1660.750=-22.000
σ597.187-635.984=-38.797
min634.000-687.000=-53.000
max2435.000-2766.000=-331.000
mean2.773-2.853=-0.081
σ0.164-0.165=-0.001
min2.294-2.283=0.011
max2.957-3.190=-0.233

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.751=0.003
σ0.006-0.006=-0.000
min271.745-271.745=-0.001
max271.760-271.761=-0.001
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean0.382-0.379=0.003
σ0.004-0.005=-0.001
min0.379-0.377=0.003
max0.389-0.388=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.181-1932.172=0.008
σ0.012-0.017=-0.005
min1932.168-1932.146=0.021
max1932.199-1932.190=0.008
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean2.899-3.011=-0.112
σ0.194-0.092=0.102
min2.590-2.871=-0.280
max3.092-3.119=-0.028
iters=5
new-facts=6402
prior-facts=1
mean4752.934-4752.928=0.006
σ0.834-0.899=-0.065
min4752.490-4752.423=0.067
max4754.421-4754.526=-0.106
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean8.384-8.416=-0.032
σ0.384-0.514=-0.130
min7.771-7.621=0.150
max8.831-8.926=-0.096
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.306=0.071
σ0.016-0.174=-0.158
min4943.354-4942.994=0.359
max4943.392-4943.391=0.000
mean3000.800-2986.600=14.200
σ306.295-218.209=88.086
min2599.000-2766.000=-167.000
max3395.000-3301.000=94.000
mean8.541-8.530=0.011
σ0.121-0.071=0.051
min8.424-8.445=-0.021
max8.700-8.629=0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.781-1.020=0.761
σ0.118-0.143=-0.026
min1.665-0.926=0.739
max1.930-1.252=0.678

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-467.861=4.981
σ575.913-575.926=-0.013
min184.884-179.891=4.993
max1336.711-1331.749=4.961
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean0.568-0.480=0.088
σ0.559-0.397=0.162
min0.284-0.278=0.006
max1.407-1.075=0.332
policies=20
mean1849.165-1799.167=49.999
σ0.383-0.355=0.028
min1848.903-1798.965=49.938
max1849.729-1799.698=50.032
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean2.854-2.776=0.079
σ0.024-0.027=-0.003
min2.823-2.754=0.069
max2.882-2.814=0.069
policies=200
mean18498.605-17998.477=500.128
σ0.413-0.396=0.017
min18498.236-17998.218=500.018
max18499.196-17999.063=500.133
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2435.000-2766.000=-331.000
σ0.000
min2435.000-2766.000=-331.000
max2435.000-2766.000=-331.000
mean28.747-28.177=0.570
σ0.050-0.140=-0.090
min28.682-28.058=0.624
max28.803-28.331=0.472