Compare commits

Home / Compare 85a5905d .. 4194de34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.245=-0.002
σ0.054-0.055=-0.001
min35.215-35.217=-0.002
max35.396-35.401=-0.005
mean414.800-417.000=-2.200
σ0.422-0.000=0.422
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.083-0.082=0.001
σ0.005-0.005=0.001
min0.078-0.076=0.002
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.002-0.004=-0.002
min23.764-23.764=0.000
max23.773-23.778=-0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.066=-0.000
σ0.004-0.005=-0.001
min0.062-0.061=0.001
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.362=0.002
σ0.365-0.365=-0.000
min1755.788-1755.787=0.001
max1756.958-1756.954=0.004
mean1643.550-1651.800=-8.250
σ631.832-638.585=-6.754
min627.000-630.000=-3.000
max2838.000-2830.000=8.000
mean2.313-2.337=-0.023
σ0.062-0.078=-0.016
min2.248-2.254=-0.005
max2.433-2.530=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.589=-0.008
σ0.058-0.041=0.017
min324.480-324.517=-0.038
max324.618-324.615=0.003
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean0.429-0.423=0.006
σ0.009-0.001=0.007
min0.422-0.422=-0.000
max0.444-0.425=0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.140-1985.144=-0.005
σ0.007-0.005=0.002
min1985.132-1985.138=-0.007
max1985.149-1985.150=-0.001
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean2.600-2.592=0.008
σ0.047-0.050=-0.004
min2.561-2.540=0.021
max2.659-2.646=0.013
iters=5
new-facts=6402
prior-facts=1
mean4808.762-4808.740=0.023
σ7.727-7.676=0.051
min4805.217-4805.235=-0.018
max4822.585-4822.470=0.115
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean8.944-8.873=0.071
σ0.353-0.228=0.124
min8.485-8.504=-0.020
max9.399-9.098=0.300
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4996.273=0.072
σ0.018-0.177=-0.160
min4996.324-4995.956=0.368
max4996.370-4996.365=0.006
mean3058.400-3048.600=9.800
σ210.215-187.848=22.367
min2838.000-2830.000=8.000
max3368.000-3312.000=56.000
mean8.815-8.642=0.173
σ0.236-0.209=0.027
min8.556-8.400=0.156
max9.055-8.834=0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-0.928=0.056
σ0.065-0.011=0.054
min0.922-0.921=0.001
max1.063-0.947=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.968=0.007
σ574.250-574.247=0.003
min175.835-175.837=-0.002
max1324.351-1324.338=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean0.432-0.432=-0.001
σ0.301-0.299=0.002
min0.278-0.280=-0.002
max0.884-0.881=0.002
policies=20
mean1758.710-1758.720=-0.010
σ0.350-0.338=0.011
min1758.472-1758.503=-0.031
max1759.229-1759.224=0.005
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean2.795-2.789=0.006
σ0.005-0.013=-0.008
min2.789-2.769=0.021
max2.801-2.798=0.003
policies=200
mean17593.075-17593.304=-0.229
σ0.742-0.702=0.040
min17592.046-17592.334=-0.288
max17593.644-17593.850=-0.206
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2830.000=8.000
σ0.000
min2838.000-2830.000=8.000
max2838.000-2830.000=8.000
mean27.888-27.975=-0.087
σ0.341-0.454=-0.113
min27.559-27.575=-0.017
max28.278-28.491=-0.213