Compare commits

Home / Compare a59f8e06 .. 9d5de8ac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-73.045=-37.802
σ0.054-0.047=0.007
min35.215-73.021=-37.806
max35.396-73.178=-37.782
mean414.800-414.000=0.800
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.083-0.160=-0.076
σ0.005-0.004=0.001
min0.078-0.152=-0.075
max0.092-0.167=-0.074
cache=y
dps=1
iters=10
policies=100
mean23.768-23.740=0.028
σ0.002-0.004=-0.002
min23.764-23.735=0.029
max23.773-23.747=0.026
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.066=-0.000
σ0.004-0.004=0.000
min0.062-0.059=0.003
max0.073-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1758.787=-2.422
σ0.365-0.357=0.007
min1755.788-1758.213=-2.425
max1756.958-1759.369=-2.410
mean1643.550-1657.150=-13.600
σ631.832-622.031=9.801
min627.000-622.000=5.000
max2838.000-2500.000=338.000
mean2.313-2.815=-0.502
σ0.062-0.137=-0.075
min2.248-2.470=-0.222
max2.433-2.984=-0.551

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.018=0.564
σ0.058-0.044=0.013
min324.480-323.939=0.540
max324.618-324.047=0.571
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean0.429-0.425=0.003
σ0.009-0.002=0.007
min0.422-0.423=-0.002
max0.444-0.428=0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.140-1984.592=0.548
σ0.007-0.010=-0.004
min1985.132-1984.575=0.557
max1985.149-1984.600=0.549
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean2.600-2.636=-0.036
σ0.047-0.070=-0.024
min2.561-2.575=-0.015
max2.659-2.738=-0.079
iters=5
new-facts=6402
prior-facts=1
mean4808.762-4808.238=0.524
σ7.727-7.813=-0.086
min4805.217-4804.724=0.493
max4822.585-4822.215=0.370
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean8.944-9.015=-0.071
σ0.353-0.117=0.236
min8.485-8.860=-0.376
max9.399-9.141=0.257
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4995.806=0.538
σ0.018-0.025=-0.008
min4996.324-4995.777=0.547
max4996.370-4995.832=0.539
mean3058.400-2939.600=118.800
σ210.215-372.098=-161.883
min2838.000-2500.000=338.000
max3368.000-3416.000=-48.000
mean8.815-8.567=0.248
σ0.236-0.146=0.090
min8.556-8.431=0.126
max9.055-8.781=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.554=-0.570
σ0.065-0.219=-0.155
min0.922-1.252=-0.331
max1.063-1.780=-0.717

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-468.325=-5.350
σ574.250-574.237=0.014
min175.835-181.205=-5.370
max1324.351-1329.680=-5.330
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean0.432-0.562=-0.130
σ0.301-0.555=-0.253
min0.278-0.283=-0.005
max0.884-1.394=-0.511
policies=20
mean1758.710-1812.395=-53.685
σ0.350-0.391=-0.041
min1758.472-1812.145=-53.673
max1759.229-1812.976=-53.747
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean2.795-2.805=-0.010
σ0.005-0.021=-0.016
min2.789-2.777=0.012
max2.801-2.825=-0.024
policies=200
mean17593.075-18131.449=-538.374
σ0.742-0.630=0.112
min17592.046-18130.829=-538.783
max17593.644-18132.317=-538.673
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2838.000-2500.000=338.000
σ0.000
min2838.000-2500.000=338.000
max2838.000-2500.000=338.000
mean27.888-28.300=-0.413
σ0.341-0.020=0.321
min27.559-28.273=-0.715
max28.278-28.320=-0.041