Compare commits

Home / Compare b49794e3 .. cef596fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.243=0.000
σ0.054-0.055=-0.001
min35.215-35.214=0.001
max35.396-35.398=-0.002
mean414.800-414.900=-0.100
σ0.422-0.316=0.105
min414.000
max415.000
mean0.083-0.080=0.003
σ0.005-0.005=0.000
min0.078-0.076=0.002
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean23.768-23.771=-0.003
σ0.002-0.004=-0.002
min23.764-23.765=-0.001
max23.773-23.778=-0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.066-0.068=-0.003
σ0.004-0.003=0.000
min0.062-0.066=-0.004
max0.073-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.362=0.002
σ0.365-0.365=-0.000
min1755.788-1755.787=0.001
max1756.958-1756.955=0.004
mean1643.550-1653.600=-10.050
σ631.832-633.682=-1.850
min627.000-678.000=-51.000
max2838.000-2826.000=12.000
mean2.313-2.330=-0.017
σ0.062-0.070=-0.008
min2.248-2.211=0.038
max2.433-2.459=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.587=-0.006
σ0.058-0.047=0.010
min324.480-324.503=-0.024
max324.618-324.621=-0.004
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean0.429-0.424=0.005
σ0.009-0.002=0.007
min0.422-0.422=0.000
max0.444-0.427=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.140-1985.141=-0.001
σ0.007-0.008=-0.001
min1985.132-1985.133=-0.001
max1985.149-1985.151=-0.002
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean2.600-2.625=-0.025
σ0.047-0.072=-0.026
min2.561-2.568=-0.007
max2.659-2.714=-0.054
iters=5
new-facts=6402
prior-facts=1
mean4808.762-4808.687=0.075
σ7.727-7.682=0.045
min4805.217-4804.663=0.554
max4822.585-4822.414=0.171
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean8.944-8.716=0.228
σ0.353-0.761=-0.408
min8.485-7.489=0.996
max9.399-9.453=-0.054
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4996.276=0.069
σ0.018-0.147=-0.129
min4996.324-4996.015=0.309
max4996.370-4996.365=0.005
mean3058.400-3026.000=32.400
σ210.215-203.470=6.745
min2838.000-2826.000=12.000
max3368.000-3306.000=62.000
mean8.815-8.667=0.149
σ0.236-0.234=0.003
min8.556-8.433=0.123
max9.055-9.029=0.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-0.984=0.000
σ0.065-0.069=-0.004
min0.922-0.924=-0.002
max1.063-1.060=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.976=-0.001
σ574.250-574.253=-0.003
min175.835-175.839=-0.004
max1324.351-1324.355=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean0.432-0.433=-0.002
σ0.301-0.305=-0.004
min0.278-0.278=0.000
max0.884-0.891=-0.007
policies=20
mean1758.710-1758.723=-0.012
σ0.350-0.363=-0.013
min1758.472-1758.477=-0.005
max1759.229-1759.262=-0.033
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean2.795-2.798=-0.003
σ0.005-0.007=-0.002
min2.789-2.788=0.001
max2.801-2.803=-0.003
policies=200
mean17593.075-17593.280=-0.205
σ0.742-0.696=0.046
min17592.046-17592.333=-0.287
max17593.644-17593.816=-0.172
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2826.000=12.000
σ0.000
min2838.000-2826.000=12.000
max2838.000-2826.000=12.000
mean27.888-27.928=-0.040
σ0.341-0.356=-0.015
min27.559-27.608=-0.050
max28.278-28.295=-0.016