Compare commits

Home / Compare f668add8 .. 91badecf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.055=-0.002
min35.241-35.232=0.009
max35.415-35.419=-0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.085-0.083=0.002
σ0.003-0.005=-0.002
min0.082-0.077=0.005
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=0.001
min23.765-23.765=-0.000
max23.774-23.774=0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.066-0.069=-0.003
σ0.004-0.004=0.001
min0.061-0.066=-0.005
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.363-0.365=-0.002
min1755.913-1755.910=0.003
max1757.072-1757.069=0.003
mean1657.250-1649.800=7.450
σ619.673-644.994=-25.321
min627.000-644.000=-17.000
max2492.000-2843.000=-351.000
mean2.364-2.369=-0.005
σ0.126-0.102=0.024
min2.205-2.263=-0.057
max2.811-2.609=0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.704-324.701=0.003
σ0.053-0.054=-0.000
min324.610-324.605=0.005
max324.739-324.731=0.008
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean0.422-0.425=-0.003
σ0.001-0.001=0.000
min0.421-0.423=-0.002
max0.424-0.427=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.252-1985.267=-0.016
σ0.021-0.014=0.007
min1985.230-1985.246=-0.016
max1985.276-1985.283=-0.007
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean2.626-2.697=-0.071
σ0.191-0.203=-0.011
min2.459-2.533=-0.074
max2.942-3.030=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4808.859-4808.872=-0.012
σ7.691-7.661=0.031
min4805.401-4805.331=0.069
max4822.617-4822.575=0.043
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean8.930-8.889=0.040
σ0.244-0.229=0.015
min8.531-8.609=-0.077
max9.147-9.201=-0.054
iters=5
new-facts=6402
prior-facts=6402
mean4996.399-4996.385=0.014
σ0.157-0.171=-0.014
min4996.120-4996.082=0.038
max4996.480-4996.479=0.001
mean2947.800-3069.000=-121.200
σ429.246-301.910=127.336
min2492.000-2843.000=-351.000
max3533.000-3538.000=-5.000
mean8.495-8.516=-0.021
σ0.133-0.119=0.014
min8.396-8.416=-0.020
max8.723-8.718=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.637-1.000=0.637
σ0.135-0.063=0.072
min1.456-0.920=0.536
max1.747-1.047=0.700

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.944-462.959=-0.015
σ574.247-574.253=-0.006
min175.815-175.818=-0.004
max1324.315-1324.339=-0.024
mean86.250
σ8.500
min82.000
max99.000
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean0.551-0.430=0.121
σ0.556-0.294=0.262
min0.270-0.280=-0.010
max1.385-0.871=0.515
policies=20
mean1758.500-1758.565=-0.065
σ0.337-0.355=-0.018
min1758.258-1758.322=-0.064
max1758.997-1759.092=-0.094
mean820.000
σ0.000
min820.000
max820.000
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean2.717-2.778=-0.061
σ0.022-0.010=0.013
min2.694-2.769=-0.075
max2.743-2.789=-0.046
policies=200
mean17592.466-17592.477=-0.011
σ0.559-0.327=0.232
min17592.083-17592.216=-0.133
max17593.294-17592.955=0.339
mean8200.000
σ0.000
min8200.000
max8200.000
mean2492.000-2843.000=-351.000
σ0.000
min2492.000-2843.000=-351.000
max2492.000-2843.000=-351.000
mean27.346-27.833=-0.488
σ0.168-0.373=-0.205
min27.166-27.441=-0.275
max27.520-28.273=-0.754