Compare commits

Home / Compare f1e4f74d .. bdcb8654

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.054-0.054=0.000
min35.232-35.238=-0.005
max35.415-35.415=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.083-0.084=-0.001
σ0.005-0.005=-0.000
min0.078-0.078=-0.000
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.768-23.769=-0.001
σ0.002-0.003=-0.001
min23.766-23.766=0.001
max23.772-23.775=-0.003
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.067-0.065=0.003
σ0.003-0.002=0.001
min0.061-0.061=-0.000
max0.075-0.067=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.468=0.003
σ0.365-0.368=-0.003
min1755.893-1755.896=-0.003
max1757.057-1757.064=-0.007
mean1647.200-1656.550=-9.350
σ639.606-637.000=2.606
min624.000-677.000=-53.000
max2824.000-2843.000=-19.000
mean2.331-2.325=0.005
σ0.089-0.107=-0.018
min2.201-2.131=0.070
max2.566-2.583=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.694-324.690=0.004
σ0.047-0.051=-0.005
min324.612-324.599=0.013
max324.727-324.720=0.007
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean0.429-0.424=0.005
σ0.007-0.003=0.004
min0.422-0.421=0.001
max0.439-0.429=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.252-1985.257=-0.005
σ0.013-0.005=0.007
min1985.237-1985.251=-0.014
max1985.265-1985.263=0.002
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean2.593-2.581=0.012
σ0.108-0.074=0.034
min2.452-2.494=-0.042
max2.742-2.671=0.071
iters=5
new-facts=6402
prior-facts=1
mean4808.535-4808.873=-0.338
σ7.903-7.625=0.278
min4804.188-4805.391=-1.203
max4822.637-4822.513=0.124
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean8.566-9.066=-0.500
σ0.664-0.348=0.316
min7.769-8.518=-0.750
max9.134-9.473=-0.338
iters=5
new-facts=6402
prior-facts=6402
mean4996.384-4996.398=-0.014
σ0.165-0.140=0.026
min4996.090-4996.150=-0.061
max4996.471-4996.477=-0.006
mean3040.400-3051.600=-11.200
σ291.934-191.680=100.254
min2824.000-2843.000=-19.000
max3498.000-3330.000=168.000
mean8.505-8.661=-0.156
σ0.106-0.192=-0.085
min8.419-8.472=-0.052
max8.685-8.889=-0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-1.036=-0.047
σ0.153-0.164=-0.011
min0.915-0.913=0.002
max1.261-1.230=0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.955-462.951=0.004
σ574.257-574.253=0.004
min175.813-175.816=-0.003
max1324.341-1324.331=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean0.538-0.435=0.103
σ0.512-0.300=0.212
min0.278-0.282=-0.004
max1.306-0.885=0.421
policies=20
mean1758.474-1758.489=-0.015
σ0.364-0.351=0.014
min1758.224-1758.234=-0.009
max1759.014-1759.004=0.010
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean2.780-2.797=-0.017
σ0.012-0.019=-0.008
min2.771-2.774=-0.002
max2.797-2.819=-0.023
policies=200
mean17591.114-17591.085=0.029
σ0.713-0.662=0.051
min17590.142-17590.274=-0.132
max17591.686-17591.638=0.048
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2843.000=-19.000
σ0.000
min2824.000-2843.000=-19.000
max2824.000-2843.000=-19.000
mean27.880-27.941=-0.061
σ0.268-0.288=-0.020
min27.627-27.672=-0.045
max28.217-28.294=-0.076