Compare commits

Home / Compare bcaf38e2 .. f6c01e57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.053-0.054=-0.001
min35.229-35.230=-0.001
max35.412-35.416=-0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.085-0.084=0.001
σ0.003-0.003=0.000
min0.083-0.082=0.000
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.004-0.004=-0.000
min23.765-23.764=0.000
max23.776-23.776=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.068-0.069=-0.000
σ0.004-0.003=0.000
min0.066-0.066=-0.000
max0.077-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.472-1756.486=-0.014
σ0.365-0.365=-0.000
min1755.896-1755.909=-0.013
max1757.061-1757.072=-0.011
mean1626.600-1647.900=-21.300
σ593.742-642.307=-48.565
min650.000-623.000=27.000
max2425.000-2840.000=-415.000
mean2.342-2.345=-0.003
σ0.139-0.098=0.041
min2.158-2.245=-0.087
max2.779-2.583=0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.690-324.683=0.007
σ0.055-0.041=0.014
min324.592-324.611=-0.019
max324.719-324.708=0.011
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean0.429-0.430=-0.001
σ0.007-0.007=0.000
min0.422-0.423=-0.001
max0.441-0.440=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.250-1985.261=-0.011
σ0.017-0.015=0.003
min1985.224-1985.244=-0.020
max1985.263-1985.273=-0.009
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean2.665-2.659=0.006
σ0.154-0.146=0.008
min2.458-2.520=-0.062
max2.855-2.855=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4808.863-4808.898=-0.035
σ7.631-7.688=-0.058
min4805.402-4805.396=0.006
max4822.513-4822.651=-0.138
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean8.904-9.109=-0.204
σ0.276-0.292=-0.016
min8.445-8.673=-0.228
max9.158-9.362=-0.204
iters=5
new-facts=6402
prior-facts=6402
mean4996.456-4996.469=-0.012
σ0.017-0.009=0.009
min4996.432-4996.458=-0.026
max4996.479-4996.480=-0.001
mean2942.000-3041.800=-99.800
σ398.065-203.884=194.181
min2474.000-2840.000=-366.000
max3472.000-3319.000=153.000
mean8.458-8.806=-0.348
σ0.118-0.247=-0.129
min8.329-8.501=-0.172
max8.641-9.144=-0.503

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.689-0.998=0.690
σ0.056-0.062=-0.006
min1.628-0.920=0.708
max1.755-1.048=0.708

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.924-462.978=-0.053
σ574.246-574.252=-0.007
min175.795-175.838=-0.043
max1324.293-1324.356=-0.063
mean86.250
σ8.500
min82.000
max99.000
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean0.558-0.431=0.127
σ0.566-0.299=0.267
min0.272-0.276=-0.004
max1.408-0.880=0.528
policies=20
mean1758.280-1758.707=-0.427
σ0.321-0.347=-0.026
min1758.054-1758.470=-0.415
max1758.755-1759.220=-0.465
mean820.000
σ0.000
min820.000
max820.000
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean2.715-2.803=-0.088
σ0.025-0.007=0.018
min2.694-2.797=-0.103
max2.747-2.814=-0.067
policies=200
mean17590.156-17593.288=-3.133
σ0.592-0.676=-0.084
min17589.763-17592.420=-2.657
max17591.034-17593.861=-2.827
mean8200.000
σ0.000
min8200.000
max8200.000
mean2425.000-2840.000=-415.000
σ0.000
min2425.000-2840.000=-415.000
max2425.000-2840.000=-415.000
mean27.490-27.931=-0.441
σ0.150-0.374=-0.224
min27.347-27.475=-0.128
max27.673-28.362=-0.689