Compare commits

Home / Compare 28db8171 .. 0d2c41ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.002
σ0.056-0.054=0.002
min35.235-35.234=0.001
max35.422-35.415=0.007
mean412.000-415.800=-3.800
σ0.000-0.422=-0.422
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.085-0.085=0.000
σ0.003-0.004=-0.000
min0.083-0.080=0.002
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.004-0.004=-0.000
min23.761-23.764=-0.003
max23.775-23.780=-0.005
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.066-0.066=0.000
σ0.004-0.004=-0.000
min0.061-0.062=-0.000
max0.073-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.469-1756.472=-0.002
σ0.364-0.365=-0.002
min1755.896-1755.896=-0.000
max1757.052-1757.055=-0.003
mean1657.300-1653.400=3.900
σ642.020-644.139=-2.120
min628.000-627.000=1.000
max2777.000-2843.000=-66.000
mean2.351-2.336=0.015
σ0.120-0.083=0.037
min2.231-2.245=-0.014
max2.799-2.555=0.244

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.668-324.694=-0.026
σ0.045-0.053=-0.008
min324.589-324.601=-0.012
max324.698-324.724=-0.026
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean0.431-0.427=0.004
σ0.009-0.008=0.001
min0.424-0.422=0.002
max0.446-0.441=0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.250-1985.251=-0.001
σ0.013-0.019=-0.007
min1985.229-1985.229=-0.000
max1985.262-1985.271=-0.009
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean2.629-2.631=-0.002
σ0.095-0.158=-0.063
min2.544-2.538=0.006
max2.749-2.912=-0.162
iters=5
new-facts=6402
prior-facts=1
mean4808.872-4808.776=0.096
σ7.692-7.765=-0.074
min4805.384-4804.748=0.636
max4822.631-4822.654=-0.023
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean9.144-8.781=0.363
σ0.191-0.568=-0.377
min8.913-7.933=0.980
max9.345-9.299=0.046
iters=5
new-facts=6402
prior-facts=6402
mean4996.385-4996.384=0.001
σ0.167-0.160=0.007
min4996.089-4996.101=-0.012
max4996.487-4996.477=0.010
mean3036.200-3070.800=-34.600
σ262.833-309.451=-46.618
min2777.000-2843.000=-66.000
max3405.000-3551.000=-146.000
mean8.802-8.557=0.244
σ0.335-0.129=0.207
min8.485-8.441=0.044
max9.241-8.717=0.525

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-0.977=-0.025
σ0.060-0.067=-0.007
min0.916-0.917=-0.001
max1.057-1.051=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.950-462.955=-0.005
σ574.254-574.253=0.001
min175.811-175.817=-0.006
max1324.331-1324.335=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean0.466-0.468=-0.002
σ0.368-0.376=-0.009
min0.273-0.277=-0.004
max1.017-1.033=-0.015
policies=20
mean1758.494-1758.484=0.010
σ0.365-0.350=0.015
min1758.251-1758.252=-0.001
max1759.036-1759.004=0.032
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean2.791-2.773=0.017
σ0.008-0.010=-0.002
min2.785-2.766=0.018
max2.803-2.788=0.015
policies=200
mean17590.243-17591.025=-0.782
σ0.454-0.655=-0.202
min17589.939-17590.187=-0.247
max17590.917-17591.674=-0.757
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2843.000=-66.000
σ0.000
min2777.000-2843.000=-66.000
max2777.000-2843.000=-66.000
mean27.502-27.868=-0.367
σ0.112-0.323=-0.211
min27.364-27.488=-0.124
max27.617-28.176=-0.558