Compare commits

Home / Compare 1347627b .. b9c1206f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.054-0.054=0.000
min35.237-35.233=0.004
max35.415-35.415=0.000
mean417.000-414.800=2.200
σ0.000-0.422=-0.422
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.081-0.085=-0.003
σ0.005-0.004=0.001
min0.076-0.082=-0.006
max0.089-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.002=0.000
min23.765-23.767=-0.002
max23.774-23.774=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.069-0.069=-0.000
σ0.003-0.004=-0.001
min0.067-0.066=0.001
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.365-0.364=0.001
min1755.912-1755.910=0.002
max1757.077-1757.071=0.006
mean1651.000-1652.350=-1.350
σ640.585-639.953=0.632
min628.000-627.000=1.000
max2840.000-2829.000=11.000
mean2.329-2.380=-0.051
σ0.059-0.145=-0.086
min2.256-2.252=0.004
max2.433-2.904=-0.472

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.718=-0.012
σ0.048-0.030=0.018
min324.621-324.666=-0.044
max324.740-324.742=-0.003
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean0.426-0.424=0.001
σ0.006-0.003=0.003
min0.422-0.422=0.000
max0.436-0.429=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.253=0.016
σ0.007-0.016=-0.009
min1985.259-1985.231=0.028
max1985.277-1985.271=0.007
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean2.596-2.641=-0.046
σ0.058-0.119=-0.061
min2.543-2.555=-0.012
max2.669-2.830=-0.160
iters=5
new-facts=6402
prior-facts=1
mean4808.911-4808.858=0.053
σ7.708-7.671=0.037
min4805.357-4805.385=-0.028
max4822.698-4822.580=0.118
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean8.833-8.828=0.004
σ0.627-0.122=0.504
min7.771-8.650=-0.879
max9.353-8.988=0.364
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.459=0.004
σ0.021-0.025=-0.003
min4996.440-4996.421=0.019
max4996.482-4996.482=-0.000
mean3054.600-3063.400=-8.800
σ201.676-306.458=-104.782
min2840.000-2829.000=11.000
max3350.000-3537.000=-187.000
mean8.706-8.495=0.211
σ0.237-0.126=0.111
min8.475-8.334=0.141
max9.071-8.682=0.388

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.003=0.004
σ0.136-0.137=-0.001
min0.916-0.913=0.003
max1.228-1.227=0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.977=-0.008
σ574.253-574.251=0.002
min175.836-175.841=-0.005
max1324.348-1324.353=-0.005
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean0.472-0.431=0.041
σ0.382-0.297=0.084
min0.279-0.281=-0.001
max1.045-0.877=0.168
policies=20
mean1758.707-1758.718=-0.011
σ0.343-0.348=-0.005
min1758.480-1758.481=-0.001
max1759.216-1759.232=-0.017
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean2.790-2.789=0.001
σ0.015-0.014=0.001
min2.779-2.776=0.003
max2.812-2.809=0.003
policies=200
mean17593.384-17593.218=0.166
σ0.705-0.708=-0.003
min17592.409-17592.186=0.223
max17593.926-17593.692=0.234
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2829.000=11.000
σ0.000
min2840.000-2829.000=11.000
max2840.000-2829.000=11.000
mean27.903-27.846=0.057
σ0.365-0.396=-0.031
min27.543-27.499=0.044
max28.348-28.281=0.067