Compare commits

Home / Compare ff48549f .. 3f27e6c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.055-0.055=-0.000
min35.586-35.588=-0.001
max35.773-35.773=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.085-0.083=0.002
σ0.003-0.004=-0.001
min0.083-0.077=0.005
max0.092-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.003-0.002=0.001
min24.040-24.043=-0.003
max24.052-24.051=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.067=-0.002
σ0.004-0.005=-0.000
min0.061-0.061=-0.000
max0.073-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=0.000
σ0.365-0.365=-0.001
min1755.916-1755.914=0.003
max1757.081-1757.078=0.003
mean1675.450-1642.400=33.050
σ620.292-623.587=-3.295
min664.000-644.000=20.000
max2652.000-2829.000=-177.000
mean2.348-2.350=-0.002
σ0.117-0.097=0.020
min2.203-2.173=0.030
max2.765-2.591=0.173

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.775-324.763=0.012
σ0.031-0.056=-0.026
min324.721-324.664=0.057
max324.798-324.804=-0.006
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean0.432-0.422=0.009
σ0.010-0.002=0.008
min0.420-0.420=0.000
max0.444-0.426=0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.314-1985.323=-0.009
σ0.020-0.010=0.009
min1985.289-1985.314=-0.025
max1985.335-1985.336=-0.001
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean2.690-2.689=0.001
σ0.243-0.075=0.168
min2.550-2.571=-0.021
max3.121-2.773=0.348
iters=5
new-facts=6402
prior-facts=1
mean4809.087-4808.972=0.115
σ7.652-7.799=-0.147
min4805.610-4805.074=0.536
max4822.776-4822.917=-0.141
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean8.898-8.913=-0.015
σ0.223-0.242=-0.019
min8.531-8.588=-0.057
max9.092-9.208=-0.116
iters=5
new-facts=6402
prior-facts=6402
mean4996.620-4996.631=-0.011
σ0.027-0.020=0.007
min4996.589-4996.609=-0.020
max4996.659-4996.662=-0.003
mean2998.800-3050.200=-51.400
σ385.083-230.840=154.243
min2652.000-2829.000=-177.000
max3543.000-3289.000=254.000
mean8.518-8.609=-0.091
σ0.107-0.076=0.031
min8.449-8.495=-0.046
max8.701-8.687=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-0.981=0.102
σ0.239-0.137=0.102
min0.919-0.914=0.006
max1.460-1.226=0.234

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.215=-0.004
σ574.775-574.774=0.001
min175.818-175.816=0.002
max1325.373-1325.376=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean0.538-0.433=0.105
σ0.530-0.305=0.225
min0.271-0.278=-0.007
max1.332-0.890=0.443
policies=20
mean1758.493-1758.525=-0.032
σ0.324-0.353=-0.029
min1758.272-1758.285=-0.012
max1758.974-1759.048=-0.074
mean820.000
σ0.000
min820.000
max820.000
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean2.694-2.765=-0.072
σ0.018-0.021=-0.003
min2.683-2.734=-0.051
max2.721-2.778=-0.057
policies=200
mean17592.129-17592.176=-0.047
σ0.462-0.443=0.019
min17591.807-17591.886=-0.079
max17592.810-17592.835=-0.025
mean8200.000
σ0.000
min8200.000
max8200.000
mean2652.000-2829.000=-177.000
σ0.000
min2652.000-2829.000=-177.000
max2652.000-2829.000=-177.000
mean27.399-27.768=-0.370
σ0.101-0.397=-0.296
min27.251-27.370=-0.119
max27.481-28.215=-0.734