Compare commits

Home / Compare 7ec99591 .. 81bce137

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.054=-0.001
min35.238-35.233=0.005
max35.412-35.415=-0.003
mean418.000-414.800=3.200
σ0.000-0.422=-0.422
min418.000-414.000=4.000
max418.000-415.000=3.000
mean0.085-0.085=0.001
σ0.004-0.004=0.000
min0.082-0.082=-0.000
max0.092-0.093=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.002=0.001
min23.765-23.767=-0.002
max23.774-23.774=-0.000
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.069-0.069=-0.000
σ0.004-0.004=-0.000
min0.066-0.066=0.000
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.485=0.002
σ0.365-0.364=0.001
min1755.910-1755.910=-0.001
max1757.078-1757.071=0.007
mean1656.250-1652.350=3.900
σ642.871-639.953=2.917
min630.000-627.000=3.000
max2839.000-2829.000=10.000
mean2.327-2.380=-0.053
σ0.064-0.145=-0.082
min2.231-2.252=-0.020
max2.435-2.904=-0.470

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.718=-0.013
σ0.056-0.030=0.026
min324.606-324.666=-0.060
max324.738-324.742=-0.004
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean0.424-0.424=-0.000
σ0.002-0.003=-0.001
min0.421-0.422=-0.001
max0.426-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.258-1985.253=0.005
σ0.020-0.016=0.003
min1985.231-1985.231=-0.000
max1985.277-1985.271=0.006
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean2.625-2.641=-0.016
σ0.091-0.119=-0.028
min2.534-2.555=-0.021
max2.765-2.830=-0.064
iters=5
new-facts=6402
prior-facts=1
mean4808.864-4808.858=0.007
σ7.642-7.671=-0.029
min4805.371-4805.385=-0.014
max4822.534-4822.580=-0.046
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean8.695-8.828=-0.134
σ0.188-0.122=0.066
min8.494-8.650=-0.156
max8.894-8.988=-0.094
iters=5
new-facts=6402
prior-facts=6402
mean4996.458-4996.459=-0.001
σ0.019-0.025=-0.005
min4996.429-4996.421=0.008
max4996.481-4996.482=-0.001
mean3070.200-3063.400=6.800
σ303.047-306.458=-3.411
min2839.000-2829.000=10.000
max3535.000-3537.000=-2.000
mean8.536-8.495=0.040
σ0.124-0.126=-0.002
min8.427-8.334=0.093
max8.672-8.682=-0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.003=-0.007
σ0.062-0.137=-0.075
min0.911-0.913=-0.002
max1.045-1.227=-0.182

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.977=-0.004
σ574.254-574.251=0.004
min175.835-175.841=-0.006
max1324.354-1324.353=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean0.433-0.431=0.002
σ0.301-0.297=0.004
min0.279-0.281=-0.002
max0.885-0.877=0.008
policies=20
mean1758.691-1758.718=-0.027
σ0.352-0.348=0.004
min1758.440-1758.481=-0.041
max1759.208-1759.232=-0.024
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean2.813-2.789=0.024
σ0.027-0.014=0.012
min2.790-2.776=0.013
max2.849-2.809=0.040
policies=200
mean17593.290-17593.218=0.072
σ0.518-0.708=-0.190
min17592.554-17592.186=0.368
max17593.673-17593.692=-0.019
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2829.000=10.000
σ0.000
min2839.000-2829.000=10.000
max2839.000-2829.000=10.000
mean27.872-27.846=0.026
σ0.350-0.396=-0.046
min27.523-27.499=0.024
max28.230-28.281=-0.050