Compare commits

Home / Compare 0e63803c .. 9272d6b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.245=0.019
σ0.053-0.054=-0.000
min35.237-35.217=0.020
max35.415-35.396=0.019
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.086-0.086=-0.000
σ0.004-0.005=-0.000
min0.082-0.082=0.000
max0.094-0.096=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.002
σ0.002-0.002=-0.000
min23.766-23.764=0.002
max23.774-23.772=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.068=0.001
σ0.003-0.003=0.000
min0.065-0.064=0.001
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.483=0.000
σ0.364-0.365=-0.001
min1755.914-1755.910=0.003
max1757.071-1757.077=-0.006
mean1647.500-1659.600=-12.100
σ642.368-646.857=-4.489
min669.000-628.000=41.000
max2728.000-2811.000=-83.000
mean2.406-2.360=0.046
σ0.147-0.105=0.042
min2.233-2.255=-0.022
max2.792-2.713=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.695-324.709=-0.014
σ0.050-0.039=0.011
min324.609-324.639=-0.030
max324.732-324.732=-0.001
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean0.427-0.422=0.005
σ0.006-0.001=0.005
min0.423-0.421=0.002
max0.437-0.423=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.247-1985.271=-0.025
σ0.019-0.007=0.012
min1985.221-1985.264=-0.043
max1985.266-1985.282=-0.016
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean2.661-2.615=0.046
σ0.147-0.074=0.073
min2.560-2.552=0.008
max2.898-2.702=0.196
iters=5
new-facts=6402
prior-facts=1
mean4808.868-4808.890=-0.022
σ7.636-7.653=-0.017
min4805.365-4805.356=0.009
max4822.528-4822.579=-0.052
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean8.648-8.705=-0.058
σ0.206-0.572=-0.365
min8.430-7.712=0.718
max8.870-9.098=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4996.467=-0.000
σ0.015-0.016=-0.001
min4996.449-4996.450=-0.001
max4996.482-4996.485=-0.003
mean3030.800-3015.800=15.000
σ355.549-207.944=147.605
min2728.000-2811.000=-83.000
max3556.000-3301.000=255.000
mean8.633-8.667=-0.034
σ0.209-0.104=0.105
min8.459-8.541=-0.082
max8.951-8.810=0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.949=0.083
σ0.129-0.054=0.074
min0.914-0.916=-0.002
max1.229-1.042=0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.966=-0.000
σ574.280-574.249=0.031
min175.818-175.838=-0.020
max1324.386-1324.339=0.047
mean86.250
σ8.500
min82.000
max99.000
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean0.556-0.424=0.132
σ0.567-0.291=0.276
min0.271-0.275=-0.004
max1.407-0.861=0.546
policies=20
mean1758.534-1758.716=-0.183
σ0.336-0.345=-0.009
min1758.311-1758.495=-0.185
max1759.031-1759.229=-0.198
mean820.000
σ0.000
min820.000
max820.000
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean2.712-2.784=-0.072
σ0.016-0.005=0.011
min2.692-2.779=-0.087
max2.731-2.789=-0.058
policies=200
mean17592.470-17592.527=-0.057
σ0.409-0.443=-0.034
min17592.198-17592.170=0.028
max17593.075-17593.135=-0.060
mean8200.000
σ0.000
min8200.000
max8200.000
mean2728.000-2811.000=-83.000
σ0.000
min2728.000-2811.000=-83.000
max2728.000-2811.000=-83.000
mean27.539-27.502=0.037
σ0.348-0.206=0.142
min27.262-27.261=0.002
max28.023-27.764=0.259