Compare commits

Home / Compare 494f6eed .. 4a278297

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.265=-0.003
σ0.054-0.053=0.001
min35.233-35.239=-0.005
max35.415-35.415=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.001
min0.076-0.083=-0.007
max0.092-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=-0.000
min23.762-23.765=-0.002
max23.774-23.773=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.066-0.066=0.000
σ0.004-0.004=-0.001
min0.061-0.062=-0.001
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.487=-0.002
σ0.366-0.365=0.001
min1755.907-1755.913=-0.006
max1757.077-1757.079=-0.002
mean1650.750-1648.300=2.450
σ640.169-639.683=0.486
min627.000-625.000=2.000
max2832.000-2825.000=7.000
mean2.330-2.336=-0.006
σ0.074-0.093=-0.019
min2.247-2.140=0.107
max2.515-2.557=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.705=0.003
σ0.048-0.053=-0.005
min324.623-324.611=0.012
max324.731-324.737=-0.006
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean0.427-0.427=-0.000
σ0.009-0.007=0.002
min0.421-0.423=-0.002
max0.442-0.439=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.260-1985.260=-0.000
σ0.014-0.018=-0.003
min1985.243-1985.230=0.013
max1985.272-1985.272=-0.000
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean2.665-2.597=0.068
σ0.110-0.048=0.062
min2.553-2.557=-0.003
max2.805-2.665=0.140
iters=5
new-facts=6402
prior-facts=1
mean4808.786-4808.669=0.118
σ7.693-7.783=-0.091
min4804.791-4804.323=0.468
max4822.535-4822.562=-0.027
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean8.654-8.646=0.007
σ0.556-0.373=0.183
min7.738-8.015=-0.278
max9.167-8.945=0.222
iters=5
new-facts=6402
prior-facts=6402
mean4996.462-4996.340=0.122
σ0.016-0.314=-0.298
min4996.438-4995.780=0.659
max4996.476-4996.522=-0.045
mean3071.000-3057.200=13.800
σ310.052-225.927=84.124
min2832.000-2825.000=7.000
max3545.000-3392.000=153.000
mean8.542-8.780=-0.238
σ0.166-0.187=-0.021
min8.313-8.515=-0.202
max8.716-8.956=-0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-0.951=0.102
σ0.146-0.056=0.090
min0.928-0.917=0.011
max1.293-1.049=0.244

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.959-462.956=0.002
σ574.254-574.255=-0.001
min175.819-175.822=-0.003
max1324.339-1324.339=0.000
mean86.250
σ8.500
min82.000
max99.000
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean0.437-0.434=0.003
σ0.305-0.303=0.002
min0.283-0.279=0.003
max0.895-0.889=0.006
policies=20
mean1758.525-1758.569=-0.044
σ0.345-0.354=-0.010
min1758.302-1758.335=-0.033
max1759.037-1759.096=-0.059
mean820.000
σ0.000
min820.000
max820.000
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean2.782-2.784=-0.002
σ0.007-0.018=-0.010
min2.772-2.772=-0.000
max2.789-2.809=-0.021
policies=200
mean17592.478-17592.438=0.040
σ0.554-0.437=0.117
min17592.188-17591.974=0.214
max17593.309-17593.029=0.279
mean8200.000
σ0.000
min8200.000
max8200.000
mean2832.000-2825.000=7.000
σ0.000
min2832.000-2825.000=7.000
max2832.000-2825.000=7.000
mean27.846-27.888=-0.043
σ0.340-0.343=-0.004
min27.538-27.533=0.005
max28.213-28.186=0.027