Compare commits

Home / Compare b0f577e5 .. ad5e5cd6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.126-73.125=0.001
σ0.056-0.053=0.003
min73.093-73.095=-0.002
max73.284-73.275=0.010
mean415.000-415.400=-0.400
σ0.000-0.516=-0.516
min415.000
max415.000-416.000=-1.000
mean0.163-0.161=0.002
σ0.004-0.003=0.001
min0.156-0.158=-0.002
max0.170-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean23.755-23.754=0.001
σ0.004-0.003=0.001
min23.750-23.749=0.001
max23.763-23.760=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.066=-0.000
σ0.003-0.004=-0.002
min0.061-0.061=0.000
max0.068-0.074=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.821-1755.823=-0.002
σ0.361-0.361=0.000
min1755.248-1755.249=-0.001
max1756.409-1756.398=0.012
mean1657.300-1652.250=5.050
σ634.603-632.511=2.092
min632.000-628.000=4.000
max2784.000-2850.000=-66.000
mean2.766-2.825=-0.059
σ0.206-0.231=-0.025
min2.257-2.348=-0.091
max3.071-3.447=-0.376

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.055-321.064=-0.009
σ0.042-0.012=0.031
min320.981-321.045=-0.064
max321.083-321.077=0.007
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean0.424-0.420=0.005
σ0.012-0.001=0.011
min0.418-0.418=0.000
max0.446-0.421=0.025
iters=5
new-facts=1
prior-facts=6402
mean1981.631-1981.628=0.004
σ0.008-0.008=-0.001
min1981.622-1981.615=0.008
max1981.640-1981.635=0.005
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean2.626-2.599=0.027
σ0.154-0.071=0.083
min2.442-2.531=-0.089
max2.838-2.698=0.140
iters=5
new-facts=6402
prior-facts=1
mean4805.172-4805.237=-0.066
σ7.782-7.708=0.074
min4801.230-4801.726=-0.496
max4819.083-4819.025=0.058
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean8.474-8.703=-0.229
σ0.409-0.214=0.195
min7.781-8.402=-0.621
max8.781-8.882=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean4992.832-4992.832=0.000
σ0.026-0.020=0.006
min4992.800-4992.813=-0.013
max4992.865-4992.862=0.003
mean3050.600-3066.400=-15.800
σ239.738-225.820=13.918
min2784.000-2850.000=-66.000
max3387.000-3300.000=87.000
mean8.621-8.703=-0.082
σ0.196-0.259=-0.063
min8.422-8.441=-0.019
max8.871-9.094=-0.224

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.005=-0.003
σ0.139-0.131=0.008
min0.911-0.918=-0.007
max1.232-1.219=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.425-462.420=0.005
σ574.244-574.246=-0.002
min175.291-175.289=0.002
max1323.790-1323.789=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean0.430-0.426=0.003
σ0.299-0.296=0.003
min0.277-0.276=0.000
max0.878-0.871=0.007
policies=20
mean1753.256-1753.226=0.030
σ0.368-0.376=-0.009
min1753.019-1752.990=0.029
max1753.804-1753.787=0.016
mean820.000
σ0.000
min820.000
max820.000
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean2.773-2.780=-0.007
σ0.004-0.011=-0.007
min2.768-2.764=0.004
max2.777-2.789=-0.011
policies=200
mean17537.833-17538.887=-1.054
σ0.577-0.515=0.062
min17537.390-17538.284=-0.894
max17538.645-17539.362=-0.717
mean8200.000
σ0.000
min8200.000
max8200.000
mean2784.000-2850.000=-66.000
σ0.000
min2784.000-2850.000=-66.000
max2784.000-2850.000=-66.000
mean27.370-27.844=-0.474
σ0.130-0.446=-0.316
min27.196-27.371=-0.175
max27.511-28.382=-0.871