Compare commits

Home / Compare d80a57f7 .. 8fa7b72f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.054-0.054=0.000
min35.237-35.232=0.004
max35.417-35.415=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.085-0.083=0.003
σ0.005-0.005=-0.001
min0.079-0.077=0.003
max0.094-0.090=0.004
cache=y
dps=1
iters=10
policies=100
mean23.771-23.769=0.002
σ0.003-0.003=-0.001
min23.768-23.763=0.005
max23.775-23.775=0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.068-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.365-0.366=-0.001
min1755.910-1755.909=0.002
max1757.069-1757.074=-0.005
mean1652.500-1627.050=25.450
σ643.501-591.784=51.718
min626.000-660.000=-34.000
max2838.000-2422.000=416.000
mean2.326-2.347=-0.022
σ0.075-0.088=-0.012
min2.242-2.201=0.041
max2.481-2.524=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.709=-0.003
σ0.056-0.040=0.016
min324.607-324.638=-0.031
max324.744-324.731=0.013
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean0.424-0.426=-0.002
σ0.001-0.003=-0.002
min0.423-0.422=0.000
max0.425-0.431=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1985.263-1985.271=-0.008
σ0.007-0.008=-0.001
min1985.255-1985.259=-0.004
max1985.271-1985.277=-0.006
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean2.685-2.621=0.064
σ0.101-0.178=-0.077
min2.562-2.461=0.101
max2.780-2.927=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.750=-0.002
σ7.410-7.396=0.013
min4805.384-4805.337=0.047
max4822.002-4821.980=0.022
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean8.858-8.984=-0.126
σ0.183-0.227=-0.044
min8.655-8.705=-0.049
max9.100-9.253=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean4996.477-4996.392=0.084
σ0.021-0.157=-0.135
min4996.451-4996.114=0.337
max4996.500-4996.478=0.023
mean3037.000-2939.800=97.200
σ210.812-450.548=-239.736
min2838.000-2422.000=416.000
max3257.000-3541.000=-284.000
mean8.653-8.506=0.147
σ0.113-0.129=-0.016
min8.511-8.427=0.084
max8.811-8.731=0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.969-1.792=-0.823
σ0.062-0.123=-0.061
min0.915-1.635=-0.720
max1.040-1.979=-0.938

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.973-462.944=0.029
σ574.251-574.248=0.004
min175.839-175.817=0.022
max1324.349-1324.315=0.034
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean0.430-0.566=-0.136
σ0.299-0.590=-0.291
min0.279-0.270=0.009
max0.878-1.451=-0.573
policies=20
mean1758.694-1758.514=0.180
σ0.349-0.335=0.014
min1758.454-1758.294=0.160
max1759.210-1759.013=0.198
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean2.792-2.713=0.079
σ0.007-0.021=-0.014
min2.783-2.687=0.096
max2.799-2.734=0.064
policies=200
mean17593.370-17592.513=0.857
σ0.632-0.508=0.125
min17592.509-17592.233=0.276
max17593.932-17593.274=0.658
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2422.000=416.000
σ0.000
min2838.000-2422.000=416.000
max2838.000-2422.000=416.000
mean27.843-27.499=0.344
σ0.318-0.114=0.204
min27.514-27.341=0.173
max28.188-27.614=0.574