Compare commits

Home / Compare e4c89c91 .. 1427d704

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=0.000
σ0.056-0.054=0.002
min35.233-35.237=-0.003
max35.422-35.416=0.006
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.083-0.083=0.000
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.002-0.004=-0.001
min23.765-23.762=0.003
max23.773-23.776=-0.004
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.067-0.065=0.002
σ0.005-0.006=-0.001
min0.062-0.061=0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.486=-0.000
σ0.364-0.365=-0.001
min1755.910-1755.913=-0.002
max1757.069-1757.079=-0.010
mean1651.250-1651.000=0.250
σ643.280-640.332=2.948
min625.000-629.000=-4.000
max2838.000-2832.000=6.000
mean2.341-2.325=0.016
σ0.084-0.078=0.006
min2.266-2.187=0.079
max2.539-2.474=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.703=0.002
σ0.055-0.052=0.003
min324.609-324.612=-0.003
max324.739-324.740=-0.002
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean0.429-0.427=0.002
σ0.009-0.002=0.007
min0.421-0.424=-0.003
max0.444-0.430=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.259-1985.257=0.001
σ0.018-0.007=0.012
min1985.241-1985.248=-0.007
max1985.279-1985.263=0.015
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean2.698-2.691=0.007
σ0.255-0.156=0.099
min2.530-2.581=-0.051
max3.142-2.942=0.200
iters=5
new-facts=6402
prior-facts=1
mean4808.675-4808.882=-0.207
σ7.844-7.659=0.184
min4804.228-4805.416=-1.189
max4822.671-4822.583=0.088
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean8.747-8.941=-0.194
σ0.522-0.219=0.303
min7.844-8.616=-0.772
max9.197-9.178=0.019
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.394=0.075
σ0.017-0.149=-0.132
min4996.449-4996.130=0.319
max4996.488-4996.481=0.007
mean3037.200-3066.600=-29.400
σ278.309-305.565=-27.256
min2838.000-2832.000=6.000
max3477.000-3538.000=-61.000
mean8.521-8.543=-0.021
σ0.104-0.160=-0.056
min8.449-8.426=0.024
max8.702-8.821=-0.119

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-0.949=0.108
σ0.112-0.055=0.057
min0.916-0.914=0.001
max1.229-1.044=0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.974-462.966=0.008
σ574.254-574.252=0.002
min175.837-175.837=0.000
max1324.354-1324.343=0.011
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean0.432-0.429=0.003
σ0.298-0.297=0.001
min0.280-0.278=0.001
max0.879-0.874=0.005
policies=20
mean1758.714-1758.711=0.003
σ0.353-0.337=0.016
min1758.476-1758.488=-0.012
max1759.238-1759.211=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean2.786-2.799=-0.014
σ0.011-0.008=0.003
min2.770-2.789=-0.019
max2.794-2.807=-0.013
policies=200
mean17593.405-17593.360=0.046
σ0.594-0.726=-0.132
min17592.743-17592.368=0.375
max17593.963-17593.915=0.048
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2832.000=6.000
σ0.000
min2838.000-2832.000=6.000
max2838.000-2832.000=6.000
mean27.889-27.970=-0.081
σ0.304-0.319=-0.015
min27.547-27.645=-0.098
max28.228-28.321=-0.093