Compare commits

Home / Compare 08b9a495 .. f522fdb2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.572=-0.005
σ0.045-0.044=0.001
min70.544-70.531=0.013
max70.694-70.691=0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.154-0.159=-0.005
σ0.004-0.003=0.001
min0.147-0.155=-0.008
max0.162-0.165=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.294-21.290=0.003
σ0.010-0.003=0.007
min21.286-21.284=0.002
max21.322-21.296=0.026
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.062-0.065=-0.003
σ0.004-0.003=0.001
min0.059-0.063=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.171-1753.172=-0.001
σ0.361-0.361=0.000
min1752.603-1752.609=-0.006
max1753.758-1753.744=0.014
mean1672.950-1654.100=18.850
σ621.460-640.517=-19.057
min688.000-631.000=57.000
max2717.000-2839.000=-122.000
mean2.845-2.849=-0.004
σ0.099-0.134=-0.035
min2.644-2.666=-0.022
max3.096-3.237=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.614-271.614=0.000
σ0.008-0.007=0.001
min271.604-271.602=0.002
max271.626-271.620=0.006
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean0.374-0.374=0.000
σ0.007-0.007=-0.000
min0.369-0.369=-0.000
max0.386-0.387=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.048-1932.047=0.002
σ0.012-0.012=-0.001
min1932.038-1932.033=0.005
max1932.068-1932.064=0.003
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean2.937-2.963=-0.025
σ0.254-0.272=-0.017
min2.500-2.506=-0.006
max3.127-3.208=-0.081
iters=5
new-facts=6402
prior-facts=1
mean4752.835-4752.742=0.093
σ0.809-0.913=-0.104
min4752.407-4751.853=0.553
max4754.278-4754.290=-0.013
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean8.016-7.888=0.128
σ0.378-0.299=0.079
min7.683-7.612=0.071
max8.443-8.379=0.064
iters=5
new-facts=6402
prior-facts=6402
mean4943.227-4943.184=0.043
σ0.024-0.149=-0.125
min4943.201-4942.919=0.282
max4943.263-4943.265=-0.002
mean3026.800-3053.400=-26.600
σ359.442-263.995=95.447
min2717.000-2839.000=-122.000
max3554.000-3444.000=110.000
mean8.346-8.521=-0.174
σ0.167-0.195=-0.029
min8.151-8.390=-0.238
max8.562-8.862=-0.300

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.116=-0.098
σ0.139-0.096=0.043
min0.920-1.072=-0.152
max1.242-1.287=-0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.290-472.296=-0.005
σ575.926-575.921=0.005
min184.317-184.325=-0.008
max1336.179-1336.177=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean0.558-0.452=0.106
σ0.544-0.308=0.236
min0.282-0.296=-0.014
max1.374-0.914=0.460
policies=20
mean1843.528-1843.569=-0.041
σ0.388-0.382=0.006
min1843.259-1843.289=-0.030
max1844.102-1844.125=-0.023
mean840.000
σ0.000
min840.000
max840.000
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean2.858-2.956=-0.098
σ0.033-0.013=0.020
min2.810-2.945=-0.135
max2.884-2.976=-0.092
policies=200
mean18442.058-18441.989=0.069
σ0.485-0.401=0.084
min18441.762-18441.663=0.099
max18442.782-18442.512=0.270
mean8400.000
σ0.000
min8400.000
max8400.000
mean2717.000-2839.000=-122.000
σ0.000
min2717.000-2839.000=-122.000
max2717.000-2839.000=-122.000
mean28.907-29.210=-0.303
σ0.064-0.666=-0.602
min28.821-28.797=0.025
max28.973-30.204=-1.232