Compare commits

Home / Compare 60f01021 .. 5cb4447f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.050-0.050=0.000
min33.947-33.946=0.000
max34.119-34.118=0.001
mean416.000-416.600=-0.600
σ0.000-0.516=-0.516
min416.000
max416.000-417.000=-1.000
mean0.084-0.081=0.003
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=0.000
min23.314-23.313=0.001
max23.324-23.321=0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.065-0.064=0.000
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.492=0.002
σ0.365-0.364=0.001
min1756.921-1756.919=0.002
max1758.080-1758.080=-0.000
mean1647.200-1664.750=-17.550
σ634.933-625.149=9.784
min654.000-673.000=-19.000
max2832.000-2607.000=225.000
mean2.377-2.398=-0.021
σ0.110-0.110=0.001
min2.281-2.290=-0.009
max2.671-2.761=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.635-326.629=0.005
σ0.054-0.060=-0.006
min326.539-326.523=0.016
max326.668-326.661=0.007
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean0.423-0.427=-0.004
σ0.001-0.004=-0.003
min0.422-0.425=-0.003
max0.424-0.434=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.796=0.008
σ0.008-0.016=-0.007
min1988.792-1988.778=0.014
max1988.814-1988.812=0.002
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean2.703-2.722=-0.019
σ0.105-0.103=0.003
min2.578-2.617=-0.039
max2.831-2.885=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4813.663-4813.551=0.111
σ7.776-7.768=0.008
min4810.133-4809.547=0.587
max4827.572-4827.434=0.138
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean8.991-8.685=0.306
σ0.405-0.583=-0.178
min8.602-7.711=0.891
max9.591-9.221=0.370
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-5001.201=0.010
σ0.039-0.027=0.012
min5001.177-5001.171=0.006
max5001.274-5001.230=0.044
mean3054.000-2949.600=104.400
σ216.849-257.357=-40.508
min2832.000-2607.000=225.000
max3328.000-3290.000=38.000
mean9.915-9.762=0.152
σ0.203-0.285=-0.083
min9.641-9.353=0.289
max10.195-10.046=0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-1.214=-0.291
σ0.008-0.400=-0.392
min0.915-0.920=-0.005
max0.935-1.763=-0.828

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.629=0.001
σ574.767-574.780=-0.013
min177.244-177.235=0.009
max1326.780-1326.799=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean0.437-0.554=-0.118
σ0.307-0.562=-0.255
min0.279-0.271=0.007
max0.897-1.398=-0.501
policies=20
mean1772.723-1772.645=0.079
σ0.360-0.357=0.002
min1772.496-1772.412=0.083
max1773.259-1773.176=0.083
mean840.000
σ0.000
min840.000
max840.000
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean2.794-2.732=0.063
σ0.008-0.008=0.000
min2.788-2.724=0.064
max2.807-2.741=0.066
policies=200
mean17734.030-17733.866=0.163
σ0.398-0.552=-0.154
min17733.667-17733.414=0.253
max17734.598-17734.672=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2832.000-2607.000=225.000
σ0.000
min2832.000-2607.000=225.000
max2832.000-2607.000=225.000
mean27.776-27.486=0.290
σ0.392-0.140=0.252
min27.387-27.353=0.033
max28.181-27.652=0.529