Compare commits

Home / Compare 14019ec2 .. 693e3754

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.566=0.130
σ0.047-0.045=0.001
min70.667-70.536=0.132
max70.827-70.692=0.136
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.159-0.161=-0.001
σ0.005-0.004=0.001
min0.151-0.156=-0.005
max0.169-0.169=0.000
cache=y
dps=1
iters=10
policies=100
mean21.420-21.287=0.133
σ0.002-0.003=-0.001
min21.418-21.282=0.136
max21.424-21.293=0.131
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.065-0.063=0.002
σ0.003-0.005=-0.002
min0.060-0.059=0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.460-1753.656=0.804
σ0.362-0.360=0.002
min1753.893-1753.085=0.807
max1755.044-1754.238=0.805
mean1643.550-1646.450=-2.900
σ629.272-636.923=-7.651
min644.000-645.000=-1.000
max2852.000-2853.000=-1.000
mean2.827-2.808=0.019
σ0.213-0.181=0.032
min2.280-2.281=-0.001
max3.175-3.041=0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-272.098=1.405
σ0.006-0.005=0.001
min273.496-272.093=1.403
max273.509-272.106=1.404
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean0.378-0.393=-0.015
σ0.005-0.010=-0.006
min0.373-0.382=-0.009
max0.384-0.405=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1933.900-1932.519=1.381
σ0.013-0.006=0.007
min1933.882-1932.513=1.370
max1933.913-1932.529=1.384
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean2.995-2.972=0.024
σ0.172-0.147=0.025
min2.718-2.732=-0.015
max3.189-3.107=0.082
iters=5
new-facts=6402
prior-facts=1
mean4754.581-4753.296=1.285
σ0.914-0.833=0.081
min4753.924-4752.740=1.184
max4756.186-4754.770=1.416
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean8.272-8.159=0.114
σ0.618-0.673=-0.055
min7.801-7.663=0.139
max9.186-9.197=-0.011
iters=5
new-facts=6402
prior-facts=6402
mean4945.109-4943.711=1.398
σ0.015-0.007=0.008
min4945.094-4943.701=1.393
max4945.131-4943.718=1.412
mean3034.000-3082.200=-48.200
σ258.140-302.294=-44.154
min2852.000-2853.000=-1.000
max3443.000-3547.000=-104.000
mean8.436-8.510=-0.073
σ0.115-0.226=-0.111
min8.338-8.303=0.035
max8.622-8.860=-0.238

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.065=-0.042
σ0.140-0.223=-0.083
min0.932-0.931=0.001
max1.250-1.450=-0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.065-472.292=0.773
σ575.910-575.922=-0.012
min185.106-184.322=0.785
max1336.930-1336.175=0.754
mean88.250
σ8.500
min84.000
max101.000
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean0.486-0.446=0.040
σ0.374-0.301=0.073
min0.293-0.293=-0.000
max1.048-0.898=0.150
policies=20
mean1851.306-1843.552=7.754
σ0.384-0.379=0.005
min1851.008-1843.263=7.745
max1851.859-1844.102=7.756
mean840.000
σ0.000
min840.000
max840.000
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean2.986-2.942=0.044
σ0.016-0.002=0.014
min2.970-2.940=0.030
max3.008-2.944=0.064
policies=200
mean18519.387-18442.211=77.176
σ0.588-0.502=0.087
min18518.949-18441.946=77.003
max18520.255-18442.963=77.292
mean8400.000
σ0.000
min8400.000
max8400.000
mean2852.000-2853.000=-1.000
σ0.000
min2852.000-2853.000=-1.000
max2852.000-2853.000=-1.000
mean29.213-29.168=0.045
σ0.448-0.401=0.047
min28.908-28.862=0.047
max29.877-29.710=0.167