Compare commits

Home / Compare c3a594b5 .. ffc9708e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-70.391=-0.007
σ0.049-0.048=0.001
min70.355-70.361=-0.005
max70.521-70.524=-0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.159-0.160=-0.001
σ0.005-0.003=0.002
min0.153-0.158=-0.005
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.141-21.145=-0.004
σ0.003-0.003=-0.000
min21.137-21.141=-0.004
max21.148-21.150=-0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.062-0.065=-0.003
σ0.004-0.003=0.001
min0.059-0.063=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.393=0.001
σ0.360-0.362=-0.001
min1751.823-1751.827=-0.004
max1752.981-1752.977=0.004
mean1644.850-1652.600=-7.750
σ632.951-627.386=5.565
min619.000-615.000=4.000
max2768.000-2769.000=-1.000
mean2.848-2.798=0.050
σ0.176-0.163=0.013
min2.381-2.356=0.025
max3.124-2.988=0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.140=-0.001
σ0.011-0.006=0.005
min270.128-270.136=-0.008
max270.153-270.150=0.003
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean0.389-0.380=0.009
σ0.010-0.002=0.007
min0.379-0.378=0.001
max0.399-0.382=0.017
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.606=-0.011
σ0.020-0.004=0.016
min1930.570-1930.602=-0.032
max1930.616-1930.611=0.005
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean2.565-2.532=0.033
σ0.142-0.088=0.054
min2.458-2.453=0.005
max2.813-2.680=0.133
iters=5
new-facts=6402
prior-facts=1
mean4751.311-4751.300=0.010
σ0.920-0.915=0.005
min4750.767-4750.820=-0.053
max4752.947-4752.929=0.019
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean8.565-8.489=0.076
σ0.555-0.588=-0.033
min7.676-7.717=-0.041
max9.080-9.017=0.064
iters=5
new-facts=6402
prior-facts=6402
mean4941.765-4941.702=0.063
σ0.024-0.143=-0.119
min4941.735-4941.446=0.289
max4941.788-4941.779=0.009
mean2987.800-3016.400=-28.600
σ257.200-231.103=26.096
min2768.000-2769.000=-1.000
max3366.000-3320.000=46.000
mean8.503-8.581=-0.078
σ0.151-0.204=-0.053
min8.323-8.408=-0.085
max8.675-8.918=-0.243

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.030=0.033
σ0.132-0.134=-0.003
min0.944-0.941=0.003
max1.265-1.251=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.373-466.369=0.004
σ575.936-575.919=0.017
min178.401-178.399=0.002
max1330.277-1330.248=0.029
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean0.447-0.446=0.001
σ0.305-0.308=-0.003
min0.289-0.289=-0.000
max0.904-0.908=-0.004
policies=20
mean1784.331-1784.306=0.025
σ0.334-0.333=0.001
min1784.101-1784.059=0.042
max1784.816-1784.787=0.030
mean800.000
σ0.000
min800.000
max800.000
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean2.856-2.839=0.017
σ0.127-0.093=0.034
min2.781-2.782=-0.001
max3.046-2.976=0.069
policies=200
mean17849.784-17849.641=0.142
σ0.582-0.532=0.049
min17849.351-17849.271=0.081
max17850.642-17850.412=0.230
mean8000.000
σ0.000
min8000.000
max8000.000
mean2768.000-2769.000=-1.000
σ0.000
min2768.000-2769.000=-1.000
max2768.000-2769.000=-1.000
mean28.095-28.032=0.064
σ0.372-0.101=0.270
min27.866-27.931=-0.065
max28.650-28.149=0.501