Compare commits

Home / Compare 4d3e0220 .. 8ded92d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.391=0.175
σ0.045-0.046=-0.001
min70.541-70.368=0.173
max70.692-70.522=0.170
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.158-0.158=0.001
σ0.005-0.005=-0.001
min0.151-0.150=0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.144=0.142
σ0.002-0.003=-0.000
min21.283-21.140=0.143
max21.289-21.148=0.141
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.062=0.000
σ0.003-0.003=0.000
min0.059-0.058=0.001
max0.070-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1752.698=0.676
σ0.361-0.360=0.000
min1752.800-1752.125=0.675
max1753.959-1753.282=0.677
mean1661.200-1658.650=2.550
σ638.128-631.548=6.580
min618.000-622.000=-4.000
max2812.000-2777.000=35.000
mean2.817-2.820=-0.003
σ0.082-0.096=-0.014
min2.575-2.585=-0.010
max2.950-2.975=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-270.605=1.152
σ0.007-0.003=0.004
min271.749-270.601=1.148
max271.768-270.608=1.159
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean0.388-0.381=0.007
σ0.009-0.004=0.005
min0.379-0.377=0.001
max0.399-0.387=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1931.051=1.128
σ0.010-0.007=0.003
min1932.165-1931.045=1.119
max1932.194-1931.063=1.131
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean2.953-2.934=0.019
σ0.109-0.176=-0.067
min2.789-2.642=0.147
max3.084-3.102=-0.018
iters=5
new-facts=6402
prior-facts=1
mean4752.941-4751.792=1.149
σ0.915-0.856=0.059
min4752.350-4751.313=1.037
max4754.552-4753.315=1.237
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean8.481-8.441=0.040
σ0.620-0.376=0.244
min7.730-7.906=-0.176
max9.227-8.911=0.317
iters=5
new-facts=6402
prior-facts=6402
mean4943.296-4942.166=1.130
σ0.156-0.152=0.004
min4943.019-4941.895=1.124
max4943.390-4942.255=1.135
mean3043.000-3058.400=-15.400
σ282.166-263.824=18.341
min2812.000-2777.000=35.000
max3467.000-3431.000=36.000
mean8.540-8.679=-0.139
σ0.159-0.238=-0.079
min8.402-8.420=-0.018
max8.760-9.032=-0.272

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.053=0.003
σ0.126-0.183=-0.057
min0.940-0.938=0.001
max1.250-1.364=-0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.205=0.658
σ575.942-575.946=-0.004
min179.887-179.227=0.660
max1331.775-1331.123=0.652
mean86.250
σ8.500
min82.000
max99.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean0.470-0.482=-0.011
σ0.367-0.392=-0.025
min0.284-0.283=0.001
max1.021-1.069=-0.048
policies=20
mean1799.167-1792.607=6.561
σ0.356-0.355=0.001
min1798.920-1792.397=6.523
max1799.696-1793.137=6.559
mean820.000
σ0.000
min820.000
max820.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean2.801-2.794=0.007
σ0.019-0.008=0.011
min2.785-2.785=-0.000
max2.826-2.803=0.024
policies=200
mean17998.513-17932.957=65.556
σ0.510-0.449=0.061
min17998.212-17932.660=65.552
max17999.276-17933.623=65.653
mean8200.000
σ0.000
min8200.000
max8200.000
mean2812.000-2777.000=35.000
σ0.000
min2812.000-2777.000=35.000
max2812.000-2777.000=35.000
mean28.268-28.175=0.094
σ0.147-0.162=-0.015
min28.166-28.043=0.123
max28.485-28.406=0.079