Compare commits

Home / Compare 69a945a3 .. adf8e50a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.694-70.697=-0.003
σ0.042-0.048=-0.006
min70.673-70.673=0.000
max70.812-70.833=-0.021
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.156-0.160=-0.004
σ0.006-0.004=0.002
min0.151-0.157=-0.007
max0.168-0.170=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.424-21.422=0.002
σ0.009-0.012=-0.002
min21.417-21.416=0.001
max21.450-21.455=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.062=0.002
σ0.003-0.003=-0.000
min0.060-0.058=0.002
max0.073-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.456=0.002
σ0.362-0.360=0.002
min1753.888-1753.886=0.001
max1755.057-1755.023=0.034
mean1671.900-1644.100=27.800
σ628.543-628.658=-0.115
min680.000-626.000=54.000
max2666.000-2863.000=-197.000
mean2.780-2.826=-0.046
σ0.224-0.163=0.061
min2.258-2.346=-0.088
max3.082-3.154=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.499-273.503=-0.004
σ0.006-0.007=-0.001
min273.491-273.495=-0.004
max273.506-273.514=-0.008
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean0.375-0.375=0.000
σ0.004-0.005=-0.001
min0.372-0.371=0.001
max0.382-0.383=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.902-1933.892=0.010
σ0.016-0.011=0.005
min1933.886-1933.878=0.009
max1933.927-1933.909=0.018
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean2.980-2.950=0.030
σ0.148-0.118=0.029
min2.813-2.760=0.053
max3.136-3.085=0.051
iters=5
new-facts=6402
prior-facts=1
mean4754.671-4754.556=0.115
σ0.822-0.872=-0.050
min4754.136-4753.860=0.276
max4756.129-4756.074=0.055
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean8.446-8.327=0.119
σ0.536-0.516=0.019
min7.618-7.615=0.003
max9.111-9.018=0.094
iters=5
new-facts=6402
prior-facts=6402
mean4945.052-4945.046=0.006
σ0.150-0.164=-0.014
min4944.784-4944.754=0.031
max4945.142-4945.145=-0.003
mean3050.600-3026.600=24.000
σ304.327-184.653=119.674
min2666.000-2863.000=-197.000
max3340.000-3313.000=27.000
mean8.701-8.437=0.264
σ0.235-0.104=0.131
min8.402-8.331=0.071
max9.032-8.572=0.460

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.019=0.073
σ0.232-0.142=0.091
min0.925-0.928=-0.003
max1.425-1.254=0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.060-473.076=-0.016
σ575.917-575.909=0.008
min185.090-185.115=-0.025
max1336.936-1336.939=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean0.564-0.449=0.115
σ0.530-0.299=0.232
min0.295-0.298=-0.003
max1.359-0.897=0.462
policies=20
mean1851.243-1851.433=-0.191
σ0.372-0.368=0.004
min1850.985-1851.164=-0.179
max1851.790-1851.969=-0.179
mean840.000
σ0.000
min840.000
max840.000
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean2.879-2.940=-0.061
σ0.027-0.006=0.022
min2.854-2.935=-0.081
max2.904-2.946=-0.042
policies=200
mean18519.344-18519.943=-0.599
σ0.434-0.768=-0.334
min18519.055-18519.265=-0.209
max18519.984-18520.901=-0.917
mean8400.000
σ0.000
min8400.000
max8400.000
mean2666.000-2863.000=-197.000
σ0.000
min2666.000-2863.000=-197.000
max2666.000-2863.000=-197.000
mean28.886-29.063=-0.177
σ0.112-0.454=-0.342
min28.752-28.732=0.020
max29.019-29.697=-0.678