Compare commits

Home / Compare 868765ec .. c661d773

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.691-70.564=0.128
σ0.048-0.046=0.003
min70.658-70.540=0.119
max70.826-70.691=0.135
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.161-0.161=-0.001
σ0.004-0.003=0.001
min0.158-0.157=0.001
max0.168-0.166=0.003
cache=y
dps=1
iters=10
policies=100
mean21.420-21.288=0.132
σ0.003-0.002=0.001
min21.416-21.284=0.132
max21.425-21.292=0.133
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.064-0.064=0.000
σ0.004-0.004=0.000
min0.058-0.058=-0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1753.568=0.890
σ0.360-0.364=-0.004
min1753.881-1753.001=0.879
max1755.039-1754.150=0.889
mean1670.850-1645.600=25.250
σ628.866-623.103=5.763
min664.000-698.000=-34.000
max2620.000-2842.000=-222.000
mean2.800-2.865=-0.065
σ0.126-0.115=0.011
min2.412-2.660=-0.248
max2.927-3.199=-0.272

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.501-272.019=1.482
σ0.005-0.008=-0.003
min273.493-272.010=1.482
max273.506-272.030=1.476
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean0.378-0.390=-0.011
σ0.004-0.008=-0.004
min0.376-0.380=-0.004
max0.386-0.397=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.892-1932.437=1.454
σ0.005-0.007=-0.002
min1933.883-1932.426=1.457
max1933.896-1932.447=1.450
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean3.035-3.033=0.002
σ0.137-0.077=0.061
min2.820-2.935=-0.115
max3.158-3.125=0.033
iters=5
new-facts=6402
prior-facts=1
mean4613.988-4753.057=-139.068
σ314.468-0.951=313.517
min4051.453-4752.152=-700.699
max4756.134-4754.672=1.462
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean8.081-8.502=-0.422
σ0.725-0.516=0.209
min7.000-7.644=-0.645
max8.942-8.947=-0.006
iters=5
new-facts=6402
prior-facts=6402
mean4945.056-4943.558=1.497
σ0.173-0.148=0.025
min4944.747-4943.294=1.454
max4945.160-4943.645=1.515
mean3014.000-3062.000=-48.000
σ378.325-214.564=163.761
min2620.000-2842.000=-222.000
max3543.000-3332.000=211.000
mean8.815-8.577=0.238
σ0.366-0.124=0.243
min8.538-8.481=0.057
max9.448-8.785=0.663

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.286-1.014=0.271
σ0.358-0.127=0.231
min0.927-0.926=0.002
max1.739-1.215=0.524

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.567-473.084=-0.517
σ574.933-575.915=-0.983
min185.096-185.120=-0.024
max1334.966-1336.957=-1.991
mean88.250
σ8.500
min84.000
max101.000
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean0.558-0.489=0.069
σ0.534-0.375=0.160
min0.289-0.300=-0.011
max1.359-1.051=0.308
policies=20
mean1851.234-1851.475=-0.241
σ0.368-0.395=-0.027
min1850.985-1851.173=-0.188
max1851.780-1852.043=-0.263
mean840.000
σ0.000
min840.000
max840.000
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean2.859-2.963=-0.104
σ0.021-0.005=0.016
min2.836-2.956=-0.120
max2.877-2.966=-0.089
policies=200
mean18519.214-18521.159=-1.945
σ0.574-0.422=0.152
min18518.830-18520.791=-1.961
max18520.056-18521.764=-1.707
mean8400.000
σ0.000
min8400.000
max8400.000
mean2620.000-2842.000=-222.000
σ0.000
min2620.000-2842.000=-222.000
max2620.000-2842.000=-222.000
mean28.955-29.159=-0.204
σ0.032-0.590=-0.558
min28.925-28.783=0.142
max28.998-30.038=-1.040