Compare commits

Home / Compare 8292a883 .. cde2d815

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.001
σ0.055-0.054=0.002
min35.587-35.590=-0.003
max35.774-35.770=0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.084-0.083=0.000
σ0.006-0.005=0.001
min0.077-0.076=0.001
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.003=-0.001
min24.044-24.044=0.000
max24.051-24.054=-0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.069-0.069=-0.000
σ0.003-0.003=0.000
min0.067-0.067=-0.001
max0.076-0.076=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.492=-0.003
σ0.365-0.366=-0.001
min1755.915-1755.919=-0.004
max1757.083-1757.078=0.006
mean1661.400-1648.250=13.150
σ643.030-633.167=9.863
min625.000-622.000=3.000
max2782.000-2830.000=-48.000
mean2.367-2.326=0.041
σ0.126-0.103=0.023
min2.251-2.072=0.178
max2.798-2.497=0.301

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.778=-0.016
σ0.062-0.033=0.029
min324.654-324.722=-0.068
max324.803-324.807=-0.004
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean0.436-0.423=0.013
σ0.010-0.001=0.009
min0.430-0.422=0.008
max0.455-0.425=0.030
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.323=0.002
σ0.011-0.015=-0.004
min1985.306-1985.306=-0.000
max1985.332-1985.337=-0.005
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean2.637-2.621=0.016
σ0.083-0.054=0.029
min2.577-2.573=0.004
max2.764-2.690=0.075
iters=5
new-facts=6402
prior-facts=1
mean4809.095-4808.808=0.287
σ7.676-7.790=-0.115
min4805.642-4804.837=0.805
max4822.826-4822.735=0.091
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean8.900-8.712=0.187
σ0.162-0.264=-0.101
min8.626-8.342=0.285
max9.012-9.044=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean4996.617-4996.530=0.088
σ0.037-0.025=0.013
min4996.557-4996.504=0.052
max4996.658-4996.563=0.096
mean3047.200-3034.200=13.000
σ328.860-280.479=48.380
min2782.000-2830.000=-48.000
max3546.000-3475.000=71.000
mean8.505-8.489=0.016
σ0.101-0.150=-0.049
min8.427-8.370=0.057
max8.681-8.750=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.927-0.944=-0.017
σ0.012-0.056=-0.044
min0.919-0.910=0.009
max0.948-1.041=-0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.947=0.261
σ574.767-574.251=0.517
min175.818-175.819=-0.000
max1325.359-1324.323=1.036
mean86.250
σ8.500
min82.000
max99.000
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean0.430-0.426=0.004
σ0.296-0.294=0.003
min0.279-0.276=0.003
max0.875-0.867=0.008
policies=20
mean1758.526-1758.523=0.002
σ0.336-0.340=-0.004
min1758.322-1758.315=0.007
max1759.027-1759.030=-0.003
mean820.000
σ0.000
min820.000
max820.000
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean2.795-2.791=0.004
σ0.010-0.012=-0.002
min2.781-2.781=-0.000
max2.803-2.807=-0.004
policies=200
mean17592.004-17591.973=0.031
σ0.446-0.546=-0.099
min17591.616-17591.663=-0.047
max17592.648-17592.790=-0.142
mean8200.000
σ0.000
min8200.000
max8200.000
mean2782.000-2830.000=-48.000
σ0.000
min2782.000-2830.000=-48.000
max2782.000-2830.000=-48.000
mean27.544-27.773=-0.229
σ0.099-0.392=-0.293
min27.395-27.360=0.035
max27.605-28.176=-0.571