Compare commits

Home / Compare 6566a06b .. 62ddbdd0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.244=0.374
σ0.054-0.055=-0.001
min35.590-35.219=0.371
max35.770-35.399=0.370
mean414.000
σ0.000
min414.000
max414.000
mean0.083-0.082=0.001
σ0.005-0.006=-0.001
min0.076-0.077=-0.000
max0.092-0.096=-0.004
cache=y
dps=1
iters=10
policies=100
mean24.048-23.769=0.279
σ0.003-0.003=0.000
min24.044-23.764=0.280
max24.054-23.775=0.279
mean414.000
σ0.000
min414.000
max414.000
mean0.069-0.067=0.002
σ0.003-0.002=0.001
min0.067-0.065=0.002
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.362=0.130
σ0.366-0.366=0.000
min1755.919-1755.788=0.131
max1757.078-1756.951=0.126
mean1648.250-1642.850=5.400
σ633.167-632.987=0.180
min622.000-625.000=-3.000
max2830.000-2838.000=-8.000
mean2.326-2.373=-0.047
σ0.103-0.080=0.023
min2.072-2.247=-0.175
max2.497-2.605=-0.108

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.778-324.571=0.208
σ0.033-0.037=-0.004
min324.722-324.509=0.213
max324.807-324.598=0.208
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean0.423-0.431=-0.008
σ0.001-0.006=-0.005
min0.422-0.422=-0.000
max0.425-0.439=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.139=0.184
σ0.015-0.014=0.001
min1985.306-1985.114=0.193
max1985.337-1985.150=0.187
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean2.621-2.638=-0.017
σ0.054-0.089=-0.035
min2.573-2.572=0.001
max2.690-2.741=-0.052
iters=5
new-facts=6402
prior-facts=1
mean4808.808-4808.787=0.021
σ7.790-7.625=0.165
min4804.837-4805.233=-0.396
max4822.735-4822.425=0.309
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean8.712-8.720=-0.007
σ0.264-0.591=-0.328
min8.342-7.748=0.594
max9.044-9.178=-0.134
iters=5
new-facts=6402
prior-facts=6402
mean4996.530-4996.343=0.187
σ0.025-0.016=0.009
min4996.504-4996.324=0.181
max4996.563-4996.361=0.201
mean3034.200-3061.400=-27.200
σ280.479-297.721=-17.242
min2830.000-2838.000=-8.000
max3475.000-3524.000=-49.000
mean8.489-8.518=-0.029
σ0.150-0.145=0.005
min8.370-8.416=-0.046
max8.750-8.772=-0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.944=-0.001
σ0.056-0.056=-0.000
min0.910-0.910=-0.000
max1.041-1.043=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.966=-0.019
σ574.251-574.248=0.002
min175.819-175.838=-0.019
max1324.323-1324.338=-0.015
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean0.426-0.432=-0.006
σ0.294-0.298=-0.004
min0.276-0.279=-0.004
max0.867-0.880=-0.013
policies=20
mean1758.523-1758.701=-0.178
σ0.340-0.339=0.001
min1758.315-1758.483=-0.168
max1759.030-1759.204=-0.174
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean2.791-2.782=0.009
σ0.012-0.008=0.003
min2.781-2.770=0.011
max2.807-2.790=0.017
policies=200
mean17591.973-17593.207=-1.234
σ0.546-0.821=-0.275
min17591.663-17592.139=-0.475
max17592.790-17593.909=-1.119
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2838.000=-8.000
σ0.000
min2830.000-2838.000=-8.000
max2830.000-2838.000=-8.000
mean27.773-27.919=-0.147
σ0.392-0.371=0.021
min27.360-27.595=-0.234
max28.176-28.289=-0.113