Compare commits

Home / Compare 34445ca4 .. 72737a3d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=0.000
σ0.054-0.053=0.001
min35.594-35.591=0.004
max35.770-35.768=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.082=0.002
σ0.003-0.004=-0.002
min0.082-0.076=0.006
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.003=-0.001
min24.045-24.044=0.001
max24.050-24.054=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.067-0.068=-0.002
σ0.001-0.003=-0.002
min0.065-0.067=-0.001
max0.068-0.075=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.487=0.002
σ0.363-0.365=-0.002
min1755.915-1755.912=0.004
max1757.075-1757.072=0.003
mean1653.050-1654.050=-1.000
σ641.782-643.499=-1.718
min620.000-628.000=-8.000
max2843.000-2841.000=2.000
mean2.342-2.347=-0.004
σ0.094-0.079=0.015
min2.256-2.265=-0.009
max2.609-2.534=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.744-324.765=-0.021
σ0.051-0.045=0.006
min324.654-324.684=-0.030
max324.784-324.792=-0.008
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean0.430-0.416=0.013
σ0.008-0.001=0.007
min0.421-0.415=0.006
max0.441-0.418=0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.310-1985.317=-0.007
σ0.015-0.016=-0.002
min1985.295-1985.287=0.007
max1985.327-1985.326=0.002
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean2.755-2.742=0.013
σ0.116-0.142=-0.025
min2.652-2.599=0.053
max2.940-2.949=-0.009
iters=5
new-facts=6402
prior-facts=1
mean4808.967-4809.105=-0.138
σ7.476-7.648=-0.171
min4805.579-4805.580=-0.001
max4822.341-4822.784=-0.443
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean8.912-8.824=0.088
σ0.219-0.314=-0.095
min8.673-8.477=0.196
max9.263-9.194=0.069
iters=5
new-facts=6402
prior-facts=6402
mean4996.562-4996.631=-0.069
σ0.150-0.020=0.130
min4996.296-4996.610=-0.314
max4996.652-4996.660=-0.008
mean3051.000-3078.800=-27.800
σ227.512-255.919=-28.408
min2843.000-2841.000=2.000
max3292.000-3348.000=-56.000
mean8.686-8.720=-0.034
σ0.213-0.125=0.088
min8.416-8.527=-0.111
max9.010-8.827=0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-0.953=0.031
σ0.133-0.056=0.077
min0.919-0.918=0.001
max1.222-1.052=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.204=0.007
σ574.774-574.773=0.001
min175.816-175.811=0.005
max1325.372-1325.364=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean0.421-0.431=-0.010
σ0.284-0.299=-0.015
min0.276-0.279=-0.003
max0.847-0.880=-0.033
policies=20
mean1758.504-1758.496=0.009
σ0.361-0.344=0.017
min1758.266-1758.262=0.004
max1759.041-1759.004=0.037
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean2.785-2.795=-0.010
σ0.012-0.016=-0.003
min2.774-2.778=-0.004
max2.800-2.815=-0.016
policies=200
mean17592.102-17592.058=0.045
σ0.421-0.512=-0.091
min17591.802-17591.715=0.087
max17592.712-17592.819=-0.107
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2841.000=2.000
σ0.000
min2843.000-2841.000=2.000
max2843.000-2841.000=2.000
mean27.921-27.780=0.141
σ0.342-0.353=-0.011
min27.548-27.358=0.190
max28.304-28.164=0.140