Compare commits

Home / Compare b22bb10a .. a68a7af3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.055-0.054=0.002
min35.587-35.586=0.001
max35.773-35.769=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.084-0.080=0.004
σ0.005-0.004=0.001
min0.078-0.076=0.001
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.003-0.004=-0.001
min24.043-24.038=0.005
max24.051-24.051=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.066=-0.001
σ0.003-0.004=-0.001
min0.061-0.061=0.001
max0.069-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.002
σ0.365-0.365=-0.000
min1755.915-1755.916=-0.002
max1757.081-1757.079=0.002
mean1655.850-1647.050=8.800
σ641.870-639.374=2.497
min623.000-625.000=-2.000
max2848.000-2822.000=26.000
mean2.354-2.328=0.026
σ0.068-0.075=-0.007
min2.266-2.221=0.045
max2.507-2.549=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.766=-0.004
σ0.056-0.053=0.002
min324.663-324.671=-0.008
max324.793-324.794=-0.000
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean0.429-0.431=-0.002
σ0.009-0.010=-0.000
min0.424-0.423=0.001
max0.445-0.442=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.317=-0.001
σ0.015-0.022=-0.007
min1985.298-1985.297=0.002
max1985.332-1985.343=-0.011
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean2.658-2.636=0.022
σ0.105-0.134=-0.029
min2.567-2.518=0.050
max2.778-2.812=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4809.000-4809.120=-0.120
σ7.774-7.705=0.069
min4805.014-4805.573=-0.559
max4822.897-4822.903=-0.006
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean8.795-8.833=-0.038
σ0.409-0.473=-0.065
min8.075-7.993=0.082
max9.056-9.127=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean4996.489-4996.626=-0.137
σ0.192-0.024=0.168
min4996.256-4996.593=-0.337
max4996.647-4996.653=-0.006
mean3067.000-3054.400=12.600
σ291.781-303.324=-11.543
min2848.000-2822.000=26.000
max3517.000-3520.000=-3.000
mean8.543-8.512=0.031
σ0.132-0.122=0.010
min8.465-8.410=0.055
max8.777-8.723=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-0.978=0.031
σ0.118-0.068=0.051
min0.928-0.921=0.008
max1.194-1.058=0.137

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.210=-0.001
σ574.767-574.773=-0.006
min175.816-175.814=0.002
max1325.360-1325.369=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean0.435-0.434=0.002
σ0.301-0.301=-0.000
min0.283-0.280=0.004
max0.887-0.886=0.001
policies=20
mean1758.501-1758.505=-0.004
σ0.352-0.353=-0.002
min1758.253-1758.269=-0.016
max1759.020-1759.030=-0.010
mean820.000
σ0.000
min820.000
max820.000
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean2.791-2.780=0.012
σ0.004-0.006=-0.002
min2.786-2.771=0.015
max2.795-2.783=0.012
policies=200
mean17592.131-17592.135=-0.005
σ0.512-0.487=0.026
min17591.834-17591.828=0.006
max17592.897-17592.861=0.036
mean8200.000
σ0.000
min8200.000
max8200.000
mean2848.000-2822.000=26.000
σ0.000
min2848.000-2822.000=26.000
max2848.000-2822.000=26.000
mean28.030-27.803=0.227
σ0.376-0.378=-0.003
min27.662-27.465=0.197
max28.494-28.224=0.270