Compare commits

Home / Compare 35267f40 .. 2ab5e071

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-73.048=0.000
σ0.046-0.048=-0.002
min73.026-73.026=0.001
max73.177-73.182=-0.006
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.168-0.161=0.007
σ0.014-0.004=0.010
min0.153-0.154=-0.001
max0.184-0.167=0.018
cache=y
dps=1
iters=10
policies=100
mean23.739-23.740=-0.000
σ0.003-0.003=0.000
min23.735-23.737=-0.002
max23.745-23.744=0.001
mean420.500-415.000=5.500
σ0.527-0.000=0.527
min420.000-415.000=5.000
max421.000-415.000=6.000
mean0.066-0.063=0.003
σ0.001-0.003=-0.002
min0.065-0.060=0.005
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.786=0.002
σ0.361-0.361=0.000
min1758.218-1758.222=-0.004
max1759.371-1759.362=0.009
mean1639.400-1629.300=10.100
σ611.098-597.877=13.221
min655.000-633.000=22.000
max2447.000-2424.000=23.000
mean2.804-2.814=-0.010
σ0.190-0.186=0.004
min2.260-2.471=-0.211
max3.194-3.112=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.014-324.018=-0.003
σ0.053-0.040=0.013
min323.920-323.947=-0.027
max324.046-324.043=0.003
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean0.431-0.428=0.003
σ0.009-0.002=0.007
min0.426-0.424=0.001
max0.448-0.430=0.018
iters=5
new-facts=1
prior-facts=6402
mean1984.586-1984.572=0.015
σ0.025-0.016=0.009
min1984.551-1984.557=-0.007
max1984.610-1984.597=0.013
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean2.613-2.682=-0.069
σ0.062-0.137=-0.075
min2.565-2.563=0.001
max2.718-2.881=-0.163
iters=5
new-facts=6402
prior-facts=1
mean4808.243-4808.254=-0.011
σ7.821-7.788=0.033
min4804.699-4804.659=0.040
max4822.234-4822.185=0.049
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean9.007-8.795=0.212
σ0.176-0.324=-0.148
min8.770-8.315=0.454
max9.190-9.139=0.052
iters=5
new-facts=6402
prior-facts=6402
mean4995.807-4995.659=0.148
σ0.028-0.175=-0.147
min4995.776-4995.466=0.310
max4995.832-4995.803=0.029
mean2965.000-2900.000=65.000
σ254.861-396.795=-141.935
min2640.000-2424.000=216.000
max3307.000-3428.000=-121.000
mean8.543-8.595=-0.052
σ0.073-0.232=-0.159
min8.471-8.452=0.019
max8.634-9.008=-0.374

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.763-1.757=0.006
σ0.092-0.127=-0.035
min1.648-1.536=0.111
max1.876-1.839=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.325-468.324=0.001
σ574.225-574.225=-0.000
min181.206-181.207=-0.001
max1329.663-1329.662=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean0.563-0.561=0.002
σ0.555-0.549=0.006
min0.284-0.284=-0.001
max1.396-1.384=0.012
policies=20
mean1812.437-1812.434=0.003
σ0.387-0.386=0.000
min1812.174-1812.180=-0.006
max1813.007-1813.006=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean2.835-2.824=0.011
σ0.031-0.010=0.021
min2.807-2.815=-0.008
max2.880-2.835=0.045
policies=200
mean18131.648-18131.647=0.001
σ0.439-0.465=-0.026
min18131.366-18131.363=0.003
max18132.302-18132.341=-0.038
mean8400.000
σ0.000
min8400.000
max8400.000
mean2447.000-2424.000=23.000
σ0.000
min2447.000-2424.000=23.000
max2447.000-2424.000=23.000
mean28.521-28.371=0.150
σ0.064-0.029=0.035
min28.437-28.338=0.099
max28.590-28.406=0.184