Compare commits

Home / Compare ed233f7f .. eb9e76bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.002
σ0.047-0.046=0.001
min70.750-70.748=0.002
max70.910-70.908=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.156-0.156=0.000
σ0.005-0.005=0.000
min0.150-0.147=0.002
max0.164-0.162=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.002
σ0.003-0.002=0.001
min21.490-21.489=0.001
max21.498-21.496=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.061=0.005
σ0.003-0.004=-0.001
min0.064-0.058=0.005
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.002
σ0.360-0.362=-0.002
min1753.528-1753.530=-0.003
max1754.665-1754.675=-0.010
mean1661.450-1649.000=12.450
σ635.957-637.943=-1.986
min619.000-644.000=-25.000
max2782.000-2849.000=-67.000
mean2.752-2.824=-0.073
σ0.180-0.185=-0.005
min2.307-2.267=0.040
max3.069-3.148=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.954=-0.002
σ0.004-0.003=0.001
min271.945-271.950=-0.005
max271.955-271.957=-0.002
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean0.380-0.379=0.001
σ0.002-0.001=0.001
min0.378-0.377=0.001
max0.384-0.381=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.325-1932.328=-0.003
σ0.010-0.008=0.002
min1932.310-1932.319=-0.009
max1932.336-1932.337=-0.001
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean3.056-3.106=-0.050
σ0.436-0.134=0.302
min2.462-2.986=-0.525
max3.669-3.270=0.399
iters=5
new-facts=6402
prior-facts=1
mean4753.116-4753.005=0.111
σ0.893-1.007=-0.114
min4752.579-4752.021=0.558
max4754.694-4754.695=-0.002
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean8.380-8.229=0.152
σ0.598-0.724=-0.126
min7.591-7.510=0.080
max8.959-9.082=-0.123
iters=5
new-facts=6402
prior-facts=6402
mean4943.555-4943.492=0.063
σ0.014-0.153=-0.139
min4943.542-4943.219=0.323
max4943.575-4943.576=-0.001
mean3025.200-3048.400=-23.200
σ218.304-264.140=-45.836
min2782.000-2849.000=-67.000
max3290.000-3446.000=-156.000
mean8.577-8.516=0.061
σ0.132-0.209=-0.077
min8.415-8.284=0.130
max8.729-8.751=-0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.064=0.052
σ0.244-0.177=0.068
min0.943-0.927=0.016
max1.537-1.360=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.657-468.655=0.001
σ574.881-574.880=0.001
min181.207-181.204=0.003
max1330.978-1330.975=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean0.449-0.449=-0.000
σ0.303-0.303=0.000
min0.295-0.295=-0.000
max0.904-0.904=-0.000
policies=20
mean1812.359-1812.391=-0.032
σ0.306-0.382=-0.076
min1812.131-1812.125=0.006
max1812.800-1812.950=-0.150
mean840.000
σ0.000
min840.000
max840.000
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean2.936-2.928=0.008
σ0.049-0.004=0.045
min2.893-2.922=-0.029
max3.006-2.931=0.075
policies=200
mean18129.175-18129.872=-0.697
σ0.400-0.865=-0.466
min18128.864-18128.731=0.133
max18129.761-18130.727=-0.966
mean8400.000
σ0.000
min8400.000
max8400.000
mean2782.000-2849.000=-67.000
σ0.000
min2782.000-2849.000=-67.000
max2782.000-2849.000=-67.000
mean28.663-29.100=-0.437
σ0.166-0.586=-0.420
min28.507-28.560=-0.053
max28.875-29.685=-0.810