Compare commits

Home / Compare 19c0dd2e .. 56748c5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=0.000
σ0.048-0.046=0.002
min73.022-73.022=0.001
max73.181-73.176=0.005
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.162-0.161=0.001
σ0.004-0.003=0.001
min0.158-0.158=-0.000
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=0.001
σ0.003-0.002=0.001
min23.736-23.736=-0.000
max23.744-23.743=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.066-0.066=-0.000
σ0.002-0.003=-0.001
min0.065-0.064=0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.001
σ0.361-0.362=-0.001
min1758.211-1758.210=0.001
max1759.376-1759.372=0.004
mean1655.600-1654.550=1.050
σ627.734-620.191=7.543
min620.000-624.000=-4.000
max2515.000-2502.000=13.000
mean2.775-2.815=-0.041
σ0.169-0.191=-0.022
min2.327-2.084=0.243
max2.973-3.010=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.022=-0.010
σ0.052-0.032=0.020
min323.920-323.968=-0.048
max324.039-324.048=-0.009
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean0.429-0.430=-0.001
σ0.005-0.007=-0.001
min0.425-0.424=0.001
max0.437-0.439=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.591-1984.587=0.004
σ0.017-0.021=-0.004
min1984.572-1984.551=0.021
max1984.610-1984.605=0.005
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean2.662-2.592=0.070
σ0.096-0.109=-0.014
min2.570-2.446=0.123
max2.812-2.716=0.096
iters=5
new-facts=6402
prior-facts=1
mean4808.234-4807.985=0.249
σ7.771-7.952=-0.180
min4804.670-4804.163=0.506
max4822.135-4822.202=-0.067
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean8.854-8.831=0.023
σ0.182-0.140=0.042
min8.641-8.663=-0.022
max9.092-9.031=0.061
iters=5
new-facts=6402
prior-facts=6402
mean4995.806-4995.805=0.001
σ0.020-0.025=-0.005
min4995.786-4995.773=0.012
max4995.827-4995.834=-0.006
mean2973.400-3012.000=-38.600
σ407.210-303.720=103.490
min2515.000-2600.000=-85.000
max3488.000-3394.000=94.000
mean8.629-8.605=0.025
σ0.195-0.077=0.118
min8.467-8.499=-0.031
max8.924-8.687=0.237

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.595-1.641=-0.046
σ0.271-0.177=0.094
min1.232-1.375=-0.143
max1.876-1.837=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.329=-0.001
σ574.230-574.232=-0.001
min181.207-181.211=-0.004
max1329.674-1329.677=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean0.547-0.559=-0.012
σ0.526-0.547=-0.021
min0.282-0.280=0.002
max1.336-1.380=-0.044
policies=20
mean1812.428-1812.427=0.000
σ0.394-0.385=0.008
min1812.172-1812.178=-0.005
max1813.012-1812.999=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean2.798-2.809=-0.011
σ0.021-0.008=0.013
min2.771-2.798=-0.027
max2.821-2.817=0.003
policies=200
mean18131.639-18131.470=0.169
σ0.453-0.562=-0.109
min18131.348-18131.113=0.235
max18132.316-18132.306=0.009
mean8400.000
σ0.000
min8400.000
max8400.000
mean2515.000-2502.000=13.000
σ0.000
min2515.000-2502.000=13.000
max2515.000-2502.000=13.000
mean28.239-28.269=-0.030
σ0.100-0.071=0.029
min28.172-28.186=-0.013
max28.387-28.355=0.032