Compare commits

Home / Compare 0781bfb9 .. 0066a668

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.707=2.339
σ0.048-0.045=0.002
min73.022-70.677=2.345
max73.181-70.834=2.347
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.162-0.161=0.000
σ0.004-0.003=0.001
min0.158-0.158=-0.001
max0.168-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-21.412=2.328
σ0.003-0.003=0.001
min23.736-21.407=2.328
max23.744-21.416=2.328
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.066-0.065=0.001
σ0.002-0.002=-0.000
min0.065-0.064=0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1754.931=3.857
σ0.361-0.360=0.001
min1758.211-1754.355=3.856
max1759.376-1755.514=3.862
mean1655.600-1661.800=-6.200
σ627.734-621.237=6.497
min620.000-624.000=-4.000
max2515.000-2513.000=2.000
mean2.775-2.815=-0.040
σ0.169-0.128=0.041
min2.327-2.485=-0.158
max2.973-2.940=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-272.788=51.224
σ0.052-0.009=0.043
min323.920-272.784=51.136
max324.039-272.804=51.235
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean0.429-0.382=0.047
σ0.005-0.009=-0.004
min0.425-0.377=0.048
max0.437-0.398=0.039
iters=5
new-facts=1
prior-facts=6402
mean1984.591-1933.218=51.373
σ0.017-0.018=-0.001
min1984.572-1933.193=51.379
max1984.610-1933.238=51.372
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean2.662-3.071=-0.409
σ0.096-0.090=0.006
min2.570-3.008=-0.438
max2.812-3.229=-0.417
iters=5
new-facts=6402
prior-facts=1
mean4808.234-4756.886=51.348
σ7.771-7.296=0.476
min4804.670-4753.589=51.081
max4822.135-4769.937=52.198
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean8.854-8.278=0.576
σ0.182-0.373=-0.190
min8.641-7.737=0.904
max9.092-8.612=0.480
iters=5
new-facts=6402
prior-facts=6402
mean4995.806-4944.449=51.356
σ0.020-0.021=-0.001
min4995.786-4944.422=51.364
max4995.827-4944.473=51.354
mean2973.400-2920.800=52.600
σ407.210-366.784=40.426
min2515.000-2513.000=2.000
max3488.000-3429.000=59.000
mean8.629-8.408=0.221
σ0.195-0.102=0.092
min8.467-8.253=0.215
max8.924-8.535=0.389

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.595-1.534=0.061
σ0.271-0.187=0.085
min1.232-1.227=0.005
max1.876-1.731=0.145

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.305=0.023
σ574.230-574.232=-0.002
min181.207-181.186=0.021
max1329.674-1329.653=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean0.547-0.564=-0.016
σ0.526-0.561=-0.035
min0.282-0.281=0.001
max1.336-1.406=-0.070
policies=20
mean1812.428-1812.159=0.269
σ0.394-0.375=0.019
min1812.172-1811.919=0.253
max1813.012-1812.716=0.296
mean840.000
σ0.000
min840.000
max840.000
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean2.798-2.800=-0.002
σ0.021-0.017=0.003
min2.771-2.778=-0.007
max2.821-2.821=-0.000
policies=200
mean18131.639-18128.972=2.667
σ0.453-0.502=-0.049
min18131.348-18128.694=2.654
max18132.316-18129.725=2.591
mean8400.000
σ0.000
min8400.000
max8400.000
mean2515.000-2513.000=2.000
σ0.000
min2515.000-2513.000=2.000
max2515.000-2513.000=2.000
mean28.239-28.312=-0.073
σ0.100-0.054=0.046
min28.172-28.243=-0.070
max28.387-28.370=0.017