Compare commits

Home / Compare 122d6594 .. 2c6126b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-70.707=2.341
σ0.046-0.045=0.001
min73.022-70.677=2.345
max73.178-70.834=2.344
mean412.100-414.000=-1.900
σ0.316-0.000=0.316
min412.000-414.000=-2.000
max413.000-414.000=-1.000
mean0.168-0.161=0.007
σ0.011-0.003=0.008
min0.153-0.158=-0.005
max0.183-0.167=0.016
cache=y
dps=1
iters=10
policies=100
mean23.740-21.412=2.328
σ0.003-0.003=0.000
min23.735-21.407=2.327
max23.745-21.416=2.329
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.061-0.064=-0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1754.931=3.858
σ0.363-0.360=0.003
min1758.214-1754.355=3.859
max1759.388-1755.514=3.874
mean1646.250-1661.800=-15.550
σ629.224-621.237=7.987
min616.000-624.000=-8.000
max2770.000-2513.000=257.000
mean2.827-2.815=0.013
σ0.163-0.128=0.035
min2.372-2.485=-0.113
max3.088-2.940=0.148

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.986-272.788=51.197
σ0.045-0.009=0.037
min323.905-272.784=51.121
max324.013-272.804=51.209
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean0.429-0.382=0.047
σ0.006-0.009=-0.003
min0.425-0.377=0.048
max0.439-0.398=0.041
iters=5
new-facts=1
prior-facts=6402
mean1984.585-1933.218=51.368
σ0.018-0.018=0.000
min1984.553-1933.193=51.360
max1984.600-1933.238=51.362
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean2.583-3.071=-0.488
σ0.076-0.090=-0.014
min2.471-3.008=-0.536
max2.653-3.229=-0.576
iters=5
new-facts=6402
prior-facts=1
mean4808.238-4756.886=51.352
σ7.778-7.296=0.482
min4804.739-4753.589=51.151
max4822.152-4769.937=52.215
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean9.006-8.278=0.728
σ0.086-0.373=-0.287
min8.918-7.737=1.182
max9.137-8.612=0.525
iters=5
new-facts=6402
prior-facts=6402
mean4995.809-4944.449=51.359
σ0.019-0.021=-0.002
min4995.788-4944.422=51.366
max4995.835-4944.473=51.362
mean2988.800-2920.800=68.000
σ214.749-366.784=-152.035
min2770.000-2513.000=257.000
max3305.000-3429.000=-124.000
mean8.670-8.408=0.262
σ0.166-0.102=0.064
min8.495-8.253=0.242
max8.910-8.535=0.376

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.534=-0.503
σ0.133-0.187=-0.054
min0.913-1.227=-0.314
max1.240-1.731=-0.491

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.354-468.305=0.049
σ574.229-574.232=-0.004
min181.231-181.186=0.045
max1329.697-1329.653=0.044
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean0.444-0.564=-0.120
σ0.304-0.561=-0.258
min0.289-0.281=0.008
max0.899-1.406=-0.507
policies=20
mean1812.634-1812.159=0.476
σ0.400-0.375=0.026
min1812.360-1811.919=0.441
max1813.224-1812.716=0.508
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean2.888-2.800=0.088
σ0.025-0.017=0.008
min2.866-2.778=0.088
max2.923-2.821=0.103
policies=200
mean18131.541-18128.972=2.569
σ0.344-0.502=-0.158
min18131.317-18128.694=2.623
max18132.046-18129.725=2.321
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2513.000=257.000
σ0.000
min2770.000-2513.000=257.000
max2770.000-2513.000=257.000
mean28.386-28.312=0.074
σ0.128-0.054=0.074
min28.247-28.243=0.005
max28.530-28.370=0.159