Compare commits

Home / Compare 7d0b26f9 .. 13f10596

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.061-70.703=2.359
σ0.052-0.048=0.004
min73.036-70.668=2.368
max73.206-70.835=2.372
mean416.600-417.000=-0.400
σ0.843-0.000=0.843
min415.000-417.000=-2.000
max417.000
mean0.159-0.161=-0.001
σ0.006-0.004=0.002
min0.149-0.152=-0.004
max0.169-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean23.755-21.408=2.347
σ0.002-0.002=0.000
min23.750-21.404=2.347
max23.758-21.412=2.346
mean417.000
σ0.000
min417.000
max417.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.059=0.007
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1754.931=0.888
σ0.364-0.363=0.001
min1755.252-1754.359=0.894
max1756.425-1755.514=0.911
mean1662.550-1649.250=13.300
σ646.306-632.320=13.986
min618.000-626.000=-8.000
max2825.000-2774.000=51.000
mean2.751-2.829=-0.078
σ0.219-0.192=0.027
min2.242-2.264=-0.021
max3.089-3.204=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean313.194-272.760=40.434
σ17.568-0.007=17.562
min281.767-272.754=9.013
max321.075-272.768=48.307
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean0.411-0.391=0.020
σ0.026-0.008=0.018
min0.365-0.379=-0.014
max0.424-0.401=0.022
iters=5
new-facts=1
prior-facts=6402
mean1981.613-1933.157=48.456
σ0.015-0.018=-0.004
min1981.589-1933.132=48.457
max1981.625-1933.177=48.448
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean2.616-3.044=-0.428
σ0.070-0.130=-0.060
min2.551-2.931=-0.380
max2.715-3.257=-0.542
iters=5
new-facts=6402
prior-facts=1
mean4805.304-4756.922=48.382
σ7.673-7.639=0.034
min4801.705-4753.442=48.263
max4819.029-4770.588=48.441
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean9.050-8.576=0.473
σ0.707-0.399=0.308
min8.367-7.928=0.439
max10.153-8.906=1.247
iters=5
new-facts=6402
prior-facts=6402
mean4992.829-4944.396=48.432
σ0.019-0.015=0.005
min4992.811-4944.380=48.431
max4992.857-4944.413=48.444
mean3062.200-2991.600=70.600
σ249.578-208.858=40.720
min2825.000-2774.000=51.000
max3423.000-3291.000=132.000
mean8.730-8.527=0.203
σ0.290-0.096=0.194
min8.436-8.430=0.006
max9.076-8.630=0.446

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.002=0.039
σ0.254-0.132=0.121
min0.917-0.910=0.007
max1.494-1.220=0.274

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.421-468.339=-5.918
σ574.246-574.255=-0.009
min175.290-181.202=-5.913
max1323.791-1329.721=-5.931
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean0.473-0.444=0.029
σ0.389-0.302=0.087
min0.275-0.289=-0.014
max1.057-0.897=0.159
policies=20
mean1753.219-1812.380=-59.160
σ0.370-0.389=-0.019
min1752.985-1812.112=-59.126
max1753.771-1812.951=-59.180
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean2.781-2.891=-0.110
σ0.011-0.008=0.003
min2.767-2.883=-0.117
max2.794-2.903=-0.109
policies=200
mean17537.728-18128.915=-591.187
σ0.489-0.749=-0.260
min17537.150-18128.019=-590.870
max17538.180-18129.841=-591.661
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2825.000-2774.000=51.000
σ0.000
min2825.000-2774.000=51.000
max2825.000-2774.000=51.000
mean27.489-28.488=-0.999
σ0.178-0.227=-0.049
min27.302-28.370=-1.068
max27.731-28.829=-1.097