Compare commits

Home / Compare aa79f24e .. 14f31e11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.030-56.290=-1.260
σ0.052-0.053=-0.001
min54.992-56.253=-1.261
max55.171-56.436=-1.264
mean414.000
σ0.000
min414.000
max414.000
mean0.140-0.141=-0.001
σ0.004-0.004=-0.000
min0.135-0.137=-0.002
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean44.362-44.805=-0.442
σ0.003-0.005=-0.002
min44.357-44.797=-0.441
max44.368-44.815=-0.446
mean414.000
σ0.000
min414.000
max414.000
mean0.121-0.122=-0.001
σ0.003-0.005=-0.002
min0.119-0.118=0.001
max0.127-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1767.107-1766.169=0.938
σ0.366-0.367=-0.001
min1766.532-1765.590=0.942
max1767.704-1766.759=0.945
mean1646.050-1650.550=-4.500
σ622.197-622.851=-0.654
min647.000-633.000=14.000
max2504.000-2506.000=-2.000
mean2.339-2.324=0.016
σ0.088-0.080=0.008
min2.247-2.155=0.093
max2.663-2.461=0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean350.631-348.778=1.853
σ0.068-0.062=0.006
min350.512-348.667=1.845
max350.678-348.810=1.868
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean0.456-0.457=-0.001
σ0.006-0.009=-0.003
min0.452-0.452=0.000
max0.466-0.474=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2012.702-2009.248=3.454
σ0.024-0.004=0.021
min2012.662-2009.244=3.419
max2012.722-2009.253=3.469
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean2.754-2.935=-0.181
σ0.087-0.095=-0.009
min2.677-2.819=-0.142
max2.893-3.063=-0.170
iters=5
new-facts=6402
prior-facts=1
mean4837.590-4833.011=4.578
σ7.775-7.725=0.050
min4833.748-4829.435=4.313
max4851.493-4846.830=4.663
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean8.221-8.513=-0.293
σ0.421-0.514=-0.093
min7.881-7.815=0.066
max8.955-9.152=-0.197
iters=5
new-facts=6402
prior-facts=6402
mean5025.193-5020.352=4.841
σ0.025-0.315=-0.289
min5025.157-5019.874=5.283
max5025.218-5020.592=4.626
mean2963.400-3000.600=-37.200
σ420.862-393.170=27.692
min2504.000-2506.000=-2.000
max3539.000-3518.000=21.000
mean9.299-8.872=0.428
σ0.588-0.317=0.271
min8.658-8.614=0.043
max9.862-9.229=0.634

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.461-1.599=-0.138
σ0.161-0.211=-0.049
min1.226-1.234=-0.008
max1.673-1.774=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.015-467.536=1.480
σ574.771-574.248=0.523
min181.627-180.405=1.222
max1331.172-1328.908=2.264
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean0.545-0.554=-0.008
σ0.524-0.546=-0.022
min0.282-0.279=0.003
max1.331-1.373=-0.042
policies=20
mean1816.597-1804.344=12.252
σ0.395-0.396=-0.001
min1816.318-1804.112=12.205
max1817.181-1804.935=12.246
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean2.814-2.777=0.037
σ0.018-0.011=0.007
min2.803-2.766=0.037
max2.841-2.789=0.052
policies=200
mean18173.159-18050.631=122.529
σ0.518-0.475=0.043
min18172.822-18050.249=122.573
max18173.919-18051.324=122.595
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean2504.000-2506.000=-2.000
σ0.000
min2504.000-2506.000=-2.000
max2504.000-2506.000=-2.000
mean28.121-28.088=0.033
σ0.205-0.152=0.053
min27.962-27.934=0.028
max28.421-28.266=0.156