Compare commits

Home / Compare 694d2c7e .. 4c27ba51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.781=-0.001
σ0.044-0.047=-0.003
min70.750-70.750=-0.000
max70.902-70.912=-0.009
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.157-0.160=-0.003
σ0.005-0.004=0.001
min0.149-0.157=-0.008
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=0.000
min21.488-21.486=0.001
max21.497-21.496=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.062-0.060=0.002
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.001
σ0.363-0.360=0.003
min1753.528-1753.528=-0.000
max1754.676-1754.678=-0.001
mean1670.250-1658.050=12.200
σ638.892-632.502=6.391
min672.000-624.000=48.000
max2734.000-2759.000=-25.000
mean2.822-2.865=-0.043
σ0.177-0.110=0.068
min2.264-2.628=-0.364
max3.032-3.124=-0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.599=0.357
σ0.007-0.004=0.003
min271.947-271.593=0.353
max271.966-271.603=0.363
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean0.385-0.387=-0.002
σ0.007-0.005=0.002
min0.381-0.382=-0.001
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.331-1931.991=0.339
σ0.013-0.018=-0.005
min1932.313-1931.960=0.353
max1932.347-1932.003=0.344
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean2.946-2.480=0.466
σ0.286-0.106=0.180
min2.449-2.350=0.099
max3.173-2.609=0.564
iters=5
new-facts=6402
prior-facts=1
mean4752.979-4752.589=0.390
σ1.009-1.006=0.003
min4752.048-4751.751=0.298
max4754.701-4754.339=0.363
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean8.621-8.809=-0.188
σ0.369-0.198=0.171
min8.013-8.591=-0.578
max8.926-9.039=-0.114
iters=5
new-facts=6402
prior-facts=6402
mean4943.556-4943.064=0.492
σ0.014-0.185=-0.171
min4943.537-4942.858=0.679
max4943.570-4943.213=0.357
mean3041.200-3019.600=21.600
σ224.355-232.175=-7.820
min2734.000-2759.000=-25.000
max3328.000-3322.000=6.000
mean8.486-8.683=-0.197
σ0.126-0.237=-0.111
min8.338-8.390=-0.052
max8.631-8.993=-0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-0.992=0.064
σ0.132-0.143=-0.011
min0.938-0.927=0.012
max1.262-1.248=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.638=0.028
σ574.934-574.939=-0.005
min181.190-181.166=0.024
max1331.067-1331.047=0.020
mean88.250
σ8.500
min84.000
max101.000
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean0.585-0.556=0.029
σ0.588-0.521=0.066
min0.287-0.286=0.000
max1.466-1.338=0.128
policies=20
mean1812.213-1811.905=0.308
σ0.388-0.317=0.071
min1811.945-1811.675=0.270
max1812.785-1812.370=0.415
mean840.000
σ0.000
min840.000
max840.000
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean2.843-2.846=-0.003
σ0.021-0.019=0.002
min2.817-2.824=-0.007
max2.863-2.863=-0.000
policies=200
mean18129.228-18126.650=2.579
σ0.437-0.636=-0.198
min18128.941-18125.926=3.015
max18129.880-18127.463=2.417
mean8400.000
σ0.000
min8400.000
max8400.000
mean2734.000-2759.000=-25.000
σ0.000
min2734.000-2759.000=-25.000
max2734.000-2759.000=-25.000
mean28.664-28.695=-0.031
σ0.042-0.094=-0.052
min28.618-28.578=0.041
max28.718-28.799=-0.081