Compare commits

Home / Compare 1b3acefe .. 573bc4f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.562=0.001
σ0.046-0.046=0.000
min70.538-70.542=-0.004
max70.693-70.693=0.000
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.157-0.159=-0.003
σ0.002-0.006=-0.004
min0.155-0.151=0.004
max0.162-0.171=-0.009
cache=y
dps=1
iters=10
policies=100
mean21.290-21.287=0.003
σ0.011-0.003=0.008
min21.282-21.282=-0.000
max21.319-21.290=0.029
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.061-0.060=0.001
σ0.004-0.004=0.000
min0.059-0.058=0.001
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.373=0.001
σ0.359-0.360=-0.001
min1752.801-1752.802=-0.001
max1753.960-1753.960=-0.000
mean1643.850-1648.100=-4.250
σ636.704-648.012=-11.308
min633.000-641.000=-8.000
max2855.000-2895.000=-40.000
mean2.778-2.759=0.019
σ0.149-0.198=-0.049
min2.379-2.190=0.189
max2.976-3.046=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.759=-0.002
σ0.003-0.004=-0.000
min271.752-271.754=-0.003
max271.760-271.763=-0.004
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean0.379-0.382=-0.003
σ0.002-0.014=-0.012
min0.375-0.374=0.002
max0.380-0.406=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1932.178-1932.174=0.004
σ0.007-0.004=0.003
min1932.171-1932.170=0.001
max1932.189-1932.180=0.009
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean2.932-3.069=-0.137
σ0.075-0.125=-0.050
min2.822-2.977=-0.155
max3.007-3.283=-0.276
iters=5
new-facts=6402
prior-facts=1
mean4752.454-4752.848=-0.394
σ0.888-0.901=-0.014
min4751.827-4752.254=-0.427
max4753.946-4754.433=-0.488
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean8.663-8.180=0.483
σ0.326-0.792=-0.466
min8.370-7.512=0.858
max9.087-9.438=-0.351
iters=5
new-facts=6402
prior-facts=6402
mean4943.307-4943.372=-0.065
σ0.151-0.022=0.129
min4943.039-4943.348=-0.309
max4943.393-4943.396=-0.003
mean3013.400-3075.400=-62.000
σ183.316-251.399=-68.083
min2855.000-2895.000=-40.000
max3303.000-3469.000=-166.000
mean8.583-8.438=0.145
σ0.217-0.102=0.115
min8.347-8.328=0.019
max8.932-8.588=0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.023=-0.026
σ0.152-0.144=0.008
min0.924-0.928=-0.004
max1.269-1.259=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.860=0.001
σ575.925-575.924=0.001
min179.896-179.891=0.005
max1331.749-1331.745=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean0.442-0.444=-0.002
σ0.300-0.302=-0.002
min0.287-0.292=-0.005
max0.892-0.896=-0.005
policies=20
mean1799.202-1799.176=0.026
σ0.380-0.376=0.004
min1798.940-1798.910=0.030
max1799.762-1799.729=0.033
mean820.000
σ0.000
min820.000
max820.000
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean2.882-2.895=-0.013
σ0.009-0.021=-0.012
min2.870-2.867=0.002
max2.891-2.914=-0.023
policies=200
mean17998.435-17998.541=-0.106
σ0.555-0.511=0.043
min17998.052-17998.252=-0.200
max17999.239-17999.305=-0.066
mean8200.000
σ0.000
min8200.000
max8200.000
mean2855.000-2895.000=-40.000
σ0.000
min2855.000-2895.000=-40.000
max2855.000-2895.000=-40.000
mean28.428-28.585=-0.157
σ0.427-0.437=-0.010
min28.041-28.163=-0.123
max29.033-29.016=0.017