Compare commits

Home / Compare 2be9f407 .. 4c58c775

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.395=0.172
σ0.044-0.045=-0.001
min70.542-70.371=0.171
max70.689-70.518=0.172
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.159-0.157=0.002
σ0.006-0.004=0.002
min0.149-0.149=-0.000
max0.167-0.160=0.007
cache=y
dps=1
iters=10
policies=100
mean21.288-21.144=0.144
σ0.003-0.003=0.000
min21.282-21.139=0.144
max21.293-21.147=0.145
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.063-0.061=0.001
σ0.004-0.004=-0.000
min0.058-0.058=0.001
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1752.699=0.675
σ0.358-0.364=-0.005
min1752.806-1752.125=0.681
max1753.942-1753.283=0.659
mean1662.400-1658.700=3.700
σ634.230-629.708=4.522
min618.000-619.000=-1.000
max2780.000-2774.000=6.000
mean2.789-2.767=0.022
σ0.195-0.197=-0.003
min2.163-2.254=-0.091
max2.987-3.064=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.728-270.609=1.119
σ0.008-0.005=0.003
min271.716-270.602=1.114
max271.736-270.613=1.123
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean0.387-0.380=0.007
σ0.009-0.006=0.003
min0.378-0.376=0.002
max0.400-0.390=0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1931.053=1.124
σ0.019-0.021=-0.002
min1932.147-1931.030=1.117
max1932.194-1931.083=1.111
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean3.001-2.876=0.125
σ0.091-0.336=-0.245
min2.857-2.462=0.396
max3.099-3.200=-0.101
iters=5
new-facts=6402
prior-facts=1
mean4752.666-4751.723=0.943
σ1.110-0.900=0.210
min4751.897-4751.300=0.596
max4754.611-4753.333=1.277
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean8.817-8.763=0.054
σ0.325-0.168=0.157
min8.408-8.524=-0.117
max9.297-8.930=0.367
iters=5
new-facts=6402
prior-facts=6402
mean4943.371-4942.157=1.214
σ0.015-0.167=-0.152
min4943.354-4941.861=1.493
max4943.387-4942.256=1.131
mean2998.200-3042.800=-44.600
σ290.951-257.083=33.867
min2780.000-2774.000=6.000
max3459.000-3405.000=54.000
mean8.472-8.593=-0.121
σ0.178-0.203=-0.026
min8.349-8.400=-0.050
max8.782-8.896=-0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.010=0.033
σ0.114-0.125=-0.011
min0.934-0.916=0.018
max1.207-1.207=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.204=0.654
σ575.940-575.937=0.003
min179.885-179.231=0.654
max1331.768-1331.110=0.658
mean86.250
σ8.500
min82.000
max99.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean0.479-0.481=-0.002
σ0.402-0.399=0.003
min0.274-0.280=-0.006
max1.081-1.079=0.002
policies=20
mean1799.154-1792.629=6.525
σ0.368-0.359=0.008
min1798.930-1792.378=6.552
max1799.702-1793.162=6.540
mean820.000
σ0.000
min820.000
max820.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean2.832-2.795=0.037
σ0.038-0.034=0.004
min2.800-2.767=0.033
max2.871-2.844=0.028
policies=200
mean17998.436-17932.920=65.516
σ0.448-0.596=-0.148
min17998.096-17932.522=65.574
max17999.088-17933.802=65.286
mean8200.000
σ0.000
min8200.000
max8200.000
mean2780.000-2774.000=6.000
σ0.000
min2780.000-2774.000=6.000
max2780.000-2774.000=6.000
mean28.248-28.012=0.236
σ0.155-0.132=0.022
min28.127-27.894=0.234
max28.452-28.199=0.253