Compare commits

Home / Compare cf8dc013 .. 437e8753

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.393=0.002
σ0.045-0.045=0.000
min70.371-70.371=0.000
max70.518-70.519=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.157-0.159=-0.002
σ0.004-0.003=0.001
min0.149-0.155=-0.005
max0.160-0.163=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=0.000
min21.139-21.139=-0.000
max21.147-21.148=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.064=-0.003
σ0.004-0.002=0.002
min0.058-0.063=-0.005
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.394=0.305
σ0.364-0.360=0.004
min1752.125-1751.826=0.299
max1753.283-1752.960=0.324
mean1658.700-1656.650=2.050
σ629.708-629.902=-0.194
min619.000-616.000=3.000
max2774.000-2772.000=2.000
mean2.767-2.813=-0.045
σ0.197-0.150=0.047
min2.254-2.441=-0.187
max3.064-3.042=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.609-270.241=0.368
σ0.005-0.007=-0.002
min270.602-270.231=0.370
max270.613-270.250=0.363
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean0.380-0.386=-0.006
σ0.006-0.011=-0.005
min0.376-0.376=-0.000
max0.390-0.401=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1931.053-1930.704=0.349
σ0.021-0.009=0.012
min1931.030-1930.692=0.338
max1931.083-1930.713=0.370
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean2.876-2.511=0.365
σ0.336-0.107=0.229
min2.462-2.387=0.074
max3.200-2.665=0.535
iters=5
new-facts=6402
prior-facts=1
mean4751.723-4751.444=0.280
σ0.900-0.834=0.066
min4751.300-4750.847=0.454
max4753.333-4752.910=0.423
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean8.763-8.202=0.561
σ0.168-0.607=-0.439
min8.524-7.797=0.727
max8.930-9.209=-0.279
iters=5
new-facts=6402
prior-facts=6402
mean4942.157-4941.866=0.291
σ0.167-0.032=0.136
min4941.861-4941.828=0.032
max4942.256-4941.898=0.358
mean3042.800-3043.800=-1.000
σ257.083-329.698=-72.615
min2774.000-2772.000=2.000
max3405.000-3535.000=-130.000
mean8.593-8.432=0.161
σ0.203-0.148=0.055
min8.400-8.303=0.097
max8.896-8.683=0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-1.000=0.010
σ0.125-0.141=-0.016
min0.916-0.933=-0.016
max1.207-1.252=-0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.204-466.754=0.450
σ575.937-575.933=0.004
min179.231-178.784=0.447
max1331.110-1330.654=0.456
mean86.250
σ8.500
min82.000
max99.000
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean0.481-0.442=0.039
σ0.399-0.303=0.095
min0.280-0.287=-0.007
max1.079-0.898=0.182
policies=20
mean1792.629-1788.138=4.490
σ0.359-0.378=-0.018
min1792.378-1787.890=4.489
max1793.162-1788.697=4.465
mean820.000
σ0.000
min820.000
max820.000
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean2.795-2.851=-0.056
σ0.034-0.088=-0.054
min2.767-2.774=-0.007
max2.844-2.970=-0.126
policies=200
mean17932.920-17888.018=44.902
σ0.596-0.427=0.169
min17932.522-17887.612=44.910
max17933.802-17888.618=45.184
mean8200.000
σ0.000
min8200.000
max8200.000
mean2774.000-2772.000=2.000
σ0.000
min2774.000-2772.000=2.000
max2774.000-2772.000=2.000
mean28.012-28.188=-0.177
σ0.132-0.112=0.020
min27.894-28.092=-0.199
max28.199-28.331=-0.132