Compare commits

Home / Compare c430c4c5 .. 92b1bda9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.397=-0.002
σ0.045-0.045=-0.001
min70.371-70.370=0.000
max70.518-70.522=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.157-0.159=-0.003
σ0.004-0.003=0.001
min0.149-0.156=-0.007
max0.160-0.166=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.003=-0.000
min21.139-21.141=-0.002
max21.147-21.149=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.064=-0.002
σ0.004-0.003=0.001
min0.058-0.060=-0.002
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.392=0.307
σ0.364-0.363=0.001
min1752.125-1751.827=0.297
max1753.283-1752.980=0.303
mean1658.700-1655.000=3.700
σ629.708-628.638=1.070
min619.000
max2774.000-2770.000=4.000
mean2.767-2.839=-0.072
σ0.197-0.205=-0.008
min2.254-2.391=-0.137
max3.064-3.379=-0.316

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.609-270.237=0.372
σ0.005-0.007=-0.002
min270.602-270.231=0.371
max270.613-270.247=0.366
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean0.380-0.379=0.001
σ0.006-0.006=-0.000
min0.376-0.370=0.006
max0.390-0.387=0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.053-1930.704=0.349
σ0.021-0.005=0.016
min1931.030-1930.696=0.334
max1931.083-1930.710=0.374
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean2.876-2.535=0.341
σ0.336-0.093=0.243
min2.462-2.454=0.007
max3.200-2.662=0.539
iters=5
new-facts=6402
prior-facts=1
mean4751.723-4751.414=0.310
σ0.900-0.831=0.069
min4751.300-4750.900=0.400
max4753.333-4752.890=0.443
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean8.763-8.464=0.299
σ0.168-0.443=-0.275
min8.524-7.784=0.740
max8.930-8.994=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean4942.157-4941.867=0.290
σ0.167-0.022=0.145
min4941.861-4941.840=0.021
max4942.256-4941.895=0.361
mean3042.800-3048.800=-6.000
σ257.083-211.984=45.099
min2774.000-2770.000=4.000
max3405.000-3328.000=77.000
mean8.593-8.610=-0.017
σ0.203-0.192=0.011
min8.400-8.420=-0.020
max8.896-8.830=0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-1.055=-0.044
σ0.125-0.191=-0.066
min0.916-0.937=-0.020
max1.207-1.381=-0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.204-466.756=0.448
σ575.937-575.936=0.001
min179.231-178.781=0.451
max1331.110-1330.660=0.450
mean86.250
σ8.500
min82.000
max99.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean0.481-0.446=0.035
σ0.399-0.307=0.092
min0.280-0.290=-0.010
max1.079-0.907=0.173
policies=20
mean1792.629-1788.112=4.516
σ0.359-0.340=0.020
min1792.378-1787.853=4.525
max1793.162-1788.602=4.560
mean820.000
σ0.000
min820.000
max820.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean2.795-2.844=-0.049
σ0.034-0.101=-0.067
min2.767-2.785=-0.018
max2.844-2.995=-0.152
policies=200
mean17932.920-17888.166=44.754
σ0.596-0.511=0.085
min17932.522-17887.884=44.638
max17933.802-17888.932=44.871
mean8200.000
σ0.000
min8200.000
max8200.000
mean2774.000-2770.000=4.000
σ0.000
min2774.000-2770.000=4.000
max2774.000-2770.000=4.000
mean28.012-28.140=-0.128
σ0.132-0.077=0.056
min27.894-28.032=-0.138
max28.199-28.210=-0.011