Compare commits

Home / Compare 3f1a6173 .. f3a50184

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.000
σ0.108-0.107=0.001
min35.924-35.925=-0.000
max36.279-36.278=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.078-0.076=0.002
σ0.004-0.004=0.000
min0.074-0.071=0.003
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.004-0.004=-0.000
min26.202-26.203=-0.001
max26.216-26.215=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.061-0.061=0.001
σ0.003-0.003=-0.001
min0.060-0.056=0.003
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.365=-0.002
σ0.372-0.373=-0.001
min1757.786-1757.794=-0.008
max1758.965-1758.963=0.002
mean1659.450-1630.350=29.100
σ621.733-593.631=28.103
min690.000-638.000=52.000
max2760.000-2423.000=337.000
mean2.394-2.362=0.032
σ0.114-0.090=0.024
min2.287-2.280=0.007
max2.665-2.592=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.498-279.515=-0.018
σ0.016-0.010=0.006
min279.480-279.506=-0.026
max279.514-279.529=-0.015
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean0.410-0.413=-0.003
σ0.002-0.009=-0.007
min0.407-0.406=0.001
max0.414-0.426=-0.013
iters=5
new-facts=1
prior-facts=6402
mean2178.423-2178.437=-0.014
σ0.032-0.010=0.022
min2178.378-2178.421=-0.043
max2178.465-2178.446=0.020
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean3.432-3.465=-0.032
σ0.087-0.169=-0.082
min3.291-3.214=0.077
max3.517-3.673=-0.156
iters=5
new-facts=6402
prior-facts=1
mean5056.380-5056.390=-0.009
σ0.979-1.012=-0.033
min5055.815-5055.800=0.015
max5058.125-5058.191=-0.067
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean8.860-8.848=0.012
σ0.612-0.560=0.053
min8.061-8.376=-0.315
max9.556-9.743=-0.187
iters=5
new-facts=6402
prior-facts=6402
mean5193.747-5193.687=0.061
σ0.101-0.211=-0.111
min5193.641-5193.335=0.306
max5193.857-5193.853=0.005
mean3296.000-3232.400=63.600
σ400.590-368.808=31.782
min2760.000-2713.000=47.000
max3680.000-3678.000=2.000
mean8.879-8.971=-0.092
σ0.169-0.419=-0.250
min8.611-8.695=-0.084
max9.049-9.713=-0.664

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.969-1.768=-0.798
σ0.054-0.220=-0.165
min0.937-1.400=-0.463
max1.064-1.953=-0.889

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.478-465.465=0.013
σ572.662-572.648=0.014
min179.140-179.139=0.001
max1324.471-1324.437=0.034
mean79.500
σ7.000
min76.000
max90.000
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean0.480-0.564=-0.084
σ0.397-0.558=-0.161
min0.279-0.282=-0.003
max1.075-1.400=-0.324
policies=20
mean1791.671-1791.677=-0.006
σ0.339-0.342=-0.003
min1791.476-1791.443=0.033
max1792.177-1792.183=-0.006
mean760.000
σ0.000
min760.000
max760.000
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean2.811-2.803=0.008
σ0.017-0.006=0.011
min2.790-2.796=-0.006
max2.827-2.809=0.017
policies=200
mean17923.160-17923.507=-0.347
σ0.313-0.520=-0.207
min17922.894-17923.220=-0.326
max17923.612-17924.286=-0.674
mean7600.000
σ0.000
min7600.000
max7600.000
mean2760.000-2423.000=337.000
σ0.000
min2760.000-2423.000=337.000
max2760.000-2423.000=337.000
mean28.333-28.230=0.102
σ0.123-0.163=-0.040
min28.220-28.075=0.144
max28.453-28.396=0.057