Compare commits

Home / Compare d002422c .. 0b70b5ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.000
σ0.047-0.051=-0.004
min33.953-33.943=0.010
max34.108-34.117=-0.009
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=-0.001
max0.090-0.091=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.002-0.003=-0.001
min23.315-23.312=0.003
max23.321-23.321=-0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.063=0.002
σ0.003-0.005=-0.002
min0.063-0.059=0.004
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.430=-0.002
σ0.364-0.365=-0.001
min1756.858-1756.856=0.002
max1758.016-1758.018=-0.002
mean1645.200-1647.200=-2.000
σ634.971-626.561=8.410
min643.000-636.000=7.000
max2832.000-2835.000=-3.000
mean2.387-2.362=0.025
σ0.126-0.068=0.059
min2.250-2.283=-0.033
max2.682-2.515=0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.547-326.577=-0.030
σ0.049-0.040=0.009
min326.462-326.507=-0.046
max326.584-326.603=-0.018
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean0.426-0.423=0.003
σ0.005-0.002=0.003
min0.421-0.421=-0.000
max0.434-0.425=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.743-1988.739=0.003
σ0.009-0.012=-0.003
min1988.730-1988.719=0.011
max1988.750-1988.750=-0.001
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean2.676-2.690=-0.014
σ0.048-0.069=-0.021
min2.612-2.638=-0.026
max2.734-2.811=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4813.479-4813.639=-0.160
σ7.790-7.703=0.087
min4809.507-4810.044=-0.537
max4827.405-4827.418=-0.013
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean9.002-8.183=0.819
σ0.452-0.640=-0.189
min8.409-7.651=0.758
max9.414-9.210=0.204
iters=5
new-facts=6402
prior-facts=6402
mean5001.130-5001.139=-0.008
σ0.029-0.016=0.013
min5001.086-5001.124=-0.038
max5001.159-5001.163=-0.004
mean3045.600-3071.200=-25.600
σ186.811-312.686=-125.875
min2832.000-2835.000=-3.000
max3308.000-3556.000=-248.000
mean9.641-9.746=-0.105
σ0.512-0.022=0.490
min8.735-9.720=-0.985
max9.936-9.772=0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-0.949=0.089
σ0.151-0.062=0.089
min0.912-0.912=-0.000
max1.284-1.056=0.228

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.569-464.567=0.002
σ574.768-574.771=-0.003
min177.171-177.176=-0.006
max1326.722-1326.723=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean0.435-0.437=-0.002
σ0.303-0.308=-0.004
min0.281-0.279=0.002
max0.890-0.899=-0.008
policies=20
mean1772.053-1772.078=-0.025
σ0.378-0.361=0.017
min1771.799-1771.834=-0.034
max1772.613-1772.612=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean2.782-2.796=-0.014
σ0.008-0.012=-0.004
min2.772-2.781=-0.009
max2.790-2.809=-0.019
policies=200
mean17727.413-17727.464=-0.051
σ0.450-0.425=0.025
min17727.124-17727.058=0.066
max17728.074-17728.047=0.027
mean8400.000
σ0.000
min8400.000
max8400.000
mean2832.000-2835.000=-3.000
σ0.000
min2832.000-2835.000=-3.000
max2832.000-2835.000=-3.000
mean27.785-27.900=-0.114
σ0.333-0.452=-0.120
min27.411-27.504=-0.093
max28.149-28.382=-0.233