Compare commits

Home / Compare 61b4dee1 .. d2b57280

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.840-32.841=-0.001
σ0.372-0.372=0.000
min32.704-32.710=-0.006
max33.898
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.084=0.001
σ0.003-0.003=-0.000
min0.082-0.082=-0.000
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean22.087-22.088=-0.001
σ0.002-0.003=-0.000
min22.082-22.083=-0.001
max22.091-22.092=-0.001
mean414.000-415.900=-1.900
σ0.000-0.316=-0.316
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.064-0.066=-0.002
σ0.003-0.002=0.001
min0.060-0.064=-0.004
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean983.405-983.412=-0.007
σ1.109-1.116=-0.007
min982.890-982.892=-0.003
max988.055-988.097=-0.041
mean1057.700-1057.200=0.500
σ319.481-305.129=14.352
min573.000-648.000=-75.000
max1623.000-1513.000=110.000
mean1.384-1.394=-0.010
σ0.072-0.079=-0.007
min1.309-1.315=-0.006
max1.573-1.628=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean262.594-262.590=0.005
σ0.006-0.005=0.001
min262.585-262.584=0.001
max262.599-262.595=0.004
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean0.355-0.356=-0.001
σ0.010-0.007=0.002
min0.347-0.347=-0.000
max0.368-0.364=0.004
iters=5
new-facts=1
prior-facts=6402
mean1262.633-1262.666=-0.032
σ0.049-0.110=-0.060
min1262.607-1262.613=-0.006
max1262.721-1262.862=-0.141
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean1.855-1.923=-0.068
σ0.062-0.096=-0.034
min1.785-1.775=0.010
max1.955-2.038=-0.082
iters=5
new-facts=6402
prior-facts=1
mean2058.192-2058.163=0.029
σ7.017-6.877=0.140
min2054.890-2054.902=-0.012
max2070.735-2070.452=0.282
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean4.766-4.590=0.176
σ0.241-0.239=0.002
min4.467-4.304=0.163
max5.079-4.849=0.230
iters=5
new-facts=6402
prior-facts=6402
mean2047.385-2047.396=-0.011
σ0.020-0.008=0.012
min2047.353-2047.389=-0.036
max2047.406-2047.409=-0.002
mean1789.200-1755.200=34.000
σ164.544-186.209=-21.665
min1623.000-1513.000=110.000
max2004.000-1979.000=25.000
mean4.436-4.468=-0.032
σ0.188-0.095=0.093
min4.310-4.376=-0.066
max4.767-4.607=0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.247-1.523=-0.276
σ0.342-0.310=0.032
min0.902-1.167=-0.265
max1.694-1.823=-0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.114-437.103=0.010
σ572.832-572.825=0.006
min150.689-150.686=0.004
max1296.361-1296.341=0.020
mean88.250
σ8.500
min84.000
max101.000
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean0.546-0.515=0.032
σ0.589-0.523=0.066
min0.250-0.250=-0.000
max1.430-1.300=0.131
policies=20
mean1507.088-1507.077=0.011
σ0.244-0.258=-0.014
min1506.922-1506.890=0.032
max1507.450-1507.458=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean2.515-2.512=0.003
σ0.015-0.022=-0.007
min2.503-2.491=0.012
max2.536-2.541=-0.004
policies=200
mean15078.772-15078.829=-0.057
σ0.439-0.444=-0.005
min15078.418-15078.565=-0.147
max15079.413-15079.491=-0.078
mean8400.000
σ0.000
min8400.000
max8400.000
mean1623.000-1513.000=110.000
σ0.000
min1623.000-1513.000=110.000
max1623.000-1513.000=110.000
mean25.407-25.400=0.007
σ0.350-0.091=0.259
min25.097-25.300=-0.202
max25.884-25.513=0.371