Compare commits

Home / Compare 1f369cbe .. 6c326ca5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.720-36.733=-0.012
σ0.651-0.616=0.035
min35.932-35.920=0.011
max37.535-37.217=0.319
mean4160.000-3779.000=381.000
σ0.000
min4160.000-3779.000=381.000
max4160.000-3779.000=381.000
mean0.075-0.076=-0.001
σ0.002-0.003=-0.001
min0.073-0.071=0.002
max0.079-0.080=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.589-26.714=-0.125
σ0.603-0.648=-0.045
min26.206-26.208=-0.002
max27.469-27.470=-0.002
mean4160.000-3779.000=381.000
σ0.000
min4160.000-3779.000=381.000
max4160.000-3779.000=381.000
mean0.060-0.059=0.001
σ0.001-0.001=-0.000
min0.059-0.057=0.002
max0.061-0.060=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.359=-0.002
σ0.374-0.373=0.001
min1755.787-1755.786=0.001
max1756.950-1756.961=-0.011
mean1658.850-1636.800=22.050
σ627.154-620.593=6.560
min685.000-631.000=54.000
max2607.000-2832.000=-225.000
mean2.252-2.264=-0.012
σ0.081-0.122=-0.042
min2.138-2.129=0.009
max2.440-2.674=-0.235

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.675-278.673=0.003
σ0.013-0.011=0.001
min278.659-278.663=-0.003
max278.688-278.691=-0.003
mean2607.000-2832.000=-225.000
σ0.000
min2607.000-2832.000=-225.000
max2607.000-2832.000=-225.000
mean0.423-0.420=0.003
σ0.009-0.001=0.008
min0.415-0.418=-0.003
max0.437-0.421=0.015
iters=5
new-facts=1
prior-facts=6402
mean2268.846-2268.832=0.014
σ0.010-0.023=-0.012
min2268.832-2268.802=0.030
max2268.859-2268.853=0.006
mean2607.000-2832.000=-225.000
σ0.000
min2607.000-2832.000=-225.000
max2607.000-2832.000=-225.000
mean2.985-3.204=-0.219
σ0.172-0.171=0.001
min2.825-2.920=-0.095
max3.210-3.347=-0.137
iters=5
new-facts=6402
prior-facts=1
mean4952.174-4952.070=0.104
σ0.863-0.873=-0.010
min4951.704-4951.236=0.468
max4953.714-4953.555=0.159
mean2607.000-2832.000=-225.000
σ0.000
min2607.000-2832.000=-225.000
max2607.000-2832.000=-225.000
mean7.962-7.793=0.169
σ0.274-0.193=0.081
min7.729-7.589=0.140
max8.400-8.069=0.331
iters=5
new-facts=6402
prior-facts=6402
mean5166.900-5166.685=0.215
σ0.027-0.305=-0.278
min5166.883-5166.211=0.672
max5166.948-5166.892=0.055
mean3466.800-3338.200=128.600
σ465.017-439.730=25.287
min2888.000-2832.000=56.000
max4160.000-3779.000=381.000
mean9.433-9.223=0.210
σ0.376-0.144=0.232
min9.143-9.078=0.065
max10.065-9.464=0.601

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.140-1.611=-0.471
σ0.234-0.194=0.040
min0.940-1.303=-0.363
max1.497-1.776=-0.279

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-460.255=0.001
σ572.608-572.608=-0.000
min173.951-173.949=0.001
max1319.167-1319.167=0.001
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.550-0.538=0.012
σ0.556-0.519=0.037
min0.266-0.273=-0.007
max1.383-1.317=0.067
policies=20
mean1740.017-1740.012=0.004
σ0.342-0.338=0.005
min1739.773-1739.774=-0.000
max1740.520-1740.509=0.011
mean760.000
σ0.000
min760.000
max760.000
mean447.750-448.750=-1.000
σ9.743-10.874=-1.132
min437.000
max456.000-458.000=-2.000
mean2.679-2.671=0.008
σ0.018-0.013=0.005
min2.661-2.659=0.002
max2.702-2.686=0.015
policies=200
mean17409.399-17409.343=0.057
σ0.136-0.094=0.042
min17409.232-17409.252=-0.020
max17409.563-17409.473=0.090
mean7600.000
σ0.000
min7600.000
max7600.000
mean493.000-492.750=0.250
σ2.449-2.500=-0.051
min491.000-490.000=1.000
max496.000
mean27.101-26.990=0.111
σ0.125-0.041=0.084
min26.957-26.933=0.024
max27.235-27.027=0.208