Compare commits

Home / Compare f4829752 .. d06d192b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.917-53.914=0.003
σ0.368-0.367=0.001
min53.786-53.786=-0.000
max54.965-54.960=0.005
mean416.800-415.000=1.800
σ0.422-0.000=0.422
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.146-0.137=0.008
σ0.012-0.005=0.007
min0.134-0.132=0.002
max0.166-0.144=0.022
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.008-0.007=0.001
min43.129-43.131=-0.002
max43.151-43.149=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.124-0.119=0.005
σ0.007-0.003=0.004
min0.117-0.114=0.003
max0.137-0.124=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.807-991.814=-0.007
σ1.248-1.264=-0.016
min991.229-991.238=-0.009
max997.061-997.136=-0.075
mean1066.800-1063.550=3.250
σ322.268-321.474=0.794
min569.000
max1638.000-1637.000=1.000
mean1.530-1.538=-0.008
σ0.084-0.102=-0.018
min1.397-1.456=-0.059
max1.720-1.847=-0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.412=-0.004
σ0.013-0.011=0.002
min285.388-285.396=-0.008
max285.423-285.422=0.001
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean0.379-0.381=-0.003
σ0.006-0.007=-0.001
min0.375-0.376=-0.001
max0.389-0.391=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.370-1285.376=-0.006
σ0.126-0.138=-0.012
min1285.307-1285.308=-0.001
max1285.595-1285.623=-0.028
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean2.051-1.857=0.194
σ0.207-0.068=0.139
min1.859-1.799=0.061
max2.362-1.968=0.394
iters=5
new-facts=6402
prior-facts=1
mean1807.685-1807.682=0.003
σ7.019-7.023=-0.004
min1804.346-1804.316=0.029
max1820.228-1820.232=-0.004
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean4.122-4.099=0.022
σ0.169-0.238=-0.068
min3.914-3.807=0.107
max4.370-4.401=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean2070.193-2070.196=-0.003
σ0.010-0.006=0.004
min2070.181-2070.190=-0.009
max2070.205-2070.206=-0.001
mean1864.800-1847.000=17.800
σ199.999-174.581=25.418
min1638.000-1637.000=1.000
max2093.000-2090.000=3.000
mean4.513-4.499=0.013
σ0.076-0.096=-0.021
min4.406-4.433=-0.026
max4.594-4.666=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.125-1.266=-0.141
σ0.206-0.252=-0.046
min0.918-1.038=-0.120
max1.468-1.559=-0.091

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.779-436.787=-0.008
σ572.349-572.358=-0.009
min150.600-150.601=-0.001
max1295.302-1295.324=-0.022
mean90.250
σ8.500
min86.000
max103.000
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean0.540-0.551=-0.011
σ0.573-0.601=-0.027
min0.252-0.249=0.004
max1.399-1.451=-0.052
policies=20
mean1506.266-1506.248=0.018
σ0.252-0.235=0.018
min1506.103-1506.093=0.010
max1506.642-1506.597=0.045
mean860.000
σ0.000
min860.000
max860.000
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean2.534-2.510=0.024
σ0.015-0.013=0.002
min2.512-2.493=0.018
max2.544-2.525=0.018
policies=200
mean15070.290-15070.337=-0.048
σ0.073-0.111=-0.038
min15070.187-15070.219=-0.032
max15070.357-15070.447=-0.090
mean8600.000
σ0.000
min8600.000
max8600.000
mean1638.000-1637.000=1.000
σ0.000
min1638.000-1637.000=1.000
max1638.000-1637.000=1.000
mean25.642-25.663=-0.021
σ0.181-0.225=-0.044
min25.445-25.425=0.020
max25.854-25.966=-0.112