Compare commits

Home / Compare 76b57a8d .. fe41e06e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.970=0.003
σ0.107-0.106=0.001
min35.926-35.921=0.005
max36.277-36.271=0.006
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.078-0.078=0.000
σ0.004-0.005=-0.001
min0.075-0.072=0.003
max0.086-0.086=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.205=0.003
σ0.005-0.004=0.001
min26.198-26.201=-0.003
max26.217-26.214=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.060=0.001
σ0.004-0.003=0.001
min0.058-0.057=0.001
max0.070-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.378-1758.378=0.001
σ0.370-0.369=0.001
min1757.798-1757.803=-0.004
max1758.971-1758.975=-0.004
mean1659.150-1656.550=2.600
σ624.895-620.624=4.271
min669.000-688.000=-19.000
max2595.000-2745.000=-150.000
mean2.392-2.394=-0.002
σ0.092-0.088=0.004
min2.306-2.305=0.001
max2.641-2.605=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.899-280.902=-0.003
σ0.021-0.006=0.014
min280.864-280.893=-0.028
max280.919-280.910=0.009
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean0.421-0.418=0.003
σ0.012-0.008=0.004
min0.412-0.414=-0.002
max0.436-0.431=0.005
iters=5
new-facts=1
prior-facts=6402
mean2270.925-2270.900=0.025
σ0.019-0.026=-0.008
min2270.899-2270.862=0.037
max2270.945-2270.929=0.016
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean3.120-3.197=-0.077
σ0.192-0.351=-0.159
min2.954-2.831=0.123
max3.422-3.738=-0.316
iters=5
new-facts=6402
prior-facts=1
mean5148.156-5148.202=-0.046
σ1.014-0.984=0.031
min5147.404-5147.675=-0.271
max5149.927-5149.957=-0.031
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean9.391-8.638=0.752
σ0.732-0.500=0.232
min8.372-8.151=0.221
max10.306-9.470=0.836
iters=5
new-facts=6402
prior-facts=6402
mean5286.121-5286.128=-0.007
σ0.176-0.198=-0.022
min5285.866-5285.860=0.006
max5286.316-5286.371=-0.054
mean3494.400-3451.000=43.400
σ532.863-436.431=96.432
min2789.000-2829.000=-40.000
max4004.000-3977.000=27.000
mean10.179-10.125=0.054
σ0.235-0.123=0.112
min9.936-9.913=0.023
max10.432-10.209=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.000=0.232
σ0.375-0.140=0.235
min0.942-0.932=0.010
max1.842-1.249=0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.539-465.550=-0.011
σ572.667-572.657=0.011
min179.202-179.198=0.004
max1324.540-1324.535=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean0.564-0.504=0.060
σ0.558-0.426=0.132
min0.284-0.278=0.005
max1.401-1.142=0.259
policies=20
mean1792.288-1792.276=0.011
σ0.354-0.344=0.010
min1792.046-1792.036=0.010
max1792.811-1792.784=0.027
mean760.000
σ0.000
min760.000
max760.000
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean2.817-2.812=0.005
σ0.013-0.015=-0.002
min2.804-2.798=0.006
max2.835-2.831=0.004
policies=200
mean17929.525-17929.557=-0.032
σ0.452-0.505=-0.053
min17929.274-17929.269=0.005
max17930.201-17930.312=-0.111
mean7600.000
σ0.000
min7600.000
max7600.000
mean2595.000-2745.000=-150.000
σ0.000
min2595.000-2745.000=-150.000
max2595.000-2745.000=-150.000
mean28.387-28.382=0.005
σ0.087-0.152=-0.065
min28.322-28.163=0.159
max28.513-28.506=0.007