Compare commits

Home / Compare a9f025b3 .. 5d561d9c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.000
σ0.106-0.106=0.000
min35.755-35.753=0.002
max36.100-36.099=0.001
mean414.800-414.000=0.800
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.076-0.077=-0.001
σ0.003-0.003=0.000
min0.073-0.074=-0.002
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.003=-0.000
min26.061-26.058=0.003
max26.069-26.069=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.059=0.002
σ0.003-0.003=0.000
min0.060-0.056=0.003
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.923=0.001
σ0.367-0.366=0.001
min1755.346-1755.347=-0.001
max1756.518-1756.514=0.004
mean1664.450-1665.850=-1.400
σ627.291-628.210=-0.919
min672.000-673.000=-1.000
max2661.000-2663.000=-2.000
mean2.708-2.808=-0.100
σ0.237-0.158=0.080
min2.280-2.363=-0.084
max3.072-3.002=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.197=-0.001
σ0.005-0.006=-0.001
min277.190-277.190=0.000
max277.204-277.205=-0.001
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean0.405-0.410=-0.005
σ0.007-0.010=-0.003
min0.402-0.402=-0.000
max0.419-0.421=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.441-2174.406=0.035
σ0.023-0.018=0.005
min2174.418-2174.390=0.029
max2174.476-2174.431=0.045
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean2.954-2.902=0.052
σ0.114-0.150=-0.036
min2.760-2.785=-0.025
max3.066-3.118=-0.052
iters=5
new-facts=6402
prior-facts=1
mean5052.595-5052.508=0.087
σ0.961-1.063=-0.101
min5052.034-5051.754=0.280
max5054.305-5054.384=-0.079
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean8.632-9.023=-0.391
σ0.540-0.734=-0.194
min7.986-8.006=-0.019
max9.347-9.758=-0.411
iters=5
new-facts=6402
prior-facts=6402
mean5188.404-5188.410=-0.006
σ0.067-0.103=-0.037
min5188.353-5188.311=0.043
max5188.513-5188.524=-0.011
mean3227.800-3221.200=6.600
σ366.624-479.814=-113.190
min2697.000-2663.000=34.000
max3685.000-3873.000=-188.000
mean8.931-8.752=0.179
σ0.298-0.196=0.102
min8.680-8.578=0.101
max9.406-9.089=0.316

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.169=0.022
σ0.405-0.351=0.054
min0.937-0.953=-0.016
max1.877-1.789=0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-464.859=-0.003
σ572.659-572.666=-0.006
min178.521-178.523=-0.002
max1323.845-1323.858=-0.012
mean79.500
σ7.000
min76.000
max90.000
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean0.555-0.578=-0.023
σ0.553-0.587=-0.034
min0.278-0.283=-0.005
max1.385-1.459=-0.074
policies=20
mean1785.475-1785.464=0.011
σ0.354-0.345=0.010
min1785.237-1785.237=-0.001
max1786.000-1785.976=0.024
mean760.000
σ0.000
min760.000
max760.000
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean2.783-2.785=-0.002
σ0.019-0.006=0.013
min2.764-2.780=-0.016
max2.808-2.793=0.014
policies=200
mean17861.528-17861.508=0.020
σ0.450-0.552=-0.102
min17861.256-17861.104=0.152
max17862.201-17862.324=-0.123
mean7600.000
σ0.000
min7600.000
max7600.000
mean2661.000-2663.000=-2.000
σ0.000
min2661.000-2663.000=-2.000
max2661.000-2663.000=-2.000
mean28.177-28.180=-0.003
σ0.175-0.169=0.006
min27.996-27.958=0.038
max28.408-28.319=0.089