Compare commits

Home / Compare 40cf2671 .. 42ecd261

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.310=0.337
σ0.366-0.367=-0.001
min53.514-53.171=0.343
max54.689-54.353=0.336
mean414.000-417.300=-3.300
σ0.000-0.483=-0.483
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.139-0.136=0.003
σ0.004-0.005=-0.001
min0.132-0.129=0.003
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-42.545=0.396
σ0.006-0.013=-0.006
min42.932-42.528=0.404
max42.952-42.574=0.378
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.118-0.118=-0.001
σ0.004-0.003=0.001
min0.113-0.115=-0.002
max0.123-0.124=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.796-989.875=1.921
σ1.234-1.245=-0.011
min991.242-989.292=1.951
max996.988-995.108=1.880
mean1072.450-1055.200=17.250
σ322.062-294.917=27.145
min614.000-622.000=-8.000
max1650.000-1473.000=177.000
mean1.530-1.531=-0.001
σ0.088-0.081=0.007
min1.443-1.389=0.055
max1.728-1.747=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-280.215=5.177
σ0.011-0.010=0.001
min285.378-280.203=5.175
max285.404-280.225=5.179
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean0.380-0.370=0.010
σ0.010-0.004=0.006
min0.373-0.368=0.005
max0.393-0.377=0.016
iters=5
new-facts=1
prior-facts=6402
mean1285.354-1280.283=5.071
σ0.128-0.124=0.003
min1285.291-1280.214=5.077
max1285.582-1280.502=5.079
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean2.021-1.841=0.180
σ0.216-0.040=0.177
min1.863-1.799=0.064
max2.378-1.902=0.476
iters=5
new-facts=6402
prior-facts=1
mean1807.698-1802.580=5.118
σ7.005-7.057=-0.052
min1804.325-1799.178=5.147
max1820.213-1815.188=5.024
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean4.206-4.305=-0.099
σ0.219-0.203=0.017
min3.858-4.006=-0.149
max4.416-4.481=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2065.010=5.169
σ0.012-0.011=0.001
min2070.160-2065.002=5.158
max2070.193-2065.028=5.165
mean1838.400-1802.000=36.400
σ166.914-195.974=-29.060
min1650.000-1561.000=89.000
max2073.000-1993.000=80.000
mean4.513-4.412=0.102
σ0.042-0.087=-0.045
min4.455-4.329=0.126
max4.567-4.532=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.793=-0.627
σ0.322-0.064=0.258
min0.909-1.702=-0.793
max1.693-1.868=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-435.103=1.672
σ572.362-572.812=-0.450
min150.593-148.692=1.900
max1295.318-1294.321=0.996
mean90.250
σ8.500
min86.000
max103.000
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean0.523-0.524=-0.001
σ0.551-0.539=0.012
min0.230-0.252=-0.022
max1.350-1.333=0.017
policies=20
mean1506.166-1487.169=18.997
σ0.229-0.236=-0.007
min1506.020-1487.007=19.013
max1506.507-1487.519=18.988
mean860.000
σ0.000
min860.000
max860.000
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean2.506-2.503=0.003
σ0.022-0.022=-0.000
min2.486-2.471=0.015
max2.529-2.518=0.012
policies=200
mean15069.526-14879.297=190.230
σ0.049-0.101=-0.052
min15069.493-14879.222=190.271
max15069.599-14879.442=190.156
mean8600.000
σ0.000
min8600.000
max8600.000
mean1650.000-1473.000=177.000
σ0.000
min1650.000-1473.000=177.000
max1650.000-1473.000=177.000
mean25.390-25.315=0.076
σ0.095-0.160=-0.065
min25.328-25.178=0.149
max25.530-25.505=0.024