Compare commits

Home / Compare f1e4f74d .. 33e908df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-35.263=18.652
σ0.369-0.054=0.315
min53.788-35.238=18.551
max54.964-35.415=19.549
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.141-0.084=0.056
σ0.004-0.005=-0.001
min0.136-0.078=0.059
max0.146-0.093=0.054
cache=y
dps=1
iters=10
policies=100
mean43.141-23.769=19.372
σ0.005-0.003=0.002
min43.132-23.766=19.366
max43.149-23.775=19.374
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.065=0.057
σ0.004-0.002=0.001
min0.118-0.061=0.057
max0.128-0.067=0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-1756.468=-764.665
σ1.224-0.368=0.856
min991.257-1755.896=-764.639
max996.953-1757.064=-760.111
mean1060.700-1656.550=-595.850
σ323.935-637.000=-313.066
min607.000-677.000=-70.000
max1639.000-2843.000=-1204.000
mean1.522-2.325=-0.804
σ0.104-0.107=-0.003
min1.375-2.131=-0.756
max1.776-2.583=-0.807

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-324.690=-39.279
σ0.011-0.051=-0.041
min285.392-324.599=-39.207
max285.417-324.720=-39.303
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean0.377-0.424=-0.047
σ0.004-0.003=0.001
min0.375-0.421=-0.047
max0.383-0.429=-0.045
iters=5
new-facts=1
prior-facts=6402
mean1285.372-1985.257=-699.885
σ0.128-0.005=0.123
min1285.305-1985.251=-699.946
max1285.601-1985.263=-699.662
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean1.866-2.581=-0.714
σ0.095-0.074=0.021
min1.748-2.494=-0.746
max1.951-2.671=-0.720
iters=5
new-facts=6402
prior-facts=1
mean1807.696-4808.873=-3001.177
σ7.019-7.625=-0.606
min1804.316-4805.391=-3001.075
max1820.235-4822.513=-3002.278
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean4.121-9.066=-4.945
σ0.229-0.348=-0.119
min3.802-8.518=-4.716
max4.437-9.473=-5.036
iters=5
new-facts=6402
prior-facts=6402
mean2070.193-4996.398=-2926.205
σ0.008-0.140=-0.131
min2070.183-4996.150=-2925.967
max2070.206-4996.477=-2926.271
mean1836.200-3051.600=-1215.400
σ144.571-191.680=-47.109
min1639.000-2843.000=-1204.000
max2030.000-3330.000=-1300.000
mean4.553-8.661=-4.108
σ0.155-0.192=-0.037
min4.433-8.472=-4.038
max4.806-8.889=-4.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.273-1.036=0.238
σ0.379-0.164=0.215
min0.899-0.913=-0.013
max1.724-1.230=0.493

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-462.951=-26.164
σ572.358-574.253=-1.895
min150.597-175.816=-25.219
max1295.324-1324.331=-29.007
mean90.250-86.250=4.000
σ8.500
min86.000-82.000=4.000
max103.000-99.000=4.000
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean0.524-0.435=0.089
σ0.546-0.300=0.246
min0.249-0.282=-0.033
max1.343-0.885=0.459
policies=20
mean1506.270-1758.489=-252.219
σ0.244-0.351=-0.107
min1506.110-1758.234=-252.124
max1506.633-1759.004=-252.370
mean860.000-820.000=40.000
σ0.000
min860.000-820.000=40.000
max860.000-820.000=40.000
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean2.518-2.797=-0.279
σ0.013-0.019=-0.006
min2.502-2.774=-0.271
max2.533-2.819=-0.286
policies=200
mean15070.391-17591.085=-2520.694
σ0.101-0.662=-0.561
min15070.246-17590.274=-2520.027
max15070.466-17591.638=-2521.171
mean8600.000-8200.000=400.000
σ0.000
min8600.000-8200.000=400.000
max8600.000-8200.000=400.000
mean1639.000-2843.000=-1204.000
σ0.000
min1639.000-2843.000=-1204.000
max1639.000-2843.000=-1204.000
mean25.618-27.941=-2.323
σ0.248-0.288=-0.040
min25.393-27.672=-2.279
max25.963-28.294=-2.331