Compare commits

Home / Compare 154656a7 .. 9951f2d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.703=-0.002
σ0.047-0.049=-0.002
min70.672-70.667=0.005
max70.832-70.838=-0.007
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.161-0.161=-0.000
σ0.004-0.003=0.000
min0.157-0.159=-0.002
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.001
σ0.002-0.003=-0.001
min21.405-21.401=0.004
max21.411-21.411=0.000
mean415.000-414.500=0.500
σ0.000-0.527=-0.527
min415.000-414.000=1.000
max415.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.063-0.059=0.005
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.929=0.002
σ0.363-0.362=0.001
min1754.363-1754.357=0.005
max1755.519-1755.512=0.007
mean1666.200-1660.650=5.550
σ636.621-646.005=-9.384
min669.000-623.000=46.000
max2699.000-2779.000=-80.000
mean2.821-2.782=0.039
σ0.222-0.179=0.043
min2.260-2.248=0.012
max3.123-2.978=0.145

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.757=-0.000
σ0.007-0.006=0.001
min272.747-272.750=-0.003
max272.764-272.764=0.001
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean0.383-0.383=-0.000
σ0.005-0.008=-0.003
min0.380-0.378=0.002
max0.392-0.397=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1933.168=-0.009
σ0.014-0.015=-0.001
min1933.140-1933.145=-0.004
max1933.174-1933.181=-0.008
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean3.114-3.057=0.057
σ0.080-0.054=0.026
min3.029-3.019=0.010
max3.207-3.152=0.055
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4756.923=-0.000
σ7.634-7.561=0.072
min4753.441-4753.485=-0.044
max4770.577-4770.449=0.129
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean8.573-8.436=0.138
σ0.406-0.400=0.006
min7.941-7.837=0.104
max8.937-8.909=0.028
iters=5
new-facts=6402
prior-facts=6402
mean4944.387-4944.325=0.062
σ0.018-0.146=-0.128
min4944.368-4944.065=0.304
max4944.413-4944.406=0.007
mean3019.600-3038.200=-18.600
σ349.647-315.303=34.345
min2699.000-2779.000=-80.000
max3530.000-3512.000=18.000
mean8.477-8.496=-0.019
σ0.132-0.114=0.018
min8.369-8.414=-0.044
max8.706-8.690=0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.003=0.012
σ0.143-0.134=0.009
min0.911-0.914=-0.004
max1.226-1.220=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.331-468.339=-0.008
σ574.270-574.257=0.014
min181.188-181.203=-0.015
max1329.736-1329.724=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean0.557-0.446=0.111
σ0.542-0.301=0.241
min0.285-0.291=-0.007
max1.370-0.896=0.473
policies=20
mean1812.189-1812.370=-0.181
σ0.380-0.395=-0.015
min1811.934-1812.090=-0.156
max1812.752-1812.948=-0.196
mean840.000
σ0.000
min840.000
max840.000
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean2.825-2.886=-0.061
σ0.013-0.006=0.007
min2.808-2.877=-0.069
max2.836-2.890=-0.054
policies=200
mean18129.052-18129.090=-0.038
σ0.450-0.526=-0.076
min18128.786-18128.626=0.159
max18129.725-18129.577=0.148
mean8400.000
σ0.000
min8400.000
max8400.000
mean2699.000-2779.000=-80.000
σ0.000
min2699.000-2779.000=-80.000
max2699.000-2779.000=-80.000
mean28.358-28.545=-0.186
σ0.098-0.238=-0.140
min28.248-28.328=-0.080
max28.452-28.884=-0.431