Compare commits

Home / Compare c58adf8c .. b6c05cc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.647=-0.001
σ0.366-0.365=0.002
min53.510-53.508=0.002
max54.688-54.685=0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.137-0.138=-0.001
σ0.005-0.004=0.001
min0.133-0.135=-0.003
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.942-42.942=-0.001
σ0.006-0.007=-0.001
min42.932-42.934=-0.001
max42.952-42.954=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.118-0.120=-0.002
σ0.001-0.004=-0.003
min0.117-0.113=0.003
max0.120-0.127=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.810=-0.011
σ1.250-1.243=0.008
min991.234-991.220=0.013
max997.062-997.029=0.033
mean1063.650-1067.250=-3.600
σ322.894-313.651=9.243
min565.000-614.000=-49.000
max1639.000-1644.000=-5.000
mean1.522-1.542=-0.021
σ0.084-0.116=-0.032
min1.439-1.454=-0.015
max1.724-1.977=-0.254

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.392=0.001
σ0.013-0.006=0.007
min285.372-285.383=-0.011
max285.405-285.400=0.004
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.378-0.378=-0.000
σ0.008-0.008=-0.001
min0.374-0.373=0.001
max0.392-0.393=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.347-1285.353=-0.006
σ0.107-0.129=-0.022
min1285.290-1285.292=-0.002
max1285.538-1285.585=-0.046
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean2.002-1.989=0.013
σ0.254-0.120=0.134
min1.773-1.864=-0.092
max2.381-2.136=0.245
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.709=-0.019
σ7.001-6.987=0.014
min1804.333-1804.358=-0.025
max1820.199-1820.191=0.007
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean4.187-4.231=-0.043
σ0.200-0.151=0.049
min3.861-4.054=-0.193
max4.385-4.429=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean2070.176-2070.174=0.002
σ0.010-0.010=0.000
min2070.168-2070.163=0.005
max2070.193-2070.189=0.004
mean1837.000-1801.400=35.600
σ169.663-140.765=28.898
min1639.000-1644.000=-5.000
max2073.000-1998.000=75.000
mean4.557-4.380=0.176
σ0.127-0.032=0.094
min4.459-4.344=0.115
max4.776-4.422=0.355

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.166=-0.004
σ0.277-0.307=-0.030
min0.894-0.893=0.001
max1.553-1.628=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.772-436.776=-0.004
σ572.360-572.364=-0.004
min150.587-150.589=-0.003
max1295.311-1295.322=-0.010
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.545-0.523=0.023
σ0.579-0.547=0.032
min0.249-0.247=0.002
max1.413-1.343=0.070
policies=20
mean1506.159-1506.183=-0.024
σ0.220-0.231=-0.010
min1506.016-1506.036=-0.020
max1506.488-1506.527=-0.039
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean2.493-2.502=-0.009
σ0.029-0.023=0.006
min2.456-2.474=-0.019
max2.528-2.531=-0.003
policies=200
mean15069.480-15069.433=0.047
σ0.100-0.109=-0.009
min15069.397-15069.289=0.108
max15069.597-15069.547=0.050
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean25.394-25.447=-0.053
σ0.087-0.088=-0.001
min25.311-25.341=-0.030
max25.491-25.535=-0.044