Compare commits

Home / Compare e86894bf .. 5fe72b72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.917=-0.002
σ0.368-0.365=0.003
min53.786-53.779=0.007
max54.963-54.956=0.007
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.140-0.147=-0.007
σ0.004-0.011=-0.007
min0.136-0.134=0.001
max0.146-0.168=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=-0.000
σ0.006-0.006=-0.000
min43.130-43.132=-0.002
max43.148-43.151=-0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.120-0.118=0.002
σ0.004-0.003=0.001
min0.115-0.113=0.001
max0.127-0.121=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.808-991.808=0.000
σ1.262-1.268=-0.006
min991.248-991.247=0.001
max997.124-997.150=-0.026
mean1064.650-1062.850=1.800
σ328.955-321.836=7.119
min574.000-567.000=7.000
max1635.000-1637.000=-2.000
mean1.564-1.540=0.023
σ0.127-0.148=-0.021
min1.459-1.392=0.067
max1.980-2.037=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.411=-0.002
σ0.012-0.011=0.000
min285.393-285.394=-0.001
max285.418-285.425=-0.007
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean0.374-0.382=-0.008
σ0.002-0.017=-0.015
min0.372-0.366=0.007
max0.377-0.406=-0.029
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.374=0.002
σ0.140-0.131=0.009
min1285.307-1285.310=-0.003
max1285.626-1285.608=0.018
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean1.949-1.981=-0.033
σ0.144-0.150=-0.006
min1.830-1.826=0.003
max2.166-2.149=0.017
iters=5
new-facts=6402
prior-facts=1
mean1807.740-1807.712=0.028
σ6.997-7.077=-0.080
min1804.363-1804.327=0.036
max1820.241-1820.357=-0.116
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean4.251-4.203=0.047
σ0.219-0.339=-0.120
min4.005-3.898=0.107
max4.518-4.779=-0.261
iters=5
new-facts=6402
prior-facts=6402
mean2070.200-2070.194=0.007
σ0.011-0.008=0.003
min2070.193-2070.182=0.010
max2070.219-2070.202=0.016
mean1833.600-1833.400=0.200
σ173.365-173.961=-0.596
min1635.000-1637.000=-2.000
max2068.000-2070.000=-2.000
mean4.558-4.591=-0.033
σ0.054-0.289=-0.235
min4.512-4.420=0.092
max4.636-5.103=-0.467

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.179=0.016
σ0.334-0.351=-0.017
min0.905-0.918=-0.013
max1.764-1.763=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.787=-0.002
σ572.366-572.363=0.003
min150.598-150.603=-0.006
max1295.334-1295.332=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean0.529-0.515=0.015
σ0.554-0.532=0.022
min0.249-0.247=0.003
max1.360-1.313=0.047
policies=20
mean1506.282-1506.262=0.020
σ0.253-0.230=0.023
min1506.125-1506.126=-0.000
max1506.660-1506.606=0.054
mean860.000
σ0.000
min860.000
max860.000
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean2.543-2.514=0.028
σ0.028-0.017=0.011
min2.519-2.496=0.023
max2.583-2.536=0.047
policies=200
mean15070.368-15070.314=0.054
σ0.078-0.101=-0.024
min15070.280-15070.182=0.098
max15070.468-15070.406=0.063
mean8600.000
σ0.000
min8600.000
max8600.000
mean1635.000-1637.000=-2.000
σ0.000
min1635.000-1637.000=-2.000
max1635.000-1637.000=-2.000
mean25.500-25.469=0.031
σ0.269-0.102=0.167
min25.282-25.340=-0.058
max25.864-25.585=0.279