Compare commits

Home / Compare f6b8f10c .. ff4ada7c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.372-70.373=-0.001
σ0.059-0.059=-0.000
min70.338-70.331=0.008
max70.537-70.538=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.155-0.157=-0.002
σ0.007-0.004=0.002
min0.148-0.152=-0.004
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.001=0.001
min21.140-21.143=-0.003
max21.148-21.146=0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.064=-0.002
σ0.003-0.002=0.001
min0.057-0.062=-0.005
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.199=0.001
σ0.362-0.363=-0.001
min1751.630-1751.632=-0.002
max1752.791-1752.786=0.005
mean1655.300-1650.650=4.650
σ641.913-623.661=18.252
min620.000-689.000=-69.000
max2775.000-2804.000=-29.000
mean2.799-2.828=-0.029
σ0.193-0.110=0.084
min2.334-2.554=-0.220
max3.143-2.991=0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.907-269.932=-0.025
σ0.008-0.008=-0.000
min269.895-269.920=-0.025
max269.915-269.941=-0.027
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean0.374-0.371=0.003
σ0.004-0.007=-0.003
min0.370-0.365=0.004
max0.381-0.384=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.399-1930.388=0.011
σ0.014-0.019=-0.005
min1930.384-1930.364=0.021
max1930.418-1930.408=0.010
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean2.557-2.523=0.034
σ0.197-0.144=0.053
min2.395-2.402=-0.007
max2.859-2.766=0.093
iters=5
new-facts=6402
prior-facts=1
mean4750.856-4750.915=-0.059
σ0.819-0.783=0.036
min4750.334-4750.476=-0.141
max4752.311-4752.305=0.006
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean8.505-8.194=0.311
σ0.528-0.310=0.218
min7.617-7.866=-0.249
max8.921-8.574=0.347
iters=5
new-facts=6402
prior-facts=6402
mean4941.260-4941.114=0.146
σ0.201-0.363=-0.162
min4940.932-4940.562=0.370
max4941.426-4941.405=0.022
mean3045.800-3059.400=-13.600
σ208.752-319.305=-110.554
min2775.000-2804.000=-29.000
max3324.000-3541.000=-217.000
mean8.602-8.393=0.210
σ0.208-0.030=0.178
min8.362-8.342=0.020
max8.912-8.423=0.489

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.085=-0.021
σ0.170-0.113=0.057
min0.923-0.943=-0.020
max1.345-1.260=0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.942-465.941=0.001
σ575.815-575.830=-0.015
min178.030-178.023=0.007
max1329.664-1329.686=-0.022
mean81.750
σ7.500
min78.000
max93.000
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean0.444-0.442=0.002
σ0.307-0.308=-0.001
min0.289-0.285=0.004
max0.904-0.904=0.000
policies=20
mean1780.498-1780.476=0.022
σ0.334-0.338=-0.004
min1780.260-1780.222=0.038
max1780.988-1780.967=0.021
mean780.000
σ0.000
min780.000
max780.000
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean2.849-2.867=-0.017
σ0.145-0.098=0.047
min2.741-2.766=-0.024
max3.057-3.002=0.056
policies=200
mean17811.515-17811.357=0.158
σ0.437-0.526=-0.089
min17811.149-17810.930=0.219
max17812.149-17812.124=0.025
mean7800.000
σ0.000
min7800.000
max7800.000
mean2775.000-2804.000=-29.000
σ0.000
min2775.000-2804.000=-29.000
max2775.000-2804.000=-29.000
mean27.938-27.831=0.107
σ0.146-0.104=0.041
min27.778-27.757=0.021
max28.117-27.980=0.137