Compare commits

Home / Compare 2bd65c0f .. 335cf48b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.394=-0.005
σ0.046-0.047=-0.000
min70.360-70.363=-0.004
max70.518-70.524=-0.006
mean416.200-417.000=-0.800
σ0.422-0.000=0.422
min416.000-417.000=-1.000
max417.000
mean0.157-0.155=0.002
σ0.004-0.006=-0.002
min0.150-0.147=0.003
max0.164-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.147=-0.003
σ0.003-0.003=0.000
min21.141-21.142=-0.002
max21.150-21.152=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.064-0.061=0.003
σ0.003-0.003=0.000
min0.062-0.057=0.005
max0.071-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=0.000
σ0.362-0.363=-0.001
min1751.825-1751.823=0.002
max1752.999-1752.978=0.020
mean1655.150-1650.750=4.400
σ643.260-626.083=17.178
min634.000-626.000=8.000
max2847.000-2849.000=-2.000
mean2.794-2.811=-0.017
σ0.183-0.161=0.022
min2.425-2.266=0.159
max3.131-3.046=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.129=0.014
σ0.004-0.009=-0.005
min270.136-270.120=0.017
max270.149-270.142=0.007
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean0.376-0.380=-0.004
σ0.003-0.006=-0.003
min0.370-0.372=-0.002
max0.378-0.389=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.604=0.004
σ0.011-0.015=-0.004
min1930.596-1930.581=0.015
max1930.623-1930.619=0.004
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean2.513-2.517=-0.004
σ0.061-0.075=-0.015
min2.441-2.478=-0.037
max2.584-2.652=-0.068
iters=5
new-facts=6402
prior-facts=1
mean4751.338-4750.811=0.527
σ0.893-1.303=-0.411
min4750.769-4749.619=1.150
max4752.920-4752.855=0.065
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean8.797-8.971=-0.174
σ0.529-0.285=0.244
min8.098-8.561=-0.463
max9.361-9.231=0.130
iters=5
new-facts=6402
prior-facts=6402
mean4941.700-4941.765=-0.064
σ0.166-0.013=0.153
min4941.405-4941.753=-0.348
max4941.792-4941.780=0.012
mean3077.000-3028.400=48.600
σ231.353-199.484=31.869
min2847.000-2849.000=-2.000
max3422.000-3334.000=88.000
mean8.582-8.477=0.105
σ0.228-0.120=0.108
min8.344-8.347=-0.004
max8.865-8.652=0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.009=0.045
σ0.127-0.138=-0.011
min0.938-0.940=-0.002
max1.250-1.256=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.376-466.369=0.007
σ575.925-575.920=0.005
min178.407-178.397=0.010
max1330.264-1330.249=0.015
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean0.438-0.442=-0.004
σ0.289-0.301=-0.012
min0.284-0.286=-0.003
max0.871-0.893=-0.022
policies=20
mean1784.355-1784.344=0.010
σ0.364-0.346=0.018
min1784.094-1784.113=-0.018
max1784.889-1784.856=0.033
mean800.000
σ0.000
min800.000
max800.000
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean2.862-2.844=0.018
σ0.012-0.048=-0.036
min2.851-2.774=0.077
max2.879-2.883=-0.004
policies=200
mean17849.966-17849.810=0.155
σ0.481-0.431=0.050
min17849.631-17849.523=0.109
max17850.679-17850.452=0.227
mean8000.000
σ0.000
min8000.000
max8000.000
mean2847.000-2849.000=-2.000
σ0.000
min2847.000-2849.000=-2.000
max2847.000-2849.000=-2.000
mean28.332-28.549=-0.217
σ0.490-0.451=0.038
min27.819-27.997=-0.178
max28.776-28.936=-0.160