Compare commits

Home / Compare 4c08c188 .. d8aff9db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.392=0.003
σ0.043-0.046=-0.003
min70.370-70.364=0.006
max70.514-70.520=-0.006
mean412.000-417.400=-5.400
σ0.000-0.516=-0.516
min412.000-417.000=-5.000
max412.000-418.000=-6.000
mean0.155-0.154=0.001
σ0.005-0.005=0.000
min0.149-0.146=0.004
max0.162-0.161=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.148=-0.004
σ0.003-0.012=-0.009
min21.140-21.140=0.000
max21.148-21.181=-0.033
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.062-0.062=-0.001
σ0.004-0.004=-0.001
min0.058-0.057=0.001
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.699=-0.001
σ0.362-0.361=0.001
min1752.124-1752.126=-0.002
max1753.288-1753.279=0.010
mean1653.750-1657.750=-4.000
σ644.236-626.511=17.726
min630.000-621.000=9.000
max2859.000-2768.000=91.000
mean2.767-2.721=0.046
σ0.162-0.237=-0.074
min2.289-2.166=0.123
max2.916-3.013=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.596-270.607=-0.010
σ0.015-0.004=0.011
min270.580-270.602=-0.022
max270.615-270.610=0.005
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean0.381-0.379=0.002
σ0.005-0.008=-0.003
min0.376-0.372=0.004
max0.389-0.393=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1931.047=-0.005
σ0.006-0.008=-0.002
min1931.033-1931.037=-0.004
max1931.048-1931.057=-0.009
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean3.009-2.915=0.095
σ0.052-0.144=-0.092
min2.960-2.708=0.252
max3.074-3.081=-0.007
iters=5
new-facts=6402
prior-facts=1
mean4751.820-4751.721=0.099
σ0.843-0.894=-0.051
min4751.356-4751.261=0.095
max4753.321-4753.319=0.002
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean8.144-8.729=-0.585
σ0.423-0.292=0.131
min7.693-8.300=-0.607
max8.627-9.068=-0.441
iters=5
new-facts=6402
prior-facts=6402
mean4942.151-4942.227=-0.075
σ0.166-0.013=0.153
min4941.857-4942.212=-0.355
max4942.241-4942.237=0.004
mean3085.400-2955.000=130.400
σ301.803-256.102=45.702
min2859.000-2768.000=91.000
max3550.000-3362.000=188.000
mean8.464-8.430=0.033
σ0.199-0.040=0.159
min8.311-8.378=-0.067
max8.811-8.487=0.324

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.966-1.126=-0.159
σ0.056-0.264=-0.208
min0.931-0.934=-0.003
max1.066-1.477=-0.411

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.225-467.212=0.013
σ575.927-575.943=-0.016
min179.254-179.228=0.026
max1331.116-1331.127=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean0.438-0.490=-0.051
σ0.300-0.413=-0.113
min0.281-0.282=-0.002
max0.888-1.109=-0.221
policies=20
mean1792.802-1792.627=0.176
σ0.371-0.365=0.006
min1792.548-1792.374=0.174
max1793.351-1793.170=0.182
mean820.000
σ0.000
min820.000
max820.000
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean2.874-2.786=0.088
σ0.003-0.008=-0.005
min2.871-2.778=0.093
max2.878-2.796=0.081
policies=200
mean17933.841-17932.982=0.859
σ0.776-0.431=0.345
min17932.755-17932.683=0.072
max17934.438-17933.620=0.817
mean8200.000
σ0.000
min8200.000
max8200.000
mean2859.000-2768.000=91.000
σ0.000
min2859.000-2768.000=91.000
max2859.000-2768.000=91.000
mean28.528-28.067=0.460
σ0.512-0.167=0.345
min28.013-27.887=0.125
max28.987-28.285=0.702