Compare commits

Home / Compare 505ea04b .. f89de287

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.244=0.018
σ0.052-0.053=-0.000
min35.232-35.220=0.012
max35.409-35.393=0.016
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.081-0.085=-0.004
σ0.005-0.004=0.001
min0.076-0.081=-0.005
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.001
σ0.003-0.004=-0.000
min23.766-23.764=0.002
max23.774-23.778=-0.004
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.068-0.069=-0.002
σ0.003-0.004=-0.001
min0.063-0.066=-0.003
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.484=0.001
σ0.364-0.364=0.000
min1755.911-1755.908=0.003
max1757.073-1757.075=-0.002
mean1652.050-1655.200=-3.150
σ644.406-642.785=1.621
min626.000-628.000=-2.000
max2841.000-2840.000=1.000
mean2.351-2.326=0.025
σ0.073-0.078=-0.006
min2.256-2.193=0.063
max2.519-2.542=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.711-324.702=0.009
σ0.040-0.055=-0.016
min324.640-324.603=0.037
max324.736-324.731=0.005
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean0.425-0.425=-0.000
σ0.001-0.002=-0.001
min0.423-0.423=0.000
max0.427-0.428=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.272-1985.258=0.014
σ0.008-0.020=-0.011
min1985.261-1985.226=0.035
max1985.283-1985.276=0.007
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean2.622-2.564=0.058
σ0.059-0.048=0.011
min2.570-2.512=0.058
max2.690-2.643=0.047
iters=5
new-facts=6402
prior-facts=1
mean4808.891-4808.910=-0.019
σ7.664-7.645=0.018
min4805.338-4805.327=0.011
max4822.599-4822.585=0.014
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean9.057-8.465=0.592
σ0.364-0.605=-0.241
min8.567-7.721=0.847
max9.382-9.051=0.330
iters=5
new-facts=6402
prior-facts=6402
mean4996.404-4996.412=-0.008
σ0.141-0.141=0.001
min4996.153-4996.162=-0.009
max4996.486-4996.493=-0.007
mean3072.600-3052.200=20.400
σ231.267-222.074=9.193
min2841.000-2840.000=1.000
max3417.000-3371.000=46.000
mean8.695-8.666=0.029
σ0.218-0.200=0.018
min8.445-8.503=-0.057
max8.941-8.991=-0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.954-1.040=-0.086
σ0.050-0.125=-0.075
min0.919-0.918=0.001
max1.039-1.236=-0.197

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.949-462.956=-0.007
σ574.246-574.252=-0.006
min175.822-175.823=-0.001
max1324.319-1324.335=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean0.433-0.432=0.001
σ0.297-0.301=-0.004
min0.281-0.279=0.002
max0.878-0.884=-0.005
policies=20
mean1758.569-1758.537=0.031
σ0.351-0.370=-0.020
min1758.333-1758.299=0.034
max1759.088-1759.089=-0.000
mean820.000
σ0.000
min820.000
max820.000
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean2.790-2.782=0.008
σ0.018-0.006=0.011
min2.768-2.775=-0.007
max2.808-2.790=0.018
policies=200
mean17592.471-17592.374=0.097
σ0.377-0.599=-0.222
min17592.116-17592.026=0.090
max17593.002-17593.269=-0.267
mean8200.000
σ0.000
min8200.000
max8200.000
mean2841.000-2840.000=1.000
σ0.000
min2841.000-2840.000=1.000
max2841.000-2840.000=1.000
mean27.985-27.895=0.090
σ0.380-0.329=0.051
min27.527-27.590=-0.063
max28.438-28.286=0.152