Compare commits

Home / Compare aa7a7933 .. 1fdfb634

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.000
σ0.055-0.052=0.003
min35.236-35.237=-0.002
max35.417-35.409=0.008
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.002
min0.083-0.077=0.006
max0.090-0.090=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.771=-0.002
σ0.003-0.002=0.001
min23.765-23.768=-0.003
max23.773-23.774=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.067-0.070=-0.003
σ0.001-0.004=-0.003
min0.066-0.067=-0.001
max0.068-0.077=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.487=-0.002
σ0.365-0.365=-0.000
min1755.908-1755.910=-0.002
max1757.070-1757.077=-0.007
mean1651.450-1640.450=11.000
σ642.674-625.620=17.054
min624.000-651.000=-27.000
max2836.000
mean2.339-2.356=-0.016
σ0.068-0.129=-0.062
min2.251-2.250=0.000
max2.480-2.812=-0.332

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.711-324.704=0.007
σ0.047-0.056=-0.009
min324.628-324.605=0.023
max324.744-324.739=0.005
mean2836.000
σ0.000
min2836.000
max2836.000
mean0.433-0.423=0.009
σ0.010-0.001=0.009
min0.425-0.423=0.002
max0.445-0.424=0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.269=0.001
σ0.009-0.008=0.000
min1985.259-1985.259=0.001
max1985.281-1985.281=-0.000
mean2836.000
σ0.000
min2836.000
max2836.000
mean2.643-2.592=0.051
σ0.113-0.067=0.046
min2.541-2.535=0.006
max2.780-2.675=0.105
iters=5
new-facts=6402
prior-facts=1
mean4808.653-4808.858=-0.204
σ7.534-7.683=-0.149
min4804.770-4805.394=-0.623
max4822.120-4822.601=-0.481
mean2836.000
σ0.000
min2836.000
max2836.000
mean9.000-8.824=0.175
σ0.212-0.285=-0.073
min8.661-8.344=0.317
max9.231-9.060=0.171
iters=5
new-facts=6402
prior-facts=6402
mean4996.468-4996.467=0.001
σ0.020-0.018=0.002
min4996.444-4996.449=-0.005
max4996.489-4996.494=-0.005
mean3051.200-3067.400=-16.200
σ225.662-219.865=5.796
min2836.000
max3376.000-3391.000=-15.000
mean8.673-8.683=-0.009
σ0.171-0.165=0.006
min8.491-8.509=-0.017
max8.940-8.879=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-0.980=0.072
σ0.225-0.069=0.156
min0.913-0.916=-0.002
max1.440-1.060=0.380

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.966=0.012
σ574.254-574.255=-0.001
min175.840-175.832=0.008
max1324.359-1324.349=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2836.000
σ0.000
min2836.000
max2836.000
mean0.434-0.429=0.005
σ0.298-0.297=0.001
min0.281-0.279=0.002
max0.881-0.875=0.006
policies=20
mean1758.710-1758.687=0.023
σ0.351-0.353=-0.002
min1758.464-1758.443=0.021
max1759.229-1759.210=0.019
mean820.000
σ0.000
min820.000
max820.000
mean2836.000
σ0.000
min2836.000
max2836.000
mean2.800-2.788=0.011
σ0.009-0.018=-0.009
min2.790-2.770=0.021
max2.811-2.812=-0.001
policies=200
mean17593.394-17593.266=0.128
σ0.638-0.589=0.049
min17592.539-17592.439=0.100
max17593.944-17593.721=0.222
mean8200.000
σ0.000
min8200.000
max8200.000
mean2836.000
σ0.000
min2836.000
max2836.000
mean27.880-27.835=0.045
σ0.355-0.443=-0.088
min27.571-27.348=0.223
max28.340-28.333=0.007