Compare commits

Home / Compare 3f6ea8e3 .. 2ccd9b01

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.053-0.055=-0.001
min35.235-35.229=0.006
max35.413-35.416=-0.003
mean415.700-413.900=1.800
σ0.483-0.316=0.167
min415.000-413.000=2.000
max416.000-414.000=2.000
mean0.085-0.083=0.002
σ0.003-0.004=-0.000
min0.083-0.077=0.006
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=0.000
min23.767-23.765=0.002
max23.775-23.774=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.068-0.068=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=0.000
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.485=-0.014
σ0.366-0.364=0.002
min1755.894-1755.910=-0.016
max1757.064-1757.068=-0.003
mean1648.450-1656.750=-8.300
σ639.307-636.909=2.398
min627.000-678.000=-51.000
max2824.000-2845.000=-21.000
mean2.324-2.341=-0.017
σ0.083-0.077=0.005
min2.234-2.256=-0.022
max2.505-2.506=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.704-324.715=-0.011
σ0.029-0.035=-0.005
min324.653-324.654=-0.001
max324.726-324.736=-0.010
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean0.423-0.425=-0.002
σ0.001-0.002=-0.000
min0.421-0.423=-0.002
max0.425-0.427=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.246-1985.264=-0.017
σ0.014-0.014=0.000
min1985.227-1985.247=-0.020
max1985.258-1985.277=-0.019
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean2.657-2.600=0.057
σ0.097-0.080=0.017
min2.548-2.533=0.015
max2.785-2.737=0.048
iters=5
new-facts=6402
prior-facts=1
mean4808.865-4808.763=0.101
σ7.688-7.786=-0.098
min4805.341-4804.829=0.511
max4822.617-4822.683=-0.066
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean8.880-8.671=0.209
σ0.245-0.571=-0.326
min8.467-7.801=0.666
max9.116-9.223=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean4996.392-4996.460=-0.069
σ0.138-0.017=0.121
min4996.145-4996.442=-0.297
max4996.464-4996.484=-0.021
mean3055.600-3067.000=-11.400
σ302.639-296.500=6.139
min2824.000-2845.000=-21.000
max3523.000-3525.000=-2.000
mean8.446-8.568=-0.122
σ0.158-0.138=0.020
min8.277-8.454=-0.177
max8.694-8.754=-0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-0.995=-0.019
σ0.069-0.132=-0.062
min0.916-0.908=0.008
max1.053-1.209=-0.156

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.954-462.972=-0.018
σ574.252-574.253=-0.002
min175.817-175.834=-0.017
max1324.331-1324.352=-0.021
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean0.419-0.434=-0.014
σ0.294-0.298=-0.004
min0.263-0.284=-0.021
max0.859-0.880=-0.020
policies=20
mean1758.485-1758.695=-0.210
σ0.355-0.348=0.007
min1758.249-1758.463=-0.214
max1759.012-1759.210=-0.199
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean2.797-2.790=0.007
σ0.008-0.010=-0.002
min2.787-2.780=0.007
max2.807-2.804=0.003
policies=200
mean17590.954-17593.367=-2.412
σ0.654-0.522=0.132
min17589.997-17592.702=-2.705
max17591.376-17593.869=-2.493
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean27.845-27.895=-0.050
σ0.348-0.317=0.031
min27.541-27.485=0.056
max28.198-28.235=-0.037