Compare commits

Home / Compare e63fc585 .. d43a5a1d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.054-0.053=0.000
min35.233-35.237=-0.004
max35.415-35.415=0.001
mean414.800-414.000=0.800
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.085-0.086=-0.001
σ0.004-0.004=-0.001
min0.082-0.082=-0.000
max0.093-0.094=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.002=-0.000
min23.767-23.766=0.001
max23.774-23.774=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.069-0.068=0.001
σ0.004-0.003=0.000
min0.066-0.065=0.000
max0.075-0.075=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.484=0.001
σ0.364-0.364=0.000
min1755.910-1755.914=-0.003
max1757.071-1757.071=0.000
mean1652.350-1647.500=4.850
σ639.953-642.368=-2.415
min627.000-669.000=-42.000
max2829.000-2728.000=101.000
mean2.380-2.406=-0.026
σ0.145-0.147=-0.002
min2.252-2.233=0.019
max2.904-2.792=0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.718-324.695=0.022
σ0.030-0.050=-0.020
min324.666-324.609=0.057
max324.742-324.732=0.011
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean0.424-0.427=-0.003
σ0.003-0.006=-0.003
min0.422-0.423=-0.001
max0.429-0.437=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.247=0.007
σ0.016-0.019=-0.003
min1985.231-1985.221=0.011
max1985.271-1985.266=0.005
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean2.641-2.661=-0.020
σ0.119-0.147=-0.028
min2.555-2.560=-0.005
max2.830-2.898=-0.068
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.868=-0.011
σ7.671-7.636=0.035
min4805.385-4805.365=0.019
max4822.580-4822.528=0.052
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean8.828-8.648=0.181
σ0.122-0.206=-0.084
min8.650-8.430=0.220
max8.988-8.870=0.118
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.466=-0.007
σ0.025-0.015=0.009
min4996.421-4996.449=-0.028
max4996.482-4996.482=0.001
mean3063.400-3030.800=32.600
σ306.458-355.549=-49.091
min2829.000-2728.000=101.000
max3537.000-3556.000=-19.000
mean8.495-8.633=-0.138
σ0.126-0.209=-0.083
min8.334-8.459=-0.125
max8.682-8.951=-0.269

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.032=-0.029
σ0.137-0.129=0.008
min0.913-0.914=-0.000
max1.227-1.229=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.966=0.011
σ574.251-574.280=-0.029
min175.841-175.818=0.023
max1324.353-1324.386=-0.033
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean0.431-0.556=-0.125
σ0.297-0.567=-0.270
min0.281-0.271=0.009
max0.877-1.407=-0.530
policies=20
mean1758.718-1758.534=0.184
σ0.348-0.336=0.012
min1758.481-1758.311=0.170
max1759.232-1759.031=0.201
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean2.789-2.712=0.077
σ0.014-0.016=-0.002
min2.776-2.692=0.084
max2.809-2.731=0.078
policies=200
mean17593.218-17592.470=0.748
σ0.708-0.409=0.299
min17592.186-17592.198=-0.011
max17593.692-17593.075=0.617
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2728.000=101.000
σ0.000
min2829.000-2728.000=101.000
max2829.000-2728.000=101.000
mean27.846-27.539=0.308
σ0.396-0.348=0.048
min27.499-27.262=0.236
max28.281-28.023=0.258