Compare commits

Home / Compare 6353ce35 .. c1ed5f16

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.730=-0.000
σ0.048-0.046=0.002
min70.700-70.702=-0.002
max70.865-70.860=0.006
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.160-0.159=0.001
σ0.003-0.004=-0.000
min0.156-0.154=0.002
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.003-0.003=-0.000
min21.441-21.441=0.000
max21.450-21.450=0.001
mean416.000-412.800=3.200
σ0.000-0.422=-0.422
min416.000-412.000=4.000
max416.000-413.000=3.000
mean0.065-0.066=-0.000
σ0.002-0.002=0.000
min0.063-0.064=-0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1716.605=37.922
σ0.358-169.603=-169.244
min1753.962-996.044=757.918
max1755.089-1755.116=-0.026
mean1646.600-1615.650=30.950
σ626.941-592.039=34.902
min629.000-637.000=-8.000
max2858.000-2417.000=441.000
mean2.812-2.727=0.085
σ0.149-0.362=-0.213
min2.399-1.424=0.975
max2.989-3.149=-0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.605=0.004
σ0.009-0.006=0.003
min273.595-273.598=-0.003
max273.619-273.615=0.004
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean0.385-0.384=0.001
σ0.003-0.004=-0.000
min0.382-0.380=0.001
max0.391-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.991-1933.998=-0.007
σ0.012-0.006=0.007
min1933.975-1933.994=-0.018
max1934.009-1934.008=0.001
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean3.049-2.982=0.067
σ0.052-0.167=-0.115
min3.000-2.706=0.294
max3.111-3.131=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4754.719-4754.802=-0.083
σ0.945-0.843=0.102
min4754.203-4754.366=-0.163
max4756.402-4756.305=0.097
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean8.950-8.296=0.654
σ0.391-0.391=0.000
min8.341-7.845=0.496
max9.342-8.705=0.637
iters=5
new-facts=6402
prior-facts=6402
mean4945.152-4945.223=-0.071
σ0.165-0.014=0.151
min4944.858-4945.202=-0.344
max4945.241-4945.238=0.003
mean3032.200-2902.400=129.800
σ190.966-408.551=-217.584
min2858.000-2417.000=441.000
max3321.000-3456.000=-135.000
mean8.511-8.440=0.071
σ0.093-0.072=0.021
min8.419-8.356=0.063
max8.647-8.519=0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.849=-0.827
σ0.145-0.060=0.085
min0.910-1.798=-0.888
max1.258-1.920=-0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-472.830=0.012
σ574.927-574.930=-0.003
min185.367-185.364=0.003
max1335.233-1335.226=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean0.449-0.585=-0.136
σ0.303-0.597=-0.294
min0.295-0.283=0.012
max0.904-1.481=-0.577
policies=20
mean1854.004-1853.967=0.037
σ0.367-0.385=-0.017
min1853.738-1853.702=0.036
max1854.538-1854.533=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean2.959-2.871=0.088
σ0.011-0.018=-0.007
min2.946-2.848=0.098
max2.973-2.890=0.083
policies=200
mean18546.693-18546.707=-0.014
σ0.490-0.474=0.016
min18546.407-18546.419=-0.012
max18547.424-18547.416=0.008
mean8400.000
σ0.000
min8400.000
max8400.000
mean2858.000-2417.000=441.000
σ0.000
min2858.000-2417.000=441.000
max2858.000-2417.000=441.000
mean29.189-28.840=0.348
σ0.440-0.102=0.338
min28.881-28.753=0.128
max29.840-28.950=0.890