Compare commits

Home / Compare f411b51e .. dc43ab5e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.160-35.143=0.017
σ0.053-0.051=0.002
min35.137-35.111=0.026
max35.309-35.285=0.025
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.081-0.084=-0.002
σ0.004-0.006=-0.001
min0.076-0.076=0.000
max0.089-0.093=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.756-23.740=0.016
σ0.004-0.003=0.000
min23.749-23.734=0.016
max23.762-23.746=0.016
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.069-0.066=0.003
σ0.004-0.002=0.002
min0.066-0.064=0.002
max0.077-0.072=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.354-1759.325=-2.972
σ0.365-0.366=-0.001
min1755.778-1758.751=-2.974
max1756.938-1759.913=-2.975
mean1657.950-1643.000=14.950
σ644.905-615.503=29.402
min631.000-622.000=9.000
max2852.000-2484.000=368.000
mean2.330-2.332=-0.003
σ0.080-0.079=0.001
min2.240-2.202=0.038
max2.524-2.556=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.570-327.471=-2.901
σ0.046-0.060=-0.013
min324.488-327.364=-2.876
max324.597-327.502=-2.905
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean0.427-0.431=-0.004
σ0.010-0.007=0.004
min0.421-0.427=-0.006
max0.445-0.443=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.128-1988.036=-2.908
σ0.014-0.008=0.005
min1985.108-1988.026=-2.918
max1985.143-1988.047=-2.904
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean2.617-2.622=-0.005
σ0.076-0.077=-0.002
min2.548-2.541=0.008
max2.704-2.714=-0.011
iters=5
new-facts=6402
prior-facts=1
mean4808.747-4811.647=-2.900
σ7.706-7.680=0.026
min4805.278-4808.147=-2.869
max4822.532-4825.386=-2.853
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean9.073-8.868=0.205
σ0.156-0.173=-0.016
min8.850-8.620=0.231
max9.277-9.079=0.198
iters=5
new-facts=6402
prior-facts=6402
mean4996.325-4999.103=-2.778
σ0.022-0.182=-0.161
min4996.297-4998.904=-2.607
max4996.350-4999.269=-2.919
mean3073.000-2952.200=120.800
σ302.361-253.307=49.054
min2852.000-2634.000=218.000
max3539.000-3298.000=241.000
mean8.575-8.560=0.015
σ0.190-0.058=0.132
min8.422-8.498=-0.077
max8.846-8.640=0.207

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-1.590=-0.619
σ0.142-0.291=-0.149
min0.901-1.085=-0.184
max1.225-1.772=-0.546

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-468.862=-5.913
σ574.237-574.236=0.001
min175.821-181.738=-5.917
max1324.304-1330.215=-5.912
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean0.430-0.562=-0.133
σ0.301-0.553=-0.253
min0.276-0.283=-0.007
max0.881-1.392=-0.512
policies=20
mean1758.575-1817.788=-59.213
σ0.336-0.393=-0.056
min1758.349-1817.508=-59.159
max1759.075-1818.365=-59.290
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean2.777-2.817=-0.040
σ0.011-0.015=-0.004
min2.767-2.797=-0.031
max2.791-2.833=-0.041
policies=200
mean17592.041-18185.181=-593.140
σ0.440-0.490=-0.050
min17591.436-18184.767=-593.331
max17592.384-18185.879=-593.495
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2852.000-2484.000=368.000
σ0.000
min2852.000-2484.000=368.000
max2852.000-2484.000=368.000
mean27.823-28.474=-0.651
σ0.389-0.080=0.308
min27.430-28.401=-0.971
max28.264-28.551=-0.287