线性等式约束广义Lasso问题的算法研究
Algorithm Research on Generalized Lasso Problems with Linear Equality Constraints
摘要: 随着大数据时代的到来，众多研究领域都涉及到优化问题的求解，其中Lasso问题的求解尤其受到学者们的广泛研究。针对Lasso问题的求解，学者们研发出众多算法。随着应用的场景不同以及对数据的要求不同，带有约束的广义Lasso问题逐渐受到人们关注。本文将已有的快速邻近点算法结合半光滑牛顿算法，应用到对一类含线性等式约束的广义Lasso问题进行求解，并在一定的假设条件下证明了该算法的收敛性。最后，通过数值实验证实了该算法的高效性。
Abstract: With the advent of the big data era, many research fields involve solving optimization problems, among which the solution of the Lasso problem has been widely studied by scholars. Scholars have developed numerous algorithms for solving the Lasso problem. As the application scenarios vary and the data requirements differ, the generalized Lasso problem with constraints has gradually attracted attention. This paper combines existing fast proximal point algorithms with a semi-smooth Newton algorithm to solve a class of generalized Lasso problems with linear equality constraints. The convergence of the algorithm is proved under certain assumptions. Finally, the efficiency of the algorithm is verified through numerical experiments.
文章引用：吴娟娟. 线性等式约束广义Lasso问题的算法研究[J]. 运筹与模糊学, 2024, 14(3): 694-706. https://doi.org/10.12677/orf.2024.143306

参考文献

[1] Cristofari, A. (2023) A Decomposition Method for Lasso Problems with Zero-Sum Constraint. European Journal of Operational Research, 306, 358-369. [Google Scholar] [CrossRef] 
[2] Gloor, G.B., Macklaim, J.M., Pawlowsky-Glahn, V. and Egozcue, J.J. (2017) Microbiome Datasets Are Compositional: And This Is Not Optional. Frontiers in Microbiology, 8, Article 2224. [Google Scholar] [CrossRef] [PubMed]
[3] Shi, P., Zhang, A. and Li, H. (2016) Regression Analysis for Microbiome Compositional Data. The Annals of Applied Statistics, 10, 1019-1040. [Google Scholar] [CrossRef] 
[4] Lin, W., Shi, P., Feng, R. and Li, H. (2014) Variable Selection in Regression with Compositional Covariates. Biometrika, 101, 785-797. [Google Scholar] [CrossRef] 
[5] Altenbuchinger, M., Rehberg, T., Zacharias, H.U., Stämmler, F., Dettmer, K., Weber, D., et al. (2016) Reference Point Insensitive Molecular Data Analysis. Bioinformatics, 33, 219-226. [Google Scholar] [CrossRef] [PubMed]
[6] 郦旭东. 复合凸优化的快速邻近点算法[J]. 计算数学, 2020, 42(4): 385-404.
[7] Gaines, B.R., Kim, J. and Zhou, H. (2018) Algorithms for Fitting the Constrained Lasso. Journal of Computational and Graphical Statistics, 27, 861-871. [Google Scholar] [CrossRef] [PubMed]
[8] Deng, Z., Yue, M. and So, A.M. (2020). An Efficient Augmented Lagrangian-Based Method for Linear Equality-Constrained Lasso. ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, 4-8 May 2020, 5760-5764.[CrossRef] 
[9] Jeon, J., Kim, Y., Won, S. and Choi, H. (2020) Primal Path Algorithm for Compositional Data Analysis. Computational Statistics & Data Analysis, 148, Article ID: 106958. [Google Scholar] [CrossRef] 
[10] Tibshirani, R.J. and Taylor, J. (2011) The Solution Path of the Generalized Lasso. The Annals of Statistics, 39, 1335-1371. [Google Scholar] [CrossRef] 
[11] Beck, A. (2017). First-Order Methods in Optimization. Society for Industrial and Applied Mathematics.[CrossRef] 
[12] Rockafellar, R.T. and Wets, R.J.B. (2009) Variational Analysis. Springer Science & Business Media.
[13] Facchinei, F. and Pang, J.S. (2003) Finite-Dimensional Variational Inequalities and Complementarity Problems. Springer. [Google Scholar] [CrossRef] 
[14] Zhang, Y., Zhang, N., Sun, D. and Toh, K. (2018) An Efficient Hessian Based Algorithm for Solving Large-Scale Sparse Group Lasso Problems. Mathematical Programming, 179, 223-263. [Google Scholar] [CrossRef] 
[15] Li, Q. (2012) Conjugate Gradient Type Methods for the Nondifferentiable Convex Minimization. Optimization Letters, 7, 533-545. [Google Scholar] [CrossRef] 
[16] Bertsekas, D. (2015) Convex Optimization Algorithms. Athena Scientific.
[17] Shen, C., Xue, W., Zhang, L. and Wang, B. (2020) An Active-Set Proximal-Newton Algorithm for ℓ1 Regularized Optimization Problems with Box Constraints. Journal of Scientific Computing, 85, Article No. 57. [Google Scholar] [CrossRef] 
[18] Cui, Y., Leng, C. and Sun, D. (2016) Sparse Estimation of High-Dimensional Correlation Matrices. Computational Statistics & Data Analysis, 93, 390-403. [Google Scholar] [CrossRef] 

为你推荐