一类带变换 1 罚函数的正则化问题的强度量次正则研究
Study on the Strong Metric Subregularity for a Class of Regularization Problems with Transformed 1 Penalty Function
DOI: 10.12677/pm.2024.145186, PDF,    科研立项经费支持
作者: 周金玉:重庆交通大学数学与统计学院,重庆;李明华:重庆文理学院数学与大数据学院,重庆
关键词: 变换罚函数邻近(极限)次微分图像导数强度量次正则Transformed Penalty Function Proximal (Limiting) Subdifferentials Graphical Derivative Strong Metric Subregularity
摘要: 本文研究一类带变换ℓ1罚函数的正则化问题,该模型的目标函数由损失函数和变换ℓ1罚函数两部分组成,其中损失函数是二次可微函数,变换ℓ1罚函数是一个非凸函数。本文首先研究变换ℓ1罚函数的邻近次微分和极限次微分,然后利用变换ℓ1罚函数的次微分表达式和集值映射的图像导数工具得到了该类问题目标函数的次微分的图像导数,最后利用该图像导数表达式分别建立了该正则化问题的强度量次正则的一个充分条件和充要条件。
Abstract: This paper studies the regularization problem for a class of penalty functions with transformedℓ1. The objective function of the model consists of two parts: the loss function and the transformedℓ1penalty function, where the loss function is a quadratic differentiable function and the transformedℓ1penalty function is a nonconvex function. This article first studies the proximal subdifferentials and limiting subdifferentials of the transformedℓ1penalty function. Then, by the subdifferential expression of the transformedℓ1penalty function and graphical derivative tool for set-value mapping, we obtain the graphical derivative of the subdifferentials of the objective function. Finally, using the graphical derivative expression, we establish a sufficient condition, a necessary and sufficient condition of the strong metric subregularity for the regularization problem.
文章引用:周金玉, 李明华. 一类带变换 1 罚函数的正则化问题的强度量次正则研究[J]. 理论数学, 2024, 14(5): 293-306. https://doi.org/10.12677/pm.2024.145186

参考文献

[1] Nikolova, M. (2001) Local Strong Homogeneity of a Regularized Estimator. SIAM Journal on Applied Mathematics, 61, 633-658. [Google Scholar] [CrossRef
[2] Donoho, D.L. (2006) Compressed Sensing. IEEE Transactions on Information Theory, 52, 1289-1306. [Google Scholar] [CrossRef
[3] Fan, J. and Li, R. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360. [Google Scholar] [CrossRef
[4] Lv, J. and Fan, Y. (2009) A Unified Approach to Model Selection and Sparse Recovery Using Regularized Least Squares. The Annals of Statistics, 37, 3498-3528. [Google Scholar] [CrossRef
[5] Zhang, S. and Xin, J. (2014) Minimization of Transformed Penalty: Theory, Difference of Convex Function Algorithm, and Robust Application in Compressed Sensing. Mathmatical Programming, 169, 307-336. [Google Scholar] [CrossRef
[6] Zhang, S. and Xin, J. (2016) Minimization of Transformed Penalty: Closed Form Representation and Iterative Thresholding Algorithms. Communications in Mathematical Sciences, 15, 511-537. [Google Scholar] [CrossRef
[7] Ahn, M., Pang, J.-S. and Xin, J. (2017) Difference-of-Convex Learning: Directional Stationarity, Optimality, and Sparsity. SIAM Journal on Optimization, 27, 1637-1665. [Google Scholar] [CrossRef
[8] Zhang, S., Yin, P.H. and Xin, J. (2017) Transformed Schatten-1 Iterative Thresholding Algorithms for Low Rank Matrix Completion. Communications in Mathematical Sciences, 15, 839-862. [Google Scholar] [CrossRef
[9] Guo, L., Li, J. and Liu, Y. (2018) Stochastic Collocation Methods via Minimisation of the Transformed-Penalty. East Asian Journal on Applied Mathematics, 8, 566-585. [Google Scholar] [CrossRef
[10] Ma, R.R., Miao, J.Y., Niu, L.F., et al. (2019) Transformed Regularization for Learning Sparse Deep Neural Networks. Neural Networks, 119, 286-298. [Google Scholar] [CrossRef] [PubMed]
[11] Bello-Cruz, Y., Li, G.Y. and Nghia, T.T.A. (2022) Quadratic Growth Conditions and Uniqueness of Optimal Solution to Lasso. Journal of Optimization Theory and Applications, 194, 167-190. [Google Scholar] [CrossRef
[12] Li, M.H., Meng, K.W. and Yang, X.Q. (2023) Variational Analysis of Kurdyka-Łojasiewicz Property, Exponent and Modulus.
https://arxiv.org/abs/2308.15760v2
[13] Chieu, N.H. and Hien, L.V. (2017) Computation of Graphical Derivative for a Class of Normal Cone Mappings under a Very Weak Condition. SIAM Journal on Optimization, 27, 190-204. [Google Scholar] [CrossRef
[14] Gfrerer, H. and Mordukhovich, B.S. (2019) Second-Order Variational Analysis of Parametric Constraint and Variational Systems. SIAM Journal on Optimization, 29, 423-453. [Google Scholar] [CrossRef
[15] Henrion, R., Kruger, A.Y. and Outrata, J.V. (2013) Some Remarks on Stability of Generalized Equations. Journal of Optimization Theory and Applications, 159, 681-697. [Google Scholar] [CrossRef
[16] Dontchev, A.L. and Rockafellar, R.T. (2009) Implicit Functions and Solution Mappings. A View from Variational Analysis. Springer, New York. [Google Scholar] [CrossRef
[17] Zheng, X.Y. and Ng, K.F. (2007) Metric Subregularity and Constraint Qualifications for Convex Generalized Equations in Banach Spaces. SIAM Journal on Optimization, 18, 437-460. [Google Scholar] [CrossRef
[18] Chieu, N.H., Hien, L.V., Nghia, T.T.A., et al. (2021) Quadratic Growth and Strong Metric Subregularity of the Subdifferential via Subgradient Graphical Derivative. SIAM Journal on Optimization, 31, 545-568. [Google Scholar] [CrossRef
[19] Cibulka, R., Dontchev, A.L. and Kruger, A.Y. (2017) Strong Metric Subregularity of Mappings in Variational Analysis and Optimization. Journal of Mathematical Analysis and Applications, 457, 1247-1282. [Google Scholar] [CrossRef
[20] Aragón Artacho, F.J. and Geoffroy, M.H. (2013) Metric Subregularity of the Convex Subdifferential in Banach Spaces. Journal of Nonlinear and Convex Analysis, 15, 35-47.
[21] Drusvyatskiy, D., Mordukhovich, B.S. and Nghia, T.T.A. (2014) Second-Order Growth, Tilt Stability, and Metric Regularity of the Subdifferential. Journal of Convex Analysis, 21, 1165-1192.
[22] Chieu, N.H., Trang, N.T.Q. and Tuan, H.A. (2022) Quadratic Growth and Strong Metric Subregularity of the Subdifferential for a Class of Non-Prox-Regular Functions. Journal of Optimization Theory and Applications, 194, 1081-1106. [Google Scholar] [CrossRef
[23] Clarke, F.H., Ledyaev, Y.S., Stern, R.J., et al. (1998) Nonsmooth Analysis and Control Theory. Springer, New York.
[24] Rockafellar, R.T. and Wets, R.J.-B. (2009) Variational Analysis. Springer, Heidelberg.