两个二维多参数绝对值优化问题解的等价性
Equivalence of Solutions for Two Two-Dimensional Multi-Parameter Absolute Value Optimization Problems
摘要: 对带稀疏惩罚的最小一乘问题,采用MCP函数来连续松弛l0函数,在二维情况下研究由此得到的两个多参数绝对值优化问题解的等价性。 在简单条件下证明了两个问题具有相同全局最优解和最优值,为进一步研究相应高维问题提供了参考。
Abstract: In this paper, the MCP function is used to continuously relax the l0 function for the least absolute deviation with sparse penalty, and the equivalence of the solutions of the two multi-parameter absolute value optimization problems is studied in two-dimensional space. Under simple conditions, it is proved that the two problems have the same global optimal solution and optimal value, which provides a reference for further study of the corresponding high-dimensional problems.
文章引用:苑文丽, 张弦. 两个二维多参数绝对值优化问题解的等价性[J]. 运筹与模糊学, 2023, 13(2): 859-876. https://doi.org/10.12677/ORF.2023.132089

参考文献

[1] Liang, H., Ding, X., Jakobsson, A., et al. (2022) Sparse Optimization for Nonlinear Group Delay Mode Estimation. The Journal of the Acoustical Society of America, 152, 2187-2203.
https://doi.org/10.1121/10.0014696
[2] Kropp, I., Nejadhashemi, A.P. and Deb, K. (2022) Benefits of Sparse Population Sampling in Multi-Objective Evolutionary Computing for Large-Scale Sparse Optimization Problems. Swarm and Evolutionary Computation, 69, Article ID: 101025.
https://doi.org/10.1016/j.swevo.2021.101025
[3] Ma, L. and Bian, W. (2021) A Simple Neural Network for Sparse Optimization with l1 Regularization. IEEE Transactions on Network Science and Engineering, 8, 3430-3442.
https://doi.org/10.1109/TNSE.2021.3114426
[4] Zhang, C.H. (2010) Nearly Unbiased Variable Selection under Minimax Concave Penalty. The Annals of Statistics, 38, 894-942.
https://doi.org/10.1214/09-AOS729
[5] Bruckstein, A.M., Donoho, D.L. and Elad, M. (2009) From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images. SIAM Review, 51, 34-81.
https://doi.org/10.1137/060657704
[6] Nikolova, M., Ng, M.K. and Tam, C.P. (2010) Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction. IEEE Transactions on Image Process,19, 3073-3088.
https://doi.org/10.1109/TIP.2010.2052275
[7] Wen, B., Chen, X.J. and Pong, T.L. (2017) Linear Convergence of Proximal Gradient Algorithm with Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems. SIAM Journal on Optimization, 27, 124-125.
https://doi.org/10.1137/16M1055323
[8] Davis, G., Mallat, S. and Avellaneda, M. (1997) Adaptive Greedy Approximations. Construc- tive Approximation, 13, 57-98.
https://doi.org/10.1007/BF02678430
[9] Natarajan, B.K. (1995) Sparse Approximate Solutions to Linear Systems. SIAM Journal on Computing, 24, 227-234.
https://doi.org/10.1137/S0097539792240406
[10] Donoho, D.L. (2006) Compressed Sensing. IEEE Transactions on Information Theory, 52, 1289-1306.
https://doi.org/10.1109/TIT.2006.871582
[11] Candes, E. and Tao, T. (2005) Decoding by Linear Programming. IEEE Transactions on Information Theory, 51, 4203-4215.
https://doi.org/10.1109/TIT.2005.858979
[12] Donoho, D.L. (2006) Compressed Sensing. IEEE Transactions on Information Theory, 52, 1289-1306.
https://doi.org/10.1109/TIT.2006.871582
[13] 刘浩洋, 户将, 李勇锋, 文再文. 最优化: 建模、算法与理论[M]. 北京: 高教出版社, 2021.
[14] Zhang, C.H. and Huang, J. (2008) The Sparsity and Bias of the Lasso Selection in High-Dimensional Linear Regression. The Annals of Statistics, 36, 1567-1594.
https://doi.org/10.1214/07-AOS520
[15] Fan, J.Q. and Peng, H. (2004) Nonconcave Penalized Likelihood with a Diverging Number of Parameters. The Annals of Statistics, 32, 928-961.
https://doi.org/10.1214/009053604000000256
[16] Liu, H.C., Yao, T., Li, R.Z., et al. (2017) Folded Concave Penalized Sparse Linear Regression: Sparsity, Statistical Performance and Algorithmic Theory for Local Solution. Mathematical Programming, 166, 207-240.
https://doi.org/10.1007/s10107-017-1114-y
[17] Fan, J.Q. and Li, R.Z. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360.
https://doi.org/10.1198/016214501753382273
[18] Bian, W. and Chen, X.J. (2020) A Smoothing Proximal Gradient Algorithm for Nonsmooth Convex Regression with Cardinalty Penalty. SIAM Journal on Numerical Analysis, 58, 858- 883.
https://doi.org/10.1137/18M1186009
[19] 罗孝敏, 彭定涛. 两个绝对值优化问题解的等价性[J]. 重庆工商大学学报: 自然科学版, 2020, 37(5): 37-42.
[20] Peng, D.T. and Chen, X.J. (2020) Computation of Second-Order Directional Stationary Points for Group Sparse Optimization. Optimization Methods and Software, 35, 348-376.
https://doi.org/10.1080/10556788.2019.1684492
[21] 彭定涛, 唐琦, 张弦. 组稀疏优化问题精确连续Capped-L1松弛[J]. 数学学报, 2022,65(2):243-262.
[22] Zhang, X. and Peng, D.T. (2022) Solving Constrained Nonsmooth Group Sparse Optimization via Group Capped-l1 Relaxation and Group Smoothing Proximal Gradient Algorithm. Computational Optimization and Applications, 83, 801-844.
https://doi.org/10.1007/s10589-022-00419-2
[23] 陈纪主, 於崇华, 金路. 数学分析. 下册[M]. 北京: 高等教育出版社, 2004.