基于监控视频背景建模的一类非凸矩阵优化算法研究
Research on a Class of Nonconvex Matrix Optimization Algorithm Based on Surveillance Video Background Modeling
摘要: 为了实现稳健的低秩–稀疏矩阵分解,本文考虑非凸非光滑优化模型,其中矩阵的秩函数采用奇异值的Capped-l1松弛,矩阵的l0范数采用矩阵的l1范数松弛。首先,给出了适用于矩阵问题的Capped-l1阈值算子。其次,提出了交替方向乘子法求解我们的非凸非光滑矩阵优化模型,并分析了算法的收敛性。最后,通过大量数值实验表明:在有噪声和无噪声的情况下,所提出的算法都能有效、稳健地分解出低秩–稀疏矩阵。并将提出的算法应用于监控视频的前景和背景分离问题,发现所提出的算法对于该问题有良好的性能,这说明该算法能够解决相关实际问题。
Abstract: In order to achieve robust low-rank sparse matrix decomposition, this paper considers a non-convex and nonsmooth optimization model, in which the ranking function of the matrix is relaxed by Capped-l1 regularization of the singular values, and l0 norm of the matrix is relaxed with the l1 norm of the matrix. First, we provide the closed-form thresholding operator for the matrixCapped-l1 function. Secondly, the alternating direction method of multipliers is proposed to solve our nonconvex and nonsmooth optimization model, and the convergence analysis is provided. Finally, a large number of numerical experiments show that the proposed algorithm can effectively and robustly decompose the low-rank and sparse matrices in the case of noise and noise. The proposed algorithm is applied to the background separation problem of surveillance video, and it is indicated that the proposed algorithm has good performance for this problem, which shows that the algorithm can solve the relevant practical problems.
文章引用:贾凯贤, 陈小英, 孟书羽, 程越, 张弦, 彭定涛. 基于监控视频背景建模的一类非凸矩阵优化算法研究[J]. 运筹与模糊学, 2023, 13(4): 2817-2830. https://doi.org/10.12677/ORF.2023.134282

参考文献

[1] Wright, J., Ganesh, A., Rao, S. and Ma, Y. (2009) Robust Principal Component Analysis: Exact Recovery of Cor-rupted Low-Rank Matrices. Advances in Neural Information Processing Systems, 87, 3-56.
[2] Chinh, D. and Hayder, R. (2015) RPCA-KFE: Key Frame Extraction for Video Using Robust Principal Component Analysis. IEEE Transactions on Image Processing, 24, 3742-3753. [Google Scholar] [CrossRef
[3] Moradikia, M. and Samadi, S. (2018) SAR Image Formation and Feature Separation via Low Rank Sparse Decomposition. Iranian Conference on Electrical Engineering (ICEE), Mashhad, 8-10 May 2018, 737-742. [Google Scholar] [CrossRef
[4] He, R., Hu, B.G., Zheng, W.S. and Kong, X.W. (2011) Ro-bust Principal Component Analysis Based on Maximum Correntropy Criterion. IEEE Transactions on Image Pro-cessing, 20, 1485-1494. [Google Scholar] [CrossRef
[5] Yuki, Y., Kensuke, T. and Hiroshi, Y. (2019) Constrained Nonmetric Principal Component Analysis. Behaviormetrika, 46, 313-332. [Google Scholar] [CrossRef
[6] Candes, E.J., Li, X.D., Ma, Y. and Wright, J. (2011) Robust Principle Component Analysis. Journal of Association for Computing Machinery, 58, 1-37. [Google Scholar] [CrossRef
[7] Hu, Y., Zhang, D.B., Ye, J.P., Li, X.L. and He, X.F. (2013) Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2117-2130. [Google Scholar] [CrossRef
[8] Hong, B., Wei, L., Hu, Y., Cai, D. and He, X.F. (2016) Online Robust Principal Component Analysis via Truncated Nuclear Norm Regularization. Neurocomputing, 175, 216-222. [Google Scholar] [CrossRef
[9] Kim, H. and Choe, Y. (2017) Background Subtraction via Truncated Nuclear Norm Minimization. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, Kuala Lumpur, 12-15 December 2017, 447-451. [Google Scholar] [CrossRef
[10] Oh, T.H., Tai, Y.W., Bazin J.C., Kim, H. and Kweon, I.S. (2016) Partial Sum Minimization of Singular Values in Robust PCA: Algorithm and Applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 744-758. [Google Scholar] [CrossRef
[11] Massimo, F. and Holger, R. (2008) Iterative Thresholding Algorithms. Applied and Computational Harmonic Analysis, 25, 187-208. [Google Scholar] [CrossRef
[12] Lin, Z.C., Ganesh, A., Wright, J., Wu, L.Q., Chen, M.M. and Ma, Y. (2009) Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix. Journal of the Marine Biological Association of the UK, 56, 707-722. [Google Scholar] [CrossRef
[13] Kim, M.S. and Choi, D.H. (2000) A New Penalty Pa-rameter Update Rule in the Augmented Lagrange Multiplier Method for Dynamic Response Optimization. KSME International Journal, 14, 1122-1130. [Google Scholar] [CrossRef
[14] Boyd, S., Parikh, N., Chu, E., Peleato, B. and Eckstein, J. (2010) Distributed Optimization and Statistical Learning via Thealternating Direction Method of Multipliers. Foundations and Trends in Machine Learning, 3, 1-122. [Google Scholar] [CrossRef
[15] Fang, E.X., He, B.S., Liu, H. and Yuan, X.M. (2015) Generalized Alternating Direction Method of Multipliers: New Theoretical Insights and Applications. Mathematical Program-ming Computation, 7, 149-187. [Google Scholar] [CrossRef] [PubMed]
[16] Xiao, Y., Chen, L. and Li, D. (2018) A Generalized Alter-nating Direction Method of Multipliers with Semi-Proximal Terms for Convex Composite Conic Programming. Mathematical Programming Computation, 10, 533-555. [Google Scholar] [CrossRef
[17] Peng, D.T., Xiu, N.H. and Yu, J. (2017) S1/2 Regularization Methods and Fixed Point Algorithms for Affine Rank Minimization Problems. Computational Optimization and Applications, 67, 543-569. [Google Scholar] [CrossRef
[18] Peng, D.T., Xiu, N.H. and Yu, J. (2018) Global Optimality Condition and Fixed Point Continuation Algorithm for Non-Lipschitz Lp Regularized Matrix Minimization. Science China Mathematics, 61, 1139-1152. [Google Scholar] [CrossRef
[19] Zhang, T. (2010) Analysis of Multi-Stage Convex Relaxation for Sparse Regularization. Journal of Machine Learning Research, 11, 1081-1107.
[20] Zhang, X. and Peng, D.T. (2022) Solving Constrained Nonsmooth Group Sparse Optimization via Group Capped-l1 Relaxation and Group Smoothing Proximal Gradient Algorithm. Computational Optimization and Applications, 83, 801-844. [Google Scholar] [CrossRef
[21] Zhao, Q., Meng, D.Y., Xu, Z.B., Zuo, W.M. and Zhang, L. (2014) Robust Principal Component Analysis with Complex Noise. Proceedings of the 31st International Confer-ence on Machine Learning, Vol. 32, 55-63.
[22] Gu, S.H., Xie, Q., Meng, D.Y., Zuo, W.M., Feng, X.C. and Zhang, L. (2017) Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision. International Journal of Computer Vision, 121, 183-208. [Google Scholar] [CrossRef
[23] Mackey, L., Talwalkar, A. and Jordan, M.I. (2011) Di-vide-and-Conquer Matrix Factorization. Proceedings of the 24th International Conference on Neural Information Processing Systems NIPS’11, Granada, 12-15 December 2011, 1134-1142.
[24] Li, L.Y., Huang, W.M., Gu, I.Y.H. and Tian, Q. (2004) Statistical Modeling of Complex Backgrounds for Foreground Object Detection. IEEE Trans-actions on Image Processing, 13, 1459-1472. [Google Scholar] [CrossRef