基于重构残差保持的深度矩阵分解的多视图聚类
Multi-View Clustering Based on Deep Matrix Factorization with Local Residual Preserving
摘要: 多视图聚类是机器学习中的一个基本问题,近年来,基于矩阵分解用于学习多视图数据获得广泛的关注,并且取得了不错的效果。然而,我们发现现有的多视图聚类方法大多主要关注多视图数据所蕴含的重要属性,即一致性和互补性,而忽略了属于单个视图的特定统计属性。为此,本文提出一个矩阵深度矩阵分解的局部残差保持的多视图聚类算法(LRPDMF),我们通过图嵌入的方式,捕捉到每个视图的特定统计属性,保证每一层的数据重构,相似的数据点具有相似的重建残差。在融合阶段的,我们利用这些学习到的特征,由于不同的视图可能会有不同的权重,我们利用自适应的方式将他们逼近到一个相似低维空间。在不同的数据集上,我们的LRPDMF与现在最先进的方法比较,获得不错的实验效果。
Abstract: Multi-view clustering is a fundamental problem in machine learning, and in recent years, the use of matrix factorization-based for learning multi-view data has gained widespread attention and achieved good results. However, we find that most of the existing multi-view clustering methods mainly focus on the important attributes embedded in multi-view data, i.e., consistency and complementarity, while ignoring the specific statistical properties belonging to individual views. To this end, in this paper, we propose a local residual preserving multi-view clustering algorithm with deep matrix factorization (LRPDMF), where we capture the specific statistical properties of each view by means of graph embedding, which ensures that the data is reconstructed at each layer and similar data points have similar reconstructed residuals. In the fusion phase, we utilize these learned features, and since different views may have different weights, we approximate them to a similar low-dimensional space using an adaptive approach. On different datasets, our LRPDMF obtains good experimental results when compared with the state-of-the-art methods.
文章引用:李家庆. 基于重构残差保持的深度矩阵分解的多视图聚类[J]. 计算机科学与应用, 2024, 14(4): 123-132. https://doi.org/10.12677/csa.2024.144083

参考文献

[1] Liu, J., Wang, C., Gao, J. and Han, J. (2013) Multi-View Clustering via Joint Nonnegative Matrix Factorization. Proceedings of the 2013 SIAM International Conference on Data Mining, Austin, 2-4 May 2013, 252-260. [Google Scholar] [CrossRef
[2] Yang, Y. and Wang, H. (2018) Multi-View Clustering: A Survey. Big Data Mining and Analytics, 1, 83-107. [Google Scholar] [CrossRef
[3] Blum, A. and Mitchell, T. (1998) Combining Labeled and Unlabeled Data with Co-Training. Proceedings of the Eleventh Annual Conference on Computational Learning Theory, New York, 24-26 July 1998, 92-100. [Google Scholar] [CrossRef
[4] Liu, J., Liu, X., Xiong, J., Liao, Q., Zhou, S., Wang, S. and Yang, Y. (2020) Optimal Neighborhood Multiple Kernel Clustering with Adaptive Local Kernels. IEEE Transactions on Knowledge and Data Engineering, 34, 2872-2885.
[5] Tang, C., Liu, X., Zhu, X., Zhu, E. and Gao, W. (2020) CGD: Multi-View Clustering via Cross-View Graph Diffusion. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 5924-5931. [Google Scholar] [CrossRef
[6] Tang, C., Zheng, X., Liu, X., Zhang, W., Zhang, J., Xiong, J. and Wang, L. (2021) Cross-View Locality Preserved Diversity and Consensus Learning for Multi-View Unsupervised Feature Selection. IEEE Transactions on Knowledge and Data Engineering, 34, 4705-4716. [Google Scholar] [CrossRef
[7] Chen, M.S., Huang, L., Wang, C.D., Huang, D. and Lai, J.H. (2021) Relaxed Multi-View Clustering in Latent Embedding Space. Information Fusion, 68, 8-21. [Google Scholar] [CrossRef
[8] Liang, N., Yang, Z., Li, Z., Sun, W. and Xie, S. (2020) Multi-View Clustering by Non-Negative Matrix Factorization with Co-Orthogonal Constraints. Knowledge-Based Systems, 194, Article ID: 105582. [Google Scholar] [CrossRef
[9] Trigeorgis, G., Bousmalis, K., Zafeiriou, S. and Schuller, B.W. (2016) A Deep Matrix Factorization Method for Learning Attribute Representations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 417-429. [Google Scholar] [CrossRef
[10] Zhao, H., Ding, Z. and Fu, Y. (2017) Multi-View Clustering via Deep Matrix Factorization. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, 20-27 February 2024, Vol. 31, 2921-2937. [Google Scholar] [CrossRef
[11] Li, J., Zhou, G., Qiu, Y., Wang, Y., Zhang, Y. and Xie, S. (2020) Deep Graph Regularized Non-Negative Matrix Factorization for Multi-View Clustering. Neurocomputing, 390, 108-116. [Google Scholar] [CrossRef
[12] Ding, C.H., Li, T. and Jordan, M.I. (2008) Convex and Semi-Nonnegative Matrix Factorizations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 45-55. [Google Scholar] [CrossRef
[13] Cui, J., Fu, Y., Huang, C. and Wen, J. (2022) Low-Rank Graph Completion-Based Incomplete Multiview Clustering. IEEE Transactions on Neural Networks and Learning Systems, 1-11. [Google Scholar] [CrossRef
[14] Wen, J., Han, N., Fang, X., Fei, L., Yan, K. and Zhan, S. (2018) Low-Rank Preserving Projection via Graph Regularized Reconstruction. IEEE transactions on Cybernetics, 49, 1279-1291. [Google Scholar] [CrossRef
[15] Wang, J., Tian, F., Yu, H., Liu, C. H., Zhan, K. and Wang, X. (2017) Diverse Non-Negative Matrix Factorization for Multiview Data Representation. IEEE Transactions on Cybernetics, 48, 2620-2632. [Google Scholar] [CrossRef
[16] Xu, W., Liu, X. and Gong, Y. (2003) Document Clustering Based on Non-Negative Matrix Factorization. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval, New York, 28 July-1 August, 2003, 267-273. [Google Scholar] [CrossRef
[17] Wang, C.D., Lai, J.H. and Philip, S.Y. (2015) Multi-View Clustering Based on Belief Propagation. IEEE Transactions on Knowledge and Data Engineering, 28, 1007-1021. [Google Scholar] [CrossRef