快速的分区融合多视图子空间聚类
Fast Partition Fusion Multi-View Subspace Clustering
摘要: 近年来,子空间聚类算法的研究取得了显著进展,其中多视图聚类方法因其能够有效地整合多数据来源信息而成为研究热点。新近提出的基于分区融合的多视图子空间聚类方法通过对每个视图分块进行研究,并设计加权融合机制,显著提升了模型对噪声和视图差异的鲁棒性。然而,该方法仍存在一定的局限性:其一,加权机制中的参数优化容易出现极端取值情况,影响模型稳定性;其二,对自表达系数矩阵施加的非负约束限制了其表示能力;其三,在处理大规模数据集时,部分子问题涉及的计算项过多,导致迭代更新过程效率低下,计算消耗过大。针对上述局限性,本文提出以下创新性改进:首先,通过引入亲和矩阵,有效解除了非负约束的限制,从而显著提升了模型的表达能力;其次,创新性地设计中间变量优化策略,重构计算流程,使算法复杂度降低,大幅提升了运算效率;同时,在保留原有加权参数优势的基础上,修改自适应加权机制,有效避免了参数极端化问题。为验证改进效果,我们在4个标准数据集上进行了系统性实验,实验结果表明,我们的方法不仅有效克服了原方法的局限性,同时在处理大规模数据时展现出更高的计算效率。
Abstract: In recent years, the research of subspace clustering algorithms has made significant progress, among which the multi-view clustering method has become a research hotspot because of its ability to effectively integrate multi-data source information. The newly proposed multi-view subspace clustering method based on partition fusion significantly improves the robustness of the model to noise and view differences by studying each view block and designing a weighted fusion mechanism. However, this method still has certain limitations: first, the parameter optimization in the weighting mechanism is prone to extreme values, affecting the stability of the model; second, the non-negative constraints imposed on the self-expression coefficient matrix limit its representation ability; third, when processing large-scale data sets, the calculation items involved in some sub-problems too much, resulting in inefficiency of the iterative update process and excessive computing consumption. In view of the above limitations, this paper proposes the following innovative improvements: first, by introducing the affinity matrix, the restriction of non-negative constraints is effectively lifted, thus significantly improving the expression ability of the model; second, the innovative design of intermediate variable optimization strategies, reconstructing the calculation process, reducing the complexity of the algorithm, and greatly improving the operation calculate efficiency; at the same time, on the basis of retaining the advantages of the original weighting parameters, the adaptive weighting mechanism is modified, which effectively avoids the problem of parameter extremes. In order to verify the improvement effect, we conducted systematic experiments on four standard data sets. The experimental results showed that our method not only effectively overcame the limitations of the original method, but also showed higher computing efficiency when processing large-scale data.
文章引用:王伟, 唐科威. 快速的分区融合多视图子空间聚类[J]. 应用数学进展, 2025, 14(6): 421-433. https://doi.org/10.12677/aam.2025.146331

参考文献

[1] Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y. and Ma, Y. (2013) Robust Recovery of Subspace Structures by Low-Rank Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 171-184. [Google Scholar] [CrossRef] [PubMed]
[2] Elhamifar, E. and Vidal, R. (2013) Sparse Subspace Clustering: Algorithm, Theory, and Applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2765-2781. [Google Scholar] [CrossRef] [PubMed]
[3] Lu, C., Min, H., Zhao, Z., Zhu, L., Huang, D. and Yan, S. (2012) Robust and Efficient Subspace Segmentation via Least Squares Regression. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y. and Schmid, C., Eds., Computer VisionECCV 2012, Springer, 347-360. [Google Scholar] [CrossRef
[4] Lu, C., Feng, J., Lin, Z., Mei, T. and Yan, S. (2019) Subspace Clustering by Block Diagonal Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 487-501. [Google Scholar] [CrossRef] [PubMed]
[5] Zhou, P., Lu, C., Feng, J., Lin, Z. and Yan, S. (2019) Tensor Low-Rank Representation for Data Recovery and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 41, 1881-1894.
[6] Gao, H., Nie, F., Li, X. and Huang, H. (2015) Multi-View Subspace Clustering. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 7-13 December 2015, 4238-4246. [Google Scholar] [CrossRef
[7] Chen, J., Yang, S., Mao, H. and Fahy, C. (2022) Multiview Subspace Clustering Using Low-Rank Representation. IEEE Transactions on Cybernetics, 52, 12364-12378. [Google Scholar] [CrossRef] [PubMed]
[8] Guo, J., Sun, Y., Gao, J., Hu, Y. and Yin, B. (2022) Rank Consistency Induced Multiview Subspace Clustering via Low-Rank Matrix Factorization. IEEE Transactions on Neural Networks and Learning Systems, 33, 3157-3170. [Google Scholar] [CrossRef] [PubMed]
[9] Cao, X., Zhang, C., Fu, H., Si Liu, and Hua Zhang, (2015) Diversity-Induced Multi-View Subspace Clustering. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 7-12 June 2015, 586-594. [Google Scholar] [CrossRef
[10] Zhang, C., Fu, H., Liu, S., Liu, G. and Cao, X. (2015) Low-Rank Tensor Constrained Multiview Subspace Clustering. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 7-13 December 2015, 1582-1590. [Google Scholar] [CrossRef
[11] Zhang, G., Huang, D. and Wang, C. (2023) Facilitated Low-Rank Multi-View Subspace Clustering. Knowledge-Based Systems, 260, Article ID: 110141. [Google Scholar] [CrossRef
[12] Lv, J., Kang, Z., Wang, B., Ji, L. and Xu, Z. (2021) Multi-view Subspace Clustering via Partition Fusion. Information Sciences, 560, 410-423. [Google Scholar] [CrossRef
[13] Kumar, A., Rai, P. and Daume, H. (2011) Co-Regularized Multi-View Spectral Clustering. Proceedings of the 14th International Conference on Neural Information Processing Systems, Granada, 12-15 December 2011, 1413-1421.
[14] Ng, A., Jordan, M. and Weiss, Y. (2001) On Spectral Clustering: Analysis and an Algorithm. Proceedings of the 14th International Conference on Neural Information Processing Systems, Granada, 12-15 December 2011, 849-856.
[15] De, S. and Virginia, R. (2005) Spectral Clustering with Two Views. Proceedings of the International Conference on Machine Learning, Los Angeles, 15-17 December 2005, 20-27.
[16] Nie, F., Li, J., Li, X., et al. (2016) Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification. Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), New York, 9-15 July 2016, 1881-1887.
[17] Kang, Z., Guo, Z., Huang, S., Wang, S., Chen, W., Su, Y., et al. (2019) Multiple Partitions Aligned Clustering. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, 10-16 August 2019, 2701-2707. [Google Scholar] [CrossRef