基于核相似性的模糊多核最小二乘支持向量机
Kernel Similarity-Based Fuzzy Multi-Kernel Least Squares Support Vector Machine
DOI: 10.12677/HJDM.2022.122014, PDF,    国家自然科学基金支持
作者: 宋菲菲, 何 强*, 王恒友, 张长伦, 陈琳琳:北京建筑大学理学院,北京;北京建筑大学大数据建模理论与技术研究所,北京
关键词: 最小二乘支持向量机隶属度多核学习核相似性LSSVM Membership Multi-Kernel Learning Kernel Similarity
摘要: 最小二乘支持向量机(Least Squares Support Vector Machine, LSSVM)由于同等对待所有样例,从而易受噪声干扰,影响分类性能。模糊LSSVM的提出一定程度上克服了以上问题。本文给出了一种新的样例隶属度计算方法,其在特征空间中,利用每一样例与其他样例核相似性获得隶属度,并将其应用于模糊多核LSSVM (Fuzzy Multi-Kernel LSSVM, FMK-LSSVM),得到具有强鲁棒性的基于核相似性的模糊多核LSSVM。实验结果验证该方法的可行性与有效性。
Abstract: Least squares support vector machine (LSSVM) is vulnerable to noise and affects the classification performance because it treats all samples equally. Fuzzy LSSVM overcomes the above problems by introducing membership. In this paper, we develop a new method to compute membership. In the feature space, the membership degree is obtained by using the kernel similarity between each sample and other samples, and applied to fuzzy multi-kernel LSSVM (FMK-LSSVM) to obtain a strong robust FMK-LSSVM. Experimental results verify the feasibility and effectiveness of this method.
文章引用:宋菲菲, 何强, 王恒友, 张长伦, 陈琳琳. 基于核相似性的模糊多核最小二乘支持向量机[J]. 数据挖掘, 2022, 12(2): 123-132. https://doi.org/10.12677/HJDM.2022.122014

参考文献

[1] Cortes, C. and Vapnik, V. (1995) Support-Vector Networks. Machine Learning, 20, 273-297. [Google Scholar] [CrossRef
[2] Vapnik, V. (1998) Statistical Learning Theory. Wiley, New York.
[3] Suykens, J.A.K. and Vandewalle, J. (1999) Least Squares Support Vector Machine Classifiers. Neural Pro-cessing Letters, 9, 293-300. [Google Scholar] [CrossRef
[4] Zhao, Y.G., Song, Z., Zheng, F. and Shao, L. (2018) Learning a Multiple Kernel Similarity Metric for Kinship Verification. Information Sciences, 430-431, 247-260. [Google Scholar] [CrossRef
[5] Mehmet, G. and Ethem, A. (2011) Multiple Kernel Learn-ing Algorithms. Journal of Machine Learning Research, 12, 2211-2268.
[6] Wang, T., Lu, J. and Zhang, G. (2018) Two-Stage Fuzzy Multiple Kernel Learning Based on Hilbert-Schmidt Independence Criterion. IEEE Transactions on Fuzzy Systems, 26, 3703-3714. [Google Scholar] [CrossRef
[7] Wang, Z., Zhu, Z. and Li, D. (2020) Collaborative and Geo-metric Multi-Kernel Learning for Multi-Class Classification. Pattern Recognition, 99, 107050. [Google Scholar] [CrossRef
[8] Gautam, C. and Tiwari, A. (2018) Localized Multiple Kernel Support Vector Data Description. 2018 IEEE International Conference on Data Mining Workshops (ICDMW), Singa-pore, 17-20 November 2018, 1514-1521. [Google Scholar] [CrossRef
[9] Lin, C. and Wang, S. (2002) Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks, 13, 464-471. [Google Scholar] [CrossRef] [PubMed]
[10] Song, F.F. and He, Q. (2021) Kernel-Target Alignment based Fuzzy Multi-Kernel Least Squares Support Vector Machine. International Journal of Intelligent Information and Management Science, 10, 113-119.
[11] Huang, H.P. and Liu, Y.H. (2001) Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems, 4, 826-835.
[12] Liu, S.Y. and Du, Z.U. (2007) An Improved Fuzzy Support Vector Machine Method. CAAI Transactions on Intelligent Systems, 2, 30-33.
[13] 曾山, 同小军, 桑农, 等. 基于对应分析的冗余模糊C均值聚类算法研究. 华中科技大学学报(自然科学版), 2012(40), 107-111.
[14] He, Q. and Wu, C.X. (2011) Membership Evaluation and Feature Selection for Fuzzy Support Vector Machine Based on Fuzzy Rough Sets. Soft Computing, 15, 1105-1114. [Google Scholar] [CrossRef
[15] De Diego, I.M., Muñoz, A. and Moguerza, J.M. (2010) Methods for the Combination of Kernel Matrices within a Support Vector Framework. Machine Learning, 78, Article No. 137. [Google Scholar] [CrossRef
[16] Wang, T.H., Zhao, D.Y. and Tian, S.F. (2015) An Overview of Kernel Alignment and Its Applications. Artificial Intelligence Review, 43, 179-192. [Google Scholar] [CrossRef
[17] Cortes, C., Mohri, M. and Rostamizadeh, A. (2012) Algorithms for Learning Kernels Based on Centered Alignment. Journal of Machine Learning Research, 13, 795-828.
[18] Wang, T., Qiu, Y. and Hua, J. (2020) Centered Kernel Alignment Inspired Fuzzy Support Vector Machine. Fuzzy Sets and Sys-tems, 394, 110-123. [Google Scholar] [CrossRef
[19] He, Q., Zhang, Q.S., Wang, H.Y. and Zhang, C.L. (2020) Local Similarity Based Fuzzy Multiple Kernel One-Class Support Vector Machine. Complexity, 2020, Article ID: 8853277. [Google Scholar] [CrossRef
[20] 周志华. 机器学习[M]. 北京: 清华大学出版社, 2016.