SVM和RLR算法的对比分析
Comparative Analysis of SVM and RLR Algorithms
DOI: 10.12677/AAM.2021.1012456, PDF,   
作者: 韩蓓丽:浙江师范大学数学与计算机科学学院,浙江 金华
关键词: SVMRLR维度离群值稳定性计算复杂度SVM RLR Dimension Outliers Stability Computational Complexity
摘要: 在机器学习领域中,支持向量机(SVM)和逻辑回归(RLR)作为两种有监督的分类算法,在不同场合下有着不同的分类效果。本文旨在通过数据分析对二者进行比较。数值实验结果显示:随着数据样本维度的增加,SVM的预测准确率、稳定性、计算时间及计算资源占用情况比RLR更好;对存在离群值的样本数据分类时,SVM在稳定性和分类效果方面表现更佳;在高维小样本中,RLR预测准确率比SVM更高,表现更佳。
Abstract: In the field of machine learning, support vector machine (SVM) and logistic regression (RLR), as two supervised classification algorithms, have different classification effects in different situations. This paper aims to compare them through data analysis. The numerical experiment results show that, with the increase of data sample dimension, SVM has better prediction accuracy, stability, calculation time and calculation resource occupation than RLR. When classifying the sample data with outliers, SVM performs better in terms of stability and classification effect. In high-dimensional small samples, RLR has higher prediction accuracy and better performance than SVM.
文章引用:韩蓓丽. SVM和RLR算法的对比分析[J]. 应用数学进展, 2021, 10(12): 4292-4303. https://doi.org/10.12677/AAM.2021.1012456

参考文献

[1] 周志华. 机器学习[M]. 北京: 清华大学出版社, 2016.
[2] 李航. 统计学习方法[M]. 北京: 清华大学出版社, 2012.
[3] Xiang, D.H. (2011) Classification with Gaussians and Convex Loss II: Improving Error Bounds by Noise Conditions. Science China Mathematics, 54, 165-171. [Google Scholar] [CrossRef
[4] Xiang, D.H. and Zhou, D.X. (2009) Classification with Gaussians and Convex Loss. Journal of Machine Learning Research, 10, 1447-1468.
[5] Ahn, J. (2010) The Maximal Data Piling Direction for Discrimination. Biometrika, 97, 254-259. [Google Scholar] [CrossRef
[6] Liu, Y.F., Zhang, H.H. and Wu, Y.C. (2011) Hard or Soft Classification? Large-Margin Unified Machines. Journal of the American Statistical Association, 106, 166-177. [Google Scholar] [CrossRef] [PubMed]
[7] Xiang, D.-H. (2010) Logistic Classification with Varying Gaussians. Computers and Mathematics with Applications, 61, 397-407. [Google Scholar] [CrossRef
[8] 袁梅宇. 机器学习基础原理、算法与实践[M]. 北京: 清华大学出版社, 2018.
[9] 徐新红. 基于高维小样本数据和类别不平衡数据的反距离加权支持向量机[D]: [硕士学位论文]. 济南: 山东大学, 2020.