一种提高SVM分类能力的同步优化算法
A Synchronous Optimization Algorithm for Increasing Accuracy of SVM Classification
DOI: 10.12677/AAM.2017.69130, PDF,    国家自然科学基金支持
作者: 何 凡, 卢常景:中国地质大学数学与物理学院,湖北 武汉
关键词: SVM蝙蝠算法特征选择参数优化分类SVM Bat Algorithm Feature Selection Parameter Optimization Classification
摘要: 近年来,支持向量机(SVM)理论广泛应用于模式分类,然而影响其分类准确率的两个主要因素特征选择和参数优化又是相互影响和制约的。文章提出一种BA + SVM算法,利用蝙蝠算法(BA)来同步完成SVM的参数优化和输入数据的特征属性选择,提高了SVM的分类能力。设计的三种实验方式在10个测试数据集上实验结果表明,BA + SVM同步优化算法与单一进行参数优化或单一进行特征选择算法相比,具有输入特征少分类准确率高的优势。
Abstract: Support vector machines (SVM), which is a popular method for pattern classification, has been recently adopted in range of problems. In training procedure of SVM, feature selection and parameter optimization are two main factors that impact on classification accuracy. In order to improve the classification accuracy by optimizing parameter and choosing feature subset for SVM, a new algorithm is proposed through combining Bat Algorithm (BA) with SVM, termed BA + SVM. For assessing the performance of BA + SVM, 10 public data-sets are employed to test the classification accuracy rate. Compared with grid algorithm, conventional parameter optimization method, our study concludes that BA + SVM has a higher classification accuracy with fewer input features for support vector classification.
文章引用:何凡, 卢常景. 一种提高SVM分类能力的同步优化算法[J]. 应用数学进展, 2017, 6(9): 1073-1081. https://doi.org/10.12677/AAM.2017.69130

参考文献

[1] Vapnik, V.N. (1995) The Nature of Statistical Learning Theory. Springer-Verlag, New York.
[Google Scholar] [CrossRef
[2] Joachims, T. (1998) Text Categorization with Support Vector Machines: Learning with Many Relevant Features. Proceedings of Support Vector Learning Machine Learning: ECML-98, Volume 1398 of the Series Lecture Notes in Computer Science, 137-142.
[Google Scholar] [CrossRef
[3] Yu, G.-X., Ostrouchov, G., Geist, A., et al. (2003) An SVM Based Algorithm for Identification of Photosynthesis-Specific Genome Features. Proceedings of the 2003 IEEE Bioinformatics Conference on Computational Systems Bioinformatics, California, 235-243.
[Google Scholar] [CrossRef
[4] Keerthi, S.S. and Lin, C.-J. (2003) Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel. Neural Computation, 15, 1667-1689.
[Google Scholar] [CrossRef] [PubMed]
[5] Xiao, H.J., Wei, Y.B., Yu, Z.L., et al. (2010) A New Active Learning Method for Instance Selection. Journal of Information & Computational Science, 7, 2789-2795.
[6] Oliveira, A.L.I., Braga, P.L., Lima, R.M.F. and Cornélio, M.L. (2010) GA-Based Method for Feature Selection and Parameters Optimization for Machine Learning Regression Applied to Software Effort Estimation. Information and Software Technology, 52, 1155-1166.
[Google Scholar] [CrossRef
[7] Huang, C.-L. and Dun, J.-F. (2008) A Distributed PSO-SVM Hybrid System with Feature Selection and Parameter Optimization. Applied Soft Computing, 8, 1381-1391.
[Google Scholar] [CrossRef
[8] Lin, S.W., Ying, K.C., Chen, S.C., et al. (2008) Particle Swarm Optimization for Parameter Determination and Feature Selection of Support Vector Machines. Expert Systems with Applications, 35, 1817-1824.
[Google Scholar] [CrossRef
[9] Li, X.F. (2014) Network Intrusion Detection with Genetic Algo-rithm Synchronous Selecting Feature and SVM Parameters. Computer Applications and Software, 63, S76.
[10] Griffin, D.R., Webster, F.A., Michael, C.R., et al. (1960) The Echolocation of Flying Insects by Bats. Animal Behaviour, 8, 141-154.
[Google Scholar] [CrossRef
[11] Tharwat, A., Hassanien, A.E. and Elnaghi, B.E. (2017) A BA-Based Algorithm for Parameter Optimization of Support Vector Machine. Pattern Recognition Letters, 93, 13-22.
[Google Scholar] [CrossRef
[12] Metzner, W. (1991) Echolocation Behaviour in Bats. Science Progress Edinburgh, 75, 453-465.
[13] Liu, H. and Motoda, H. (1998) Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic, Boston.
[14] Chen, R.-C. and Hsieh, C.-H. (2006) Web Page Classification Based on a Support Vector Machine Using a Weighed Vote Schema. Expert Systems with Applications, 31, 427-435.
[Google Scholar] [CrossRef
[15] Chang, C.C. and Lin, C.J. (2001) LIBSVM: A Library for Support Vector Machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm