支撑向量机的一致光滑牛顿法
A Uniformly Smoothing Newton Method for Support Vector Machine
摘要: 提升光滑支撑向量机分类性能,本文引入了一种新的一致光滑逼近函数来替代正号函数,此函数不仅克服了支撑向量机模型求解过程中出现的不可微性,也在求解收敛速度上优于其他光滑函数。基于此一致光滑逼近函数我们设计了相应的牛顿算法并证明了该光滑函数的收敛性,最后通过数值模拟体现了该函数在光滑支撑向量机模型中的求解精度、效率和推广适应性的优越性能。
Abstract:
To improve the classification performance of smooth support vector machines, a new uniformly smooth approximation function is introduced to replace the positive sign function. It doesn’t only overcome the non-differentiability in the process of solving the support vector machine model, but also is superior to other smooth functions in solving convergence rate. Based on the uniform smooth approximation function, we design a corresponding Newton algorithm and es-tablish the convergence of the proposed algorithm. Finally, numerical simulation shows the su-perior performance of the function in accuracy, efficiency and generalization adaptability for solving the smooth support vector machine model.
参考文献
|
[1]
|
Vapnik, V.N. (1995) The Nature of Statistical Learning Theory. Spring Verlag, New York, 1-299.
https://doi.org/ 10.1007/978-1-4757-2440-0
|
|
[2]
|
Lee, Y.J. and Mangasarian, O.L. (2001) SSVM: A Smooth Support Vector Machine for Classification. Computational Optimization and Applications, 20, 5-22. https://doi.org/ 10.1023/A:1011215321374
|
|
[3]
|
Lee, Y.J. and Mangasarian, O.L. (2001) RSVM: Reduced Support Vector Machine. Proceedings of the SIAM International Conference on Data Mining, Chicago, 5-7 April 2001, 1-17. https://doi.org/ 10.1137/1.9781611972719.13
|
|
[4]
|
袁玉波, 严杰, 徐成贤. 多项式光滑的支撑向量机[J]. 计算机学, 2005, 28(1): 9-17.
|
|
[5]
|
Yuan, Y., Fan, W. and Pu, D. (2007) Spline Function Smooth Support Vector for Classification. Journal of Industrial and Management Optimization, 3, 529-542.
|
|
[6]
|
黄仁泰, 熊金志. 一个支持向量机的新光滑函数及其性能分析[J]. 计算机工程与应用, 2008, 44(18): 64-65.
|
|
[7]
|
雍龙泉. 绝对值函数的一致光滑逼近函数[J]. 数学的实践与认识, 2015, 45(20): 250-255.
|
|
[8]
|
李兴斯. 解非线性规划的凝聚函数法[J]. 中国科学: A辑, 1991, 12(12): 1283-1288.
|
|
[9]
|
李兴斯. 一类不可微优化问题的有效解法[J]. 中国科学: A辑, 1994, 24(4): 371-377.
|
|
[10]
|
杨庆之, 杨德庄, 张敏洪. 调节熵函数法[J]. 计算数学, 2001, 23(1): 81-86.
|
|
[11]
|
杨庆之. 对凝聚函数法的分析[J]. 计算数学, 1996, 18(4): 405-410.
|