基于Universum数据的多视角学习算法
Multi-View Learning Algorithm Based on Universum Data
DOI: 10.12677/CSA.2021.113069, PDF,  被引量    国家自然科学基金支持
作者: 曾 博, 肖燕珊:广东工业大学计算机学院,广东 广州;刘 波:广东工业大学自动化学院,广东 广州
关键词: 多视角学习Universum数据支持向量机Multi-View Learning Universum Data Support Vector Machine
摘要: 多视角学习是以不同方法获得的特征集表示的数据中学习的问题,其中双视角学习是一种仅由双视角数据组成的多视角学习。由于多视角学习可能会忽略一些多视角数据的原始信息,这些数据之间存在着内在的联系和不同视角之间的差异。因此,为了解决多视角数据之间存在的问题,我们引入了既不属于正类又不属于负类的无标签数据Universum数据。本文提出了一种基于Universum数据的多视角学习算法,将Universum数据和多视角学习结合到一个目标模型中,其中Universum数据被认为是该模型的先验知识。为了解决提出的算法模型,我们推导了该算法模型的对偶问题并得到了预测分类器。最后,通过大量的实验对该方法的性能进行了研究,结果表明,所提算法的性能优于传统的方法。
Abstract: Multi-View Learning (MVL) focuses on the problem of learning from the data represented by feature sets obtained from different approaches, in which two-view learning is a kind of MVL which only consists of two-view data. Since multi-view learning may ignore the original information of some multi-view data, there are inherent connections between these data and the differences between different perspectives. Therefore, in order to solve the problems between multi-view data, we introduce the unlabeled data Universum data that neither belongs to the positive category nor the negative category. This paper proposes a multi-perspective learning algorithm based on Universum data, which combines Universum data and multi-perspective learning into a target model, in which Universum data is considered as the prior knowledge of the model. In order to solve the proposed algorithm model, we derive the dual problem of the algorithm model and get the predictive classifier. Finally, the performance of the method is studied through a large number of experiments, and the results show that the performance of the proposed algorithm is better than that of the traditional method.
文章引用:曾博, 肖燕珊, 刘波. 基于Universum数据的多视角学习算法[J]. 计算机科学与应用, 2021, 11(3): 672-681. https://doi.org/10.12677/CSA.2021.113069

参考文献

[1] Qin, B., Xia, Y., Wang, S. and Du, X.Y. (2011) A Novel Bayesian Classification for Uncertain Data. Knowledge- Based Systems, 24, 1151-1158. [Google Scholar] [CrossRef
[2] 唐静静, 田英杰. 多视角学习综述[J]. 数学建模及其应用, 2017, 6(3): 1-15, 25.
[3] Sun, S. (2013) A Survey of Multi-View Machine Learning. Neural Computing and Applications, 23, 2031-2038. [Google Scholar] [CrossRef
[4] DeSa, V.R. (1993) Learning Classification with Unlabeled Data. 6th International Conference on Neural Information Processing Systems, Denver, November 1993, 112-119.
[5] Jiang, Y., Liu, J., Li, Z. and Lu, H. (2014) Semi-Supervised Unified Latent Factor Learning with Mul-ti-View Data. Machine Vision & Applications, 25, 1635-1645. [Google Scholar] [CrossRef
[6] Farquhar, J.D.R., Hardoon, D.R., Meng, H., Shawe-Taylor, J. and Szedmák, S. (2006) Two View Learning: SVM-2K, Theory and Practice. In: Weiss, Y., Schölkopf, B. and Platt, J., Eds., Advances in Neural Information Processing Systems, MIT Press, Cambridge, 355-362.
[7] Chen, X., Chen, S., Xue, H. and Zhou, X. (2012) A Unified Dimensionality Reduction Framework for Semi-Paired and Semi-Supervised Multi-View Data. Pattern Recognition, 45, 2005-2018. [Google Scholar] [CrossRef
[8] Bickel, S. and Scheffer, T. (2004) Multi-View Clustering. 2004 4th IEEE International Conference on Data Mining, Brighton, 1-4 November 2004, 19-26. [Google Scholar] [CrossRef
[9] Vapnik, V. (2006) Estimation of De-pendences Based on Empirical Data. 2nd Edition, Springer, Berlin.
[10] Weston, J., Collobert, R., Sinz, F.H., Bottou, L. and Vapnik, V. (2006) Inference with the Universum. Machine Learning, Proceedings of the 23rd International Confer-ence (ICML 2006), Pittsburgh, June 25-29 2006, 1009-1016. [Google Scholar] [CrossRef
[11] Liu, C.L., Hsaio, W.H., Lee, C.H., Chang, T.-H. and Kuo, T.-H. (2017) Semi-Supervised Text Classification with Universum Learning. IEEE Transactions on Cybernetics, 46, 462-473. [Google Scholar] [CrossRef
[12] Richhariya, B. and Gupta, D. (2018) Facial Expression Recog-nition Using Iterative Universum Twin Support Vector Machine. Applied Soft Computing, 76, 53-67. [Google Scholar] [CrossRef
[13] Qiu, J., Wang, Y., Pan, Z. and Jia, B. (2014) Semi-Supervised Feature Selection with Universum Based on Linked Social Media Data. IEICE Transactions on Information and Systems, E97, 2522-2525. [Google Scholar] [CrossRef
[14] Zhang, D., Wang, J., Wang, F. and Zhang, C. (2008) Semi-Supervised Classification with Universum. Proceedings of the 2008 SIAM International Conference on Data Min-ing, Atlanta, 24-26 April 2008, 323-333. [Google Scholar] [CrossRef
[15] Xie, X. and Sun, S. (2015) Multi-View Twin Support Vector Machines. Intelligent Data Analysis, 19, 701-712. [Google Scholar] [CrossRef
[16] Tang, J., Li, D., Tian, Y. and Liu, D. (2018) Multi-View Learning Based on Nonparallel Support Vector Machine. Knowledge-Based Systems, 158, 94-108. [Google Scholar] [CrossRef