融合BERT和知识图谱的文本情感分析模型
Text Sentiment Analysis Model Based on BERT and Knowledge Graph
DOI: 10.12677/MOS.2023.124382, PDF,   
作者: 刘斐瑜, 俞卫琴:上海工程技术大学数理与统计学院,上海
关键词: 情感分析BERT注意力知识图谱Sentiment Analysis BERT Attention Knowledge Graph
摘要: 近年来,在线评论数与日俱增,这些在线评论涉及的范围较广,在某些特定领域里专业性较强。深度学习模型在大规模语料库上学习到了自然语言的通用表达,但在一些专业领域里对语义信息的提取还不够充分。针对该问题,本文提出一种基于BERT和知识图谱的情感分析模型。该模型在文本输入中利用知识图谱注入专家知识,再利用BERT进行词向量化,生成包含上下文语义信息的动态词向量,最后通过全连接层输出情感极性。结果表明,该文章提出的模型在几个公开数据集上提升了准确率,具有实际意义。
Abstract: In recent years, the number of online comments has increased, and these online reviews are widely involved, and they are professional in some specific areas. Deep learning models have learned the common expression of natural languages in large -scale corpus libraries, but for some professional fields, it is not sufficient to rely on context to extract semantic information. In response to these is-sues, the article proposes an emotional analysis model based on BERT and knowledge graph. In the input, the model uses the knowledge graph to inject expert knowledge, and then use BERT for quantification to generate a dynamic word vector containing the above semantic information, and finally output the emotional polarity through the full connection layer. The results show that the model proposed by the article has improved accuracy on several public datasets and has practical significance.
文章引用:刘斐瑜, 俞卫琴. 融合BERT和知识图谱的文本情感分析模型[J]. 建模与仿真, 2023, 12(4): 4195-4200. https://doi.org/10.12677/MOS.2023.124382

参考文献

[1] Nasukawa, T. and Yi, J. (2003) Sentiment Analysis: Capturing Favorability Using Natural Language Processing. Proceedings of the 2nd International Conference on Knowledge Capture, Sanibel Island, 23-25 October 2003, 70-77. [Google Scholar] [CrossRef
[2] Liu, B. (2012) Sentiment Analysis and Opinion Mining. Synthesis Lectures on Human Language Technologies, Vol. 5, Springer, Berlin, 1-167. [Google Scholar] [CrossRef
[3] Singh, N.K., Tomar, D.S. and Sangaiah, A.K. (2020) Sentiment Analysis: A Review and Comparative Analysis over Social Media. Journal of Ambient Intelligence and Humanized Computing, 11, 97-117. [Google Scholar] [CrossRef
[4] Bengio, Y., Ducharme, R., Vincent, P., et al. (2003) A Neural Probabil-istic Language Model. Journal of Machine Learning Research, 3, 1137-1155.
[5] Mikolov, T., Sutskever, I., Chen, K., et al. (2013) Distributed Representations of Words and Phrases and Their Compositionality. 27th Annual Conference on Neural In-formation. Processing Systems, Lake Tahoe, 5-10 December 2013, 3111-3119.
[6] Pennington, J., Socher, R. and Manning, C. (2014) Glove: Global Vectors for Word Representation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Doha, 25-29 October 2014, 1532-1543. [Google Scholar] [CrossRef
[7] Peters, M., Neumann, M. and Iyyer, M. (2018) Deep Contextualized Word Representations. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguis-tics, Vol. 1, 2227-2237. [Google Scholar] [CrossRef
[8] Wei, J.Y., Lao, J., Yang, Z.F., et al. (2020) BiLSTM with Multi-Polarity Or-thogonal Attention for Implicit Sentiment Analysis. Neuro Computing, 33, 165-173. [Google Scholar] [CrossRef
[9] 衡红军, 徐天宝. 基于多尺度卷积和门控机制的注意力情感分析模型[J]. 计算机应用, 2022, 42(9): 2674-2679.
[10] Devlin, J., Chang, M.W., Lee, K., et al. (2019) Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 17th Annual Conference of the North Ameri-can Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL, Minneapolis, 2-7 June 2019, 4171-4186.
[11] Donatas, M. and Flavius, F. (2020) ALDONAr: A Hybrid Solution for Sentence-Level Aspect-Based Sentiment Analysis Using a Lexicalized Domain Ontology and a Regularized Neural Attention Model. Information Processing & Management, 57, 102-121. [Google Scholar] [CrossRef
[12] 杨秀璋, 郭明镇, 候红涛, 等. 融合情感词典的改进BiLSTM-CNN+Attention情感分类算法[J]. 科学技术与工程, 2022, 22(20): 8761-8770.
[13] Xiao, H.Z. (2020) A Survey on Application of Knowledge Graph. Proceeding of 4th International Conference Control Engineering and Artificial Intelligence, CCEAI, Singapore, 17-19 January 2020, 141-151.
[14] 中文开放知识图谱[Z/OL].
http://openkg.cn/dataset/cndbpedia
[15] 基于义原的语言知识库[Z/OL].
https://openhownet.thunlp.org/about_hownet
[16] 吴小华, 陈莉, 魏甜甜, 等. 基于Self-Attention和Bi-LSTM的中文短文本情感分析[J]. 中文信息学报, 2019, 33(6): 100-107.
[17] 严驰腾, 何利力. 基于BERT的双通道神经网络模型文本情感分析研究[J]. 智能计算机与应用, 2022, 12(5): 16-22.