基于BERT模型和LDA主题模型的用户兴趣模型构建方法

User Interest Model Construction Method Based on BERT Model and LDA Topic Model

摘要: 用户兴趣模型构建主要结合用户的兴趣爱好信息、游览行为以及用户画像信息等综合分析用户兴趣。用户兴趣模型作为个性化信息推荐环节中的关键部分，也是个性化服务的重要部分，其质量的好坏直接影响着个性化信息推荐服务的水平。为了提高用户兴趣建模的质量，本文引入词向量模型和主题模型来准确表示用户兴趣，提出了一种基于BERT模型和LDA主题模型的用户兴趣模型构建方法。该方法将BERT模型和LDA主题模型融合，在训练过程中，模型不仅能够充分利用整个数据集的上下文信息，还能利用LDA获取隐语义信息，同时通过K-means聚类方法提取用户兴趣。实验结果表明，结合后的用户建模方法能够有效解决微博短文本的稀疏性以及上下文依赖性。与其他方法相比，提高了用户兴趣模型的质量。

Abstract: The construction of the user interest model mainly combines the user’s hobby information, travel behavior and user profile information, and comprehensively analyzes the user’s interest. As a key part of personalized information recommendation, user interest model is also an important part of personalized service. Its quality directly affects the level of personalized information recommendation services. In order to improve the quality of user interest modeling, this paper introduces word vector model and topic model to accurately express user interest, and proposes a user interest model construction method based on BERT model and LDA topic model. This method combines the BERT model and the LDA topic model. In the training process, the model can not only make full use of the context information of the entire data set, but also use LDA to obtain implicit semantic information, and at the same time extract user interests through the K-means clustering method. The experimental results show that the combined user modeling method can effectively solve the problems of sparsity and context dependence of microblog short texts. Compared with other methods, the quality of the user interest model is improved.