面向会话表示的多阶段自监督集合学习方法
Multi-Stage Self-Supervised Set Learning Approach for Session Representation
摘要: 会话推荐旨在根据用户在会话单元中的交互组对用户下一项感兴趣的交互进行推荐。然而,现有会话推荐方法通常将会话建模为序列形式,使推荐结果过于依赖交互顺序。为了应对这一问题,本文提出了一种面向会话表示的多阶段自监督集合学习方法SR-MSSL。该方法将会话建模为集合形式,通过自注意力机制对集合中的交互项进行信息聚合,并通过多阶段自监督学习挖掘元素间的隐含关联,从而在不依赖交互顺序的情况下获取具有表达力的会话表示。实验在Yoochoose和Diginetica数据集上进行,结果显示,本文方法在多个指标上优于传统推荐方法与多种深度学习模型,验证了集合建模在会话表示学习中的有效性。此外,通过位置编码消融实验进一步证明,去除交互的顺序信息能够提高会话模型的推荐性能。
Abstract: Session-based recommendation seeks to predict the next interaction of interest for a user by leveraging the set of interactions within a session. However, current session-based recommendation approaches usually treat sessions as sequences, making the recommendations excessively dependent on the order of interactions. To mitigate this limitation, we propose SR-MSSL, a multi-stage self-supervised set learning framework for session representation. The approach models sessions as sets, employing a self-attention mechanism to aggregate information across interactions and leveraging multi-stage self-supervised learning to capture latent relationships among elements, thus deriving expressive session representations independent of interaction order. Experiments on the Yoochoose and Diginetica datasets demonstrate that our method surpasses traditional recommendation techniques and several deep learning models across multiple evaluation metrics, confirming the effectiveness of set-based modeling for session representation learning. Additionally, ablation studies on positional encoding reveal that discarding the sequential information of interactions can further improve the recommendation performance of session models.
文章引用:龚晓宇. 面向会话表示的多阶段自监督集合学习方法[J]. 建模与仿真, 2025, 14(10): 155-167. https://doi.org/10.12677/mos.2025.1410614

参考文献

[1] Lei, C., Liu, Y., Zhang, L., Wang, G., Tang, H., Li, H., et al. (2021) SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Virtual Event Singapore, 14-18 August 2021, 3161-3171. [Google Scholar] [CrossRef
[2] Deldjoo, Y., Schedl, M., Cremonesi, P. and Pasi, G. (2020) Recommender Systems Leveraging Multimedia Content. ACM Computing Surveys, 53, 1-38. [Google Scholar] [CrossRef
[3] Wang, S., Cao, L., Wang, Y., Sheng, Q.Z., Orgun, M.A. and Lian, D. (2021) A Survey on Session-Based Recommender Systems. ACM Computing Surveys, 54, 1-38. [Google Scholar] [CrossRef
[4] Rendle, S., Freudenthaler, C. and Schmidt-Thieme, L. (2010) Factorizing Personalized Markov Chains for Next-Basket Recommendation. Proceedings of the 19th International Conference on World Wide Web, Raleigh, 26-30 April 2010, 811-820. [Google Scholar] [CrossRef
[5] Wu, X., Liu, Q., Chen, E., He, L., Lv, J., Cao, C., et al. (2013) Personalized Next-Song Recommendation in Online Karaokes. Proceedings of the 7th ACM conference on Recommender Systems, Hong Kong, 12-16 October 2013, 137-140. [Google Scholar] [CrossRef
[6] Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T. and Ma, J. (2017) Neural Attentive Session-Based Recommendation. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore, 6-10 November 2017, 1419-1428. [Google Scholar] [CrossRef
[7] Liu, Q., Zeng, Y., Mokhosi, R. and Zhang, H. (2018) STAMP: Short-Term Attention/Memory Priority Model for Session-Based Recommendation. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, 19-23 August 2018, 1831-1839. [Google Scholar] [CrossRef
[8] Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X. and Tan, T. (2019) Session-Based Recommendation with Graph Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 346-353. [Google Scholar] [CrossRef
[9] Wang, D., Du, R., Yang, Q., Yu, D., Wan, F., Gong, X., et al. (2024) Category-Aware Self-Supervised Graph Neural Network for Session-Based Recommendation. World Wide Web, 27, Article No. 61. [Google Scholar] [CrossRef
[10] Li, Y., Gao, C., Luo, H., Jin, D. and Li, Y. (2022) Enhancing Hypergraph Neural Networks with Intent Disentanglement for Session-Based Recommendation. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, 11-15 July 2022, 1997-2002. [Google Scholar] [CrossRef
[11] Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., et al. (2019) BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Trans-Former. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, 3-7 November 2019, 1441-1450. [Google Scholar] [CrossRef
[12] Yuan, F., He, X., Jiang, H., Guo, G., Xiong, J., Xu, Z., et al. (2020) Future Data Helps Training: Modeling Future Contexts for Session-Based Recommendation. Proceedings of The Web Conference 2020, 20-24 April 2020, 303-313. [Google Scholar] [CrossRef
[13] Tang, J. and Wang, K. (2018) Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, 5-9 February 2018, 565-573. [Google Scholar] [CrossRef
[14] Zhang, M., Wu, S., Gao, M., Jiang, X., Xu, K. and Wang, L. (2022) Personalized Graph Neural Networks with Attention Mechanism for Session-Aware Recommendation. IEEE Transactions on Knowledge and Data Engineering, 34, 3946-3957. [Google Scholar] [CrossRef
[15] Jaakkola, T.S. and Haussler, D. (1998) Exploiting Generative Models in Discriminative Classifiers. Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, Cambridge, 20 July 1999, 487-493.
[16] Jebara, T., Kondor, R. and Howard, A. (2004) Probability Product Kernels. The Journal of Machine Learning Research, 5, 819-844.
[17] Kondor, R. and Jebara, T. (2003) A Kernel between Sets of Vectors. Proceedings of the 20th International Conference on Machine Learning (ICML-03), Washington, 21-24 August 2003, 361-368.
[18] Qi, C.R., Su, H., Mo, K., et al. (2017) PointNet: DEEP Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 652-660.
[19] Zaheer, M., Kottur, S., Ravanbakhsh, S., et al. (2017) Deep Sets. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 3394-3404.
[20] Radford, A., Narasimhan, K., Salimans, T. and Sutskever, I. (2018) Improving Language Understanding by Generative Pre-Training.
https://www.mikecaptain.com/resources/pdf/GPT-1.pdf
[21] Lee, J., Lee, Y., Kim, J., et al. (2019) Set Transformer: A Framework for Attention-Based Permutation-Invariant Neural Networks. International Conference on Machine Learning, Long Beach, 10-15 June 2019, 3744-3753.
[22] Ou, Z., Xu, T., Su, Q., et al. (2022) Learning Neural Set Functions under the Optimal Subset Oracle. Advances in Neural Information Processing Systems, 35, 35021-35034.