基于CNN与Bi LSTM融合的用户行为预测方法
User Behavior Prediction Method Based on Fusion of CNN and Bi LSTM
DOI: 10.12677/csa.2024.148170, PDF,    科研立项经费支持
作者: 于璐娜, 刘国奇*, 崔文超:沈阳建筑大学计算机科学与工程学院,辽宁 沈阳
关键词: 生活日志神经网络行为预测组合模型Life Logs Neural Networks Behavioral Prediction Combinatorial Models
摘要: 随着个性化服务需求的增长,通过分析人类行为模式来预测人们的生活习惯、需求和偏好变得尤为重要。本文探讨了基于生活日志数据进行用户行为分类预测的重要性,提出一种融合卷积神经网络(CNN)和双向长短期记忆网络(Bi LSTM)的用户行为预测模型TS-CNN-Bi LSTM。使用Liu-Life Log收集十二年的用户生活日志数据作为样本数据。考虑生活日志数据存在不公开位置信息的用户,基于同一数据集构建了两种不同特征组合的数据集DCP-Life Log和TS-Life Log。使用不同数据集评估模型预测性能。实验结果表明,所提模型在两个数据集上的宏平均精确率、召回率和F1值均优于基准模型,分别提升2.23%、1.30%和1.27%。
Abstract: With the growing demand for personalized services, it has become essential to predict people’s habits, needs, and preferences by analyzing human behavior patterns. In this paper, we explore the importance of classifying and predicting user behavior based on life log data and propose a user behavior prediction model TS-CNN-Bi LSTM that integrates a convolutional neural network (CNN) and bidirectional long short-term memory network (Bi LSTM). Twelve years of user life log data collected by Liu-Life Log is used as sample data. Considering the existence of users who do not disclose their location information in the life log data, two datasets with different feature combinations, DCP-Life Log and TS-Life Log, are constructed based on the same dataset. The model prediction performance is evaluated using different datasets. The experimental results show that the proposed model outperforms the benchmark model on both datasets regarding the macro-mean precision, recall, and F1 value, with an improvement of 2.23%, 1.30%, and 1.27%, respectively.
文章引用:于璐娜, 刘国奇, 崔文超. 基于CNN与Bi LSTM融合的用户行为预测方法[J]. 计算机科学与应用, 2024, 14(8): 121-133. https://doi.org/10.12677/csa.2024.148170

参考文献

[1] Cho, Y., Seo, J., Lee, H., Choi, S., Choi, A., Sung, M., et al. (2020) Platform Design for Lifelog-Based Smart Lighting Control. Building and Environment, 185, Article 107267. [Google Scholar] [CrossRef
[2] Ribeiro, R., Trifan, A. and Neves, A.J.R. (2022) Lifelog Retrieval from Daily Digital Data: Narrative Review. JMIR mHealth and uHealth, 10, e30517. [Google Scholar] [CrossRef] [PubMed]
[3] Chakraborty, P. and Sanyal, D.K. (2023) A Comprehensive Survey of Personal Knowledge Graphs. WIREs Data Mining and Knowledge Discovery, 13, e1513. [Google Scholar] [CrossRef
[4] Yen, A., Huang, H. and Chen, H. (2019) Personal Knowledge Base Construction from Text-Based Lifelogs. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, 21-25 July 2019, 185-194. [Google Scholar] [CrossRef
[5] Tam, S., Said, R.B. and Tanriover, O.O. (2021) A Convbilstm Deep Learning Model-Based Approach for Twitter Sentiment Classification. IEEE Access, 9, 41283-41293. [Google Scholar] [CrossRef
[6] Salido Ortega, M.G., Rodríguez, L. and Gutierrez-Garcia, J.O. (2019) Towards Emotion Recognition from Contextual Information Using Machine Learning. Journal of Ambient Intelligence and Humanized Computing, 11, 3187-3207. [Google Scholar] [CrossRef
[7] Soleimaninejadian, P., Zhang, M., Liu, Y. and Ma, S. (2018) Mood Detection and Prediction Based on User Daily Activities. 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia), Beijing, 20-22 May 2018, 1-6. [Google Scholar] [CrossRef
[8] Ksibi, A., Alluhaidan, A.S.D., Salhi, A. and El-Rahman, S.A. (2021) Overview of Lifelogging: Current Challenges and Advances. IEEE Access, 9, 62630-62641. [Google Scholar] [CrossRef
[9] Martín, H., Bernardos, A.M., Iglesias, J. and Casar, J.R. (2012) Activity Logging Using Lightweight Classification Techniques in Mobile Devices. Personal and Ubiquitous Computing, 17, 675-695. [Google Scholar] [CrossRef
[10] Akhavian, R. and Behzadan, A.H. (2016) Smartphone-Based Construction Workers’ Activity Recognition and Classification. Automation in Construction, 71, 198-209. [Google Scholar] [CrossRef
[11] Chung, S., Jeong, C.Y., Lim, J.M., Lim, J., Noh, K.J., Kim, G., et al. (2021) Real‐World Multimodal Lifelog Dataset for Human Behavior Study. ETRI Journal, 44, 426-437. [Google Scholar] [CrossRef
[12] Gurrin, C., Smeaton, A.F. and Doherty, A.R. (2014) LifeLogging: Personal Big Data. Now Publishers Inc. [Google Scholar] [CrossRef
[13] Ziaei, A., Sangwan, A., Kaushik, L. and Hansen, J.H.L. (2015) Prof-Life-Log: Analysis and Classification of Activities in Daily Audio Streams. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, 19-24 April 2015, 4719-4723. [Google Scholar] [CrossRef
[14] Tong, H., Zhang, M., Soleimaninejadian, P., Zhang, Q., Wu, K., Liu, Y., et al. (2018) Music Mood Classification Based on Lifelog. Information Retrieval, Guilin, 27-29 September 2018, 55-66. [Google Scholar] [CrossRef
[15] Lee, S., Kang, W. and Moon, C. (2018) Lifelog-Based Classification of Mild Cognitive Impairment Using Artificial Neural Networks. 2018 International Conference on Electronics, Information, and Communication (ICEIC), Honolulu, 24-27 January 2018, 1-2. [Google Scholar] [CrossRef
[16] Li, J., Ma, W., Zhang, M., Wang, P., Liu, Y. and Ma, S. (2021) Know Yourself: Physical and Psychological Self-Awareness with Lifelog. Frontiers in Digital Health, 3, Article 676824. [Google Scholar] [CrossRef] [PubMed]
[17] Nair, N., Thomas, C. and Jayagopi, D.B. (2018) Human Activity Recognition Using Temporal Convolutional Network. Proceedings of the 5th International Workshop on Sensor-Based Activity Recognition and Interaction, Berlin, 20-21 September 2018, 1-8. [Google Scholar] [CrossRef
[18] Jain, A. and Kanhangad, V. (2018) Human Activity Classification in Smartphones Using Accelerometer and Gyroscope Sensors. IEEE Sensors Journal, 18, 1169-1177. [Google Scholar] [CrossRef
[19] Gupta, P. and Dallas, T. (2014) Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer. IEEE Transactions on Biomedical Engineering, 61, 1780-1786. [Google Scholar] [CrossRef] [PubMed]
[20] Jalloul, N., Poree, F., Viardot, G., L’ Hostis, P. and Carrault, G. (2018) Activity Recognition Using Complex Network Analysis. IEEE Journal of Biomedical and Health Informatics, 22, 989-1000. [Google Scholar] [CrossRef] [PubMed]
[21] Ahmed, S., Bhuiyan, T.A., Kishi, T., Nii, M. and Kobashi, S. (2021) Human Activity Classification Based on Angle Variance Analysis Utilizing the Poincare Plot. Applied Sciences, 11, Article 7230. [Google Scholar] [CrossRef
[22] Liu, G., Cui, W., Niu, S., Ma, J. and Wang, Z. (2023) Classification of Various Daily Behaviors in Lifelog Using Deep Learning. Procedia Computer Science, 224, 98-105. [Google Scholar] [CrossRef
[23] Ordóñez, F. and Roggen, D. (2016) Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16, Article 115. [Google Scholar] [CrossRef] [PubMed]
[24] Shi, M., Wang, K. and Li, C. (2019) A C-LSTM with Word Embedding Model for News Text Classification. 2019 IEEE/ACIS 18th International Conference on Computer and Information Science (ICIS), Beijing, 17-19 June 2019, 253-257. [Google Scholar] [CrossRef
[25] Lin, Y., Le Kernec, J., Yang, S., Fioranelli, F., Romain, O. and Zhao, Z. (2018) Human Activity Classification with Radar: Optimization and Noise Robustness with Iterative Convolutional Neural Networks Followed with Random Forests. IEEE Sensors Journal, 18, 9669-9681. [Google Scholar] [CrossRef
[26] 陈亮, 杨建常, 刘国奇, 张立波. 一种基于事件的Lifelog管理模型[J]. 计算机科学与应用, 2024, 14(1): 29-40.
[27] https://github.com/xinyu1205/recognize-anything.
[28] Zhang, Y., Huang, X., Ma, J., et al. (2024) Recognize Anything: A Strong Image Tagging Model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024, Seattle, 17-21 June, 2024, 1724-1732.
[29] Recognize Anything: A Strong Image Tagging Model.
https://recognize-anything.github.io/
[30] 杨军. 基于视频处理技术的运动目标姿态检测与控制[J]. 沈阳工业大学学报, 2023, 45(1): 90-96.