开放场景睡姿识别方法:基于投票的新颖性检测
Open-Set Scenarios Sleeping Posture Recognition Method: Voting-Based Novelty Detection
DOI: 10.12677/SEA.2023.123041, PDF,    科研立项经费支持
作者: 孙 田, 胡 兴:上海理工大学光电信息与计算机工程学院,上海
关键词: 睡姿开放集识别压力图Sleeping Posture Open Set Recognition Pressure Map
摘要: 传统的睡眠姿势识别模型通常是在已知明确类别的数据集上训练的,而这种基于封闭集识别的方法在遇到一些奇特罕见的睡姿时容易将其误分类为已知的睡眠姿势,从而导致睡姿识别系统在开放环境下的可靠性与适用性大大降低。为了解决这个问题,提出一种基于开放集识别的睡姿检测模型。该模型主要完成两个任务:标准监督分类和新颖性检测。当样本被输入到模型时,分类器可以根据样本的新颖性得分,采用阈值比较,判断输入样本是未知或者识别为已知类别。模型分别在压力图和RGB图上做了验证,实验结果表明在开放场景下,该模型不仅能够准确识别已知的睡姿类别,识别率达到99%,而且能够有效地甄别出未知的睡姿,AUROC值达到92%,AUPR值达到95%。
Abstract: Traditional sleep posture recognition models are usually trained on datasets with known and well-defined categories. However, this closed-set recognition method tends to misclassify some unusual and rare sleep postures as known sleep postures, which greatly reduces the reliability and applicability of the sleep posture recognition system in open environments. To address this issue, a novel open-set sleep posture detection model is proposed. This model performs two tasks: standard supervised classification and novelty detection. When a sample is input into the model, the classifier can determine whether the input sample is unknown or recognized as a known category based on the sample’s novelty score, using a threshold comparison. The model is validated on both pressure maps and RGB images, and experimental results show that in open scenarios, the model not only accurately recognizes known sleep posture categories with a recognition rate of 99%, but also effectively identifies unknown sleep postures, with an AUROC of 92% and an AUPR of 95%.
文章引用:孙田, 胡兴. 开放场景睡姿识别方法:基于投票的新颖性检测[J]. 软件工程与应用, 2023, 12(3): 410-423. https://doi.org/10.12677/SEA.2023.123041

参考文献

[1] Cartwright, R.D. (1984) Effect of Sleep Position on Sleep Apnea Severity. Sleep, 7, 110-114. [Google Scholar] [CrossRef] [PubMed]
[2] Gay, P.C. (2004) Chronic Obstructive Pulmonary Disease and Sleep. Respiratory Care, 49, 39-52.
[3] Heydarzadeh, M., Nourani, M. and Ostadabbas, S. (2016) In-Bed Posture Classification Using Deep Autoencoders. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, 16-20 August 2016, 3839-3842. [Google Scholar] [CrossRef
[4] Tang, K., Kumar, A., Nadeem, M., et al. (2021) CNN-Based Smart Sleep Posture Recognition System. IoT, 2, 119-139. [Google Scholar] [CrossRef
[5] Viriyavit, W., Sornlertlamvanich, V., Kongprawechnon, W., et al. (2017) Neural Network Based Bed Posture Classification Enhanced by Bayesian Approach. 2017 8th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES), Chennai, 23-24 February 2017, 1-5. [Google Scholar] [CrossRef
[6] Ren, W., Ma, O., Ji, H., et al. (2020) Human Posture Recognition Using a Hybrid of Fuzzy Logic and Machine Learning Approaches. IEEE Access, 8, 135628-135639. [Google Scholar] [CrossRef
[7] Yu, M.C., Wu, H., Liou, J.L., et al. (2013) Multiparameter Sleep Monitoring Using a Depth Camera. Biomedical Engineering Systems and Technologies: 5th International Joint Conference, BIOSTEC 2012, Vilamoura, 1-4 February 2012, 311-325.
[8] Kuo, C.H., Yang, F.C., Tsai, M.Y., et al. (2004) Artificial Neural Networks Based Sleep Motion Recognition Using Night Vision Cameras. Biomedical Engineering: Applications, Basis and Communications, 16, 79-86. [Google Scholar] [CrossRef
[9] Lee, H.J., Hwang, S.H., Lee, S.M., et al. (2013) Estimation of Body Postures on Bed Using Unconstrained ECG Measurements. IEEE Journal of Biomedical and Health Informatics, 17, 985-993. [Google Scholar] [CrossRef
[10] Scheirer, W.J., de Rezende Rocha, A., Sapkota, A., et al. (2012) Toward Open Set Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1757-1772. [Google Scholar] [CrossRef
[11] Pouyan, M.B., Birjandtalab, J., Heydarzadeh, M., et al. (2017) A Pressure Map Dataset for Posture and Subject Analytics. 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Orlando, 16-19 February 2017, 65-68. [Google Scholar] [CrossRef
[12] Vaze, S., Han, K., Vedaldi, A., et al. (2021) Open-Set Recognition: A Good Closed-Set Classifier Is All You Need.
[13] Schölkopf, B., Platt, J.C., Shawe-Taylor, J., et al. (2001) Estimating the Support of a High-Dimensional Distribution. Neural Computation, 13, 1443-1471. [Google Scholar] [CrossRef] [PubMed]
[14] Pimentel, M.A.F., Clifton, D.A., Clifton, L., et al. (2014) A Review of Novelty Detection. Signal Processing, 99, 215-249. [Google Scholar] [CrossRef
[15] Hassen, M. and Chan, P.K. (2020) Learning a Neural-Network-Based Representation for Open Set Recognition. Proceedings of the 2020 SIAM International Conference on Data Mining, Cincinnati, 7-9 May 2020, 154-162. [Google Scholar] [CrossRef
[16] Yang, Y., Hou, C., Lang, Y., et al. (2019) Open-Set Human Activity Recognition Based on Micro-Doppler Signatures. Pattern Recognition, 85, 60-69. [Google Scholar] [CrossRef
[17] Roitberg, A., Ma, C., Haurilet, M., et al. (2020) Open Set Driver Activity Recognition. 2020 IEEE Intelligent Vehicles Symposium, Vol. 4, 1048-1053. [Google Scholar] [CrossRef
[18] Gal, Y. and Ghahramani, Z. (2016) Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. International Conference on Machine Learning, New York, 20-22 June 2016, 1050-1059.
[19] Davis, J. and Goadrich, M. (2006) The Relationship between Precision-Recall and ROC Curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, 25-29 June 2006, 233-240. [Google Scholar] [CrossRef
[20] Manning, C. and Schutze, H. (1999) Foundations of Statistical Natural Language Processing. MIT Press, Cambridge.