基于神经网络的疲劳驾驶检测方法研究
Research on Fatigue Driving Detection Method Based on Neural Network
DOI: 10.12677/PM.2023.135133, PDF,    国家自然科学基金支持
作者: 张育榕, 谷 昆, 张轩雄:上海理工大学,光电信息与计算机工程学院,上海
关键词: 交通事故疲劳驾驶检测人脸检测PERCLOS眼部状态嘴部状态头部姿态神经网络Traffic Accidents Drowsy Driving Detection Face Detection PERCLOS Eye State Mouth State Head Posture Neural Networks
摘要: 由于疲劳驾驶是导致交通事故的重要原因。因此,针对疲劳驾驶检测,本文提出一种基于神经网络的疲劳检测方法。对于传统疲劳检测技术检测精度不高、综合检测能力不足等问题提出了相应的改进策略,这对预防疲劳驾驶、提高驾驶安全具有重要的意义。本文的主要工作如下:1) 采用基于Retina Face算法的人脸检测网络,同时本文收集了大量局部遮挡和大姿态偏转的人脸图像作为训练样本,使得人脸检测模型更加灵活,解决了传统人脸检测算法对于人脸姿态要求过严的缺点。2) 本文从驾驶员眼部、嘴部以及头部姿态出发,基于神经网络的方法,综合分析驾驶员的疲劳状态。当系统存在某一指标失效时,依然可以正常检测出驾驶员的疲劳状态,具有一定的容错性。此外,借鉴PERCLOS经验准则,提出了基于一定时间周期的疲劳判定法,使系统对于驾驶员的疲劳预估更加准确。实验结果表明,使用本文提出的方法,能够实现多特征点的定位与识别,且基于眼部状态以及嘴部状态预测疲劳的精度分别达到了97.1%和97.5%,根据头部状态预测疲劳的精度达到了88.1%,处理速度也达到了每张图片62 ms。相较于传统只基于眼部状态检测疲劳的方法,本文提出的算法在保证准确率和效率的前提下,提高了综合检测能力。
Abstract: Fatigue driving is an important cause of traffic accidents. Therefore, for fatigue driving detection, this paper puts forward a fatigue detection technology based on deep learning, and puts forward corresponding improvement strategies for the problems of low detection accuracy and poor real-time performance of traditional fatigue detection technology, which is of great significance to prevent fatigue driving and improve driving safety. The main work of this paper is as follows: 1) The face detection network based on Retina Face algorithm is adopted, and a large number of face images with partial occlusion and large posture deflection are collected as training samples, which makes the face detection model more flexible and solves the shortcoming that the traditional face detection algorithm requires too strict face posture. 2) Based on the attitude of the driver’s eyes, mouth and head, this paper comprehensively analyzes the driver’s fatigue state based on the method of neural network. When a certain index of the system fails, the fatigue state of the driver can still be detected normally, which has a high enough fault tolerance rate. In addition, a fatigue judgment method based on a certain time period is proposed by referring to PERCLOS, which makes the system more accurate for driver fatigue prediction. The experimental results show that the method proposed in this paper can realize the location and recognition of multi-feature points, and the accuracy of fatigue prediction base on the eye state and mouth state is 97.1% and 97.5% respectively. The accuracy of fatigue prediction base on the head state is 88.1%, and the processing speed of each image is 62 ms. Compared with the traditional fatigue detection methods of only de-tecting eye state, the algorithm proposed in this paper improves the comprehensive detection ca-pability, based on sufficient accuracy and efficiency.
文章引用:张育榕, 谷昆, 张轩雄. 基于神经网络的疲劳驾驶检测方法研究[J]. 理论数学, 2023, 13(5): 1298-1314. https://doi.org/10.12677/PM.2023.135133

参考文献

[1] Sayed, R. and Eskandarian, A. (2001) Unobtrusive Drowsiness Detection by Neural Network Learning of Driver Steering. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 215, 969-975. [Google Scholar] [CrossRef
[2] 柴萌. 长途客车驾驶员疲劳状态辨识与预警[D]: [博士学位论文]. 长春: 吉林大学, 2019.
[3] 陈志勇, 杨佩, 彭力, 莫子兴, 蔡岗. 基于BP神经网络的驾驶员疲劳监测研究[J]. 计算机科学, 2015, 42(S1): 67-69+93.
[4] 王斐, 王少楠, 王惜慧, 彭莹, 杨乙丁. 基于脑电图识别结合操纵特征的驾驶疲劳检测[J]. 仪器仪表学报, 2014, 35(2): 398-404.
[5] Chuang, C.-H., Huang, C.-S., Ko, L.W. and Lin, C.-T. (2015) An EEG-Based Perceptual Function Integration Network for Application to Drowsy Driving. Knowledge-Based Systems, 80, 143-152. [Google Scholar] [CrossRef
[6] 徐礼胜, 张闻勖, 庞宇轩, 吴承暘. 基于短时心电信号的疲劳驾驶检测算法[J]. 东北大学学报(自然科学版), 2019, 40(7): 937-941.
[7] Reddy, B., Kim, Y.H., Yun, S., et al. (2017) Real-Time Driver Drowsiness Detection for Embedded System Using Model Compression of Deep Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, 21-26 July 2017, 121-128. [Google Scholar] [CrossRef
[8] 李文学, 谢凯. 基于深度学习的疲劳驾驶检测方法研究[J]. 电子世界, 2019(17): 51-52.
[9] Papageo, R., Giou, C.P., et al. (1998) A General Framework for Object Detection. Proceedings of the 6th International Conference on Computer Vision, Bombay, 4-7 January 1998, 555-562.
[10] 潘志庚, 刘荣飞, 张明敏. 基于模糊综合评价的疲劳驾驶检测算法研究[J]. 软件学报, 2019, 30(10): 2954-2963.
[11] Ed-Doughmi, Y., Idrissi, N. and Hbali, Y. (2020) Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network. Journal of Imaging, 6, 8.
[12] Deng, J.K., Guo, J., Zhou, Y.X., et al. (2019) RetinaFace: Single-Stage Dense Face Localisation in the Wild. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 5202-5211. [Google Scholar] [CrossRef
[13] Ren, S.Q., Cao, X.D., Wei, Y.C., et al. (2016) Face Alignment via Regressing Local Binary Features. IEEE Transactions on Image Processing, 25, 1233-1245. [Google Scholar] [CrossRef
[14] Valle, R., et al. (2019) Face Alignment Using a 3D Deep-ly-Initialized Ensemble of Regression Trees. Computer Vision and Image Understanding, 189, Article ID: 102846. [Google Scholar] [CrossRef
[15] 万杨. 显性形状回归的人脸对齐方法实验研究[D]: [硕士学位论文]. 大连: 大连理工大学, 2015.
[16] 程泽, 林富生, 靳朝, 周鼎贺. 基于轻量化卷积神经网络的疲劳驾驶检测[J]. 重庆理工大学学报(自然科学), 2022, 36(2): 142-150.
[17] 周壮壮, 陈艳, 唐苏, 龚桂玉, 周丹. 基于PERCLOS的眼部疲劳检测系统研究[J]. 集成电路应用, 2021, 38(2): 48-49.
[18] Li, W. and Liu, K. (2021) Con-fidence-Aware Object Detection Based on MobileNetv2 for Autonomous Driving. Sensors (Basel, Switzerland), 21, Article No. 2380. [Google Scholar] [CrossRef] [PubMed]
[19] 李庆臣. 基于面部特征的疲劳驾驶检测系统设计[D]: [硕士学位论文]. 郑州: 郑州大学, 2019.