用于人脸表情识别的卷积神经网络研究
Research on Facial Expression Recognition Based on Convolutional Neural Network
DOI: 10.12677/CSA.2020.1010194, PDF,  被引量    国家自然科学基金支持
作者: 孙丽萍, 陈红倩:北京工商大学计算机学院,北京;李 慧*:北京联合大学管理学院,北京
关键词: 表情识别卷积神经网络深度学习特征提取图像分类Expression Recognition CNN Deep Learning Feature Extraction Image Classification
摘要: 为了研究卷积神经网络在人脸表情识别中的应用,设计了一种10层的卷积神经网络模型识别人脸表情,最后一层用Softmax函数将表情的分类结果输出。首先,研究了卷积神经网络的卷积和池化算法并设计了模型的结构。其次,为了更形象地展示卷积层提取的特征,把提取的特征做了可视化处理并以特征图的形式展示。本文的卷积神经网络模型在Fer-2013数据集上进行了实验,实验结果展示了识别率的优越性。为了验证模型识别的泛化能力,最后自制了一个自然状态下的人脸表情数据集,并对人脸图片做了裁剪,灰度化以及像素调整等一系列的预处理。用本文模型识别该数据集中的人脸表情图片,识别的准确率达85.1010%。
Abstract: In order to study the application of CNN in the field of facial expression recognition, the 10-layer CNN model is designed. The last layer of said model employs Softmax function to output the expression classification results. Firstly, this study concentrates on the convolution and pooling algorithm as well as the design structure of the model. In addition, the study visualized the extracted features and displayed them in the form of feature maps to show the features extracted by every convolutional layer. The study conducted experiments on the Fer-2013 dataset, and the result demonstrated the efficacy of the model. It is known that the Fer-2013 dataset contains data collected in an experimental environment. Therefore, to prove the effectiveness of the model, the study created a facial expression dataset by collecting facial expression images in a natural, spontaneous setting. The trained model, which was previously applied to the Fer-2013 dataset, was tested out on the new dataset. The experiment yielded promising results, one of which in the form of a recognition accu-racy rate as high as 85.1010%.
文章引用:孙丽萍, 陈红倩, 李慧. 用于人脸表情识别的卷积神经网络研究[J]. 计算机科学与应用, 2020, 10(10): 1843-1852. https://doi.org/10.12677/CSA.2020.1010194

参考文献

[1] Kumbhar, M., Jadhav, A. and Patil, M. (2012) Facial Expression Recognition Based on Image Feature. International Journal of Computer and Communication Engineering, 1, 117-119. [Google Scholar] [CrossRef
[2] Reddy, C., Reddy, U. and Kishore, K. (2019) Facial Emotion Recognition Using NLPCA and SVM. Traitement Du Signal, 36, 13-22. [Google Scholar] [CrossRef
[3] 邓洪波, 金连文. 一种基于局部Gabor滤波器组及PCA+LDA的人脸表情识别方法[J]. 中国图象图形学报, 2007, 12(2): 322-329.
[4] Szegedy, C., Liu, W., Jia, Y.Q., et al. (2014) Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 1-9. [Google Scholar] [CrossRef
[5] Krizhevsky, A., Sutskever, I. and Hinton, G. (2012) ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, 25, 1106-1114.
[6] 陈航, 邱晓晖. 基于卷积神经网络和池化算法的表情识别研究[J]. 计算机技术与发展, 2019, 29(1): 61-65.
[7] 卢官明, 何嘉利, 闫静杰, 等. 一种用于人脸表情识别的卷积神经网络[J]. 南京邮电大学学报: 自然科学版, 2016, 36(1): 16-22.
[8] Jeon, J., et al. (2016) A Real-Time Facial Expression Recognizer Using Deep Neural Network. Proceedings of the 10th International Conference on Ubiquitous Information Management and Com-munication, 1-4. [Google Scholar] [CrossRef
[9] Arriaga, O., Valdenegro-Toro, M. and Plöger, P. (2017) Real-Time Convolutional Neural Networks for Emotion and Gender Classification.
[10] 徐琳琳, 张树美, 赵俊莉. 构建并行卷积神经网络的表情识别算法[J]. 中国图象图形学报, 2019, 24(2): 227-236.
[11] 王忠民, 李和娜, 张荣. 融合卷积神经网络与支持向量机的表情识别[J]. 计算机工程与设计, 2019, 40(12): 3594-3600.
[12] 孙晓, 潘汀, 任福继. 基于ROI-KNN卷积神经网络的面部表情识别[J]. 自动化学报, 2016, 42(6): 883-891.
[13] 黄倩露, 王强. 基于跨连特征融合网络的面部表情识别[J]. 计算机工程与设计, 2019, 40(10): 2969-2973.
[14] 李勇, 林小竹, 蒋梦莹. 基于跨连接LeNet-5网络的面部表情识别[J]. 自动化学报, 2018, 44(1): 176-182.
[15] 钱勇生, 邵洁, 季欣欣, 等. 基于改进卷积神经网络的多视角人脸表情识别[J]. 计算机工程与应用, 2018, 54(24): 12-19.
[16] Goodfellow, I.J., Erhan, D., Carrier, P.L., et al. (2013) Challenges in Representation Learning: A Report on Three Machine Learning Con-tests. Neural Networks, 64, 59-63.