基于双目立体视觉和形变模型的人脸三维重建研究
Research on 3D Reconstruction of Face Based on Binocular Stereo Vision and Deformation Model
DOI: 10.12677/JISP.2018.73019, PDF,    科研立项经费支持
作者: 肖栩豪, 李俊杰, 侯 青, 阮 志:武汉工程大学计算机科学与工程学院,湖北 武汉;王海晖*:武汉工程大学智能机器人湖北省重点实验室,湖北 武汉
关键词: 人脸检测三维重建SIFT算法形变模型Face Detection Three-Dimensional Reconstruction SIFT Algorithm Deformation Model
摘要: 人类通常对事物的感知是从三维的角度出发,要求计算机也能够利用二维人脸图像自动重建相应的三维形状模型。双目下基于形变模型的人脸三维重建,是通过SIFT算法进行特征点匹配、视差计算得到三维坐标,将三维坐标直接应用于人脸形变模型,克服了传统方法寻找二维与三维坐标的大致转换关系,精度低的缺点,从而重建出具有较强真实感的三维人脸模型。
Abstract: People usually perceive things from a three-dimensional perspective, requiring the computer to automatically reconstruct the corresponding three-dimensional shape model using two-dimensional human face images. The three-dimensional face reconstruction based on 3DMM under binocular vision is to use SIFT algorithm for feature point matching and disparity calculation to obtain three-dimensional coordinates. The three-dimensional coordinates are applied directly to the face deformation model, which overcomes the traditional method of finding two-dimensional and three-dimensional coordinates, convert the relationship, the disadvantage of low precision, thus reconstruct a three-dimensional face model with a strong sense of reality.
文章引用:肖栩豪, 李俊杰, 王海晖, 侯青, 阮志. 基于双目立体视觉和形变模型的人脸三维重建研究[J]. 图像与信号处理, 2018, 7(3): 161-169. https://doi.org/10.12677/JISP.2018.73019

参考文献

[1] Zhang, Q. and Pless, R. (2014) Extrinsic Calibration of a Camera and Laser Range Finder (Improves Camera Ealibration). Proceedings of 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), Sendai, 28 September-2 October 2004.
[2] Liao, H.B., Chen, Q.H., Zhou, Q.J., et al. (2012) Nonuniform Resampling Based on Method for Pixel-Wise Correspond-ence between 3D Faces. Journal of Visual Communication and Image Representation, 23, 924-931.
[Google Scholar] [CrossRef
[3] Patel, A. and Smith, W.A.P. (2012) Driving 3D Morphable Models Using Shading Cues. Pattern Recognition, 45, 1993-2004.
[Google Scholar] [CrossRef
[4] Kemelmacher-Shlizerman, I. and Basri, R. (2011) 3D Face Reconstruction from a Single Image. Using a Single Reference Face Shape. IEEE Transactions on Pattern Analysis and Machine Intelligence, 3.
[5] Patel, A. and Smith, W.A.P. (2012) Driving 3D Morphable Models Using Shading Cues. Pattern Recognition, 45, 1993-2004.
[6] 谷天, 陈江龙, 李科, 等. 一种用于三维人脸重建的快速稠密视差图生成方法[J]. 西华大学学报(自然科学版), 2016, 35(1): 77-79.
[7] 隋巧燕, 董洪伟, 刘蕾. 双目下点云的三维人脸重建[J]. 现代电子技术, 2015(4): 102-105.
[8] 鹿乐, 鞠园, 蔡亮, 等. 基于特征分块的快速三维人脸重建[J]. 火力与指挥控制, 2014(z1): 152-155.
[9] 孙曦. 基于双目立体视觉的人脸三维重建与识别[D]: [博士学位论文]. 北京: 中国科学技术大学, 2011.
[10] 王小文. 基于形变模型的多摄像机人脸三维重建[D]: [硕士学位论文]. 北京: 北京理工大学, 2010.
[11] Xu, G. and Zhang, Z. (2013) Epipolaf Geometry in Stereo, Motion and Object Recognition: Aunified Approach. Springer Science & Business Media, Berlin.
[12] 吴子扬, 周大可, 杨欣, 等. 由粗到精的三维人脸稀疏重建方法[J]. 吉林大学学报(信息科学版), 2013, 31(6): 582-588.
[Google Scholar] [CrossRef