基于ORB-SLAM的智能手机实时同步定位建图与半稠密三位重构实现
The Alization of Real-Time Semi-Dense 3D Reconstruction and Simultaneous Localization and Mapping of Smart Phone Based on Orb-Slam
DOI: 10.12677/CSA.2020.1011224, PDF,    科研立项经费支持
作者: 卢鹏飞*:深圳市腾讯计算机有限公司,广东 深圳;吕剑清, 王先兵#:武汉大学国家网络安全学院,湖北 武汉;何 涛:中国科学院计算技术研究所,北京;吴中鼎, 柴婉秋:贵阳铝镁设计研究院有限公司,贵州 贵阳
关键词: ORB-SLAM半稠密同时定位与制图AR三维重构ORB-SLAM Semi-Dense Simultaneous Localization and Mapping Augment Reality Three-Dimensional Reconstruction
摘要: 实时定位与环境的三维重构已经成为越来越活跃的研究课题。随着增强现实技术的快速发展,移动设备了解自身位置与周围环境的需求越来越重要。增强现实想要实现追踪、物体识别,实现虚拟数据与现实场景相结合,就必须得到精确而可靠的位姿估计和周围详细的三维场景。相对于其他诸如谷歌眼镜等专用于AR的设备,智能手机作为当前应用范围最广的设备,在智能手机上实现实时定位与制图就变得非常重要。本次研究针对这种情况,基于当前最先进的单目视觉SLAM算法之一ORB-SLAM上实现了智能手机平台上的实时定位与三维重构,并对ORB-SLAM算法进行针对于Android上的优化,使应用可以在近年的智能手机硬件上进行实时定位与三维重构的效果,并且在ORB-SLAM的基础上实现了半稠密的三维重建,可以获得周围环境的轮廓信息而不是地图上稀疏的散点。应用获得到的结果可以用于物体识别与导航以及更有意义并且更加丰富的AR应用。
Abstract: Real-time location and three-dimensional reconstruction of the environment have become an increasingly active research topic. Augmented reality wants to implement tracking, object recognition, data and virtual reality scenarios combining, they must be aware of accurate and reliable pose estimation and around detailed 3D scenes. Compared to others such as Google for AR glasses and other special equipments, smart phone, as the current most widely used equipment, real-time locating and mapping on smartphones become very important. In this case, based on orbslam, one of the most advanced monocular vision slam algorithms, the real-time location and 3D reconstruction on the smartphone platform are realized. The orbslam algorithm is optimized for Android so that applications can be real-time location and the effect of three-dimensional reconstruction, using the smartphone hardware in recent years. And it implements a semi-dense three-dimensional reconstruction on the basis of ORB-SLAM, the contour information may be obtained in surroundings instead of sparse points on the map. The results of the applications got can be used for object recognition and navigation as well as more meaningful and richer AR applications.
文章引用:卢鹏飞, 吕剑清, 王先兵, 何涛, 吴中鼎, 柴婉秋. 基于ORB-SLAM的智能手机实时同步定位建图与半稠密三位重构实现[J]. 计算机科学与应用, 2020, 10(11): 2131-2140. https://doi.org/10.12677/CSA.2020.1011224

参考文献

[1] Smith, R., Self, M. and Cheeseman, P. (1988) Estimating Uncertain Spatial Relationships in Robotics. Journal of Cardi-ovascular Electrophysiology, 5, 435-461.
[2] Mur-Artal, R., Montiel, J.M.M. and Tardos, J.D. (2015) ORB-SLAM: A Versatile and Accurate Monocular SLAM System. Computer Science, 31, 1147-1163. [Google Scholar] [CrossRef
[3] Galvez-López, D. and Tardos, J.D. (2012) Bags of Binary Words for Fast Place Recognition in Image Sequences. IEEE Transactions on Robotics, 28, 1188-1197. [Google Scholar] [CrossRef
[4] Strasdat, H., Montiel, J.M.M. and Davison, A.J. (2010) Scale Drift-Aware Large Scale Monocular SLAM. Robotics: Science and Systems VI, Universidad de Zaragoza, Zaragoza, Spain, 27-30 June 2010. [Google Scholar] [CrossRef
[5] Strasdat, H., Davison, A.J., Montiel, J.M.M., et al. (2011) Double Window Optimisation for Constant Time Visual SLAM. IEEE International Conference on Computer Vision, Barcelona, 6-13 November 2011, 2352-2359. [Google Scholar] [CrossRef
[6] Engel, J., Schöps, T. and Cremers, D. (2014) LSD-SLAM: Large-Scale Direct Monocular SLAM. European Conference on Computer Vision, 8690, 834-849. [Google Scholar] [CrossRef
[7] Concha, A. and Civera, J. (2015) DPPTAM: Dense Piecewise Planar Tracking and Mapping from a Monocular Sequence. IEEE/RSJ International Conference on Intelligent Robots and Systems, Hamburg, 28 September-2 October 2015, 5686-5693. [Google Scholar] [CrossRef
[8] Engel, J., Sturm, J. and Cremers, D. (2013) Semi-Dense Visual Odometry for a Monocular Camera. IEEE International Conference on Computer Vision, Sydney, 1-8 December 2013, 1449-1456. [Google Scholar] [CrossRef
[9] Mur-Artal, R. and Tardos, J.D. (2015) Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM. Robotics: Science and Systems, Rome, 13-17 July 2015. [Google Scholar] [CrossRef
[10] Newcombe, R.A., Lovegrove, S.J. and Davison, A.J. (2010) DTAM: Dense Tracking and Mapping in Real-Time. International Conference on Computer Vision, Barce-lona, 6-13 November 2011, 2320-2327. [Google Scholar] [CrossRef
[11] Davison, A.J., Reid, I.D., Molton, N.D., et al. (2007) MonoSLAM: Real-Time Single Camera SLAM. IEEE Transactions on Pattern Analysis & Machine Intelligence, 29, 1052-1067. [Google Scholar] [CrossRef
[12] Szeliski, R. (2015) Computer Vision: Algorithms and Applications. Journal of Polymer Science Polymer Chemistry Edition, 21, 2601-2605.