一种改进的语义视觉里程计优化算法
An Improved Semantic Visual Odometry Optimization Algorithm
摘要: 为了优化移动机器人的视觉SLAM过程中的里程计估算问题,利用视觉图像的语义信息优化使得机器人在进行地图构建过程中的位姿估计更为准确,本文提出了一种改进的视觉里程计优化算法。该算法基于语义视觉里程计算法,提出了一种依赖语义特征不变性对视觉里程计进行约束优化的算法。通过构建由语义分割网络检测结果的语义重投影误差损失函数,并对此函数进行优化求解,从而对视觉SLAM中的里程计实现更高精度的优化。经过实验,结合文中所提出的里程计优化算法的视觉SLAM算法在数据集和实际环境中的里程计误差均有优化。
Abstract: In order to optimize the odometry estimation problem in the visual SLAM process of mobile robots, the semantic information optimization of visual images makes the robot’s pose estimation in the process of map construction more accurate. In this paper, an improved visual odometry optimization algorithm is proposed. Based on the semantic visual odometry algorithm, this algorithm proposes a constrained optimization algorithm for visual odometry relying on the invariance of semantic features. By constructing the semantic reprojection error loss function detected by the semantic segmentation network, and optimizing this function, the odometer in visual SLAM can be optimized with higher precision. After experiments, the visual SLAM algorithm combined with the odometer optimization algorithm proposed in this paper has optimized the odometer errors in both the da-taset and the actual environment.
文章引用:何杰. 一种改进的语义视觉里程计优化算法[J]. 计算机科学与应用, 2022, 12(4): 769-774. https://doi.org/10.12677/CSA.2022.124078

参考文献

[1] 赵洋, 刘国良, 田国会, 等. 基于深度学习的视觉SLAM综述[J]. 机器人, 2017, 39(6): 889-896.
[2] Sengupta, S., Valentin, J., Warrell, J., et al. (2013) Mesh Based Semantic Modelling for Indoor and Outdoor Scenes. CVPR, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Portland, OR, 23-28 June 2013, 2067-2074. [Google Scholar] [CrossRef
[3] Zhao, Z. and Chen, X. (2016) Building 3D Semantic Maps for Mo-bile Robots Using RGB-D Camera. Intelligent Service Robotics, 9, 297-309. [Google Scholar] [CrossRef
[4] Mccormac, J., Handa, A., Davison, A., et al. (2017) SemanticFu-sion: Dense 3D Semantic Mapping with Convolutional Neural Networks. IEEE International Conference on Robotics and Automation (ICRA), Singapore, 29 May-3 June 2017, 4628-4635. [Google Scholar] [CrossRef
[5] Bowman, S.L., Atanasov, N., Daniilidis, K., et al. (2017) Prob-abilistic Data Association for Semantic SLAM. 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 29 May-3 June 2017, 1722-1729. [Google Scholar] [CrossRef
[6] Lianos, K.N., Schnberger, J.L., Pollefeys, M., et al. (2018) VSO: Visual Semantic Odometry. European Conference on Computer Vision (ECCV), 11208, 246-263. [Google Scholar] [CrossRef
[7] Li, P., Qin, T. and Shen, S. (2018) Stereo Vision-Based Se-mantic 3D Object and Ego-Motion Tracking for Autonomous Driving. European Conference on Computer Vision (ECCV), 11206, 664-679. [Google Scholar] [CrossRef
[8] Stenborg, E., Toft, C. and Hammarstrand, L. (2018) Long-Term Visual Localization Using Semantically Segmented Images. 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, 21-25 May 2018, 6484-6490. [Google Scholar] [CrossRef
[9] 陈昱皓, 彭道刚, 王志萍, 等. 基于EM-ORB算法的移动机器人SLAM系统研究[J]. 电气传动, 2020, 50(5): 67-74.
[10] 周单, 董秀成, 张帆, 等. 基于自适应重投影误差单目位姿优化算法[J]. 激光与光电子学进展, 2019, 56(2): 111-118.
[11] 白方. 基于约束最优化的SLAM问题的解法和非线性分析[D]: [硕士学位论文]. 沈阳: 东北大学, 2019.
[12] Schubert, D., Goll, T., Demmel, N., et al. (2018) The TUM VI Benchmark for Evaluating Visu-al-Inertial Odometry. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 1-5 October 2018, 1680-1687. [Google Scholar] [CrossRef
[13] Seichter, D., Khler, M., Lewandowski, B., et al. (2020) Efficient RGB-D Semantic Segmentation for Indoor Scene Analysis. 2021 IEEE International Conference on Robotics and Auto-mation (ICRA), Xi’an, 30 May-5 June 2021, 13525-13531. [Google Scholar] [CrossRef
[14] Campos, C., Elvira, R., Rodríguez, J.J.G., et al. (2020) ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM. IEEE Transactions on Robotics, 37, 1874-1890. [Google Scholar] [CrossRef