基于点线特征融合的实时视觉惯性SLAM算法
Real-Time Visual Inertial SLAM Algorithm Based on Point-Line Feature Fusion
摘要: 针对室内弱纹理、光照不足环境下基于点特征的视觉同步定位和建图(SLAM)方法存在的轨迹漂移、特征缺失等问题,本文引入具有更丰富的场景结构信息的线特征,提出了一种点线特征结合的视觉惯性SLAM方法。首先,在特征检测中引入优化的双线性插值法,并采用迭代的方法来寻找亚像素角点;并通过金字塔光流和向前向后检测方法提升跟踪的鲁棒性;其次,针对构建雅可比矩阵时残差量不同,采用分步边缘化的方式,提升了后端非线性优化的时间。实验结果表明,改进后的算法在复杂环境中的适应能力和鲁棒性显著增强,相比PL-VINS算法,边缘化速度平均提升30%,平均精度提升18.2%。
Abstract: Aiming at the problems of trajectory drift and missing features in the visual simultaneous localization and map building (SLAM) method based on point features in the indoor weak texture and insufficient light environment, a visual-inertial SLAM method combining point and line features is proposed by introducing line features with richer scene structure information in this paper. Firstly, an optimized bilinear interpolation method is introduced in feature detection and an iterative approach is used to find sub-pixel corner points, and the robustness of tracking is improved by pyramidal optical flow and forward-backward detection methods; secondly, stepwise marginalization is used to improve the back-end nonlinear optimization time with respect to the different amount of residuals when constructing the Jacobi matrix. The experimental results show that the improved algorithm is significantly more adaptable and robust in complex environments, with an average increase of 30% in the marginalization speed and 18.2% in the average accuracy compared to the PL-VINS algorithm.
文章引用:王慧江, 王超. 基于点线特征融合的实时视觉惯性SLAM算法[J]. 人工智能与机器人研究, 2025, 14(3): 769-782. https://doi.org/10.12677/airr.2025.143074

参考文献

[1] 张杰, 裴东, 高文辉. 一种基于点和线的视觉惯性SLAM算法[J]. 计算机科学与应用, 2021, 11(12): 2862-2871.
[2] 曾超, 郑茜颖, 程树英. 基于VINS-Mono的室内机器人定位系统[J]. 传感器与微系统, 2022, 41(11): 85-88.
[3] Qin, T., Li, P. and Shen, S. (2018) VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator. IEEE Transactions on Robotics, 34, 1004-1020. [Google Scholar] [CrossRef
[4] Zhang, J., Yang, J., Shang, Q. and Li, M. (2023) PLI-VIO: Real-Time Monocular Visual-Inertial Odometry Using Point and Line Interrelated Features. International Journal of Control, Automation and Systems, 21, 2004-2019. [Google Scholar] [CrossRef
[5] Jin, T., Tang, W. and Wang, G. (2022). Robust Visual SLAM Systems with Constrained Sub-Pixel Corners and High-Quality Line Features. 2022 The 5th International Conference on Control and Computer Vision, Xiamen, 19-21 August 2022, 101-106.[CrossRef
[6] Fu, Q., Wang, J., Yu, H., et al. (2020) PL-VINS: Real-Time Monocular Visual-Inertial SLAM with Point and Line Features. arXiv: 2009.07462.
[7] von Gioi, R.G., Jakubowicz, J., Morel, J. and Randall, G. (2010) LSD: A Fast Line Segment Detector with a False Detection Control. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 722-732. [Google Scholar] [CrossRef] [PubMed]
[8] Fan, Y., Zhao, T. and Wang, G. (2024) SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 16-22 June 2024, 17964-17973. [Google Scholar] [CrossRef
[9] 杨靖帆, 何汉武, 吴悦明. 局部特征描述改进的LK跟踪注册方法[J]. 计算机工程与设计, 2020, 41(2): 458-464.
[10] Krishnamoorthy, and Goswami, S. (2022) Comparison of Image Interpolation Methods for Image Zooming. 2022 11th International Conference on System Modeling & Advancement in Research Trends (SMART), Moradabad, 16-17 December 2022, 1413-1417. [Google Scholar] [CrossRef
[11] Yao, X., Zhao, J., Zhou, Z., et al. (2021) Multi-Level Pixel Detection Algorithm Based on Monocular Visual Inertial System. ISCTT 2021; 6th International Conference on Information Science, Computer Technology and Transportation, Xishuangbanna, 26-28 November 2021, 1-5.
[12] Yang, H., Yuan, J., Gao, Y., Sun, X. and Zhang, X. (2023) UPLP-SLAM: Unified Point-Line-Plane Feature Fusion for RGB-D Visual SLAM. Information Fusion, 96, 51-65. [Google Scholar] [CrossRef
[13] Zhang, C., Gu, S., Li, X., Deng, J. and Jin, S. (2024) VID-SLAM: A New Visual Inertial SLAM Algorithm Coupling an RGB-D Camera and IMU Based on Adaptive Point and Line Features. IEEE Sensors Journal, 24, 41548-41562. [Google Scholar] [CrossRef
[14] Zhu, F., Ren, Y. and Zhang, F. (2022) Robust Real-Time Lidar-Inertial Initialization. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, 23-27 October 2022, 3948-3955. [Google Scholar] [CrossRef
[15] Wang, S., Zhang, A., Zhang, Z. and Zhao, X. (2023) Real-Time Monocular Visual-Inertial SLAM with Structural Constraints of Line and Point-Line Fusion. Intelligent Service Robotics, 17, 135-154. [Google Scholar] [CrossRef