基于三维变径螺旋线的路侧激光雷达和相机联合标定的方法
Roadside LiDAR-Camera Calibration Based on 3D Variable Diameter Spiral
DOI: 10.12677/csa.2024.147164, PDF,    科研立项经费支持
作者: 高 博, 吴 霞*, 王 平:同济大学电子与信息工程学院,上海
关键词: 车路协同联合标定激光雷达相机路侧感知Cooperative Vehicle Infrastructure System Joint Calibration LiDAR Camera Roadside Perception
摘要: 车路协同技术是车联网发展新阶段迫切需求的一个方向,进行路侧激光雷达和相机设备的联合标定成为实现智慧道路的必要工作。鉴于路侧与单车智能传感器部署场景的不同,本文设计了一种适用于路侧联合标定的特殊标记物,主体结构为三维变径螺旋线。首先,在激光雷达和相机的共视区分别采集标记物的点云数据和图像数据;对于点云,采用改进的随机采样一致性算法提取螺旋线结构并进行点云补全;对于图像,采用语义分割技术获取标记物的像素信息,进行距离变换形成激励掩码。我们将标定计算流程分为两个阶段。在粗标定阶段,构建pnp问题的模型获得联合标定参数旋转矩阵R和平移向量t的初始值;在细标定阶段,构建目标函数,最大化标记物点云在图像掩码上的投影覆盖率来优化标定参数。实验结果验证了所提方法相比传统方法在标定效率、鲁棒性和精度上具有显著优势,为车路协同系统中传感器的空间校准提供了有效的解决思路。
Abstract: Cooperative Vehicle Infrastructure System (CVIS) is a crucial direction in the development of Internet of Vehicles, making the spatial calibration of roadside LiDAR and camera essential for implementing intelligent roadside systems. Given the differences in deployment scenarios between roadside and onboard intelligent sensors, a unique marker is designed specifically for roadside spatial calibration, featuring a three-dimensional variable-diameter helical structure. Initially, point cloud and image of the marker are collected respectively in the common field of view of the LiDAR and camera. For the point cloud, an improved Random Sample Consensus (RANSAC) algorithm is used to extract the marker and complete the point cloud. For the images, semantic segmentation technology is employed to obtain pixel information of the marker and perform distance transformation to create an excitation mask. The calibration process is divided into two stages. In the coarse calibration stage, a model based on the perspective-n-point (PNP) problem is constructed to obtain initial values for the spatial calibration parameters, including the rotation matrix R and translation vector t. In the fine calibration stage, an objective function is constructed to optimize the calibration parameters by maximizing the projection coverage of the marker’s point cloud on the image mask. Experimental results demonstrate that the proposed method significantly outperforms traditional methods in terms of calibration efficiency, robustness, and accuracy, providing effective technical support for spatial calibration of sensors in Cooperative Vehicle Infrastructure System.
文章引用:高博, 吴霞, 王平. 基于三维变径螺旋线的路侧激光雷达和相机联合标定的方法[J]. 计算机科学与应用, 2024, 14(7): 66-77. https://doi.org/10.12677/csa.2024.147164

参考文献

[1] Roriz, R., Cabral, J. and Gomes, T. (2021) Automotive LiDAR Technology: A Survey. IEEE Transactions on Intelligent Transportation Systems, 23, 6282-6297. [Google Scholar] [CrossRef
[2] Wang, X., Li, K. and Chehri, A. (2023) Multi-Sensor Fusion Technology for 3D Object Detection in Autonomous Driving: A Review. IEEE Transactions on Intelligent Transportation Systems, 25, 1148-1165. [Google Scholar] [CrossRef
[3] Li, X., Xiao, Y., Wang, B., et al. (2023) Automatic Targetless LiDAR—Camera Calibration: A Survey. Artificial Intelligence Review, 56, 9949-9987. [Google Scholar] [CrossRef
[4] Zhang, Q. and Pless, R. (2004) Extrinsic Calibration of a Camera and Laser Range Finder (Improves Camera Calibration). 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, 28 September-2 October 2004, 2301-2306.
[5] Datta, A., Kim, J.S. and Kanade, T. (2009) Accurate Camera Calibration Using Iterative Refinement of Control Points. 2009 IEEE 12th International Conference on Computer Vision Workshops, Kyoto, 27 September-4 October 2009, 1201-1208. [Google Scholar] [CrossRef
[6] Park, Y., Yun, S., Won, C.S., et al. (2014) Calibration Between Color Camera and 3D LIDAR Instruments with a Polygonal Planar Board. Sensors, 14, 5333-5353. [Google Scholar] [CrossRef] [PubMed]
[7] Yan, G., He, F., Shi, C., et al. (2023) Joint Camera Intrinsic and Lidar-Camera Extrinsic Calibration. 2023 IEEE International Conference on Robotics and Automation, London, 29 May-2 June 2023, 11446-11452. [Google Scholar] [CrossRef
[8] Beltrán, J., Guindel, C., de la Escalera, A., et al. (2022) Automatic Extrinsic Calibration Method for Lidar and Camera Sensor Setups. IEEE Transactions on Intelligent Transportation Systems, 23, 17677-17689. [Google Scholar] [CrossRef
[9] 王世强, 孟召宗, 高楠, 等. 激光雷达与相机融合标定技术研究进展[J]. 红外与激光工程, 2023, 52(8): 111-124.
[10] Yuan, C., Liu, X., Hong, X., et al. (2021) Pixel-Level Extrinsic Self Calibration of High Resolution Lidar and Camera in Targetless Environments. IEEE Robotics and Automation Letters, 6, 7517-7524. [Google Scholar] [CrossRef
[11] Liu, X., Yuan, C. and Zhang, F. (2022) Targetless Extrinsic Calibration of Multiple Small FoV LiDARs and Cameras Using Adaptive Voxelization. IEEE Transactions on Instrumentation and Measurement, 71, 1-12. [Google Scholar] [CrossRef
[12] Song, W.S., Zhang, Z.H. and Gao, N. (2022) Spatial Pose Calibration Method for Lidar and Camera Based on Intensity Information. Laser and Optoelectronics Progress, 59, Article 0215003. [Google Scholar] [CrossRef
[13] Pandey, G., McBride, J.R., Savarese, S., et al. (2015) Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information. Journal of Field Robotics, 32, 696-722. [Google Scholar] [CrossRef
[14] Levinson, J. and Thrun, S. (2013) Automatic Online Calibration of Cameras and Lasers. [Google Scholar] [CrossRef
[15] Fischler, M.A. and Bolles, R.C. (1981) Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM, 24, 381-395. [Google Scholar] [CrossRef
[16] Wang, C.Y., Yeh, I.H. and Liao, H.Y.M. (2024) YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. arXiv: 2402.13616.
[17] Gao, X.S., Hou, X.R., Tang, J., et al. (2003) Complete Solution Classification for the Perspective-Three-Point Problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 930-943. [Google Scholar] [CrossRef
[18] Zhu, Y., Li, C. and Zhang, Y. (2020) Online Camera-Lidar Calibration with Sensor Semantic Information. 2020 IEEE International Conference on Robotics and Automation, Paris, 31 May-31 August 2020, 4970-4976. [Google Scholar] [CrossRef