一种基于多模态数据的路面平整度评估方法
A Pavement Smoothness Evaluation Method Based on Multimodal Data
摘要: 针对传统路面平整度检测中异物干扰导致的误判问题,本文提出了一种融合加速度传感与视觉识别的多模态动态评估方法。通过时间戳对齐加速度数据与视频帧,计算竖直加速度均方根作为路面平整度指数,采用图像分类模型排除异物导致的加速度波动干扰,修正了异物导致的加速度数据波动,并将修正前后的平整度曲线在软件中展示。实验结果表明,在固定路段检测中多模态方法将检测准确率从单模态的67.9%提升至95.0%,绝对准确率提高27.1个百分点;由路面异物干扰导致RMSVA波动情况244次,成功识别并修正路面平整度测量结果206次,该方法能避免84.4%由异物导致的路面平整度测量的问题,修正后各路段竖直加速度均方根降幅达19.1%~25.0%。该方法通过“振动感知–视觉校验–动态修复”闭环处理机制,在保持检测实时性的同时,降低设备成本约65%,为道路养护提供了高性价比的动态检测方案。
Abstract: To address the misjudgment caused by foreign object interference in traditional pavement smoothness detection, this study proposes a multimodal dynamic evaluation method integrating acceleration sensing and visual recognition. By synchronizing acceleration data with video frames through timestamp alignment, the root mean square of vertical acceleration (RMSVA) is calculated as the pavement smoothness index. An image classification model is employed to eliminate acceleration fluctuations induced by foreign objects, and correct acceleration data fluctuations caused by foreign objects. The pre- and post-correction smoothness profiles are visualized in the software interface. Experimental results demonstrate that the multimodal approach in the fixed road section detection improves detection accuracy from 67.9% to 95.0% in single modality, achieving an absolute accuracy increase of 27.1 percentage points. RMSVA fluctuation events caused by the interference of foreign objects on the road surface were found to fluctuate for 244 times, the pavement smoothness measurement results were successfully identified and corrected for 206 times, and the method can avoid 84.4% of the problems caused by the foreign object in the measurement of pavement smoothness. The corrected RMSVA values exhibited reductions ranging from 19.1% to 25.0% across test sections. Through the closed-loop processing mechanism of “vibration perception-visual verification-dynamic correction”, the method reduces equipment costs by approximately 65% while maintaining real-time detection capabilities, providing a cost-effective dynamic inspection solution for road maintenance.
文章引用:徐润翔, 王启源, 孟坤. 一种基于多模态数据的路面平整度评估方法[J]. 人工智能与机器人研究, 2025, 14(3): 719-730. https://doi.org/10.12677/airr.2025.143070

参考文献

[1] 交通运输部. 公路“十四五”发展规划[M]. 北京: 人民交通出版社, 2023.
[2] Balzer, L. and Leclercq, L. (2022) Modal Equilibrium of a Tradable Credit Scheme with a Trip-Based MFD and Logit-Based Decision-Making. Transportation Research Part C: Emerging Technologies, 139, Article ID: 103642. [Google Scholar] [CrossRef
[3] Zhang, D. and Li, Q. (2015) A Review of Rapid Detection Technology for Highway Pavement. Surveying. Mapping and Geographic Information Systems (GIS), 40, 1-8.
[4] 交通运输部. JTG 5210-2023公路技术状况评定标准[S]. 北京: 人民交通出版社, 2023.
[5] Zhang, Y., Wang, C. and Li, Q. (2021) Autonomous Pavement Inspection Vehicle with Multi-Sensor Fusion. Automation in Construction, 131, Article ID: 103892.
[6] Liu, X., Chen, Z. and Wu, H. (2022) Deep Learning-Based Crack Detection for Road Condition Assessment. IEEE Transactions on Intelligent Transportation Systems, 23, 4567-4578.
[7] 交通运输部. JTG/T 3430-2020公路路面性能自动化检测技术规范[S]. 北京: 人民交通出版社, 2020.
[8] Li, H., Zhou, Y. and Zhang, T. (2023) Edge Computing-Enabled Real-Time Pavement Monitoring System. Sensors, 23, Article 2345.
[9] Wang, K., Xu, M. and Lu, J. (2022) UAV-Assisted Pavement Inspection with Hyperspectral Imaging. Remote Sensing, 14, Article 2876.
[10] Yeganeh, S.F., Mahmoudzadeh, A., Azizpour, M.A., et al. (2019) Validation of Smartphone-Based Pavement Roughness Measures. AUT Journal of Civil Engineering, 1, 135-144.
[11] Aleadelat, W., Ksaibati, K., Wright, C.H.G. and Saha, P. (2018) Evaluation of Pavement Roughness Using an Android-Based Smartphone. Journal of Transportation Engineering, Part B: Pavements, 144, Article ID: 04018033. [Google Scholar] [CrossRef
[12] Nagayama, T., Miyajima, A., Kimura, S., Shimada, Y. and Fujino, Y. (2013) Road Condition Evaluation Using the Vibration Response of Ordinary Vehicles and Synchronously Recorded Movies. Journal of Transportation Engineering, 139, 1120-1128.
[13] Tai, Y.C., Chan, C.W. and Hsu, Y.J. (2010) Automatic Road Anomaly Detection Using Smart Mobile Device. Proceedings of the 2010 15th Conference on Artificial Intelligence and Applications (TAAI), Hsinchu, 2010, 123-128.
[14] Chen, L., Wu, Z. and Wang, J. (2023) Dynamic Pavement Index Using Fused Acceleration and Suspension Response data. IEEE Transactions on Intelligent Transportation Systems, 24, 7123-7134.
[15] Wang, X., Liu, Y. and Zhang, H. (2024) Deep Spectral Clustering for Pavement Anomaly Detection. Automation in Construction, 158, Article ID: 105231.
[16] Zeng, H., Park, H., Smith, B.L., et al. (2018) Feasibility Assessment of a Smartphone-Based Application to Estimate Road Roughness. KSCE Journal of Civil Engineering, 22, 3120-3129.
[17] Li, H., Zhang, Q. and Wang, P. (2024) NeRF-Based 3D Pavement Reconstruction with Inertial-Visual Fusion. Automation in Construction, 158, Article ID: 105231.
[18] Zhou, Y., Liu, X. and Chen, Z. (2023) Event-Based Spatiotemporal Registration for Multimodal Road Sensing. IEEE Sensors Journal, 23, 16890-16903.
[19] Huang, Y., Zhuang, X. and Cheng, M. (2024) Multi-Task Learning for Road Condition Assessment. Transportation Research Part C: Emerging Technologies, 159, Article ID: 104458.
[20] Xu, M., Wang, Y. and Li, H. (2023) Cross-Modal Feature Fusion for Pavement Defect Detection. Mechanical Systems and Signal Processing, 188, Article ID: 110023.
[21] Guo, L., Zhang, T. and Liu, K. (2024) Domain Adaptation for Road Anomaly Detection under Varying Conditions. IEEE Transactions on Industrial Informatics, 20, 812-823.
[22] Wang, H. and Zhang, P. (2017) Research on Road Surface Smoothness Evaluation Method Based on Smartphone. Journal of Highway and Transportation Research and Development, No. 5, 188-191.