基于RGB-D边缘信息融合的接地设备图像语义分割
Semantic Segmentation of Grounding Equipment Image Based on RGB-D Edge Information Fusion
摘要: 传统的接地设备安装质量检测方法主要由工作人员采用手工测量和经验判断的方式来检查,工作量大,检测效率低且存在经验误差,无法准确地测量出安装螺栓的参数信息。针对这一问题,本文提出了一种基于RGB-D边缘信息融合的接地设备图像语义分割方法。首先将获取到的接地设备相连螺栓的可见光和深度图像进行预处理;然后引入注意力辅助模块帮助提取可见光图像特征和深度图像特征,并进行特征融合;通过金字塔池化模块防止过拟合,最后利用边缘信息辅助监督,输出最优的预测图像语义分割结果。实验结果表明,本文方法能够实现对接地设备相连螺栓图像的精确分割,并将其应用于接地设备的安装质量检测之中。
Abstract: The traditional method of inspecting the installation quality of grounding equipment is mainly performed by manual measurement and empirical judgment. The workload is large, the inspec-tion efficiency is low and there are empirical errors. It is difficult to get accurate parameters of the installation bolts. To address this problem, this paper proposes a semantic segmentation method for grounding equipment images based on RGB-D edge information fusion. Firstly, the visible and depth images of the connected bolts of the grounding equipment are preprocessed. Then, an attention assistance module is introduced to help extract visible image features and depth image features, and perform feature fusion. The pyramid pooling module is used to pre-vent overfitting, and the edge information is used to assist supervision, and the optimal predic-tive image semantic segmentation results are output. Experimental results show that this me-thod can achieve accurate segmentation of grounding equipment and apply it to the inspection of the quality of the grounding equipment installation.
文章引用:董景, 薛黎, 许斌, 孙志强, 王琳. 基于RGB-D边缘信息融合的接地设备图像语义分割[J]. 电气工程, 2023, 11(4): 189-196. https://doi.org/10.12677/JEE.2023.114021

参考文献

[1] 王勇, 袁啸阳, 陈铎, 等. 基于多任务卷积神经网络的轨道车辆螺栓异常检测方法[J]. 铁道车辆, 2020, 58(5): 29-32.
[2] 马文琪, 石颉, 吴宏杰. 深度卷积神经网络语义分割综述[J]. 微电子学与计算机, 2023, 40(9): 55-64.
[3] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6): 1229-1251.
[4] 王宝丽, 于龙. 中低速磁浮F轨紧固螺栓松动故障检测[J]. 信息技术, 2019, 43(8): 88-92, 97.
[5] 程敦诚, 王倩, 吴福庆, 等. 基于深度学习的接触网顶紧螺栓状态智能检测[J]. 铁道学报, 2021, 43(11): 52-60.
[6] 周靖, 刘煜, 霍林生. 基于机器视觉的螺栓松动旋转角度测量[J]. 机械设计与研究, 2021, 37(4): 159-162, 175.
[7] Zhang, Y., Sun, X., Loh, K.J., et al. (2020) Autonomous Bolt Loosening Detection Using Deep Learning. Structural Health Monitoring, 19, 105-122. [Google Scholar] [CrossRef
[8] Liu, J., Wang, Y., Li, Y., et al. (2018) Collaborative Deconvolutional Neural Networks for Joint Depth Estimation and Semantic Segmentation. IEEE Transactions on Neural Networks and Learning Systems, 29, 5655-5666. [Google Scholar] [CrossRef
[9] Noh, H., Hong, S. and Han, B. (2015) Learning Deconvolution Network for Semantic Segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, 7-13 December 2015, 1520-1528. [Google Scholar] [CrossRef
[10] He, K., Zhang, X., Ren, S., et al. (2016) Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778. [Google Scholar] [CrossRef
[11] Cheng, Y., Cai, R., Li, Z., et al. (2017) Locality-Sensitive Deconvolution Networks with Gated Fusion for RGB-D Indoor Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 3029-3037. [Google Scholar] [CrossRef
[12] Jiang, J., Zheng, L., Luo, F., et al. (2018) Rednet: Residual Encoder-Decoder Network for Indoor RGB-D Semantic Segmentation. [Google Scholar] [CrossRef
[13] Hu, X., Yang, K., Fei, L., et al. (2019) Acnet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation 2019 IEEE International Conference on Image Processing (ICIP), Taipei, 22-25 September 2019, 1440-1444. [Google Scholar] [CrossRef
[14] Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2017) ImageNet Classification with Deep Convolutional Neural Networks. Communications of the ACM, 60, 84-90. [Google Scholar] [CrossRef
[15] He, K., Zhang, X., Ren, S., et al. (2015) Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 1904-1916. [Google Scholar] [CrossRef
[16] Emlek, A. and Peker, M. (2023) P3SNet: Parallel Pyramid Pooling Stereo Network. IEEE Transactions on Intelligent Transportation Systems, 24, 10433-10444. [Google Scholar] [CrossRef
[17] Chen, L.C., Papandreou, G., Kokkinos, I., et al. (2017) DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848. [Google Scholar] [CrossRef
[18] Wu, D., Guo, Z., Li, A., et al. (2023) Conditional Boundary Loss for Semantic Segmentation. IEEE Transactions on Image Processing, 32, 3717-3731. [Google Scholar] [CrossRef
[19] Chen, L.Z., Lin, Z., Wang, Z., et al. (2021) Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentation. IEEE Transactions on Image Processing, 30, 2313-2324. [Google Scholar] [CrossRef
[20] Zhou, W., Yang, E., Lei, J., et al. (2022) FRNet: Feature Reconstruction Network for RGB-D Indoor Scene Parsing. IEEE Journal of Selected Topics in Signal Processing, 16, 677-687. [Google Scholar] [CrossRef
[21] Seichter, D., Köhler, M., Lewan-dowski, B., et al. (2021) Efficient RGB-D Semantic Segmentation for Indoor Scene Analysis. 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, 30 May-5 June 2021, 13525-13531. [Google Scholar] [CrossRef
[22] Valverde-Albacete, F.J. and Peláez-Moreno, C. (2014) 100% Classification Accuracy Considered Harmful: The Normalized Information Transfer Factor Explains the Accuracy Paradox. PLOS ONE, 9, e84217. [Google Scholar] [CrossRef] [PubMed]
[23] Rezatofighi, H., Tsoi, N., Gwak, J.Y., et al. (2019) Generalized Intersection over Union: A Metric and a Loss for Bounding Box Regression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 15-20 June 2019, 658-666. [Google Scholar] [CrossRef