基于图像分割及质心拟合法的双指针式工业仪表盘读数识别
Dual Pointer Industrial Meter Reading Recognition Based on Image Segmentation and Centre of Mass Fitting Method
DOI: 10.12677/jisp.2025.141002, PDF,   
作者: 程炳鑫:安徽建徽工程质量检测有限公司,安徽 合肥;朱文锐*:西安建筑科技大学土木工程学院,陕西 西安;程 睿:浙江创悦诚科技有限公司,浙江 杭州;黄瑞丰:中国科学技术大学先进技术研究院涌现科技智能媒体计算联合实验室,安徽 合肥
关键词: 双指针式仪表图像分割质心拟合法读数识别Dual Pointer Meter Image Segmentation Centre of Mass Fitting Method Reading Recognition
摘要: 双指针式仪表盘广泛应用于建筑、材料、化工等工业生产过程中。相比于单指针式仪表盘,双指针式仪表盘存在指针易重叠和双指针读数变化呈现一定联系等特点。为了提高现有双指针式仪表盘读数识别算法的准确性,本研究提出了一种基于图像分割及质心拟合法的读数识别新方法。首先,利用YOLOv8网络从背景图像中分离出大指针表盘和小指针表盘。其次,利用Fast-SCNN将大指针和小指针进行语义分割,并将分割区域的轮廓点集伸展为二维平面以得到质心。最后,通过质心和表盘中心坐标拟合成一条直线,采用该线段与参考线的角度变换来实现初步读数。大小指针的读数采用交叉判断来进行校正,相加之后得到最终的读数。实际工业场景下的实验结果验证了该方法的可行性。
Abstract: Dual pointer instrument meters are widely used in construction, materials, chemical, and other industrial production processes. Compared with single-pointer meters, dual pointer meters have the characteristics of easy overlapping of pointers and a certain correlation between the readings of dual-pointers. To improve the accuracy of the existing dual pointer instrument meters reading recognition algorithm, this study proposes a new reading recognition method based on image segmentation and the center of mass fitting method. First, the YOLOv8 network is used to separate the large pointer dials and small pointer dials from the background image. Next, the large and small pointers are semantically segmented using Fast-SCNN, and the set of contour points in the segmented region is stretched into a two-dimensional plane to obtain the center of mass. Finally, a straight line is fitted to the center of mass and the dial center coordinates, and the angular transformation between this line segment and the reference line is used to achieve the preliminary readings. The readings of the small and large pointers are corrected by cross-judging and summed up to get the final readings. Experiment results in real industrial scenarios verify the feasibility of this method.
文章引用:程炳鑫, 朱文锐, 程睿, 黄瑞丰. 基于图像分割及质心拟合法的双指针式工业仪表盘读数识别[J]. 图像与信号处理, 2025, 14(1): 12-20. https://doi.org/10.12677/jisp.2025.141002

参考文献

[1] 钱玉宝, 王紫涵, 邱腾煌. 指针式仪表读数识别的研究现状与发展[J]. 电子测量技术, 2024, 47(8): 110-119.
[2] Liu, Y., Liu, J. and Ke, Y. (2020) A Detection and Recognition System of Pointer Meters in Substations Based on Computer Vision. Measurement, 152, Article 107333. [Google Scholar] [CrossRef
[3] Zuo, L., He, P., Zhang, C. and Zhang, Z. (2020) A Robust Approach to Reading Recognition of Pointer Meters Based on Improved Mask-RCNN. Neurocomputing, 388, 90-101. [Google Scholar] [CrossRef
[4] 陶金, 林文伟, 曾亮, 张建寰, 赵紫阳, 徐周毅, 张陈涛. 基于YOLOv4-tiny和Hourglass的指针式仪表读数识别[J]. 电子测量与仪器学报, 2023, 37(5): 1-10.
[5] Hou, L., Wang, S., Sun, X. and Mao, G. (2023) A Pointer Meter Reading Recognition Method Based on YOLOX and Semantic Segmentation Technology. Measurement, 218, Article 113241. [Google Scholar] [CrossRef
[6] Poudel, R.P.K, Liwicki, S. and Cipolla, R. (2019) Fast-SCNN: Fast Semantic Segmentation Network.
[7] Girshick, R. (2015). Fast R-CNN. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 7-13 December 2015, 1440-1448.
[8] He, K., Gkioxari, G., Dollar, P. and Girshick, R. (2017) Mask R-CNN. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 2980-2988. [Google Scholar] [CrossRef
[9] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Lecture Notes in Computer Science, Springer, 234-241. [Google Scholar] [CrossRef
[10] Badrinarayanan, V., Kendall, A. and Cipolla, R. (2017) SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2481-2495. [Google Scholar] [CrossRef] [PubMed]
[11] Chen, L., Zhu, Y., Papandreou, G., Schroff, F. and Adam, H. (2018) Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In: Lecture Notes in Computer Science, Springer, 833-851. [Google Scholar] [CrossRef