改进Pelee轻量化网络及在建筑物裂缝检测中的应用
Improved Pelee Light Network and Its Application on Crack Detection
DOI: 10.12677/AIRR.2021.104032, PDF,    国家自然科学基金支持
作者: 宋立博:上海交通大学学生创新中心,上海;费燕琼:上海交通大学机械与动力工程学院,上海
关键词: 深度学习深度网络边缘设备边缘智能目标检测Deep Learning Deep Network Edge Device Edge Intelligence Object Detection
摘要: 针对电力线绝缘子检测及高大建筑物裂缝检测等特殊应用场合,提出在边缘设备上运行深度网络程序实现智能检测的设想。综合考虑常见轻量化网络结构特点、训练难度和运行速度等特点基础上,选择Pelee为所需的轻量化深度网络。为在边缘设备上顺利运行,修改双通道全连接层结构,重新设计由主干层、残差预测层、双通道全连接层、残差预测层组成,以13 × 13为输出的深度学习网络,并在Darknet深度学习框架上设计并实现新型轻量化Pelee学习算法。建立裂缝目标检测Pascal VOC格式数据集,训练后在树莓派4B进行部署测试。结果表明,相对于YOLOv4-tiny算法,Pelee算法在权重文件大小及总计算量等方面具有明显优势,总体性能与YOLOv4-tiny相当。本文创新点在于修改双通道全连接层结构,增加残差预测模块,采用单YOLO输出头结构形式以提高小裂缝检测效果。
Abstract: In view of such special applications as power line insulator inspection with flying aircraft and crack inspection of tall buildings, the idea of running deep network program on edge equipment to realize intelligent detection is put forward in this paper. Taking the structural characteristics, training difficulty and running speed of common lightweight networks into consideration, the Pelee is selected as the required lightweight deep network. In order to run efficiently on some edge devices, the dual-channel dense layer structure was modified, and the new deep learning network consisting of stem block, residual prediction block, dual-channel dense layer and residual prediction block was redesigned with the 13 × 13 image output. Then, the Pelee lightweight learning algorithm and structure was designed on Darknet deep learning framework. After establishing dataset in Pascal VOC format for crack detection and training with Cli command, the Pelee-based crack detection deep network was deployed on RaspberryPi 4B. The results show that the Pelee algorithm has significant advantages in weight file size and total calculation in comparison to the YOLOv4-tiny network and its overall performance can be comparable to that of YOLOv4-tiny. The innovations of this paper focus on modifying structure of the dual-channel dense layer, adding an RPB module, and adopting a single YOLO output head structure to improve the detection effect of small cracks.
文章引用:宋立博, 费燕琼. 改进Pelee轻量化网络及在建筑物裂缝检测中的应用[J]. 人工智能与机器人研究, 2021, 10(4): 313-320. https://doi.org/10.12677/AIRR.2021.104032

参考文献

[1] Wang, R.J., Li, X. and Ling, C.X. (2018) Pelee: A Real-Time Object Detection System on Mobile Devices. https://arxiv.org/pdf/1804.06882.pdf
[2] Wang, R.-J. (2019) Pelee: A Real-Time Object Detection System on Mobile Devices. https://github.com/Robert-JunWang/Pelee
[3] Edison, G. (2018) PeleeNet: A Real-Time Object Detection System on Mobile Devices. https://github.com/GZQ0723/PeleeNet
[4] Li, J. (2020) Pelee: A Real-Time Object Detection System on Mobile Devices, in PyTorch. https://github.com/yxlijun/Pelee.Pytorch
[5] Yang, Y.Z. (2018) PeleeNet. https://github.com/nnUyi/PeleeNet
[6] 李环. 基于轻量级卷积神经网络的交通场景目标检测算法研究[D]: [硕士学位论文]. 广州: 华南理工大学, 2020.
[7] 黄生鹏, 范平清. 基于深度学习的实时车辆检测研究[J]. 软件工程, 2021, 24(1): 13-16, 5.
[8] 产世兵, 刘宁钟, 沈家全. 一种轻量级的不规则场景文本识别模型[J]. 计算机技术与发展, 2020, 30(11): 20-24, 29.
[9] 产世兵, 刘宁钟, 沈家全. 基于轻量级网络的PCB元器件检测[J]. 计算机技术与发展, 2020, 30(10): 14-20.
[10] 连博博. 基于谱分割和卷积网络的图像分割算法的研究与应用[D]: [硕士学位论文]. 苏州: 苏州大学, 2020.
[11] 侯金元. 基于深度视觉感知建模的大视场多类遥感目标检测[D]: [硕士学位论文]. 北京: 北方工业大学, 2020.
[12] 倪伟健, 秦会斌. GSDCPeleeNet: 基于PeleeNet的高效轻量化卷积神经网络[J]. 电子技术应用, 2021, 47(3): 22-26, 30.