基于无人机可见光影像和点目标检测的烟草烟株计数
Counting Tobacco Plants Based on UAV Visible Images and Point-Wise Object Detection
DOI: 10.12677/csa.2025.158205, PDF,    科研立项经费支持
作者: 张雨轩:济南云稷数字科技有限公司,山东 济南;聊城大学农学与农业工程学院,山东 聊城;黄 姗*, 黄永新, 潘 羲, 苏忠祯, 江昌盛:福建省三明市烟草公司沙县分公司,福建 三明;崔文昌, 赵仁杰, 胡耀红:济南云稷数字科技有限公司,山东 济南
关键词: 烟草烟株无人机影像中心点检测深度学习Tobacco UAV Image Center Point Detection Deep Learning
摘要: 无人机是一种灵活、便携、实时、高效的影像采集工具,被普遍应用于烟草烟株定位及计数,本研究以烟草烟株为研究对象,以无人机影像为数据,提出一种新的烟草烟株记数深度学习模型,该模型区别于传统的基于外围矩形框的目标检测,本文以中心点预测为目标学习烟草区域尺度形态,并采用轻量级的编、解码器从无人机遥感影像快速识别烟草。首先,本文提出的模型针对烟草植物形态学特点,通过中心关键点标注的方法,采用了基于SSD (Single Shot Multibox Detector)的多层特征融合方法,将来自不同深度层次的特征图进行融合,有效提高了目标检测的准确率。其次,对比分析了检测模型在不同高度的图像下的检测精度,本文提出的CDNet平均检测精度 > 98.89%,满足业务化应用的需求。本文提出的烟草烟株计数深度学习模型能够准确地检测不同飞行高度和不同生长期的无人机遥感影像中的烟草烟株,为烟草烟株的生长监测提供可靠数据支持。
Abstract: Drones are flexible, portable, real-time, and efficient tools for locating and counting tobacco plants. This study proposes a new deep learning model that detects tobacco plants from drone remote sensing images. Unlike traditional object detection methods that use rectangular boxes to enclose the targets, this model predicts the center point of each tobacco plant and learns its scale and shape. The model also uses a lightweight encoder and decoder to quickly identify tobacco plants from the images. The main contributions of this paper are as follows: First, the model adapts to the morphological characteristics of tobacco plants and uses a center key point annotation method. It also employs a multi-layer feature fusion method based on SSD (Single Shot Multibox Detector) to combine feature maps from different depth levels, which effectively improves the detection accuracy. Second, the model is tested on images at different heights and compared with other detection methods. The average detection accuracy of the proposed CDNet is higher than 98.89%, which meets the requirements of practical applications. The proposed deep learning model can accurately detect tobacco plants in drone remote sensing images with varying flight altitudes, growth stages, and resolutions, providing reliable data support for monitoring the growth of tobacco plants.
文章引用:张雨轩, 黄姗, 崔文昌, 赵仁杰, 黄永新, 潘羲, 胡耀红, 苏忠祯, 江昌盛. 基于无人机可见光影像和点目标检测的烟草烟株计数[J]. 计算机科学与应用, 2025, 15(8): 151-160. https://doi.org/10.12677/csa.2025.158205

参考文献

[1] Osco, L.P., Marcato Junior, J., Marques Ramos, A.P., de Castro Jorge, L.A., Fatholahi, S.N., de Andrade Silva, J., et al. (2021) A Review on Deep Learning in UAV Remote Sensing. International Journal of Applied Earth Observation and Geoinformation, 102, Article ID: 102456. [Google Scholar] [CrossRef
[2] 李佛琳. 基于光谱的烟草生长与品质监测研究[D]: [博士学位论文]. 南京: 南京农业大学, 2006.
[3] 尹慧, 蒋云雨, 姜自斌, 等, 基于无人机遥感简析烟田监测技术的应用现状[J]. 农业工程技术, 2022, 42(6): 28-29.
[4] 李朋彦. 基于无人机高光谱遥感的烤烟生长监测[D]: [博士学位论文]. 郑州: 河南农业大学, 2019.
[5] Ostu, N. and Nobuyuki, O.A. (1979) A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics, 9, 62-66. [Google Scholar] [CrossRef
[6] Moravec, H.P. (1980) Obstacle Avoidance and Navigation in the Real World by a Seeing Robot Rover. Stanford University.
[7] Wang, C., Bochkovskiy, A. and Liao, H.M. (2023) YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 7464-7475. [Google Scholar] [CrossRef
[8] Sun, X., Peng, J., Shen, Y. and Kang, H. (2020) Tobacco Plant Detection in RGB Aerial Images. Agriculture, 10, Article No. 57. [Google Scholar] [CrossRef
[9] Ren, S., He, K., Girshick, R. and Sun, J. (2017) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149. [Google Scholar] [CrossRef] [PubMed]
[10] Long, J., Shelhamer, E. and Darrell, T. (2015) Fully Convolutional Networks for Semantic Segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 7-12 June 2015, 3431-3440. [Google Scholar] [CrossRef
[11] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, 5-9 October 2015, 234-241. [Google Scholar] [CrossRef
[12] Zeng, L., Xu, X., Cai, B., Qiu, S. and Zhang, T. (2017) Multi-Scale Convolutional Neural Networks for Crowd Counting. 2017 IEEE International Conference on Image Processing (ICIP), Beijing, 17-20 September 2017, 465-469. [Google Scholar] [CrossRef
[13] Lu, H., Cao, Z., Xiao, Y., Zhuang, B. and Shen, C. (2017) TasselNet: Counting Maize Tassels in the Wild via Local Counts Regression Network. Plant Methods, 13, 1-17. [Google Scholar] [CrossRef] [PubMed]
[14] Guo, H. (2023) Wheat Head Counting by Estimating a Density Map with Convolutional Neural Networks.
[15] Kitano, B.T., Mendes, C.C.T., Geus, A.R., et al. (2019) Corn Plant Counting Using Deep Learning and UAV Images. IEEE Geo-Science and Remote Sensing Letters, 1-5.
[16] 王帅, 郭治兴, 梁雪映, 等. 基于无人机多光谱遥感数据的烟草植被指数估产模型研究[J]. 山西农业科学, 2021, 49(2): 195-203.
[17] 饶雄飞, 周龙宇, 杨春雷, 等. 基于无人机多光谱影像和关键点检测的雪茄烟株数提取[J]. 农业机械学报, 2023, 54(3): 266-273.
[18] Peppa, M.V., Hall, J., Goodyear, J. and Mills, J.P. (2019) Photogrammetric Assessment and Comparison of DJI Phantom 4 Pro and Phantom 4 RTK Small Unmanned Aircraft Systems. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2, 503-509. [Google Scholar] [CrossRef
[19] Russell, B., Torralba, A., Murphy, K. and Freeman, W.T. (2007) LabelMe: A Database and Web-Based Tool for Image Annotation. International Journal of Computer Vision, 77, 157-173.
[20] Zheng, S., Xie, Y., Li, M., Xie, C. and Li, W. (2022) A Novel Strategy for Global Lane Detection Based on Key-Point Regression and Multi-Scale Feature Fusion. IEEE Transactions on Intelligent Transportation Systems, 23, 23244-23253. [Google Scholar] [CrossRef
[21] Song, Q., Wang, C., Jiang, Z., Wang, Y., Tai, Y., Wang, C., et al. (2021) Rethinking Counting and Localization in Crowds: A Purely Point-Based Framework. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 3345-3354. [Google Scholar] [CrossRef
[22] Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., et al. (2014) Microsoft COCO: Common Objects in Context. Computer Vision-ECCV 2014: 13th European Conference, Zurich, 6-12 September 2014, 740-755. [Google Scholar] [CrossRef