针对斑马鱼幼鱼的微小目标群体轨迹跟踪算法
Micro-Object Group Trajectory Tracking Algorithm for Zebrafish Larvae
DOI: 10.12677/mos.2024.133219, PDF,  被引量   
作者: 柴鑫雨:上海理工大学健康科学与工程学院,上海
关键词: 多目标跟踪目标检测注意力机制斑马鱼幼鱼Multi-Object Tracking Object Detection Attention Mechanism Zebrafish Larvae
摘要: 针对斑马鱼幼鱼体积小,外观相似度高,运动模式不稳定等特征导致的目标丢失、目标身份匹配错误、轨迹混乱等问题,本文提出了一种基于卷积神经网络的多目标跟踪算法。算法分为目标检测和目标跟踪两部分。检测部分通过经典的检测算法YOLO (You Look Only Once) v5实现,跟踪部分,主要通过DeepSORT实现对斑马鱼幼鱼位置的跟踪与轨迹连接。针对幼鱼容易被漏检、错检等特点,在YOLOv5m的基础上改进了网络的检测层结构,提升对小目标的检测能力。同时融合双通道注意力机制(Convolutional Block Attention Module, CBAM)对网络对背景噪声的抗噪能力。结果表明,在小样本训练的情况下,本文提出的YOLOv5m-ss对斑马鱼幼鱼群体的检测精度@mAP (mean Average Precision)可达99.9%,相较原网络提升了9.4%。结合DeepSORT后的跟踪精度MOTA可达98.0%,在算法运行速度和精确率上都有一定优势。
Abstract: In this paper, we propose a multi-object tracking algorithm based on convolutional neural networks aiming at the problems of small size, high appearance similarity, unstable motion pattern and other characteristics of zebrafish larvae, such as target loss, target identity matching error, and trajectory confusion. The algorithm is divided into two parts: object detection and object tracking. The detection part is realized by the classic detection algorithm YOLO (You Look Only Once) v5, and the tracking part is mainly realized by DeepSORT to track and connect the position of zebrafish larvae. Aiming at the characteristics of young fish being easy to be missed and misdetected, the detection layer structure of the network is improved on the basis of YOLOv5m to improve the detection ability of small targets. At the same time, the dual-channel Attention mechanism (Convolutional Block Attention Module, CBAM) is fused to improve the anti-noise ability of the network against background noise. The results show that in the case of small sample training, compared with the original YOLOv5 network, the detection accuracy @mAP (mean Average Precision) of YOLOv5m-ss proposed in this paper for zebrafish juvenile population can reach 99.4%. After combining DeepSORT, the tracking accuracy MOTA can reach 98.0%, which has certain advantages in algorithm running speed and accuracy.
文章引用:柴鑫雨. 针对斑马鱼幼鱼的微小目标群体轨迹跟踪算法[J]. 建模与仿真, 2024, 13(3): 2396-2407. https://doi.org/10.12677/mos.2024.133219

参考文献

[1] Choi, T.-Y., Choi, T.-I., Lee, Y.-R., Choe, S.-K. and Kim, C.-H. (2021) Zebrafish as an Animal Model for Biomedical Research. Experimental & Molecular Medicine, 53, 310-317. [Google Scholar] [CrossRef] [PubMed]
[2] Rosa, J.G.S., Lima, C. and Lopes-Ferreira, M. (2022) Zebrafish Larvae Behavior Models as a Tool for Drug Screenings and Pre-Clinical Trials: A Review. International Journal of Molecular Sciences, 23, Article 6647. [Google Scholar] [CrossRef] [PubMed]
[3] Teame, T., et al. (2019) The Use of Zebrafish (Danio rerio) as Biomedical Models. Animal Frontiers, 9, 68-77. [Google Scholar] [CrossRef] [PubMed]
[4] Fazio, M., et al. (2020) Zebrafish Patient Avatars in Cancer Biology and Precision Cancer Therapy. Nature Reviews Cancer, 20, 263-273. [Google Scholar] [CrossRef] [PubMed]
[5] Cassar, S., et al. (2019) Use of Zebrafish in Drug Discovery Toxicology. Chemical Research in Toxicology, 33, 95-118. [Google Scholar] [CrossRef] [PubMed]
[6] Orger, M.B. and de Polavieja, G.G. (2017) Zebrafish Behavior: Opportunities and Challenges. Annual Review of Neuroscience, 40, 125-147. [Google Scholar] [CrossRef] [PubMed]
[7] 孙智慧, 贾顺姬, 孟安明. 斑马鱼: 在生命科学中畅游[J]. 生命科学, 2006, 18(5): 431-436.
[8] Fu, Z., et al. (2021) Zebrafishtracker: A Multi-Zebrafish Tracking Algorithm Can Effectively Solve Cross Occlusion. 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, 27-31 December 2021, 1992-1997. [Google Scholar] [CrossRef
[9] Pérez-Escudero, A., et al. (2014) idTracker: Tracking Individuals in a Group by Automatic Identification of Unmarked Animals. Nature Methods, 11, 743-748. [Google Scholar] [CrossRef] [PubMed]
[10] Wang, X., et al. (2017) Automatic Multiple Zebrafish Larvae Tracking in Unconstrained Microscopic Video Conditions. Scientific Reports, 7, Article No. 17596. [Google Scholar] [CrossRef] [PubMed]
[11] Sun, M., Li, W., Jiao Z. and Zhao, X. (2019) A Multi-Target Tracking Platform for Zebrafish Based on Deep Neural Network. 2019 IEEE 9th Annual International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Suzhou, 29 July-2 August 2019, 637-642. [Google Scholar] [CrossRef
[12] Gore, S.V., et al. (2023) Zebrafish Larvae Position Tracker (Z-LaP Tracker): A High-Throughput Deep-Learning Behavioral Approach for the Identification of Calcineurin Pathway-Modulating Drugs Using Zebrafish Larvae. Scientific Reports, 13, Article No. 3174. [Google Scholar] [CrossRef] [PubMed]
[13] 杨晓帅. 基于DeepSort的斑马鱼轨迹追踪研究与应用[D]: [硕士学位论文]. 成都: 电子科技大学, 2021.
[14] Barreiros, M.D.O., et al. (2021) Zebrafish Tracking Using YOLOv2 and Kalman Filter. Scientific Reports, 11, Article No. 3219. [Google Scholar] [CrossRef] [PubMed]
[15] Jocher, G., et al. (2020) Ultralytics/Yolov5: V3. 0. Zenodo.
[16] Azhar, M.I.H., et al. (2020) People Tracking System Using DeepSORT. 2020 10th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), Penang, 21-22 August 2020, 137-141. [Google Scholar] [CrossRef