基于LGMD建模的物体深度运动方向估计方法
An Estimation Method for the Direction of Object’s Motion in Depth Based on LGMD Modeling
DOI: 10.12677/MOS.2021.104094, PDF,    国家自然科学基金支持
作者: 沈克永:南昌理工学院计算机信息工程学院,江西 南昌;卢 杰, 李智军:航空工业洪都集团660研究所,江西 南昌;徐 扬, 徐立中*:南昌理工学院计算机信息工程学院,江西 南昌;河海大学计算机与信息学院,江苏 南京
关键词: 机器视觉物体运动检测深度运动方向LGMD神经元仿复眼信息处理Machine Vision Object’s Motion Detection Depth Moving Direction LGMD Neurons Information Processing of Bionic Compound Eye
摘要: 在移动机器人、自动驾驶、视频监控等应用领域,复杂的动态场景中,对于物体深度运动及方向检测一直是计算机视觉技术的难点。自然界中,昆虫在飞行过程中利用复眼视觉检测高度变化且视觉杂乱环境中的深度运动物体(或称为目标),是学习运动感知策略的良好范例。受飞行昆虫复眼视觉功能优势的启发,本文采用物体运动的缩放变量计算与基于LGMD (lobula giant movement detector)的改进型碰撞检测模型相结合的仿生策略,提出一种基于LGMD神经元建模的物体深度运动方向估计方法(简称LGMD-ED),通过对PPT合成动画视频和拍摄真实场景的样本视频进行仿真实验和测试,验证了本文所提新方法对于检测与估计物体远离和靠近二种典型深度运动方向的有效性。
Abstract: In the application fields including mobile robots, self-driving automobile, video surveillance, detecting the direction and motion in depth of objects in complex dynamic scenes has always been difficult in computer vision technology. In nature, the insects apply compound eye’s vision to detect a motion in depth of object (or target) in highly variable and visual cluttered environments during flight, which are excellent paradigms to learn motion perception strategies. Inspired by the advantages of the compound eye’s vision function of flying insects, this paper adopts the bionic strategy of combining the zoom variable calculation of object motion with the improved collision detection model based on LGMD (lobular giant movement detector), and proposes a method of estimating direction of object’s motion in depth based on LGMD neuron modeling (hereinafter referred to as LGMD-ED). Using the PPT composite animation videos and the sample videos of real scenes taken to do simulation experiments and tests, the effectiveness of the proposed method in detecting and estimating the objects moving away and approaching which are two typical directions of motion in depth is verified.
文章引用:沈克永, 卢杰, 李智军, 徐扬, 徐立中. 基于LGMD建模的物体深度运动方向估计方法[J]. 建模与仿真, 2021, 10(4): 946-954. https://doi.org/10.12677/MOS.2021.104094

参考文献

[1] Borst, A., Haag, J. and Mauss, A.S. (2020) How Fly Neurons Compute the Direction of Visual Motion. Journal of Comparative Physiology A, 206, 109-124. [Google Scholar] [CrossRef] [PubMed]
[2] Neriec, N. and Desplan, C. (2016) From the Eye to the Brain: Development of the Drosophila Visual System. Current Topics in Devel-opmental Biology, 116, 247-271. [Google Scholar] [CrossRef] [PubMed]
[3] Fu, Q., Hu, C., Peng, J., Rind, F.C. and Yue, S. (2020) A Robust Collision Perception Visual Neural Network with Specific Selectivity to Darker Ob-jects. IEEE Transactions on Cybernetics, 50, 5074-5088. [Google Scholar] [CrossRef
[4] Xu, M., Wu, X., Zhang, Z. and Lu, Y. (2021) Compound-Eye Imaging Imitation-Based Whole-Field Flow Measurement. Computers and Electrical Engineering, 92, Article ID: 107141. [Google Scholar] [CrossRef
[5] 徐梦溪, 施建强. 仿生复眼型多源监测数据融合与专题信息提取[J]. 水利信息化, 2021(1): 71-75.
[6] 徐梦溪, 施建强, 沈克永, 梁玉英. 受生物视觉“图形–背景”分辨机制启发的遥感影像水体信息提取方法[J]. 图像与信号处理, 2021, 10(4): 155-165. [Google Scholar] [CrossRef
[7] Rind, F.C. and Bramwell, D.I. (1996) Neural Network Based on the Input Organization of an Identified Neuron Signaling Impending Collision. Journal of Neurophysiology, 75, 967-998. [Google Scholar] [CrossRef] [PubMed]
[8] Blanchard, M., Rind, F.C. and Verschure, P. (2000) Collision Avoidance Using a Model of the Locust LGMD Neuron. Robotics & Autonomous Systems, 30, 17-38. [Google Scholar] [CrossRef
[9] Rind, F.C. (2002) Motion Detectors in the Locust Visual System: From Biology to Robot Sensors. Microscopy Research & Technique, 56, 256-269. [Google Scholar] [CrossRef] [PubMed]
[10] Fu, Q. and Yue, S. (2015) Modelling LGMD2 Visual Neuron System. 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, 17-20 September 2015, 1-6. [Google Scholar] [CrossRef
[11] Jayachandran, D., Oberoi, A., Sebastian, A., Choudhury, T.H., Shankar, B., Redwing, J.M., et al. (2020) A Low-Power Biomimetic Collision Detector Based on an In-Memory Mo-lybdenum Disulfide Photodetector. Nature Electronics, 3, 646-655. [Google Scholar] [CrossRef
[12] Paulk, A., Millard, S.S. and van Swinderen, B. (2013) Vision in Drosophila: Seeing the World through a Model’s Eyes. Annual Review of Entomology, 58, 313-332. [Google Scholar] [CrossRef] [PubMed]
[13] Takemura, S., Bharioke, A., Lu, Z., Nern, A., Vi-taladevuni, S., Rivlin, P.K., et al. (2013) A Visual Motion Detection Circuit Suggested by Drosophila Connectomics. Nature, 500, 175-181. [Google Scholar] [CrossRef] [PubMed]
[14] Joesch, M., Schnell, B., Raghu, S.V., Reiff, D.F. and Borst, A. (2010) ON and OFF Pathways in Drosophila Motion Vision. Nature, 468, 300-304. [Google Scholar] [CrossRef] [PubMed]
[15] Haag, J., Arenz, A., Serbe, E., Gabbiani, F. and Borst, A. (2016) Com-plementary Mechanisms Create Direction Selectivity in the Fly. eLIFE, 5, Article ID: e17421.
[16] Strother, J.A., Wu, S.T., Wong A.M, Nern, A., Rogers, E.M., Le, J.Q., Rubin, G.M. and Reiser, M.B. (2017) The Emergence of Directional Selectivity in the Visual Motion Pathway of Drosophila. Neuron, 94, 168-182.E10. [Google Scholar] [CrossRef] [PubMed]
[17] Fisher, Y.E., Leong, J.C.S, Sporar, K., Ketkar, M.D., Gohl, D.M., Clandinin, T.R. and Silies, M. (2015) A Class of Visual Neurons with Wide-Field Properties Is Required for Lo-cal Motion Detection. Current Biology, 25, 3178-3189. [Google Scholar] [CrossRef] [PubMed]
[18] 沈克永, 杨扬, 徐梦溪, 吴晓彬, 陆云扬. 一种模拟飞虫视觉运动感知的U-LSPIV测量系统[J]. 计算机科学与应用, 2021, 11(7): 1888-1895. [Google Scholar] [CrossRef
[19] Missler, J.M. and Kamangar, F.A. (1995) A Neural Network for Pursuit Tracking Inspired by the Fly Visual System. Neural Networks, 8, 463-480. [Google Scholar] [CrossRef
[20] Behnia, R., Clark, D.A., Carter, A.G., Clandinin, T.R. and Desplan, C. (2014) Processing Properties of ON and OFF Pathways for Drosophila Motion Detection. Nature, 512, 427-430. [Google Scholar] [CrossRef] [PubMed]
[21] Fu, Q. and Yue, S. (2020) Modelling Drosophila Motion Vi-sion Pathways for Decoding the Direction of Translating Objects against Cluttered Moving Backgrounds. Biological Cy-bernetics, 114, 443-460. [Google Scholar] [CrossRef] [PubMed]