基于人工复眼的红外目标运动检测研究
Research on Infrared Target Motion Detection Based on Artificial Compound Eye
DOI: 10.12677/JISP.2023.122010, PDF,  被引量    科研立项经费支持
作者: 樊飞燕, 陈 谣:南昌工程学院信息工程学院,江西 南昌;徐溪梦*:南京工程学院计算机工程学院,江苏 南京;施建强:南京工程学院能源与动力工程学院,江苏 南京
关键词: 红外目标检测运动方向人工复眼神经计算红外图像处理Infrared Target Detection Direction of Motion Artificial Compound Eye Neural Computing Infrared Image Processing
摘要: 红外光学成像应用于视觉目标运动检测具有可昼夜运用的特点。为了提升准确、可靠地检测物体(目标)运动方向的能力,提出一种红外目标运动方向检测的人工果蝇复眼模型(简称ACEM模型)。首先,对输入的红外视频进行帧差处理获取目标运动信息,模拟果蝇复眼视网膜层;其次,通过设计非线性自适应带通滤波器和仿生中心侧向抑制滤波器及算法,模拟果蝇复眼视叶结构的薄板神经节层初级视觉滤波功能;然后,模拟髓质神经节层跨层神经元T4和小叶神经节层跨层神经元T5对ON/OFF通道信号做出方向选择性响应;最后,模拟小叶板神经节层整合T4和T5对于方向的敏感响应,形成运动方向分量的检测输出。通过对杂乱视觉背景下拍摄的红外视频序列进行测试,验证了所提出的ACEM模型对于水平和垂直方向运动检测的有效性和鲁棒性。
Abstract: Infrared optical imaging can be used day and night in visual target motion detection. In order to improve the ability to accurately and reliably detect the movement direction of objects (targets), an artificial drosophila compound eye model (ACEM model for short) for infrared target movement direction detection was proposed. Firstly, the target movement information is obtained by frame difference processing of the infrared video input, and the retinula layer of drosophila compound eye is simulated. Secondly, In order to simulate the primary visual filtering function of the lamina ganglionic layer in drosophila compound eye, a nonlinear adaptive band pass filter and a bionic central lateral suppression filter and its algorithms were designed. Then, the trans lamellar neuronsT4 in medulla ganglion layer and the trans lamellar neurons T5 in lobula ganglion layer were simulated to respond directionally selectively to ON/OFF channel signals. Finally, by simulating the lobula plate ganglionic layer, to integrate the directional sensitive response of T4 and T5, form the detection output of motion direction component. By testing Infrared video sequences taken against a cluttered visual background, the effectiveness and robustness of the proposed ACEM model for horizontal and vertical directional motion detection are verified.
文章引用:樊飞燕, 徐溪梦, 施建强, 陈谣. 基于人工复眼的红外目标运动检测研究[J]. 图像与信号处理, 2023, 12(2): 96-103. https://doi.org/10.12677/JISP.2023.122010

参考文献

[1] Hassenstein, B. and Reichardt, W. (1956) Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus. Zeitschrift für Naturforschung B, 11, 513-524.
[Google Scholar] [CrossRef
[2] Fu, Q.B., Wang, H.X., Hu, C. and Yue, S.G. (2019) Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review. Artificial Life, 25, 263-311.
[Google Scholar] [CrossRef] [PubMed]
[3] 施建强, 徐扬, 徐梦溪, 郑胜男. 一种用于感知目标运动方向的人工苍蝇视觉神经网络模型[C]. 中国仪器仪表学会. 上海: 中国仪器仪表学会, 2021: 1-2.
[4] Borst, A. and Egelhaaf, M. (1989) Principles of Visual Motion Detection. Trends in Neurosciences, 12, 297-306.
[Google Scholar] [CrossRef] [PubMed]
[5] Franceschini, N., Pichon, J. and Blanes, C. (1992) From Insect Vision to Robot Vision. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 337, 283-294.
[Google Scholar] [CrossRef
[6] Iida, F. and Lambrinos, D. (2000) Navigation in an Autonomous Flying Robot by Using a Biologically Inspired Visual Odometer. Sensor Fusion and Decentralized Control in Robotic Systems III, 4196, 86-97.
[Google Scholar] [CrossRef
[7] Eichner, H., Joesch, M., Schnell, B., Reiff, D.F. and Borst, A. (2011) Internal Structure of the Fly Elementary Motion Detector. Neuron, 70, 1155-1164.
[Google Scholar] [CrossRef] [PubMed]
[8] Clark, D.A., Bursztyn, L., Horowitz, M.A., Schnitzer, M.J. and Clandinin, T.R. (2011) Defining the Computational Structure of the Motion Detector in Drosophila. Neuron, 70, 1165-1177.
[Google Scholar] [CrossRef] [PubMed]
[9] Wiederman, S.D. and O’Carroll, D.C. (2013) Biologically Inspired Feature Detection Using Cascaded Correlations of off and on Channels. Journal of Artificial Intelligence & Soft Computing Research, 3, 5-14.
[Google Scholar] [CrossRef
[10] Fu, Q. and Yue, S. (2020) Modelling Drosophila Motion Vision Pathways for Decoding the Direction of Translating Objects against Cluttered Moving Backgrounds. Biological Cybernetics, 114, 443-460.
[Google Scholar] [CrossRef] [PubMed]
[11] Borst, A., Haag, J. and Mauss, A.S. (2020) How Fly Neurons Compute the Direction of Visual Motion. Journal of Comparative Physiology A, 206, 109-124.
[Google Scholar] [CrossRef] [PubMed]
[12] Wang, H., Peng, J. and Yue, S. (2020) A Directionally Selective Small Target Motion Detecting Visual Neural Network in Cluttered Backgrounds. IEEE Transactions on Cybernetics, 50, 1541-1555.
[Google Scholar] [CrossRef
[13] Shen, K.Y., Yang, Y., Liang, Y.Y. and Xu, L.Z. (2022) Modeling Drosophila Vision Neural Pathways to Detect Weak Moving Targets from Cluttered Backgrounds. Computers and Electrical Engineering, 99, Article ID: 107678.
[Google Scholar] [CrossRef
[14] 李柯, 沈克永, 刘宝, 曹阳, 邱晓健, 陈俊宇. 模拟飞虫复眼视觉的小目标运动检测与跟踪系统研究[J]. 图像与信号处理, 2022, 11(3): 92-100.
[Google Scholar] [CrossRef
[15] Paulk, A., Millard, S.S. and van Swinderen, B. (2013) Vision in Drosophila: Seeing the World through a Model’s Eyes. Annual Review of Entomology, 58, 313-332.
[Google Scholar] [CrossRef] [PubMed]
[16] Joesch, M., Schnell, B., Raghu, S.V., Reiff, D.F. and Borst, A. (2010) ON and OFF Pathways in Drosophila Motion Vision. Nature, 468, 300-304.
[Google Scholar] [CrossRef] [PubMed]
[17] Keles, M.F. and Frye, M.A. (2017) Object-Detecting Neurons in Drosophila. Current Biology, 27, 680-687.
[Google Scholar] [CrossRef] [PubMed]
[18] Neriec, N. and Desplan, C. (2016) From the Eye to the Brain: Development of the Drosophila Visual System. Current Topics in Developmental Biology, 116, 247-271.
[Google Scholar] [CrossRef] [PubMed]
[19] 谢晓芳, 毛晓波, 陈铁军. 改进的侧抑制网络图像增强算法研究[J]. 计算机工程与应用, 2010, 46(3): 148-150.
[20] Cheng, Y., Cao, J., Zhang, Y. and Hao, Q. (2019) Review of State-of-the-Art Artificial Compound Eye Imaging Systems. Bioinpoiration & Biomimetics, 14, Article ID: 031002.
[Google Scholar] [CrossRef] [PubMed]