基于动态虚拟相机的旋转棱镜扫描成像系统运动模糊消除技术研究
Motion Deblurring Technology Research for Risley Prism Scanning Imaging System Based on Dynamic Virtual Camera
DOI: 10.12677/MOS.2023.123251, PDF,    国家自然科学基金支持
作者: 李新东*, 李安虎#, 周正旸, 刘兴盛, 邓兆军:同济大学机械与能源工程学院,上海
关键词: 运动模糊消除旋转棱镜动态虚拟相机Motion Deblurring Risley Prism Dynamic Virtual Camera
摘要: 旋转棱镜–相机成像系统在动态目标识别和跟踪等新兴领域展现了很好的应用前景。然而,其性能受到运动模糊问题的限制。为了解决旋转棱镜–相机成像系统中的运动模糊问题,本文基于运动成像分析方法,建立了动态虚拟相机的运动模糊数学模型,以表征系统的实时成像模糊机制。通过分析动态虚拟相机一阶运动表达式,提出了动态虚拟相机成像的运动模糊核估计方法和运动模糊消除算法。基于所提出的方法,可以获得扫描图像的运动模糊核,然后结合维纳滤波来消除模糊。实验结果表明,所提出的运动模糊消除算法能有效地消除运动模糊,提高实时扫描成像系统的成像质量。
Abstract: The Rotating Prism-Camera Imaging System (RPCIS) demonstrates promising application prospects in the emerging field of dynamic target tracking and recognition. However, its performance is lim-ited by motion blur issues. To solve the motion blur problem in the rotating prism-camera imaging system, developed by motion imaging analysis methods, a motion blurring mathematical model of the dynamic virtual camera (DVC) is established to characterize the real-time imaging blurring mechanism. By analyzing the kinematics of DVC based on first-order motion expression of rotating double-prism scanners, a motion blur kernel estimation method and the algorithm for motion deblurring are proposed. Based on the proposed method, the motion blur kernel of the scanning image can be obtained, and then the wiener filtering is combined to eliminate the blur. Experi-mental results demonstrate that the proposed motion deblurring method effectively eliminates motion blur and improves the image quality of the real-time scanning imaging system.
文章引用:李新东, 李安虎, 周正旸, 刘兴盛, 邓兆军. 基于动态虚拟相机的旋转棱镜扫描成像系统运动模糊消除技术研究[J]. 建模与仿真, 2023, 12(3): 2740-2751. https://doi.org/10.12677/MOS.2023.123251

参考文献

[1] Xu, Z., Wang, J., Zhao, L., Wang, P. and Fang, J. (2011) An All-Reflective Optical System for the Modulation Transfer Func-tion Measurement of Near-Infrared Focal Plane Arrays. Chinese Journal of Lasers, 38, s116002.
[2] Sandau, R. and Eckardt, A. (1995) The Stereo Camera Family WAOSS/WAAC for Spaceborne/Airborne Applications. XVIII Congress of ISPRS, Vi-enna, 9-14 July 1996, 170-175.
[3] Paparoditis, N., Souchon, J.-P., Martinoty, G. and Pierrot-Deseilligny, M. (2006) High-End Aerial Digital Cameras and Their Impact on the Automation and Quality of the Production Workflow. ISPRS Journal of Photogrammetry and Remote Sensing, 60, 400-412. [Google Scholar] [CrossRef
[4] Zhou, Y., Chen, Y., Sun, L., et al. (2020) Analysis on Key Issues of Boresight Adjustment in Imaging Tracking Based on Risley Prisms. Optical Engineering, 59, Article ID: 123104. [Google Scholar] [CrossRef
[5] Wen, P. (2022) Multivaria-ble Decoupling and Nonlinear Correction Method for Image-Based Closed-Loop Tracking of the Risley Prisms System. Mi-cromachines, 13, Article No. 2096. [Google Scholar] [CrossRef] [PubMed]
[6] Li, A., Li, Q., Deng, Z., et al. (2020) Ris-ley-Prism-Based Visual Tracing Method for Robot Guidance. Journal of the Optical Society of America A, 37, 705-713. [Google Scholar] [CrossRef
[7] Petrie, G. and Walker, A. (2010) Airborne Digital Imaging Technology: A New Overview. The Photogrammetric Record, 22, 203-225. [Google Scholar] [CrossRef
[8] Albertz, J., Ebner, H. and Neukum, G. (1996) The HRSC/WAOSS Camera Experiment on the Mars 96 Mission—A Photogrammetric and Cartographic View of the Project. ISPRS Congress, Vienna, 9-19 July 1996, 476-480.
[9] Lan, Y., Thomson, S., Huang, Y., Hoffmann, W. and Zhang, H. (2010) Current Status and Future Directions of Precision Aerial Application for Site-Specific Crop Management in the USA. Computers & Electronics in Agriculture, 74, 34-38. [Google Scholar] [CrossRef
[10] Bostater, C., Jones, J., Frystacky, H., Coppin, G. and Neyt, X. (2011) Airborne Imaging Sensors for Environmental Monitoring and Surveillance in Support of Oil Spills and Recovery Efforts. Proceedings SPIE, Remote Sensing of the Ocean, Sea Ice, Coastal Waters, and Large Water Regions, Vol. 8175, 81750B. [Google Scholar] [CrossRef
[11] Rosell, F. (1960) Prism Scanner. Journal of the Optical Society of America, 50, 521-526. [Google Scholar] [CrossRef
[12] Li, A., Sun, W., Yi, W. and Zuo, Q. (2016) Investigation of Beam Steering Performances in Rotation Risley-Prism Scanner. Optics Express, 24, 12840-12850. [Google Scholar] [CrossRef
[13] Artamonov, S.I., Gryaznov, N.A., Kuprenyuk, V.I., Romanov, N.A. and Sosnov, E.N. (2016) Selection of Scanners for Use in Lidar Systems. Journal of Optical Technology, 83, 549-555. [Google Scholar] [CrossRef
[14] Wang, Z., Cao, J., Hao, Q., et al. (2019) Super-Resolution Imaging and Field of View Extension Using a Single Camera with Risley Prisms. The Review of Scientific Instruments, 90, Article ID: 033701. [Google Scholar] [CrossRef] [PubMed]
[15] Chen, Y., Wang, B., Li, Q., et al. (2022) Field-of-View-Enlarged Single-Camera 3D Shape Reconstruction. IEEE Transactions on Instrumentation and Measurement, 71, 1-12. [Google Scholar] [CrossRef
[16] Han, Z. and Zhang, L. (2023) A Virtual Multi-Ocular 3D Reconstruction System Using a Galvanometer Scanner and a Camera. Sensors, 23, Article No. 3499. [Google Scholar] [CrossRef] [PubMed]
[17] Zhang, H., Cao, J., Zhou, D., Cui, H., et al. (2022) Three-Dimensional Computa-tional Ghost Imaging Using a Dynamic Virtual Projection Unit Generated by Risley Prisms. Optics Express, 30, 39152-39161. [Google Scholar] [CrossRef
[18] Church, P., Matheson, J., Cao, X. and Roy, G. (2017) Evaluation of a Steerable 3D Laser Scanner Using a Double Risley Prism Pair. Proceedings of the SPIE Degraded Environments: Sensing, Processing, and Display, Volume 10197, 101970O. [Google Scholar] [CrossRef
[19] Vuthea, V. and Toshiyoshi, H. (2018) A Design of Risley Scanner for LiDAR Applications. 2018 International Conference on Optical MEMS and Nanophotonics (OMN), Lausanne, 29 July-2 August 2018, 1-2. [Google Scholar] [CrossRef
[20] Lavigne, V. and Ricard, B. (2005) Step-Stare Image Gathering for High-Resolution Targeting. In: Advanced Sensory Payloads for UAV, RTO, Neuilly-sur-Seine, Paper 17.
[21] Li, A., Liu, X., Gong, W., Sun, W. and Sun, J. (2019) Prelocation Image Stitching Method Based on Flexible and Precise Boresight Adjustment Using Risley Prisms. JOSA A, 36, 305-311. [Google Scholar] [CrossRef
[22] Hao, Q., Wang, Z., Cao, J. and Zhang, F. (2018) A Hybrid Bionic Image Sensor Achieving FOV Extension and Foveated Imaging. Sensors, 18, Article No. 1042. [Google Scholar] [CrossRef] [PubMed]
[23] Li, A. and Zhong, S. (2019) Calibration Method of Risley-Prism Imaging System. Optics Communications, 459, Article ID: 124975. [Google Scholar] [CrossRef
[24] Li, A., Liu, X. and Zhao, Z. (2020) Compact Three-Dimensional Computational Imaging Using Dynamic Virtual Camera. Optics Letters, 45, 3801-3804. [Google Scholar] [CrossRef
[25] Marshall, G.F. (1999) Risley Prism Scan Patterns. Proceedings of the SPIE, 3787, 74-86.
[26] Jeon, Y.-G. (2011) Generalization of the First-Order Formula for Analysis of Scan Patterns of Risley Prisms. Optical Engineering, 50, Article ID: 113002. [Google Scholar] [CrossRef
[27] Schwarze, C., Vaillancourt, R., Carlson, D., Schundler, E., Evans, T. and Engel, J.R. (2005) Risley-Prism Based Compact Laser Beam Steering for IRCM, Laser Communications, and Laser Radar. Optra Inc., Topsfield.
[28] Lavigne, V. and Ricard, B. (2007) Fast Risley Prisms Camera Steering System: Calibration and Image Distortions Correction through the Use of a Three-Dimensional Refractive Model. Optical Engineering, 46, Article ID: 043201. [Google Scholar] [CrossRef
[29] Huang, F., Ren, H., Shen, Y. and Wang, P. (2021) Error Analysis and Optimiza-tion for Risley-Prism Imaging Distortion Correction. Applied Optics, 60, 2574-2582. [Google Scholar] [CrossRef
[30] Dainty, J.C. (1984) Theory and Practice of Scanning Optical Microscopy. Optica Acta: International Journal of Optics, 32, 1451-1452. [Google Scholar] [CrossRef
[31] Nemes, M.S., Jr., C.B. and Savoy, H. (2009) A Forward Motion Compensation System for Airborne Remote Sensing Platforms & Aerial Mapping Cam-eras. European Journal of Mechanical and Environmental Engineering, No. 2, 24-28.
[32] Chen, S., Wang, G., Li, X., Zhang, Q., Shi, Z. and Guan, Y. (2020) Formalization of Camera Pose Estimation Algorithm Based on Rodrigues Formula. Formal Aspects of Computing, 32, 417-437. [Google Scholar] [CrossRef
[33] Boisset, G.C., Robertson, B. and Hinton, H.S. (2002) Design and Con-struction of an Active Alignment Demonstrator for a Free-Space Optical Interconnect. IEEE Photonics Technology Letters, 7, 676-678. [Google Scholar] [CrossRef
[34] Moghaddam, M.E. and Jamzad, M. (2007) Motion Blur Identification in Noisy Images Using Mathematical Models and Statistical Measures. Pattern Recognition, 40, 1946-1957. [Google Scholar] [CrossRef
[35] Al-Amri, S.S. and Kalyankar, N.V. (2010) A Comparative Study for Deblurred Average Blurred Images. International Journal on Computer Science and Engineering, 2, 731-733.
[36] Gonzalez, R.C. and Woods, R.E. (2010) Digital Image Processing. 3rd Edition, Pearson Education, London, 374-376.