非视域成像系统的研究进展
Research Progress of Non-Line-of-Sight Imaging System
DOI: 10.12677/APP.2023.135025, PDF,   
作者: 肖 涵:上海理工大学光电信息与计算机工程学院,上海
关键词: 非视域成像光学成像图像重建计算成像Non-Line-of-Sight Imaging Optical Imaging Image Reconstruction Computational Imaging
摘要: 非视域成像是一种对视线范围外的场景进行成像的技术,极大地拓展了成像设备的视野范围,打破了传统光学成像技术的成像局限性。非视域成像系统一般由目标场景、中介面、探测器三部分组成,通过中介面对视野范围外隐藏的目标场景成像,是近十几年来的一种新的光学成像技术,在未来有着巨大的发展前景,包括无人驾驶、灾难救援、军事反恐和医疗成像等领域。本文针对国内外非视域成像的研究现状进行总结,根据是否加入调制光将非视域成像分为主动非视域成像和被动非视域成像,随后再根据不同的设备或原理细分,从成像系统、原理和算法等方向总结分析各个非视域成像技术的特点和发展。
Abstract: Non-line-of-sight imaging is a technology that can image scenes outside the line of sight, which greatly expands the field of view of imaging equipment and breaks the imaging limitations of traditional optical imaging technologies. The non-line-of-sight imaging system is generally composed of three parts: the target scene, the interface surface, and the detector. Through the intermediary, it faces the hidden target scene imaging outside the field of vision. It is a new optical imaging technology in the past ten years. It has a huge potential in the future. Development prospects include unmanned driving, disaster relief, military anti-terrorism and medical imaging and other fields. This paper summarizes the research status of non-line-of-sight imaging at home and abroad. According to whether to add modulated light, non-line-of-sight imaging is divided into active and passive, and then subdivided according to different equipment or principles, from imaging systems, principles and algorithms, etc. The direction summarizes and analyzes the characteristics and development trends of various non-line-of-sight imaging technologies.
文章引用:肖涵. 非视域成像系统的研究进展[J]. 应用物理, 2023, 13(5): 213-222. https://doi.org/10.12677/APP.2023.135025

参考文献

[1] Ramesh, R. and Davis, J. (2008) 5D Time-Light Transport Matrix: What Can We Reason about Scene Properties? Technical Report, Attribution-NonCommercial-NoDerivs 3.0 United States.
[2] Kirmani, A., Hutchison, T., Davis, J., et al. (2009) Looking around the Corner Using Transient Imaging. Proceedings of 2009 IEEE 12th International Conference on Computer Vision, Kyoto, 29 September-2 October 2009, 159-166. [Google Scholar] [CrossRef
[3] Velten, A., Willwacher, T., Gupta, O., Veeraraghavan, A., Bawendi, M.G. and Raskar, R. (2012) Recovering Three- Dimensional Shape around a Corner Using Ultrafast Time-of-Flight Imaging. Nature Communications, 3, Article No. 745. [Google Scholar] [CrossRef] [PubMed]
[4] Naik, N., Barsi, C., Velten, A. and Raskar, R. (2014) Estimating Wide-Angle, Spatially Varying Reflectance Using Time-Resolved Inversion of Backscattered Light. Journal of the Optical Society of America A, 31, 957-963. [Google Scholar] [CrossRef
[5] Raviv, D., Barsi, C., Naik, N., Feigin, M. and Raskar, R. (2014) Pose Estimation Using Time-Resolved Inversion of Diffuse Light. Optics Express, 22, 20164-20176. [Google Scholar] [CrossRef
[6] Maeda, T., Satat, G., Swedish, T., et al. (2019) Recent Advances in Imaging around Corners. (Preprint)
[7] Buttafava, M., Zeman, J., Tosi, A., Eliceiri, K. and Velten, A. (2015) Non-Line-of-Sight Imaging Using a Time-Gated Single Photon Avalanche Diode. Optics Express, 23, 20997-21011. [Google Scholar] [CrossRef
[8] Gariepy, G., Tonolini, F., Henderson, R., et al. (2016) Detection and Tracking of Moving Objects Hidden from View. Nature Photonics, 10, 23-26. [Google Scholar] [CrossRef
[9] Gariepy G, Tonolini, F., Henderson, R., et al. (2015) Tracking Hidden Objects with a Single-Photon Camera. (Preprint)
[10] Laurenzis, M., Klein, J., Bacher, E. and Metzger, N. (2015) Multiple-Return Single-Photon Counting of Light in Flight and Sensing of Non-Line-of-Sight Objects at Shortwave Infrared Wavelengths. Optics Letters, 40, 4815-4818. [Google Scholar] [CrossRef
[11] Laurenzis, M., Christnacher, F., Klein, J., et al. (2015) Study of Single Photon Counting for Non-Line-of-Sight Vision. Proceedings of SPIE, 9492, 31-38. [Google Scholar] [CrossRef
[12] Chan, S., Warburton, R.E., Gariepy, G., et al. (2017) Non-Line-of-Sight Tracking of People at Long Range. Optics Express, 25, 10109-10117. [Google Scholar] [CrossRef
[13] Tsai, C.Y., Kutulakos, K.N., Narasimhan, S.G., et al. (2017) The Geometry of First-Returning Photons for Non-Line- of-Sight Imaging. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 7216-7224. [Google Scholar] [CrossRef
[14] Jin, C., Xie, J., Zhang, S., Zhang, Z. and Zhao, Y. (2018) Re-construction of Multiple Non-Line-of-Sight Objects Using back Projection Based on Ellipsoid Mode Decomposition. Optics Express, 26, 20089-20101. [Google Scholar] [CrossRef
[15] Repasi, E., Lutzmann, P., Steinvall, O., et al. (2009) Advanced Short-Wavelength Infrared Range-Gated Imaging for Ground Applications in Monostatic and Bistatic Configurations. Applied Optics, 48, 5956-5969. [Google Scholar] [CrossRef
[16] Laurenzis, M. and Velten, A. (2013) Non-Line-of-Sight Active Imaging of Scattered Photons. Proceedings of SPIE, 8897, 47-53. [Google Scholar] [CrossRef
[17] Laurenzis, M. and Velten, A. (2014) Nonline-of-Sight Laser Gated Viewing of Scattered Photons. Optical Engineering, 53, 023102-023102. [Google Scholar] [CrossRef
[18] 许凯达, 金伟其, 刘敬, 裘溯, 田训卿. 基于激光距离选通成像的非视域成像应用[J]. 红外与激光工程, 2012, 41(8): 2073-2078.
[19] Hullin, M.B. (2014) Computational Imaging of Light in Flight. Proceedings of SPIE, 9273, 197-204. [Google Scholar] [CrossRef
[20] Heide, F., Xiao, L., Heidrich, W., et al. (2014) Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 3222-3229. [Google Scholar] [CrossRef
[21] Kadambi, A., Zhao, H., Shi, B. and Raskar, R. (2016) Occluded Imaging with Time-of-Flight Sensors. ACM Transactions on Graphics, 35, 1-12. [Google Scholar] [CrossRef
[22] Batarseh, M., Sukhov, S., Shen, Z., et al. (2018) Passive Sensing around the Corner Using Spatial Coherence. Nature Communications, 9, Article No. 3629. [Google Scholar] [CrossRef] [PubMed]
[23] Beckus, A., Tamasan, A. and Atia, G.K. (2019) Mul-ti-Modal Non-Line-of-Sight Passive Imaging. IEEE Transactions on Image Processing, 28, 3372-3382. [Google Scholar] [CrossRef
[24] Boger-Lombard, J. and Katz, O. (2019) Passive Optical Time-of-Flight for Non Line-of-Sight Localization. Nature Communications, 10, Article No. 3343. [Google Scholar] [CrossRef] [PubMed]
[25] Bouman, K.L., Ye, V., Yedidia, A.B., et al. (2017) Turning Corners into Cameras: Principles and Methods. Proceedings of the 2017 IEEE International Conference on Com-puter Vision, Venice, 22-29 October 2017, 2270-2278. [Google Scholar] [CrossRef
[26] Tancik, M. (2018) Non-Line-of-Sight Imaging Using Data-Driven Approaches. Master’s Thesis, Massachusetts Institute of Technology, Cambridge.
[27] Tancik, M., Swedish, T., Satat, G., et al. (2018) Data-Driven Non-Line-of-Sight Imaging with a Traditional Camera. Proceedings Imaging and Applied Optics 2018, Orlando, 25-28 June 2018. [Google Scholar] [CrossRef
[28] Tancik, M., Satat, G. and Raskar, R. (2018) Flash Photography for Data-Driven Hidden Scene Recovery. (Preprint)
[29] Bar-adad, M., Ye, V., Yedidia, A.B., et al. (2018) Inferring Light Fields from Shadows. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 6267-6275. [Google Scholar] [CrossRef
[30] Saunders, C., Murray-Bruce, J. and Goyal, V.K. (2019) Computational Periscopy with an Ordinary Digital Camera. Nature, 565, 472-475. [Google Scholar] [CrossRef] [PubMed]
[31] Yedidia, A.B., Baradad, M., Thrampoulidis, C., et al. (2019) Using Unknown Occluders to Recover Hidden Scenes. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 15-20 June 2019, 12231-12239. [Google Scholar] [CrossRef
[32] Geng, R., Hu, Y., Lu, Z., et al. (2021) Passive Non-Line-of-Sight Imaging Using Optimal Transport. IEEE Transactions on Image Processing, 31, 110-124. [Google Scholar] [CrossRef
[33] Wang, Y., Zhang, Y., Huang, M., et al. (2021) Accurate but Fragile Passive Non-Line-of-Sight Recognition. Communications Physics, 4, Article No. 88. [Google Scholar] [CrossRef
[34] Hassan, B. (2019) Polarization-Informed Non-Line-of-Sight Imaging on Diffuse Surfaces. Master’s Thesis, University of California, Los Angeles.
[35] Tanaka, K., Mukaigawa, Y. and Kadambi, A. (2020) Polarized Non-Line-of-Sight Imaging. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, 13-19 June 2020, 2136-2145. [Google Scholar] [CrossRef
[36] Kaga, M., Kushida, T., Takatani, T., et al. (2019) Thermal Non-Line-of-Sight Imaging from Specular and Diffuse Reflections. IPSJ Transactions on Computer Vision and Applications, 11, Article No. 8. [Google Scholar] [CrossRef
[37] Maeda, T., Wang, Y., Raskar, R., et al. (2019) Thermal Non-Line-of-Sight Imaging. Proceedings of 2019 IEEE International Conference on Computational Photography (ICCP), Tokyo, 15-17 May 2019, 1-11. [Google Scholar] [CrossRef
[38] Divitt, S., Gardner, D.F. and Watnik, A.T. (2020) Im-aging around Corners in the Mid-Infrared Using Speckle Correlations. Optics Express, 28, 11051-11064. [Google Scholar] [CrossRef