基于多尺度卷积神经网络的图像去雾方法研究
Research on Image Defogging Method Based on Multi-Scale Convolutional Neural Network
DOI: 10.12677/MOS.2023.125434, PDF,    国家自然科学基金支持
作者: 汤逸凡, 王媛媛, 王如刚*, 周 锋:盐城工学院信息工程学院,江苏 盐城;郭乃宏:盐城雄鹰精密机械有限公司,江苏 盐城
关键词: 图像去雾卷积神经网络大气散射模型图像恢复图像增强Image Defogging Convolutional Neural Network Atmospheric Scattering Model Image Restoration Image Enhancement
摘要: 针对图像去雾算法中存在光晕、失真或去雾不彻底等问题,本文提出了一种基于多尺度卷积神经网络的去雾方法。首先,利用多个较小的单尺度卷积提取浅层信息,其次通过多尺度卷积并行提取得到多维度的深层特征信息,增加了网络深度,丰富了语义信息,将浅层特征和深层特征进行特征融合,最后利用非线性回归来生成透射率特征。在RESIDE数据集中的ITS和OTS子数据集进行了实验分析,本文算法的SSIM和PSNR分别为0.976、25.041,结果表明,本文算法图像恢复度更佳,对易失真区域及纹理细节的处理更加自然,在去雾效果上较传统算法更好,且该方法在主观及客观上均有更好的评价。
Abstract: Aiming at the problems of distortion, halo, or incomplete defogging in image defogging algorithms, this paper proposes an image defogging method based on a multi-scale convolutional neural net-work. First, several smaller single-scale convolutions are used to extract shallow information, and then multi-scale convolutions are used to extract multi-dimensional deep feature information in parallel, which increases the depth of the network, enriches semantic information, fuses shallow features and deep features, and finally uses nonlinear regression to generate transmittance fea-tures. Experimental analysis was conducted on the ITS and OTS sub-datasets in the RESIDE dataset. The SSIM and PSNR of the algorithm proposed in this paper were 0.976 and 25.041, respectively. The results showed that the algorithm proposed in this paper had better image restoration, more natural processing of easily distorted areas and texture details, better defogging performance than traditional algorithms, and better subjective and objective evaluation.
文章引用:汤逸凡, 王媛媛, 王如刚, 周锋, 郭乃宏. 基于多尺度卷积神经网络的图像去雾方法研究[J]. 建模与仿真, 2023, 12(5): 4778-4787. https://doi.org/10.12677/MOS.2023.125434

参考文献

[1] Wu, D. and Zhu, Q.-S. (2015) The Latest Research Progress of Image Dehazing. Acta Automatica Sinica, 41, 221-239.
[2] 贾童瑶, 卓力, 李嘉锋, 张菁. 基于深度学习的单幅图像去雾研究进展[J]. 电子学报, 2023, 51(1): 231-245.
[3] Ma, R.Q. and Zhang, S.J. (2019) An Improved Color Image Defogging Algorithm Using Dark Channel Model and Enhancing Saturation. Optik, 180, 997-1000. [Google Scholar] [CrossRef
[4] 谢勇, 贾惠珍, 王同罕, 等. 图像去雾算法综述[J]. 计算机与数字工程, 2022, 50(12): 2765-2774.
[5] 李永全, 王建国. 一种基于Retinex理论的改进图像去雾算法[J]. 电脑知识与技术, 2019, 15(26): 200-201+203.
[6] Tarel, J.P. and Hautière, N. (2009) Fast Visibility Restoration from a Single Color or Gray Level Image. 2009 IEEE 12th International Conference on Computer Vision, Kyoto, 29 September-2 October 2009, 2201-2208. [Google Scholar] [CrossRef
[7] He, K.M., Sun, J. and Tang, X.O. (2010) Single Image Haze Removal Using Dark Channel Prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 2341-2353. [Google Scholar] [CrossRef
[8] He, K.M., Sun, J. and Tang, X.O. (2012) Guided Image Filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1397-1409. [Google Scholar] [CrossRef
[9] 郭鑫, 于萍, 王岩, 等. 基于自适应容差优化的暗通道去雾算法[J]. 计算机工程与设计, 2023, 44(5): 1471-1478.
[10] Tang, K.T., Yang, J.C. and Wang, J. (2014) Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing. 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 2995-3000. [Google Scholar] [CrossRef
[11] Cai, B.L., Xu, X.M., Jia, K., et al. (2016) Dehazenet: An End-to-End System for Single Image Haze Removal. IEEE Trans-actions on Image Processing, 25, 5187-5198. [Google Scholar] [CrossRef
[12] Eigen, D., Krishnan, D. and Fergus, R. (2013) Restoring an Image Taken through a Window Covered with Dirt or Rain. 2013 IEEE Interna-tional Conference on Computer Vision, Sydney, 1-8 December 2013, 633-640. [Google Scholar] [CrossRef
[13] Lin, H.-Y. and Lin, C.-J. (2017) Using a Hybrid of Fuzzy Theory and Neural Network Filter for Single Image Dehazing. Applied Intelligence, 47, 1099-1114. [Google Scholar] [CrossRef
[14] Likhitaa, P.-S. and Anand, R. (2021) A Comparative Analysis of Image Dehazing Using Image Processing and Deep Learning Techniques. 2021 6th International Conference on Com-munication and Electronics Systems (ICCES), Coimbatre, 8-10 July 2021, 1611-1616. [Google Scholar] [CrossRef
[15] Zhang, S., Cai, T.X. and Yang, W.B. (2021) A Rapid Dehazing Model in USV Imaging System Based on End-to-End Convolutional Network. 2021 IEEE Asia-Pacific Con-ference on Image Processing, Electronics and Computers (IPEC), Dalian, 14-16 April 2021, 612-616. [Google Scholar] [CrossRef
[16] 杨兆昭, 李嘉欣, 张鑫鹏. 基于映射关系的GAN网络实现图像去雾[J]. 信息与电脑(理论版), 2023, 35(2): 197-200.
[17] Yoon, J.-C., Kyeong, D.M. and Kim, M. (2023) An End-to-End Deep Learning Approach for Real-Time Single Image Dehazing. Journal of Real-Time Image Processing, 20, Article No. 12. [Google Scholar] [CrossRef
[18] Engin, D., Anil, G.C.C. and Hazim, K.E. (2018) Cycle-Dehaze: Enhanced Cyclegan for Single Image Dehazing. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, 18-22 June 2018, 825-833. [Google Scholar] [CrossRef
[19] 陈清江, 李毅, 柴昱洲. 基于卷积神经网络的红外图像融合算法[J]. 激光与红外, 2019, 49(1): 123-128.
[20] 徐海文, 魏轶伦. 基于深度学习的图像去雾方法综述研究[J]. 信息技术与信息化, 2023(4), 214-216+220.
[21] 王海群, 赵燕青, 王一. 基于明亮区域分割的图像去雾算法[J]. 液晶与显示, 2023, 38(5): 636-643.
[22] 刘万军, 赵庆国. 基于颜色饱和度的快速图像去雾研究[J]. 计算机工程与应用, 2017, 53(8): 209-215.
[23] Li, B.Y., Ren, W.Q., Fu, D.P., et al. (2018) Benchmarking Single Image Dehazing and Beyond. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society, 28, 492-505. [Google Scholar] [CrossRef