基于生成对抗网络的图像去雾算法研究
Image Dehazing Algorithm Based on Generative Adversarial Networks
摘要: 为解决目前基于先验知识与深度学习的图像去雾算法底层网络感受野较小,不能有效捕捉远距离的依赖信息、对图像全局特征利用不充分导致复原的图像整体恢复效果不佳、细节恢复不完整、图像颜色失真等问题,本文提出了基于生成对抗网络改进的图像去雾算法。生成器模块首先通过DenseNet网络进行初步特征提取,其次设计ASPP-Transformer模块,通过ASPP模块特征进行多尺度特征提取,再通过Transformer模块捕捉图像的全局特征依赖关系,实现对提取的多尺度局部特征信息与全局信息特征信息的有效融合,提升了生成器在复杂雾气场景中的全局一致性表现,最后通过解码器对融合后的特征进行重构,得到无雾图像。实验表明,通过本文算法恢复的无雾图像在主观质量与客观指标上都取得较好的评价结果。
Abstract: To address issues in current image dehazing algorithms based on prior knowledge and deep learning—such as limited receptive fields in underlying networks, insufficient capture of long-range dependencies, inadequate utilization of global features, incomplete restoration of image details, and color distortion—this paper proposes a novel image dehazing algorithm based on Generative Adversarial Networks (GAN). The generator module first performs feature extraction using a DenseNet network, followed by an ASPP-Transformer module that integrates multi-scale feature extraction through the ASPP module and captures global feature dependencies with the Transformer module. This enables effective fusion of multi-scale local and global information, enhancing the generator’s global consistency in complex hazy scenes. Finally, a decoder reconstructs the fused features to produce a dehazed image. Experimental results demonstrate that the proposed algorithm achieves superior subjective quality and objective performance in restoring dehazed images.
文章引用:姜超谦, 王悦. 基于生成对抗网络的图像去雾算法研究[J]. 计算机科学与应用, 2024, 14(12): 187-195. https://doi.org/10.12677/csa.2024.1412253

参考文献

[1] Stark, J.A. (2000) Adaptive Image Contrast Enhancement Using Generalizations of Histogram Equalization. IEEE Transactions on Image Processing, 9, 889-896. [Google Scholar] [CrossRef] [PubMed]
[2] Galdran, A., Vazquez-Corral, J., Pardo, D. and Bertalmio, M. (2016) Fusion-based Variational Image Dehazing. IEEE Signal Processing Letters, 24, 151-155. [Google Scholar] [CrossRef
[3] He, K.M., Sun, J. and Tang, X.O. (2011) Single Image Haze Removal Using Dark Channel Prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 2341-2353. [Google Scholar] [CrossRef] [PubMed]
[4] Nishita, T., Miyawaki, Y. and Nakamae, E. (1987) A Shading Model for Atmospheric Scattering Considering Luminous Intensity Distribution of Light Sources. ACM SIGGRAPH Computer Graphics, 21, 303-310. [Google Scholar] [CrossRef
[5] Cai, B., Xu, X., Jia, K., Qing, C. and Tao, D. (2016) DehazeNet: An End-To-End System for Single Image Haze Removal. IEEE Transactions on Image Processing, 25, 5187-5198. [Google Scholar] [CrossRef] [PubMed]
[6] Li, B., Peng, X., Wang, Z., Xu, J. and Feng, D. (2017) AOD-Net: All-in-One Dehazing Network. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 4780-4788. [Google Scholar] [CrossRef
[7] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., et al. (2020) Generative Adversarial Networks. Communications of the ACM, 63, 139-144. [Google Scholar] [CrossRef
[8] Liu, Y., Yin, H., Chong, A. and Wan, J. (2024) Reference-based Image Dehazing with Internal and External Contrastive Learning. IEEE Transactions on Circuits and Systems for Video Technology, 34, 6092-6104. [Google Scholar] [CrossRef
[9] Chen, D., He, M., Fan, Q., Liao, J., Zhang, L., Hou, D., et al. (2019) Gated Context Aggregation Network for Image Dehazing and Deraining. 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, 7-11 January 2019, 1375-1383. [Google Scholar] [CrossRef
[10] Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S. and Yang, M. (2022) Restormer: Efficient Transformer for High-Resolution Image Restoration. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, 18-24 June 2022, 5718-5729. [Google Scholar] [CrossRef
[11] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017) Attention Is All You Need. Advances in Neural Information Processing Systems, 30, 6000-6010.
[12] Engin, D., Genc, A. and Ekenel, H.K. (2018) Cycle-dehaze: Enhanced CycleGAN for Single Image Dehazing. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, 18-22 June 2018, 938-9388. [Google Scholar] [CrossRef
[13] Isola, P., Zhu, J., Zhou, T. and Efros, A.A. (2017) Image-to-Image Translation with Conditional Adversarial Networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 5967-5976. [Google Scholar] [CrossRef
[14] Simonyan, K. and Zisserman, A. (2015) Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 2015 International Conference on Learning Representations (ICLR), San Diego, 7-9 May 2015, 1-14.
[15] Zhao, H., Gallo, O., Frosio, I. and Kautz, J. (2017) Loss Functions for Image Restoration with Neural Networks. IEEE Transactions on Computational Imaging, 3, 47-57. [Google Scholar] [CrossRef
[16] Qin, X., Wang, Z., Bai, Y., Xie, X. and Jia, H. (2020) FFA-Net: Feature Fusion Attention Network for Single Image Dehazing. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 11908-11915. [Google Scholar] [CrossRef
[17] Wang, Z., Bovik, A.C., Sheikh, H.R. and Simoncelli, E.P. (2004) Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 13, 600-612. [Google Scholar] [CrossRef] [PubMed]