基于注意力机制的多级小波CNN遥感图像去噪算法
Remote Sensing Image Denoising Based on Multi-Level Wavelet CNN with Attention Mechanism
DOI: 10.12677/csa.2024.144079, PDF,    国家自然科学基金支持
作者: 成丽波, 苑浩然, 李 喆, 贾小宁:长春理工大学数学与统计学院,吉林 长春
关键词: 深度学习图像去噪卫星遥感图像小波变换注意力机制Deep Learning Image Denoising Remote Sensing Image Wavelet Attention Mechanism
摘要: 高质量的卫星遥感图像对计算机视觉任务来说尤为重要,在去噪模型中,感受野大小和效率之间的权衡是去噪任务的一个关键问题。普通卷积网络(CNN)通常以牺牲计算成本为代价来扩大感受野。通道注意力机制可以保证去噪性能的同时尽量减少计算成本,本文中提出了一种新的基于注意力机制的多级小波CNN模型,以更好地平衡感受野大小和计算效率。在改进U-Net结构的基础上,引入小波变换来减小收缩子网络中特征图的大小。此外,通过通道注意力机制进一步优化模型,使对噪声成分的提取更加有针对性。实验采用峰值信噪比(PSNR)和结构相似性(SSIM)两项评价指标对实验结果进行量化评判,在高斯噪声标准差为15,25,30时,较DNCNN,FFDNET等方法在PSNR值上平均提高10%左右,图像细节清晰,能有效地保护遥感图像边缘特征。
Abstract: High quality satellite remote sensing images are particularly important for computer vision tasks, and the trade-off between receptive field size and efficiency is a key issue in denoising models. Ordinary convolutional network (CNN) typically sacrifice computational costs to expand the receptive field. The channel attention mechanism can ensure denoising performance while minimizing computational costs. In this paper, a new multi-level wavelet CNN model based on attention mechanism is proposed to better balance receptive field size and computational efficiency. On the basis of improving the U-Net structure, wavelet transform is introduced to reduce the size of feature maps in the shrinking sub network. In addition, the model is further optimized through channel attention mechanism to make the extraction of noise components more targeted. The experiment uses two evaluation indicators, peak signal-to-noise ratio (PSNR) and structural similarity (SSIM), to quantitatively evaluate the experimental results, when the standard deviation of Gaussian noise is 15, 25, and 30, compared to methods such as DNCNN and FFDNET, the average PSNR value is improved by about 10%, and the image details are clear, which can effectively protect the edge features of remote sensing images.
文章引用:成丽波, 苑浩然, 李喆, 贾小宁. 基于注意力机制的多级小波CNN遥感图像去噪算法[J]. 计算机科学与应用, 2024, 14(4): 73-82. https://doi.org/10.12677/csa.2024.144079

参考文献

[1] Shao, Z. and Cai, J. (2018) Remote Sensing Image Fusion with Deep Convolutional Neural Network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11, 1656-1669. [Google Scholar] [CrossRef
[2] Gou, S., Liu, S., Yang, S. and Jiao, L. (2014) Remote Sensing Image Super-Resolution Reconstruction Based on Nonlocal Pairwise Dictionaries Anddouble Regularization. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 4784-4792. [Google Scholar] [CrossRef
[3] Liu, X., Zhai, D., Chen, R., Ji, X., Zhao, D. and Gao, W. (2019) Depth Restoration from RGB-D Data via Joint Adaptive Regularization and Thresholding on Manifolds. EE Transactions on Image Processing, 28, 1068-1079. [Google Scholar] [CrossRef
[4] Liu, X., Zhai, D., Chen, R., Ji, X., Zhao, D. and Gao, W. (2019) Depth Super-Resolution via Joint Color-Guided Internal and External Regularizations. IEEE Transactions on Image Processing, 28, 1636-1645. [Google Scholar] [CrossRef
[5] 高浩军, 杜宇人. 中值滤波在图像处理中的应用[J]. 电子工程师, 2004, 30(8): 35-36.
[6] 朱磊, 李敬曼, 潘杨, 等. 自适应调节滤波强度的SAR图像非局部平均抑斑算法[J]. 电子与信息学报, 2021, 43(5): 1258-1266.
[7] 刘向乐, 冯象初. 小波域三维块匹配图像去噪[J]. 计算机工程与应用, 2010, 46(16): 185-187.
[8] 谢杰成, 张大力, 徐文立. 小波图象去噪综述[J]. 中国图象图形学报(A辑), 2002, 7(3): 209-217.
[9] Do, M.N. and Vetterli, M. (2005) The Contourlet Transform: An Efficient Directional Multiresolution Image Representation. IEEE Transaction Image Processing, 14, 2091-2106. [Google Scholar] [CrossRef
[10] Do, M.N. (2001) Directional Multiresolution Image Representations. Ph.D. Thesis, EPEL, Lausanna.
[11] Starck, J.L., Candes, E.J. and Donoho, D.L. (2002) The Curvelet Transform for Image Denoising. IEEE Transactions on Image Processing, 11, 670-684. [Google Scholar] [CrossRef
[12] Loupas, T., Mcdicken, W.N. and Allan, P.L. (1989) An Adaptive Weighted Median Filter for Speckle Suppression in Medical Ultrasonic Images. IEEE Transactions on Circuits and Systems, 36, 129-135. [Google Scholar] [CrossRef
[13] Jain, V. and Seung, H.S. (2008) Natural Image Denoising with Convolutional Networks. In: Koller, D., Schuurmans, D., Bengio, Y. and Bottou, L., Eds., Advances in Neural Information Processing Systems 21—Proceedings of the 2008 Conference, Vancouver, 8-10 December 2008, 769-776.
[14] Burger, H.C., Schuler, C.J. and Harmeling, S. (2012) Image Denoising with Multi-Layer Perceptrons, Part 2: Training Trade-Offs and Analysis of Their Mechanisms. arXiv: 1211.1552.
[15] Xie, J., Xu, L. and Chen, E. (2012) Image Denoising and Inpainting with Deep Neural Networks. Advances in Neural Information Processing Systems, 1, 341-349.
[16] Mao, X.J., Shen, C. and Yang, Y.B. (2016) Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections. [Google Scholar] [CrossRef
[17] Zhang, K., Zuo, W., Chen, Y., et al. (2016) Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Transactions on Image Processing, 26, 3142-3155. [Google Scholar] [CrossRef
[18] Remez, T., Litany, O., Giryes, R. and Bronstein, A.M. (2018) Class-Aware Fully-Convolutional Gaussian and Poisson Denoising. IEEE Transactions on Image Processing, 27, 5707-5722. [Google Scholar] [CrossRef
[19] 魏江, 刘潇, 梅少辉. 基于卷积神经网络的遥感图像去噪算法[J]. 微电子学与计算机, 2019, 36(8): 59-62, 67.
[20] Mallat, S.G. (1989) A Theory for Multiresolution Signal Decomposition: The Wavelet Representation. IEEE Transactions on Pattern Analysis & Machine Intelligence, 11, 674-693. [Google Scholar] [CrossRef
[21] Akansu, A.N. and Haddad, R.A. (2000) Multiresolution Signal Decomposition, Transforms, Subbands and Wavelets. Academic Press, Cambridge. [Google Scholar] [CrossRef
[22] Chang, G. (2000) Adaptive Wavelet Thresholding for Image Denoising and Compression. IEEE Transactions on Image Processing, 9, 1532-1546. [Google Scholar] [CrossRef] [PubMed]
[23] Lewis, A.S. and Knowles, G. (1992) Image Compression Using the 2-D Wavelet Transform. IEEE Transactions on Image Processing, 1, 244-250. [Google Scholar] [CrossRef] [PubMed]
[24] Han, Y. and Ye, J.C. (2018) Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT. IEEE Transactions on Medical Imaging, 37, 1418-1429. [Google Scholar] [CrossRef
[25] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W. and Frangi, A., Eds., Medical Image Computing and Computer-Assisted InterventionMICCAI 2015, Springer, Cham, 234-241. [Google Scholar] [CrossRef