基于Gabor基算法展开卷积神经网络图像恢复模型
Image Restoration Based on Gabor—Based Algorithm Unrolling Convolutional Neural Network
DOI: 10.12677/CSA.2023.135110, PDF,    国家自然科学基金支持
作者: 孙 璐, 魏伟波, 杨光宇, 宋金涛, 李 倩, 潘振宽*:青岛大学计算机科学技术学院,山东 青岛
关键词: 图像恢复半二次分裂Gabor基卷积神经网络算法展开Image Restoration HQS Gabor-based Convolutional Neural Network Algorithm Unrolling
摘要: 基于变分的图像恢复模型可设计高效的即插即用算法,但涉及较多的超参数调节,且去噪器模块通常选择传统深度学习方法,网络层数和训练参数较多。针对此问题,在变分模型算法展开——半二次分裂方法基础上采用径向基函数近似非线性扩散模型的激活函数、采用Gabor基近似卷积核,进而设计了高效紧致的图像恢复深度学习卷积神经网络。Gabor基比离散余弦变换基包含更丰富的方向、尺度信息,可设计高效、紧致的网络结构。与非线性反应扩散模型相比,模型针对图像去噪在噪声级为15、25、50对应的峰值信噪比高出0.14 dB、0.7 dB、0.7 dB,在其它图像问题中也展现出良好的恢复效果。提出的框架不仅能够推广到其它图像恢复任务,还可拓展到其它图像分析与处理的深度学习卷积神经网络设计。
Abstract: The image restoration model based on variational can design an efficient plug and play algorithm, but it involves more hyperparameter adjustment, and the denoising module usually chooses the traditional deep learning method, which has more network layers and training parameters. To solve this problem, an efficient and compact deep learning convolutional neural network for image restoration is designed by using radial basis function to approximate the activation function of non-linear diffusion model and Gabor basis to approximate convolution kernel on the basis of variational model algorithm expansion—semi-quadratic splitting method. Gabor contains more direction and scale information than discrete cosine transform function, which can design efficient and compact network structure. Compared with the nonlinear reaction-diffusion model, the peak signal-to-noise ratio of the model for image denoising is 0.14 dB, 0.7 dB and 0.7 dB higher when the noise level is 15, 25 and 50, which also shows a good recovery effect in other image problems. The proposed framework can be extended not only to other image restoration tasks, but also to deep learning convolutional neural network design for image analysis and processing.
文章引用:孙璐, 魏伟波, 杨光宇, 宋金涛, 李倩, 潘振宽. 基于Gabor基算法展开卷积神经网络图像恢复模型[J]. 计算机科学与应用, 2023, 13(5): 1119-1134. https://doi.org/10.12677/CSA.2023.135110

参考文献

[1] 阮秋琦, 仵冀颖. 数字图像处理中的偏微分方程方法[J]. 信号处理, 2012, 28(3): 301-314.
[2] Chen, Y. and Pock, T. (2017) Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1256-1272. [Google Scholar] [CrossRef
[3] Chalasani, R. and Principe, J.C. (2014) Dynamic Sparse Cod-ing with Smoothing Proximal Gradient Method. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, 4-9 May 2014, 7188-7192. [Google Scholar] [CrossRef
[4] Chan, S.H., Wang, X. and Elgendy, O.A. (2017) Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications. IEEE Transactions on Com-putational Imaging, 3, 84-98. [Google Scholar] [CrossRef
[5] Ono, S. (2017) Primal-Dual Plug-and-Play Image Restoration. IEEE Signal Processing Letters, 24, 1108-1112. [Google Scholar] [CrossRef
[6] Monga, V., Li, Y. and Eldar, Y.C. (2021) Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing. IEEE Signal Processing Magazine, 38, 18-44. [Google Scholar] [CrossRef
[7] Gavaskar, R.G. and Chaudhury, K.N. (2020) Plug-and-Play ISTA Converges with Kernel Denoisers. IEEE Signal Processing Letters, 27, 610-614. [Google Scholar] [CrossRef
[8] Zhang, K., Zuo, W., Gu, S. and Zhang, L. (2017) Learning Deep CNN Denoiser Prior for Image Restoration. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 2808-2817. [Google Scholar] [CrossRef
[9] Zhang, K., Zuo, W., Chen, Y., Meng, D. and Zhang, L. (2017) Be-yond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Transactions on Image Pro-cessing, 26, 3142-3155. [Google Scholar] [CrossRef
[10] Zhang, K., Zuo, W. and Zhang, L. (2018) FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising. IEEE Transactions on Image Processing, 27, 4608-4622. [Google Scholar] [CrossRef
[11] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolu-tional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W. and Frangi, A., Eds., Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015. MICCAI 2015. Lecture Notes in Com-puter Science, Vol. 9351, Springer, Cham, 234-241. [Google Scholar] [CrossRef
[12] Dong, W., Wang, P., Yin, W., et al. (2019) Denoising Prior Driven Deep Neural Network for Image Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 2305-2318. [Google Scholar] [CrossRef
[13] Roth, S. and Black, M.J. (2009) Fields of Experts. Interna-tional Journal of Computer Vision, 82, 205-229. [Google Scholar] [CrossRef
[14] Mutgekar, M.B. and Bhaskar, P.C. (2019) Analysis of DCT and Fast DCT Using Soft Core Processor. 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, 23-25 April 2019, 1128-1132. [Google Scholar] [CrossRef
[15] Kwolek, B. (2005) Face Detection Using Convolutional Neural Networks and Gabor Filters. In: Duch, W., Kacprzyk, J., Oja, E. and Zadrożny, S., Eds., Artificial Neural Networks: Bi-ological Inspirations—ICANN 2005. ICANN 2005. Lecture Notes in Computer Science, Vol. 3696, Springer, Berlin, 551-556. [Google Scholar] [CrossRef
[16] Alekseev, A. and Bobe, A. (2019) GaborNet: Gabor Filters with Learnable Parameters in Deep Convolutional Neural Network. 2019 International Conference on Engineering and Telecommunication (EnT), Dolgoprudny, 20-21 November 2019, 1-4. [Google Scholar] [CrossRef
[17] Luan, S., Chen, C., Zhang, B., Han, J. and Liu, J. (2018) Gabor Convolutional Networks. IEEE Transactions on Image Processing, 27, 4357-4366. [Google Scholar] [CrossRef
[18] Vargas-Rubio, J.G. and Santhanam, B. (2005) On the Multiangle Centered Discrete Fractional Fourier Transform. IEEE Signal Processing Letters, 12, 273-276. [Google Scholar] [CrossRef
[19] Dabov, K., Foi, A., Katkovnik, V. and Egiazarian, K. (2007) Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Transactions on Image Processing, 16, 2080-2095. [Google Scholar] [CrossRef
[20] Zoran, D. and Weiss, Y. (2011) From Learning Models of Natural Image Patches to Whole Image Restoration. 2011 International Conference on Computer Vision, Barcelona, 6-13 November 2011, 479-486. [Google Scholar] [CrossRef
[21] Schmidt, U. and Roth, S. (2014) Shrinkage Fields for Effective Image Restoration. 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 2774-2781. [Google Scholar] [CrossRef
[22] Schmidt, U., Jancsary, J., Nowozin, S., Roth, S. and Rother, C. (2016) Cascades of Regression Tree Fields for Image Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 677-689. [Google Scholar] [CrossRef
[23] Keys, R. (1981) Cubic Convolution Interpolation for Digital Image Processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 1153-1160. [Google Scholar] [CrossRef
[24] Dong, C., Loy, C.C., He, K. and Tang, X. (2014) Learning a Deep Convolutional Network for Image Super-Resolution. In: Fleet, D., Pajdla, T., Schiele, B. and Tuytelaars, T., Eds., Computer Vision—ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, Vol. 8692, Springer, Cham. [Google Scholar] [CrossRef
[25] Danielyan, A., Katkovnik, V. and Egiazarian, K. (2012) BM3D Frames and Variational Image Deblurring. IEEE Transactions on Image Processing, 21, 1715-1728. [Google Scholar] [CrossRef