基于改进的残差网络的单幅图像去雨方法
A Single Image Derain Method Based on Improved Residual Network
摘要: 雨水是室外比较常见的天气现象。在雨水条件下,光的散射和能见度下降,导致计算机视觉算法会受到不同程度的干扰。为了进一步降低雨水给计算机视觉算法带来的影响,本文提出一种基于改进的残差网络的单幅图像去雨方法。该方法结合了图像处理传统方法和深度学习的方法,首先通过传统方法对有雨图像进行稀疏化,将稀疏化后的图像作为输入,由残差网络学习稀疏化后的图像特征,接着对网络进行训练,最终的网络可以有效的去除雨线。实验结果表明:本文提出的方法可以有效地去除雨线。同时,残差网络学习稀疏化的图像特征,可以大大提升网络的训练效率。
Abstract: Rain is a relatively common weather phenomenon outside. Under the condition of rain, the scattering and visibility of light decrease, which leads to the interference of computer vision algorithm to different degrees. In order to further reduce the influence of rain on computer vision algorithm, this paper proposes a single image derain method based on improved residual network. This method combines the traditional image processing method and the deep learning method. Firstly, the image with rain is sparsely processed by the traditional method, and the sparse image is taken as the input. The image features after sparsity, are learned by the residual network, and then the network is trained, so that the final network can effectively remove rain lines. The experimental results show that the proposed method can effectively remove the rain line. At the same time, the residual network learning sparse image features can greatly improve the training efficiency of the network.
文章引用:崔艳, 蔡瑞琪, 于小亿. 基于改进的残差网络的单幅图像去雨方法[J]. 图像与信号处理, 2021, 10(1): 1-8. https://doi.org/10.12677/JISP.2021.101001

参考文献

[1] Kang, L.W., Lin, C.W. and Fu, Y.H. (2011) Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition. IEEE Transactions on Image Processing, 21, 1742-1755.
[Google Scholar] [CrossRef
[2] Kim, J.H., Lee, C., Sim, J.Y., et al. (2013) Single-Image Deraining Using an Adaptive Nonlocal Means Filter. 2013 IEEE International Conference on Image Processing, Melbourne, 15-18 September 2013, 914-917.
[Google Scholar] [CrossRef
[3] Chen, Y.L. and Hsu, C.T. (2013) A Generalized Low-Rank Appearance Model for Spatio-Temporally Correlated Rain Streaks. Proceedings of the IEEE International Conference on Computer Vision, Sydney, 1-8 December 2013, 1968-1975.
[Google Scholar] [CrossRef
[4] Pang, B., Zhai, D., Jiang, J., et al. (2020) Single Image Deraining via Scale-Space Invariant Attention Neural Network. Proceedings of the 28th ACM International Conference on Multimedia, 375-383.
[Google Scholar] [CrossRef
[5] Wang, Y., Gong, D., Yang, J., et al. (2019) An Effective Two-Branch Model-Based Deep Network for Single Image Deraining. Computer Vision and Pattern Recognition, arXiv: 1905.05404 [cs. CV].
[6] Tan, M. and Le, Q.V. (2019) EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. International Conference on Machine Learning, arXiv: 1905.11946 [cs.LG].
[7] Zoph, B., Vasudevan, V., Shlens, J., et al. (2018) Learning Transferable Architectures for Scalable Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 8697-8710.
[Google Scholar] [CrossRef
[8] Zheng, M., Karanam, S., Wu, Z., et al. (2019) Re-Identification with Consistent Attentive Siamese Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, 15-20 June 2019, 5728-5737.
[Google Scholar] [CrossRef
[9] Li, X., Wu, J., Lin, Z., et al. (2018) Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y., Eds., Computer Vision-ECCV 2018, ECCV 2018, Lecture Notes in Computer Science, Springer, Cham, 262-277.
[Google Scholar] [CrossRef
[10] Ge, Y., Chen, D. and Li, H. (2020) Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-Identification. Computer Vision and Pattern Recognition, arXiv: 2001.01526 [cs.CV].
[11] Fu, X., Huang, J., Zeng, D., et al. (2017) Removing Rain from Single Images via a Deep Detail Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 1715-1723.
[Google Scholar] [CrossRef
[12] He, K., Zhang, X., Ren, S., et al. (2016) Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778.
[Google Scholar] [CrossRef
[13] Fu, X., Huang, J., Ding, X., et al. (2017) Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal. IEEE Transactions on Image Processing, 26, 2944-2956.
[Google Scholar] [CrossRef
[14] Isola, P., Zhu, J.Y., Zhou, T., et al. (2017) Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 5967-5976.
[Google Scholar] [CrossRef