基于深度学习的无监督磁共振图像去噪方法
An Unsupervised Deep Learning Method for MRI Image Denoising
DOI: 10.12677/CSA.2021.115129, PDF,    国家科技经费支持
作者: 唐 凡:成都信息工程大学,四川 成都;符 颖*:成都信息工程大学,四川 成都;四川省图形图像与空间信息2011协同创新中心,四川 成都;李 燕:重庆中烟工业有限责任公司重庆卷烟厂,重庆
关键词: MRI去噪莱斯噪声无监督深度学习解缠表示MRI Denoising Rician Noise Unsupervised Deep Learning Disentangled Representations
摘要: 近年来,基于深度学习的方法在医学图像去噪方面取得了很好的表现。然而,大多数基于深度学习的方法都需要成对的训练数据,这将影响如新型冠状病毒肺炎等病症的临床诊断。本文提出了一种用于磁共振成像(magnetic resonance image,简称MRI)去噪的无监督学习方法。首先,我们通过内容编码器和随机噪声编码器分离受噪声影响的低质MRI图像的内容信息和噪声信息。其次,利用Kullback-Leibler (KL)散度损失对噪声的分布进行正则化。第三,向模型加入对抗损失,使生成的去噪图像看起来更加真实。最后,我们增加了循环一致损失和感知损失来确保带噪图像和去噪图像内容信息的一致性。实验结果表明,我们提出的方法取得了良好的视觉效果。
Abstract: Recently, medical image denoising methods based on deep learning have performed well. However, one challenge for most of these methods needs paired synthetic training data, which will affect clinic diagnosis such as COVID-19. In this paper, we proposed an unsupervised learning method for Magnetic Resonance Imaging (MRI) denoising. Firstly, we separated the content and noise of low-quality MRI images affected by noise through the content encoder and random noise encoder. Secondly, we used Kullback-Leibler (KL) loss to regularize the distribution of noise. Thirdly, we apply the adversarial loss on the model to make the denoising images look more realistic. Finally, we added cycle-consistency loss and perception loss to ensure the consistency of the noisy image and the denoised image. Experimental results showed the method we proposed achieved good visual results.
文章引用:唐凡, 符颖, 李燕. 基于深度学习的无监督磁共振图像去噪方法[J]. 计算机科学与应用, 2021, 11(5): 1268-1280. https://doi.org/10.12677/CSA.2021.115129

参考文献

[1] Buades, A., Coll, B. and Morel, J.-M. (2005) A Non-Local Algorithm for Image Denoising. 2005 IEEE Computer Soci-ety Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, 20-25 June 2005, 60-65.
[2] Manjón, J.V., Carbonell-Caballero, J., A, Lull, J.J., García-Martí, G., Martí-Bonmatí, L. and Robles, M. (2008) MRI Denoising Using Non-Local Means. Medical Image Analysis, 12, 514-523. [Google Scholar] [CrossRef] [PubMed]
[3] Dabov, K., Foi, A., Katkovnik, V. and Egiazarian, K. (2007) Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Transactions on Image Processing, 16, 2080-2095. [Google Scholar] [CrossRef
[4] Eksioglu, E.M. (2016) Decoupled Algorithm for MRI Reconstruc-tion Using Nonlocal Block Matching Model: BM3D-MRI. Journal of Mathematical Imaging & Vision, 56, 430-440. [Google Scholar] [CrossRef
[5] Dong, W., Shi, G. and Li, X. (2013) Nonlocal Image Restoration with Bilateral Variance Estimation: A Low-Rank Approach. IEEE Transactions on Image Processing, 22, 700-711. [Google Scholar] [CrossRef
[6] Dong, W., Shi, G., Li, X., Ma, Y. and Huang, F. (2014) Compres-sive Sensing via Nonlocal Low-Rank Regularization. IEEE Transactions on Image Processing, 23, 3618-3632. [Google Scholar] [CrossRef
[7] Zhang, Y., Yang, Z., Hu, J., Zou, S. and Fu, Y. (2019) MRI De-noising Using Low Rank Prior and Sparse Gradient Prior. IEEE Access, 7, 45858-45865. [Google Scholar] [CrossRef
[8] Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2017) ImageNet Classification with Deep Convolutional Neural Networks. Communications of the ACM, 60, 84-90. [Google Scholar] [CrossRef
[9] Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V. and Rabinovich, A. (2015) Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, 7-12 June 2015, 1-9. [Google Scholar] [CrossRef
[10] Zhang, K., Zuo, W., Chen, Y., Meng, D. and Zhang, L. (2016) Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Transactions on Image Pro-cessing, 26, 3142-3155. [Google Scholar] [CrossRef
[11] Zhang, K., Zuo, W. and Zhang, L. (2017) FFDNet: Toward a Fast and Flexible Solution for CNN Based Image Denoising. IEEE Transactions on Image Processing, 27, 4608-4622.
[12] Jiang, D., Dou, W., Vosters, L., et al. (2018) Denoising of 3D Magnetic Resonance Images with Mul-ti-Channel Residual Learning of Convolutional Neural Network. Japanese Journal of Radiology, 36, 566-574. [Google Scholar] [CrossRef] [PubMed]
[13] Manjón, J.V. and Coupé, P. (2018) MRI Denoising Using Deep Learning. In: Bai, W., Sanroma, G., Wu, G., Munsell, B., Zhan, Y. and Coupé, P., Eds., International Workshop on Patch-Based Techniques in Medical Imaging, Springer, Cham, 12-19. [Google Scholar] [CrossRef
[14] Abbasi, A., Monadjemi, A., Fang, L., Rabbani, H. and Zhang, Y. (2019) Three-Dimensional Optical Coherence Tomography Image Denoising through Multi-Input Ful-ly-Convolutional Networks. Computers in Biology and Medicine, 108, 1-8. [Google Scholar] [CrossRef] [PubMed]
[15] Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., et al. (2014) Generative Adversarial Networks. Advances in Neural Information Processing Systems, 3, 2672-2680.
[16] Radford, A., Metz, L. and Chintala, S. (2015) Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv preprint arXiv:1511.06434.
[17] Arjovsky, M., Chintala, S. and Bottou, L. (2017) Wasserstein Gan. arXiv preprint arXiv:1701.07875.
[18] Chen, J., Chen, J., Chao, H. and Yang, M. (2018) Image Blind Denoising with Generative Adversarial Network Based Noise Modeling. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, 18-23 June 2018, 3155-3164. [Google Scholar] [CrossRef
[19] Yeh, R.A., Lim, T.Y., Chen, C., Schwing, A.G., Hasega-wa-Johnson, M. and Do, M. (2018) Image Restoration with Deep Generative Models. 2018 IEEE International Confer-ence on Acoustics, Speech and Signal Processing (ICASSP), Calgary, 15-20 April 2018, 6772-6776. [Google Scholar] [CrossRef
[20] Lu, S., Lu, Z. and Zhang, Y.D. (2019) Pathological Brain De-tection Based on AlexNet and Transfer Learning. Journal of Computational Science, 30, 41-47. [Google Scholar] [CrossRef
[21] Lu, S., Wang, S.H. and Zhang, Y.D. (2020) Detection of Abnormal Brain in MRI via Improved AlexNet and ELM Optimized by Chaotic Bat Algorithm. Neural Computing and Applica-tions. [Google Scholar] [CrossRef
[22] Zhu, J.Y., Park, T., Isola, P. and Efros, A.A. (2017) Un-paired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 2242-2251. [Google Scholar] [CrossRef
[23] Tran, L., Yin, X. and Liu, X. (2017) Disentangled Representation Learning GAN for Pose-Invariant Face Recognition. 2017 IEEE Conference on Computer Vision and Pattern Recogni-tion (CVPR), Honolulu, 21-26 July 2017, 1283-1292. [Google Scholar] [CrossRef
[24] Liu, Y., Wei, F., Shao, J., Sheng, L., Yan, J. and Wang, X. (2018) Exploring Disentangled Feature Representation Beyond Face Identification. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 2080-2089. [Google Scholar] [CrossRef
[25] Kingma, D.P. and Welling, M. (2013) Auto-Encoding Variational Bayes. arXiv preprint arXiv:1312.6114.
[26] Simonyan, K. and Zisserman, A. (2014) Very Deep Convolutional Net-works for Large-Scale Image Recognition. arXiv preprint arXiv:1409.1556.