RM Transunet:基于小样本数据的肺癌脑转移瘤分割
RM Transunet: Segmentation of Lung Cancer Brain Metastases Based on Small Sample Data
摘要: 脑肿瘤的语义分割是一项基本的医学图像分析任务,可以协助临床医生诊断患者,并持续关注病灶部分的变化情况。得益于深度学习的发展,医学图像自动分割取得了很大的进步。然而,现有的深度学习分割模型依赖于庞大的训练数据支撑,在临床上,医学数据通常数据量较小。为了改善这些问题,本文提出了一种新的深度医学图像分割框架,称为Residual Mulitse Transunet (RM Transunet),以提高小样本医学图像的语义分割质量。本文提出的RM Transunet遵循了Transunet的设计,融合了CNN和Transformer,并引入了Residual Block和MuilSE,有效地在不同尺度的特征之间建立全局依赖关系,以便充分利用这些获得的多尺度特征表示。针对医学图像分割的实验证明了RM Transunet的有效性,并表明我们的方法明显优于当下的方法。本研究的贡献不仅在于提供了一种新的思路来解决医学图像领域小样本数据的挑战,同时也为临床决策和治疗优化提供了有益的参考。
Abstract: Semantic segmentation of brain tumors is a basic medical image analysis task that can assist clinicians in diagnosing patients and continuously paying attention to changes in the lesions. Thanks to the development of deep learning, great progress has been made in automatic segmentation of medical images. However, existing deep learning segmentation models rely on the support of huge training data. In clinical practice, medical data usually have a small amount of data. To improve these problems, this paper proposes a new deep medical image segmentation framework called residual mulitse transunet (RM Transunet) to improve the semantic segmentation quality of small sample medical images. The RM Transunet proposed in this article follows the design of Transunet, integrates CNN and Transformer, and introduces Residual Block and MuilSE to effectively establish global dependencies between features at different scales in order to make full use of these obtained multi-scale feature representations. Experiments on medical image segmentation demonstrate the effectiveness of RM Transunet and show that our method significantly outperforms current methods. The contribution of this study is not only to provide a new idea to solve the challenge of small sample data in the field of medical images, but also to provide a useful reference for clinical decision-making and treatment optimization.
文章引用:杨玉婷, 祝汉灿. RM Transunet:基于小样本数据的肺癌脑转移瘤分割[J]. 计算机科学与应用, 2024, 14(4): 358-367. https://doi.org/10.12677/csa.2024.144105

参考文献

[1] 石远凯, 孙燕, 于金明, 等. 中国肺癌脑转移诊治专家共识(2017年版) [J]. 中国肺癌杂志, 2017, 20(1): 1-13.
[2] Davidson, M.R., Larsen, J.E., Yang, I.A., et al. (2010) MicroRNA-218 Is Deleted and Downregulated in Lung Squamous Cell Carcinoma. PLOS ONE, 5, e12560. [Google Scholar] [CrossRef] [PubMed]
[3] Song, Y., Ren, S., Lu, Y., et al. (2022) Deep Learning-Based Automatic Segmentation of Images in Cardiac Radiography: A Promising Challenge. Computer Methods and Programs in Biomedicine, 220, Article ID: 106821. [Google Scholar] [CrossRef] [PubMed]
[4] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted InterventionMICCAI 2015: 18th International Conference, Munich, 5-9 October 2015, 234-241.
[5] Oktay, O., Schlemper, J., Folgoc, L.L., et al. (2018) Attention U-Net: Learning Where to Look for the Pancreas.
[6] Trebing, K., Staǹczyk, T. and Mehrkanoon, S. (2021) SmaAt-UNet: Precipitation Nowcasting Using a Small Attention-UNet Architecture. Pattern Recognition Letters, 145, 178-186. [Google Scholar] [CrossRef
[7] Islam, M., Vibashan, V., Jose, V., et al. (2020) Brain Tumor Segmentation and Survival Prediction Using 3D Attention UNet. Proceedings of the Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 5th International Workshop, BrainLes 2019, Held in Conjunction with MICCAI 2019, Shenzhen, 17 October 2019, 262-272. [Google Scholar] [CrossRef
[8] Noori, M., Bahri, A. and Mohammadi, K. (2019) Attention-Guided Version of 2D UNet for Automatic Brain Tumor Segmentation. Proceedings of the 2019 9th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, 24-25 October 2019, 269-275. [Google Scholar] [CrossRef
[9] Guo, C., Szemenyei, M., Yi, Y., et al. (2021) Sa-Unet: Spatial Attention U-Net for Retinal Vessel Segmentation. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, 10-15 January 2021, 1236-1242. [Google Scholar] [CrossRef
[10] He, K., Zhang, X., Ren, S., et al. (2016) Deep Residual Learning for Image Recognition. The Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778. [Google Scholar] [CrossRef
[11] Maji, D., Sigedar, P., Singh, M., et al. (2022) Attention Res-UNet with Guided Decoder for Semantic Segmentation of Brain Tumors. Biomedical Signal Processing and Control, 71, Article ID: 103077. [Google Scholar] [CrossRef
[12] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6): 1229-1251.
[13] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017) Attention Is All You Need. NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 6000-6010.
[14] Dosovitskiy, A., Beyer, L., Kolesnikov, A., et al. (2020) An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale.
[15] Liu, Z., Lin, Y., Cao, Y., et al. (2021) Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. The Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, 10-17 October 2021, 9992-10002. [Google Scholar] [CrossRef
[16] Wang, W., Chen, C., Ding, M., et al. (2021) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer. Proceedings of the Medical Image Computing and Computer Assisted InterventionMICCAI 2021: 24th International Conference, Strasbourg, 27 September-1 October 2021, 109-119. [Google Scholar] [CrossRef
[17] Hatamizadeh, A., Tang, Y., Nath, V., et al. (2022) UNETR: Transformers for 3D Medical Image Segmentation. The Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, 3-8 January 2022, 1748-1758. [Google Scholar] [CrossRef
[18] Kim, N., Kim, D., Lan, C., et al. (2022) ReSTR: Convolution-Free Referring Image Segmentation Using Transformers. The Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, 18-24 June 2022, 18124-18133. [Google Scholar] [CrossRef
[19] He, K., Gan, C., Li, Z., et al. (2023) Transformers in Medical Image Analysis. Intelligent Medicine, 3, 59-78. [Google Scholar] [CrossRef
[20] Chen, J., Lu, Y., Yu, Q., et al. (2021) Transunet: Transformers Make Strong Encoders for Medical Image Segmentation.
[21] Wang, H., Cao, P., Wang, J., et al. (2022) UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-Wise Perspective with Transformer. The Proceedings of the AAAI Conference on Artificial Intelligence, 36, 2441-2449. [Google Scholar] [CrossRef
[22] Li, Y., Wang, Z., Yin, L., et al. (2021) X-Net: A Dual Encoding-Decoding Method in Medical Image Segmentation. The Visual Computer, 39, 2223-2233.
[23] Fang, J., Yang, C., Shi, Y., et al. (2022) External Attention Based TransUNet and Label Expansion Strategy for Crack Detection. IEEE Transactions on Intelligent Transportation Systems, 23, 19054-19063. [Google Scholar] [CrossRef
[24] Yang, Y. and Mehrkanoon, S. (2022) AA-TransUNet: Attention Augmented TransUNet for Nowcasting Tasks. Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, 18-23 July 2022, 1-8. [Google Scholar] [CrossRef
[25] Lin, M., Chen, Q. and Yan, S. (2013) Network in Network.
[26] Woo, S., Park, J., Lee, J.-Y., et al. (2018) CBAM: Convolutional Block Attention Module. The Proceedings of the European Conference on Computer Vision (ECCV), Munich, 8-14 September 2018, 3-19. [Google Scholar] [CrossRef
[27] Hu, J., Shen, L. and Sun, G. (2018) Squeeze-and-Excitation Networks. The Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 7132-7141. [Google Scholar] [CrossRef
[28] Li, X., Sun, X., Meng, Y., et al. (2020) Dice Loss for Data-Imbalanced NLP Tasks. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, July 2020, 465-476. [Google Scholar] [CrossRef