基于双视角注意力的小样本医学图像分割
Few-Shot Medical Image Segmentation Based on Dual-Perspective Attention
摘要: 专业医学图像的采集成本与标注要求高,导致可用标注数据量不足,小样本医学图像分割成为当前解决该问题的重要方向。传统的方法通常从支撑图像中学习原型,并通过最近邻搜索的方法分割查询图像。尽管这些算法展现出较高的性能,但由于部分容积效应导致组织边界模糊;灰度不均匀性造成同类组织表征差异;前景和背景共享相似视觉特征,使得模型易产生混杂错误分割。为此本文提出双视角协同增强网络(Dual-Perspective Collaborative Enhancement Network, DPCENet),通过空间–通道双视角注意力机制实现协同精准特征筛选,具体来说,空间注意力精确定位器官空间分布;通道注意力动态增强相关语义通道,抑制无关噪声。考虑到医学图像前景和背景共享许多视觉特征,模型采用双路径平衡设计,并行处理前景与背景特征流。在三个公开的医学图像数据集上的实验表明,该方法的性能优于现有方法,详细的分析也验证了该模块的有效性。
Abstract: The high acquisition cost and high annotation requirements of professional medical images lead to insufficient available annotated data. Small sample medical image segmentation has become an important direction to solve this problem. Traditional methods usually learn prototypes from supporting images and segment query images through nearest neighbor search. Although these algorithms show high performance, the partial volume effect leads to blurred tissue boundaries; grayscale inhomogeneity causes differences in the representation of similar tissues; the foreground and background share similar visual features, which makes the model prone to mixed mis-segmentation. To this end, this paper proposes a dual-perspective collaborative enhancement network (DPCENet), which achieves collaborative and precise feature screening through a spatial-channel dual-perspective attention mechanism. Specifically, spatial attention accurately locates the spatial distribution of organs; channel attention dynamically enhances related semantic channels and suppresses irrelevant noise. Considering that the foreground and background of medical images share many visual features, the model adopts a dual-path balanced design to process the foreground and background feature streams in parallel. Experiments on three public medical image datasets show that the performance of this method is better than that of existing methods, and detailed analysis also verifies the effectiveness of this module.
文章引用:祖春晓, 郑贤彬, 郭锴. 基于双视角注意力的小样本医学图像分割[J]. 建模与仿真, 2025, 14(8): 255-265. https://doi.org/10.12677/mos.2025.148564

参考文献

[1] Asgari Taghanaki, S., Abhishek, K., Cohen, J.P., Cohen-Adad, J. and Hamarneh, G. (2020) Deep Semantic Segmentation of Natural and Medical Images: A Review. Artificial Intelligence Review, 54, 137-178. [Google Scholar] [CrossRef
[2] Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H. and Rueckert, D. (2020) Self-Supervision with Superpixels: Training Few-Shot Medical Image Segmentation without Annotation. Computer Vision-ECCV 2020: 16th European Conference, Glasgow, 23-28 August 2020, 762-780. [Google Scholar] [CrossRef
[3] Guha Roy, A., Siddiqui, S., Pölsterl, S., Navab, N. and Wachinger, C. (2020) “Squeeze & Excite” Guided Few-Shot Segmentation of Volumetric Images. Medical Image Analysis, 59, Article ID: 101587. [Google Scholar] [CrossRef] [PubMed]
[4] Shen, Q., Li, Y., Jin, J. and Liu, B. (2024) Q-net: Query-Informed Few-Shot Medical Image Segmentation. In: Proceedings of SAI Intelligent Systems Conference, Springer, 610-628. [Google Scholar] [CrossRef
[5] Ding, H., Sun, C., Tang, H., Cai, D. and Yan, Y. (2023) Few-Shot Medical Image Segmentation with Cycle-Resemblance Attention. 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, 2-7 January 2023, 2488-2497. [Google Scholar] [CrossRef
[6] Zhu, Y., Wang, S., Xin, T. and Zhang, H. (2023) Few-Shot Medical Image Segmentation via a Region-Enhanced Prototypical Transformer. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 271-280. [Google Scholar] [CrossRef
[7] Wang, K., Liew, J.H., Zou, Y., Zhou, D. and Feng, J. (2019) Panet: Few-Shot Image Semantic Segmentation with Prototype Alignment. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, 27 October-2 November 2019, 9197-9206. [Google Scholar] [CrossRef
[8] 周志敏. 基于改进U-Net的医学图像分割算法研究[D]: [硕士学位论文]. 镇江: 江苏科技大学, 2024.
[9] Hansen, S., Gautam, S., Jenssen, R. and Kampffmeyer, M. (2022) Anomaly Detection-Inspired Few-Shot Medical Image Segmentation through Self-Supervision with Supervoxels. Medical Image Analysis, 78, Article ID: 102385. [Google Scholar] [CrossRef] [PubMed]
[10] Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., et al. (2014) Microsoft COCO: Common Objects in Context. Computer Vision-ECCV 2014: 13th European Conference, Zurich, 6-12 September 2014, 740-755. [Google Scholar] [CrossRef
[11] Wang, X., Girshick, R., Gupta, A. and He, K. (2018) Non-Local Neural Networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-22 June 2018, 7794-7803. [Google Scholar] [CrossRef
[12] Cheng, Z., Wang, S., Xin, T., Zhou, T., Zhang, H. and Shao, L. (2024) Few-Shot Medical Image Segmentation via Generating Multiple Representative Descriptors. IEEE Transactions on Medical Imaging, 43, 2202-2214. [Google Scholar] [CrossRef] [PubMed]
[13] Kavur, A.E., Gezer, N.S., Barış, M., Aslan, S., Conze, P., Groza, V., et al. (2021) CHAOS Challenge-Combined (CT-MR) Healthy Abdominal Organ Segmentation. Medical Image Analysis, 69, Article ID: 101950. [Google Scholar] [CrossRef] [PubMed]
[14] Landman, B., Xu, Z., Igelsias, J., Styner, M., Langerak, T. and Klein, A. (2015) Multi-Atlas Labeling beyond the Cranial Vault-Workshop and Challenge. Proceedings MICCAI Multi-Atlas Labeling beyond Cranial Vault-Workshop Challenge, Vol. 5, 12.
[15] Zhuang, X. (2019) Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 2933-2946. [Google Scholar] [CrossRef] [PubMed]
[16] Lin, Y., Chen, Y., Cheng, K. and Chen, H. (2023) Few Shot Medical Image Segmentation with Cross Attention Transformer. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 233-243. [Google Scholar] [CrossRef