增强不确定性引导均值教师模型的HER2组织病理图像半监督分割模型
Enhanced Uncertainty-Guided Mean Teacher Model for Semi-Supervised Segmentation Model of HER2 Histopathological Images
DOI: 10.12677/csa.2026.162078, PDF,   
作者: 姚 博:东北林业大学计算机与控制工程学院,黑龙江 哈尔滨;赵 晶, 谢怡宁:东北林业大学机电工程学院,黑龙江 哈尔滨;韩天晓:中电科东方通信集团有限公司北京分公司,北京
关键词: HER2图像分割半监督学习HER2 Image Segmentation Semi-Supervised Learning
摘要: 在乳腺癌诊断中,为了解决大量需求HER2组织病理染色图像专家标注的问题,传统半监督模型会过早收敛为自训练,导致生成低置信度为标签。为了应对这些挑战,本文提出一种新的增强不确定性引导的半监督分割网络,用于HER2组织病理染色图像的细胞膜分割。首先,该网络在协同均值教师模型中引入一个不确定目标选择模块,该模块通过构建联合置信度矩阵,利用学生模型和教师模型之间的预测差异,有效识别出由于系统性误差导致的伪标签噪声区域。其次,将识别出的不确定区域加入到一致性损失中,引导教师学生模型在不确定目标区域预测中达成共识,增强模型像素级目标选择能力。此外,该方法无需修改主干网络,也不增加额外的可训练参数,具备良好的泛化能力和可扩展性。我们的实验在HER2组织病理染色图片数据集中得到验证,结果表明,我们的方法在Dice评价指标下得到73.09%的分数,相较于基线模型有明显提升,同时我们的方法也超越了最新的SSL方法,也优于经典的全监督学习方法。该方法不仅在HER2组织病理染色图片数据集分割任务中表现优异,在宫颈癌细胞核分割任务中Dice评价指标也达到85.02%,也具备作为半自动标注工具在其他疾病领域的广泛应用。
Abstract: In breast cancer diagnosis, the extensive demand for expert annotations of HER2-stained histopathological images poses a major bottleneck. Conventional semi-supervised learning frameworks tend to converge prematurely into self-training, which often leads to the generation of low-confidence pseudo-labels. To address these challenges, we propose a novel enhanced uncertainty-guided semi-supervised segmentation network for cell membrane segmentation in HER2-stained histopathological images. Specifically, an uncertainty-aware target selection module is introduced into a collaborative mean teacher framework. This module constructs a joint confidence matrix and exploits the prediction discrepancies between the student and teacher models to effectively identify pseudo-label noisy regions caused by systematic errors. Subsequently, the identified uncertain regions are incorporated into the consistency loss, guiding the teacher-student models to reach consensus on uncertain targets and thereby enhancing pixel-level target selection capability. Notably, the proposed method does not require any modification of the backbone network nor introduce additional trainable parameters, demonstrating strong generalization and scalability. Extensive experiments conducted on the HER2-stained histopathological image dataset validate the effectiveness of the proposed approach. Our method achieves a Dice score of 73.09%, showing a substantial improvement over the baseline model, while also outperforming recent state-of-the-art semi-supervised learning methods and even classical fully supervised approaches. Furthermore, the proposed framework exhibits strong generalization performance on cervical cancer nucleus segmentation, attaining a Dice score of 85.02%. These results indicate that our method is not only effective for HER2 histopathological image segmentation but also holds significant potential as a semi-automatic annotation tool for a wide range of diseases.
文章引用:姚博, 赵晶, 韩天晓, 谢怡宁. 增强不确定性引导均值教师模型的HER2组织病理图像半监督分割模型[J]. 计算机科学与应用, 2026, 16(2): 488-504. https://doi.org/10.12677/csa.2026.162078

参考文献

[1] Engel, R.H. and Kaklamani, V.G. (2007) HER2-Positive Breast Cancer. Drugs, 67, 1329-1341. [Google Scholar] [CrossRef] [PubMed]
[2] Saha, M., Agarwal, S., Arun, I., Ahmed, R., Chatterjee, S., Mitra, P., et al. (2015) Histogram Based Thresholding for Automated Nucleus Segmentation Using Breast Imprint Cytology. In: Gupta, S., et al., Eds., Advancements of Medical Electronics, Springer India, 49-57. [Google Scholar] [CrossRef
[3] Saha, M., Arun, I., Agarwal, S., Ahmed, R., Chatterjee, S. and Chakraborty, C. (2017) Imprint Cytology‐Based Breast Malignancy Screening: An Efficient Nuclei Segmentation Technique. Journal of Microscopy, 268, 155-171. [Google Scholar] [CrossRef] [PubMed]
[4] Banerjee, S., Saha, M., Arun, I., Basak, B., Agarwal, S., Ahmed, R., et al. (2017) Near-Set Based Mucin Segmentation in Histopathology Images for Detecting Mucinous Carcinoma. Journal of Medical Systems, 41, Article No. 144. [Google Scholar] [CrossRef] [PubMed]
[5] Elston, C.W. and Ellis, I.O. (1991) Pathological Prognostic Factors in Breast Cancer. I. The Value of Histological Grade in Breast Cancer: Experience from a Large Study with Long‐Term Follow‐Up. Histopathology, 19, 403-410. [Google Scholar] [CrossRef] [PubMed]
[6] Liu, X., Song, L., Liu, S. and Zhang, Y. (2021) A Review of Deep-Learning-Based Medical Image Segmentation Methods. Sustainability, 13, Article No. 1224. [Google Scholar] [CrossRef
[7] Xu, Z., Wang, Y., Lu, D., Luo, X., Yan, J., Zheng, Y., et al. (2023) Ambiguity-Selective Consistency Regularization for Mean-Teacher Semi-Supervised Medical Image Segmentation. Medical Image Analysis, 88, Article ID: 102880. [Google Scholar] [CrossRef] [PubMed]
[8] Laine, S. and Aila, T. (2016) Temporal Ensembling for Semi-Supervised Learning. arXiv preprint arXiv:1610.02242.
[9] Li, X., Yu, L., Chen, H., Fu, C., Xing, L. and Heng, P. (2021) Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation. IEEE Transactions on Neural Networks and Learning Systems, 32, 523-534. [Google Scholar] [CrossRef] [PubMed]
[10] Ouali, Y., Hudelot, C. and Tami, M. (2020) Semi-Supervised Semantic Segmentation with Cross-Consistency Training. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 14-19 June 2020, 12674-12684. [Google Scholar] [CrossRef
[11] Wu, Z., Shi, X., Lin, G. and Cai, J. (2021) Learning Meta-Class Memory for Few-Shot Semantic Segmentation. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 11-17 October 2021, 517-526. [Google Scholar] [CrossRef
[12] Xia, Y., Liu, F., Yang, D., Cai, J., Yu, L., Zhu, Z., et al. (2020) 3D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Training. 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass Village, 1-5 March 2020, 3646-3655. [Google Scholar] [CrossRef
[13] Tarvainen, A. and Valpola, H. (2017) Mean Teachers Are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-Supervised Deep Learning Results. NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 1195-1204.
[14] You, C., Zhou, Y., Zhao, R., Staib, L. and Duncan, J.S. (2022) SimCVD: Simple Contrastive Voxel-Wise Representation Distillation for Semi-Supervised Medical Image Segmentation. IEEE Transactions on Medical Imaging, 41, 2228-2237. [Google Scholar] [CrossRef] [PubMed]
[15] Samuli, L. and Timo, A. (2017) Temporal Ensembling for Semi-Supervised Learning. International Conference on Learning Representations (LCLR), Vol. 4, 6.
[16] Qiao, S., Shen, W., Zhang, Z., Wang, B. and Yuille, A. (2018) Deep Co-Training for Semi-Supervised Image Recognition. Proceedings of the European Conference on Computer Vision (ECCV), Munich, 8-14 September 2018, 135-152.
[17] Chen, X., Yuan, Y., Zeng, G. and Wang, J. (2021) Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 19-25 June 2021, 2613-2622. [Google Scholar] [CrossRef
[18] Bai, W., Oktay, O., Sinclair, M., Suzuki, H., Rajchl, M., Tarroni, G., et al. (2017) Semi-Supervised Learning for Network-Based Cardiac MR Image Segmentation. Medical Image Computing and Computer-Assisted Intervention MICCAI 2017: 20th International Conference, Quebec City, 11-13 September 2017, 253-260. [Google Scholar] [CrossRef
[19] Zhang, W., Zhu, L., Hallinan, J., Zhang, S., Makmur, A., Cai, Q., et al. (2022) BoostMIS: Boosting Medical Image Semi-Supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotation. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, 18-24 June 2022, 20666-20676. [Google Scholar] [CrossRef
[20] Zheng, H., Motch Perrine, S.M., Pitirri, M.K., Kawasaki, K., Wang, C., Richtsmeier, J.T., et al. (2020) Cartilage Segmentation in High-Resolution 3D micro-CT Images via Uncertainty-Guided Self-Training with Very Sparse Annotation. In: Martel, A.L., et al., Eds., International Conference on Medical Image Computing and Computer Assisted Intervention, Springer International Publishing, 802-812. [Google Scholar] [CrossRef] [PubMed]
[21] Weng, L. (2019) From GAN to WGAN.
[22] Wu, Y., Xu, M., Ge, Z., Cai, J. and Zhang, L. (2021) Semi-Supervised Left Atrium Segmentation with Mutual Consistency Training. In: de Bruijne, M., et al., Eds., International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer International Publishing, 297-306. [Google Scholar] [CrossRef
[23] Wu, Y., Ge, Z., Zhang, D., Xu, M., Zhang, L., Xia, Y., et al. (2022) Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation. Medical Image Analysis, 81, Article ID: 102530. [Google Scholar] [CrossRef] [PubMed]
[24] Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., et al. (2021) A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges. Information Fusion, 76, 243-297. [Google Scholar] [CrossRef
[25] Gal, Y. and Ghahramani, Z. (2015) Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. Cornell University.
[26] Zheng, Z. and Yang, Y. (2021) Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation. International Journal of Computer Vision, 129, 1106-1120. [Google Scholar] [CrossRef
[27] Yu, L., Wang, S., Li, X., Fu, C. and Heng, P. (2019) Uncertainty-Aware Self-Ensembling Model for Semi-Supervised 3D Left Atrium Segmentation. In: Shen, D.G., et al., Eds., International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer International Publishing, 605-613. [Google Scholar] [CrossRef
[28] Wang, T., Lu, J., Lai, Z., Wen, J. and Kong, H. (2022) Uncertainty-Guided Pixel Contrastive Learning for Semi-Supervised Medical Image Segmentation. Proceedings of the 31st International Joint Conference on Artificial Intelligence, Vienna, 23-29 July 2022, 1444-1450. [Google Scholar] [CrossRef
[29] Rizve, M., Duarte, K., Rawat, Y. and Shah, M. (2021) In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudolabel Selection Framework for Semi-Supervised Learning.
[30] Zhao, J., He, Y., Zhou, S., Qin, J. and Xie, Y. (2023) CNSeg: A Dataset for Cervical Nuclear Segmentation. Computer Methods and Programs in Biomedicine, 241, Article ID: 107732. [Google Scholar] [CrossRef] [PubMed]
[31] Peiris, H., Chen, Z., Egan, G. and Harandi, M. (2021) Duo-SegNet: Adversarial Dual-Views for Semi-Supervised Medical Image Segmentation. In: de Bruijne, M., et al., Eds., International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer International Publishing, 428-438. [Google Scholar] [CrossRef
[32] Lou, A., Tawfik, K., Yao, X., Liu, Z. and Noble, J. (2023) Min-Max Similarity: A Contrastive Semi-Supervised Deep Learning Network for Surgical Tools Segmentation. IEEE Transactions on Medical Imaging, 42, 2832-2841. [Google Scholar] [CrossRef] [PubMed]
[33] Chen, J., Lu, Y., Yu, Q., et al. (2021) Transunet: Transformers Make Strong Encoders for Medical Image Segmentation.
[34] Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., et al. (2023) Swin-Unet: Unet-Like Pure Transformer for Medical Image Segmentation. In: Karlinsky, L., et al., Eds., European Conference on Computer Vision, Springer, 205-218. [Google Scholar] [CrossRef
[35] Zhang, Y., Liu, H. and Hu, Q. (2021) Transfuse: Fusing Transformers and CNNs for Medical Image Segmentation. In: de Bruijne, M., et al., Eds., International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer International Publishing, 14-24. [Google Scholar] [CrossRef
[36] Xu, S., Xiao, D., Yuan, B., Liu, Y., Wang, X., Li, N., et al. (2023) FAFuse: A Four-Axis Fusion Framework of CNN and Transformer for Medical Image Segmentation. Computers in Biology and Medicine, 166, Article ID: 107567. [Google Scholar] [CrossRef] [PubMed]