一种面向皮肤病变的双学生单教师网络的半监督语义分割方法
A Semi-Supervised Semantic Segmentation Method Based on a Dual-Student Single-Teacher Network for Skin Lesions
DOI: 10.12677/mos.2025.145414, PDF,   
作者: 卢金典, 张国凯:上海理工大学光电信息与计算机工程学院,上海
关键词: 半监督学习语义分割皮肤病变深度学习Semi-Supervised Learning Semantic Segmentation Skin Lesions Deep Learning
摘要: 近些年,在医学图像领域出现了很多半监督学习方法,这些方法大多数是基于学生–教师结构的一致性正则化(Consistency Regularization)的半监督学习范式,或者是基于伪标签(Pseudo-Label)的半监督学习范式,但将两种学习范式结合起来的研究较少。因此文章提出了一种双学生单教师网络的半监督语义分割方法,该方法同时结合了一致性正则化与伪标签的学习范式,通过引入额外的学生网络降低模型陷入局部最优解的几率,避免模型之间参数耦合的风险;与此同时,通过引入UMIX模块能够生成高质量的伪标签,提高模型对无标签数据中有效信息的获取,进而提升模型的分割表现。并在ISIC 2017与ISIC 2018数据集上做了大量的实验,结果表明本文提出的方法实现了更优秀的分割表现。
Abstract: In recent years, numerous semi-supervised learning methods have emerged in the field of medical image analysis. Most of these methods follow either the consistency regularization-based semi-supervised learning paradigm using the student-teacher framework or the pseudo-label-based semi-supervised learning paradigm. However, there is limited research on integrating both paradigms. Therefore, this paper proposes a semi-supervised semantic segmentation method based on a dual-student single-teacher network, which combines consistency regularization and pseudo-label learning paradigms. By introducing an additional student network, the proposed method reduces the likelihood of the model falling into local optima and mitigates the risk of parameter coupling between networks. Meanwhile, the incorporation of the UMIX module enables the generation of high-quality pseudo labels, enhancing the model’s ability to extract useful information from unlabeled data and ultimately improving segmentation performance. Extensive experiments on the ISIC 2017 and ISIC 2018 datasets demonstrate that the proposed method achieves superior segmentation performance.
文章引用:卢金典, 张国凯. 一种面向皮肤病变的双学生单教师网络的半监督语义分割方法[J]. 建模与仿真, 2025, 14(5): 558-568. https://doi.org/10.12677/mos.2025.145414

参考文献

[1] Siegel, R.L., Giaquinto, A.N. and Jemal, A. (2024) Cancer Statistics, 2024. CA: A Cancer Journal for Clinicians, 74, 12-49. [Google Scholar] [CrossRef] [PubMed]
[2] Chen, L., Zhu, Y., Papandreou, G., Schroff, F. and Adam, H. (2018) Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In: Lecture Notes in Computer Science, Springer, 833-851. [Google Scholar] [CrossRef
[3] Ma, Y., Wang, J., Yang, J. and Wang, L. (2024) Model-Heterogeneous Semi-Supervised Federated Learning for Medical Image Segmentation. IEEE Transactions on Medical Imaging, 43, 1804-1815. [Google Scholar] [CrossRef] [PubMed]
[4] Cai, Z., Ravichandran, A., Maji, S., Fowlkes, C., Tu, Z. and Soatto, S. (2021) Exponential Moving Average Normalization for Self-Supervised and Semi-Supervised Learning. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 194-203. [Google Scholar] [CrossRef
[5] Ke, Z., Wang, D., Yan, Q., Ren, J. and Lau, R. (2019) Dual Student: Breaking the Limits of the Teacher in Semi Supervised Learning. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, 27 October-2 November 2019, 6727-6735. [Google Scholar] [CrossRef
[6] Antti, T. and Valpola, H. (2017) Mean Teachers Are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-Supervised Deep Learning Results. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 1195-1204.
[7] Olsson, V., Tranheden, W., Pinto, J. and Svensson, L. (2021) Classmix: Segmentation-Based Data Augmentation for Semi-Supervised Learning. 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, 3-8 January 2021, 1368-1377. [Google Scholar] [CrossRef
[8] Kihyuk, S. (2020) Fixmatch: Simplifying Semi-Supervised Learning with Consistency and Confidence. Advances in Neural Information Processing Systems, 33, 596-608.
[9] Shen, Z., Cao, P., Yang, H., Liu, X., Yang, J. and Zaiane, O.R. (2023) Co-Training with High-Confidence Pseudo Labels for Semi-Supervised Medical Image Segmentation. Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, Macao, 19-25 August 2023, 4199-4207. [Google Scholar] [CrossRef
[10] Fan, Y., Kukleva, A., Dai, D. and Schiele, B. (2022) Revisiting Consistency Regularization for Semi-Supervised Learning. International Journal of Computer Vision, 131, 626-643. [Google Scholar] [CrossRef
[11] Wang, Z., Yu, Z., Wang, X., Qin, Y., Li, J., Zhao, C., et al. (2023) Consistency Regularization for Deep Face Anti-Spoofing. IEEE Transactions on Information Forensics and Security, 18, 1127-1140. [Google Scholar] [CrossRef
[12] Xu, Z., Wang, Y., Lu, D., Luo, X., Yan, J., Zheng, Y., et al. (2023) Ambiguity-Selective Consistency Regularization for Mean-Teacher Semi-Supervised Medical Image Segmentation. Medical Image Analysis, 88, Article 102880. [Google Scholar] [CrossRef] [PubMed]
[13] Lu, S., Zhang, Z., Yan, Z., Wang, Y., Cheng, T., Zhou, R., et al. (2023) Mutually Aided Uncertainty Incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation. Neurocomputing, 548, Article 126411. [Google Scholar] [CrossRef
[14] Basak, H. and Yin, Z. (2023). Pseudo-Label Guided Contrastive Learning for Semi-Supervised Medical Image Segmentation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 19786-19797.[CrossRef
[15] Chaitanya, K., Erdil, E., Karani, N. and Konukoglu, E. (2023) Local Contrastive Loss with Pseudo-Label Based Self-Training for Semi-Supervised Medical Image Segmentation. Medical Image Analysis, 87, Article 102792. [Google Scholar] [CrossRef] [PubMed]
[16] Hu, J., Chen, C., Cao, L., Zhang, S., Shu, A., Jiang, G., et al. (2023) Pseudo-Label Alignment for Semi-Supervised Instance Segmentation. 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, 1-6 October 2023, 16291-16301. [Google Scholar] [CrossRef
[17] Su, J., Luo, Z., Lian, S., Lin, D. and Li, S. (2024) Mutual Learning with Reliable Pseudo Label for Semi-Supervised Medical Image Segmentation. Medical Image Analysis, 94, Article 103111. [Google Scholar] [CrossRef] [PubMed]
[18] Wang, W., Luo, C., An, J., Gan, L., Liao, H. and Yuen, C. (2024) Semi-Supervised RF Fingerprinting with Consistency-Based Regularization. IEEE Internet of Things Journal, 11, 8624-8636. [Google Scholar] [CrossRef
[19] Matt, B. (2017) ISIC 2017-Skin Lesion Analysis towards Melanoma Detection.
[20] Codella, N., Rotemberg, V., et al. (2019) Skin Lesion Analysis toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC).
[21] Li, X., Yu, L., Chen, H., Fu, C., Xing, L. and Heng, P. (2021) Transformation-Consistent Self-Ensembling Model for Semi-Supervised Medical Image Segmentation. IEEE Transactions on Neural Networks and Learning Systems, 32, 523-534. [Google Scholar] [CrossRef] [PubMed]
[22] Gao, Y., Zhou, M., et al. (2022) A Data-Scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmark.
[23] Zhang, Y., Liu, H. and Hu, Q. (2021) Transfuse: Fusing Transformers and CNNs for Medical Image Segmentation. In: Lecture Notes in Computer Science, Springer, 14-24. [Google Scholar] [CrossRef
[24] Sachin, M. and Rastegari, M. (2022) Separable Self-Attention for Mobile Vision Transformers.
[25] Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L., Tan, M., et al. (2019) Searching for MobileNetV3. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, 27 October-2 November 2019, 1314-1324. [Google Scholar] [CrossRef
[26] Zhang, Y.Z., Yang, L., et al. (2017) Deep Adversarial Networks for Biomedical Image Segmentation Utilizing Unannotated Images. Medical Image Computing and Computer Assisted InterventionMICCAI 2017: 20th International Conference, Quebec, 11-13 September 2017, 408-416.
[27] Yu, L., Wang, S., Li, X., Fu, C. and Heng, P. (2019) Uncertainty-Aware Self-Ensembling Model for Semi-Supervised 3D Left Atrium Segmentation. In: Lecture Notes in Computer Science, Springer, 605-613. [Google Scholar] [CrossRef
[28] Chen, X., Yuan, Y., Zeng, G. and Wang, J. (2021) Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 2613-2622. [Google Scholar] [CrossRef
[29] Wu, Y.C., Xu, M.F., et al. (2021) Semi-Supervised Left Atrium Segmentation with Mutual Consistency Training. Medical Image Computing and Computer Assisted InterventionMICCAI 2021: 24th International Conference, Strasbourg, 27 September-1 October 2021, 297-306.
[30] Lei, T., Zhang, D., Du, X., Wang, X., Wan, Y. and Nandi, A.K. (2023) Semi-Supervised Medical Image Segmentation Using Adversarial Consistency Learning and Dynamic Convolution Network. IEEE Transactions on Medical Imaging, 42, 1265-1277. [Google Scholar] [CrossRef] [PubMed]
[31] Zhao, Z., Wang, H., Lei, T., Wang, X., Shen, X. and Yao, H. (2025) Balanced Feature Fusion Collaborative Training for Semi-Supervised Medical Image Segmentation. Pattern Recognition, 157, Article 110856. [Google Scholar] [CrossRef
[32] Huang, Z., Gai, D., Min, W., Wang, Q. and Zhan, L. (2024) Dual-Stream-Based Dense Local Features Contrastive Learning for Semi-Supervised Medical Image Segmentation. Biomedical Signal Processing and Control, 88, Article 105636. [Google Scholar] [CrossRef