皮肤疾病智能识别技术研究综述:从传统CAD到多模态大模型的演进、挑战与展望
A Review of Intelligent Recognition Technologies for Skin Disorders: Evolution, Challenges, and Prospects from Traditional CAD to Multimodal Foundation Models
摘要: 皮肤疾病是全球非致命性疾病负担的主要来源之一,但皮肤科医疗资源分布不均,尤其是在发展中国家及偏远地区,智能识别技术与生物医学工程的交叉融合为解决这一困境提供了创新路径。本文系统综述了智能识别技术在皮肤健康管理领域的研究进展、技术方法与应用现状。首先,梳理了从20世纪90年代传统计算机辅助诊断、2012年后深度学习突破、2017~2019年多模态融合探索,到2020年以来多模态大模型驱动的智能化健康管理的完整技术演进历程。其次,深入分析了多模态智能识别、跨模态图像生成(如RGB至UV图像转换)及智能诊断系统的核心原理与典型应用场景,阐述了其在皮肤疾病诊断、肤质分析及美容护肤中的重要作用。在此基础上,对比了国内外研究现状,指出我国在跨模态生成、辅助诊断系统及消费级AI测肤方面取得显著突破,但仍面临数据质量与标准化不足、算法可解释性差、泛化能力弱、跨种族适用性与公平性等挑战。最后,展望了多模态大模型、边缘计算与便携式设备、联邦学习及动态病程监测等未来发展方向。本综述旨在为生物医学工程领域的研究人员提供系统性的技术参考,推动智能识别技术在皮肤健康管理中的深入应用与发展。
Abstract: Skin disorders represent one of the major sources of non-fatal disease burden globally. However, the distribution of dermatological healthcare resources is uneven, particularly in developing countries and remote areas. The interdisciplinary integration of intelligent recognition technologies with biomedical engineering offers an innovative pathway to address this challenge. This paper provides a systematic review of the research progress, technical methods, and application status of intelligent recognition technologies in the field of skin health management. First, it outlines the complete technological evolution from traditional computer-aided diagnosis in the 1990s, the breakthrough of deep learning after 2012, the exploration of multimodal fusion during 2017~2019, to the multimodal foundation model-driven intelligent health management since 2020. Second, it analyzes in depth the core principles and typical application scenarios of multimodal intelligent recognition, cross-modal image generation (e.g., RGB-to-UV conversion), and intelligent diagnosis systems, and elaborates on their important roles in skin disease diagnosis, skin quality analysis, and cosmetic skincare. On this basis, it compares the current research status at home and abroad, noting that China has made significant breakthroughs in cross-modal generation, assisted diagnosis systems, and consumer-grade AI skin analysis, yet still faces challenges such as insufficient data quality and standardization, poor algorithmic interpretability, weak generalization ability, and cross-ethnic applicability and fairness. Finally, it discusses future directions including multimodal foundation models, edge computing and portable devices, federated learning, and dynamic disease progression monitoring. This review aims to provide researchers in biomedical engineering with systematic technical references and to promote the further development and application of intelligent recognition technologies in skin health management.
文章引用:唐颖, 王嘉怡, 蔡忠昊, 陈嘉欣, 丁欣, 蒯文琪, 徐晓燕. 皮肤疾病智能识别技术研究综述:从传统CAD到多模态大模型的演进、挑战与展望[J]. 临床医学进展, 2026, 16(6): 2441-2450. https://doi.org/10.12677/acm.2026.1662467

参考文献

[1] 李茜瑶, 周莹, 黄辉, 等. 疾病负担研究进展[J]. 中国公共卫生, 2018, 34(5): 777-780.
[2] 张政. 人工智能在皮肤病诊断中的应用[J]. 中国新通信, 2020, 22(24): 118-119.
[3] 毛子骏, 刘子灵, 周光勇. 国际比较视野下机器人在医疗卫生领域的应用政策研究[J]. 科技管理研究, 2021, 41(10): 49-59.
[4] 宛慧琴, 向蔓, 潘喆敏, 等. 多阅片者多病例设计在人工智能辅助阅片影像诊断试验评价中的应用[J]. 海军军医大学学报, 2025, 46(4): 504-510.
[5] 张飘飘, 朱锦涛, 程恩慧, 等. 图像智能识别技术的研究现状与发展趋势[J]. 工业控制计算机, 2023, 36(5): 106-108.
[6] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6): 1229-1251.
[7] 卢宏涛, 张秦川. 深度卷积神经网络在计算机视觉中的应用研究综述[J]. 数据采集与处理, 2016, 31(1): 1-17.
[8] 李浩鹏, 周琬婷, 陈玉, 等. 基于域无关循环生成对抗网络的跨模态医学影像生成[J]. 数据与计算发展前沿(中英文), 2024, 6(2): 80-88.
[9] 郑远攀, 李广阳, 李晔. 深度学习在图像识别中的应用研究综述[J]. 计算机工程与应用, 2019, 55(12): 20-36.
[10] Bono, A., Tomatis, S., Bartoli, C., Tragni, G., Radaelli, G., Maurichi, A., et al. (1999) The ABCD System of Melanoma Detection: A Spectrophotometric Analysis of the Asymmetry, Border, Color, and Dimension. Cancer, 85, 72-77. [Google Scholar] [CrossRef] [PubMed]
[11] Fikrle, T. and Pizinger, K. (2007) Digital Computer Analysis of Dermatoscopical Images of 260 Melanocytic Skin Lesions; Perimeter/Area Ratio for the Differentiation between Malignant Melanomas and Melanocytic Nevi. Journal of the European Academy of Dermatology and Venereology, 21, 48-55. [Google Scholar] [CrossRef] [PubMed]
[12] Haniffa, M.A., Lloyd, J.J. and Lawrence, C.M. (2007) The Use of a Spectrophotometric Intracutaneous Analysis Device in the Real-Time Diagnosis of Melanoma in the Setting of a Melanoma Screening Clinic. British Journal of Dermatology, 156, 1350-1352. [Google Scholar] [CrossRef] [PubMed]
[13] 梅厦锦, 巫笠平, 张文新, 等. 基于超轻量实时分割网络的皮肤病变图像分割方法[J]. 传感技术学报, 2025, 38(10): 1784-1792.
[14] 赵宇豪. 基于深度学习的皮肤病图像分割与辅助诊断技术研究[D]: [硕士学位论文]. 大连: 大连交通大学, 2025.
[15] Gutman, D., Codella, F.C.N., Celebi, E.M., et al. (2016) Skin Lesion Analysis toward Melanoma Detection: A Challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, Hosted by the International Skin Imaging Collaboration (ISIC).
[16] Marchetti, M.A., Codella, N.C.F., Dusza, S.W., Gutman, D.A., Helba, B., Kalloo, A., et al. (2018) Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging Challenge: Comparison of the Accuracy of Computer Algorithms to Dermatologists for the Diagnosis of Melanoma from Dermoscopic Images. Journal of the American Academy of Dermatology, 78, 270-277.e1. [Google Scholar] [CrossRef] [PubMed]
[17] Esteva, A., Kuprel, B., Novoa, R.A., Ko, J., Swetter, S.M., Blau, H.M., et al. (2017) Corrigendum: Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature, 546, Article No. 686. [Google Scholar] [CrossRef] [PubMed]
[18] Combalia, M., Codella, N., Rotemberg, V., Carrera, C., Dusza, S., Gutman, D., et al. (2022) Validation of Artificial Intelligence Prediction Models for Skin Cancer Diagnosis Using Dermoscopy Images: The 2019 International Skin Imaging Collaboration Grand Challenge. The Lancet Digital Health, 4, e330-e339. [Google Scholar] [CrossRef] [PubMed]
[19] Zhu, Q.A., Wang, Q., Shi, L.Y., et al. (2024) A Deep Learning Fusion Network Trained with Clinical and High-Frequency Ultrasound Images in the Multi-Classification of Skin Diseases in Comparison with Dermatologists: A Prospective and Multicenter Study. eClinicalMedicine, 67, Article 102391. [Google Scholar] [CrossRef] [PubMed]
[20] 程安雄. RGB-UV皮肤图像转换及其肤质评估方法研究与实现[D]: [硕士学位论文]. 武汉: 武汉理工大学, 2023.
[21] Kojima, K., Shido, K., Tamiya, G., Yamasaki, K., Kinoshita, K. and Aiba, S. (2021) Facial UV Photo Imaging for Skin Pigmentation Assessment Using Conditional Generative Adversarial Networks. Scientific Reports, 11, Article No. 1213. [Google Scholar] [CrossRef] [PubMed]
[22] Ou, C., Zhou, S., Yang, R., Jiang, W., He, H., Gan, W., et al. (2022) A Deep Learning Based Multimodal Fusion Model for Skin Lesion Diagnosis Using Smartphone Collected Clinical Images and Metadata. Frontiers in Surgery, 9, Article 1029991. [Google Scholar] [CrossRef] [PubMed]
[23] Cai, G., Zhu, Y., Wu, Y., Jiang, X., Ye, J. and Yang, D. (2022) A Multimodal Transformer to Fuse Images and Metadata for Skin Disease Classification. The Visual Computer, 39, 2781-2793. [Google Scholar] [CrossRef] [PubMed]
[24] Yan, S., Yu, Z., Primiero, C., Vico-Alonso, C., Wang, Z., Yang, L., et al. (2025) A Multimodal Vision Foundation Model for Clinical Dermatology. Nature Medicine, 31, 2691-2702. [Google Scholar] [CrossRef] [PubMed]
[25] Xu, J., Huang, K., Zhong, L., Gao, Y., Sun, K., Liu, W., et al. (2024) Remixformer++: A Multi-Modal Transformer Model for Precision Skin Tumor Differential Diagnosis with Memory-Efficient Attention. IEEE Transactions on Medical Imaging, 44, 320-337. [Google Scholar] [CrossRef] [PubMed]
[26] Cula, O.G., Dana, K.J., Murphy, F.P. and Rao, B.K. (2004) Bidirectional Imaging and Modeling of Skin Texture. IEEE Transactions on Biomedical Engineering, 51, 2148-2159. [Google Scholar] [CrossRef] [PubMed]
[27] Ilișanu, M.A., Moldoveanu, F. and Moldoveanu, A. (2023) Multispectral Imaging for Skin Diseases Assessment—State of the Art and Perspectives. Sensors, 23, Article 3888. [Google Scholar] [CrossRef] [PubMed]
[28] Wang, Y., Feng, Y.Q., Zhang, L., Zhou, J.T., Liu, Y., Goh, R.S.M., et al. (2022) Adversarial Multimodal Fusion with Attention Mechanism for Skin Lesion Classification Using Clinical and Dermoscopic Images. Medical Image Analysis, 81, Article 102535. [Google Scholar] [CrossRef] [PubMed]
[29] 韩俊萍, 吕波, 苏存锦, 等. 基于AHM-TOPSIS法的奥赛利定临床合理用药评价标准的建立与应用[J]. 中国现代应用药学, 2026, 43(6): 957-963.
[30] Gao, N., Wang, J., Zhao, Z., Chu, X., Lv, B., Han, G., et al. (2025) Evaluation of an Acne Lesion Detection and Severity Grading Model for Chinese Population in Online and Offline Healthcare Scenarios. Scientific Reports, 15, Article No. 1119. [Google Scholar] [CrossRef] [PubMed]
[31] Liu, Z., Zhang, Y., Wang, K., Xie, F. and Liu, J. (2025) Early Diagnosis Model of Mycosis Fungoides and Five Inflammatory Skin Diseases Based on a Multimodal Data-Based Convolutional Neural Network. British Journal of Dermatology, 193, 968-977. [Google Scholar] [CrossRef] [PubMed]
[32] 沈长兵, 李承旭, 沈雪, 等. 基于皮肤影像大数据的皮肤病人工智能系列产品研发与应用[J]. 中国数字医学, 2019, 14(3): 22-25.
[33] Ba, W., Wu, H., Chen, W.W., Wang, S.H., Zhang, Z.Y., Wei, X.J., et al. (2022) Convolutional Neural Network Assistance Significantly Improves Dermatologists’ Diagnosis of Cutaneous Tumours Using Clinical Images. European Journal of Cancer, 169, 156-165. [Google Scholar] [CrossRef] [PubMed]
[34] Esteva, A., Kuprel, B., Novoa, R.A., Ko, J., Swetter, S.M., Blau, H.M., et al. (2017) Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks. Nature, 542, 115-118. [Google Scholar] [CrossRef] [PubMed]
[35] Daneshjou, R., Vodrahalli, K., Novoa, R.A., Jenkins, M., Liang, W., Rotemberg, V., et al. (2022) Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set. Science Advances, 8, eabq6147. [Google Scholar] [CrossRef] [PubMed]
[36] Mehta, D., Primiero, C., Betz-Stablein, B., Nguyen, T.D., Gal, Y., Bowling, A., et al. (2025) Multi-Task AI Models in Dermatology: Overcoming Critical Clinical Translation Challenges for Enhanced Skin Lesion Diagnosis. Journal of the European Academy of Dermatology and Venereology, 39, 2121-2133. [Google Scholar] [CrossRef] [PubMed]
[37] 杨荟禾, 俞顺. 磁共振成像在中轴型脊柱关节炎骶髂关节结构性病变评估中的研究进展[J]. 磁共振成像, 2025, 16(7): 202-208.
[38] 张祺悦. 数字信任视角下轻量化工具重构农产品直播供应链机制研究[J]. 中国商论, 2026, 35(8): 82-86.