基于多级Logit知识蒸馏的植物病害识别研究
Plant Disease Recognition Based on Multi-Level Logit Knowledge Distillation
摘要: 植物病害是威胁全球粮食安全的重要因素,传统人工检测方式难以满足现代智慧农业对精准化、自动化病害识别的需求。深度学习虽为此提供了解决思路,但常规卷积神经网络参数量大、计算复杂度高,而轻量化网络又面临分类精度不足的问题。为此,本文提出一种基于多级Logit知识蒸馏的植物病害分类方法。该方法以ResNet34为教师模型,通过联合实例级、批次级与类别级蒸馏损失,从多个维度将教师网络的知识迁移至轻量学生模型中,在不增加推理开销的前提下提升其分类性能。基于Kaggle公开的多源植物病害分类综合数据集进行实验。结果表明,蒸馏后学生模型的Top-1准确率最高可达95.19%,超越教师模型的94.20%。CAM可视化进一步验证了蒸馏模型对病害区域的识别能力显著增强。该方法在精度与效率间取得了良好平衡,适合边缘设备部署,可为农业现代化提供有效技术支撑。
Abstract: Plant diseases are a major threat to global food security. Traditional manual inspection methods cannot meet the demands of modern smart agriculture for accurate and automated disease identification. Deep learning offers a promising solution, yet conventional convolutional neural networks suffer from large parameter sizes and high computational complexity, while lightweight networks often face insufficient classification accuracy. To address this issue, this paper proposes a plant disease classification method based on multi-level logit knowledge distillation. Taking ResNet34 as the teacher model, the method combines instance-level, batch-level, and class-level distillation losses to transfer knowledge from the teacher network to lightweight student models from multiple dimensions, thereby improving their classification performance without increasing inference overhead. Experiments are conducted on the publicly available multi-source Plant Disease Classification Merged Dataset from Kaggle. The results show that the distilled student model achieves a Top-1 accuracy of up to 95.19%, surpassing the teacher model’s 94.20%. CAM visualization further confirms that the distilled model’s ability to recognize disease regions is significantly enhanced. The proposed method achieves a favorable balance between accuracy and efficiency, is suitable for deployment on edge devices, and can provide effective technical support for agricultural modernization.
文章引用:谭颖铃, 邢荣桓, 马滨滨, 李升. 基于多级Logit知识蒸馏的植物病害识别研究[J]. 人工智能与机器人研究, 2026, 15(4): 1059-1068. https://doi.org/10.12677/airr.2026.154095

参考文献

[1] Hinton, G., Vinyals, O. and Dean J. (2015) Distilling the Knowledge in a Neural Network.
https://arxiv.org/abs/1503.02531
[2] Heo, B., Kim, J., Yun, S., Park, H., Kwak, N. and Choi, J.Y. (2019) A Comprehensive Overhaul of Feature Distillation. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 27 October-02 November 2019. [Google Scholar] [CrossRef
[3] Jin, Y., Wang, J. and Lin, D. (2023) Multi-Level Logit Distillation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 17-24 June 2023. [Google Scholar] [CrossRef
[4] 刘媛媛, 王定坤, 邬雷, 等. 基于知识蒸馏和模型剪枝的轻量化模型植物病害识别[J]. 浙江农业学报, 2023, 35(9): 2250-2264.
[5] 周罕觅, 陈佳庚, 代智光, 等. 基于知识蒸馏和轻量级卷积神经网络的植物病害识别方法[J]. 南京农业大学学报, 2024, 47(6): 1189-1201.
[6] 聂远, 周厚奎, 张广群, 等. 基于增强知识蒸馏的小样本植物病害识别方法[J]. 浙江农林大学学报, 2025, 42(4): 667-676.