基于元度量的小样本学习方法
A Metametric Based Few Shot Learning Method
DOI: 10.12677/AAM.2023.123092, PDF,    科研立项经费支持
作者: 朱唯一*, 尹伟石:长春理工大学,数学与统计学院,吉林 长春
关键词: 小样本学习元学习深度学习卷积神经网络图像分类Few-Shot Learning Meta-Learning Deep Learning Convolutional Neural Network Image Classification
摘要: 针对小样本图像分类任务中样本量不足导致的提取特征不精确、网络性能下降等问题,基于元度量学习方法提出一个用于处理小样本图像分类的学习方法。该方法通过对同一类别的每个样本特征赋予权值,利用加权求和的方式得到该类的原型。权值由样本间的曼哈顿距离、欧氏距离和切比雪夫距离综合决定.最后采用三元损失函数使网络拉近同种类之间的距离,增加不同种类之间的距离。实验结果表明,该方法在5-way 1-shot和5-way 5-shot的设置下,在MiniImageNet数据集上实验准确率为68.33%和81.75%,在CUB数据集上实验准确率为73.76%和87.35%。对比结果显示,该方法能有效处理小样本问题。
Abstract: Aiming at the problems of inaccurate extraction features and reduced network performance caused by insufficient sample size in the few-shot image classification task, a learning method for pro-cessing few-shot image classification is proposed based on the metametric learning method. This method gives weights to each sample feature of the same category and obtains the prototype of the class by weighted summation. The weight is determined by the comprehensive distance between samples, the distance between the Manhattan, the Euclidean distance and the Chebyshev distance. Finally, a ternary loss function is used to bring the network closer to the distance between the same type and increase the distance between different types. Experimental results show that under the setting of 5-way 1-shot and 5-way 5-shot, the experimental accuracy of this method is 68.33% and 81.75% on the MiniImageNet data set, and the experimental accuracy on the CUB data set is 73.76% and 87.35%. The comparison results show that this method can effectively deal with few-shot learning.
文章引用:朱唯一, 尹伟石. 基于元度量的小样本学习方法[J]. 应用数学进展, 2023, 12(3): 901-906. https://doi.org/10.12677/AAM.2023.123092

参考文献

[1] Oquab, M., Bottou, L., Laptev, I., et al. (2014) Learning and Transferring Mid-Level Image Representations Using Con-volutional Neural Networks. Computer Vision and Pattern Recognition, Columbus, OH, 23-28 June 2014, 321-334. [Google Scholar] [CrossRef
[2] 刘颖, 雷研博, 范九伦, 王富平, 公衍超, 田奇. 基于小样本学习的图像分类技术综述[J]. 自动化学报, 2021, 47(2): 297-315.
[3] Snell, J., Swersky, K. and Zemel, R. (2017) Prototypical Networks for Few-Shot Learning. Advances in Neural Information Processing Systems, 30, 1-10.
[4] Yong, W., Wu, X.M. and Li, Q. (2018) Large Margin FewShot Learning. CoRR, 11, 3-16.
[5] Finn, C., Abbeel, P. and Levine, S. (2017) Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. International Conference on Machine Learning, PMLR, Sydney, 1126-1135.
[6] Vinyals, O., Blundell, C., et al. (2016) Matching Networks for One Shot Learning. Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, 3630-3638.
[7] Ravi, S. and Larochelle, H. (2017) Optimization as a Model for Few-Shot Learn-ing. International Conference on Learning Representations, Toulon, 301-316.
[8] Wang, F., Jiang, M., Qian, C., et al. (2017) Residual Attention Network for Image Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, 21-26 July 2017, 3156-3164. [Google Scholar] [CrossRef