基于用户指导的深度学习分类系统
Deep Learning Classification System Based on User Guidance
DOI: 10.12677/CSA.2022.123072, PDF,   
作者: 温俊芳, 宋庆增*:天津工业大学,计算机科学与技术学院,天津
关键词: 标签分布标签概率用户指导Distribution of Labels Probability of Labels User Guidance
摘要: 目前,深度学习模型在现实中得到了广泛的应用,当这些模型应用于不同的环境时,可以利用环境中样本分布等经验来进一步提高分类的准确率。基于此,本文提出了基于用户指导的深度学习分类系统DLC-UG,该方法有效地利用了环境中的样本分布来提高分类精度。首先,系统在训练集上训练深度学习模型,接着,用户可以根据自己的经验或他人的建议,在相应的环境中输入每个标签的分布,之后,系统可以通过这个训练模型得到每个样本标签的概率,最后,分布信息有选择地与测试样本上标签的概率相结合。论文在三个真实数据集上选择了六种流行的深度学习模型进行评估,实验结果表明,提出的方法能够提高分类任务的准确率,且明显高于现有的分类方法。
Abstract: Currently, deep learning models are widely used in many applications. When utilizing these models in different environments, the experience like the distribution of objects in an environment can be used to further increase the accuracy of classification. In this paper, we carried out user guidance based deep learning classification task that is named DLC-UG, which efficiently utilizes this kind of distribution in an environment to increase the accuracy of classification. Firstly, we train the deep learning model on the training set. Secondly, the user can input the distribution of each label in the corresponding environment on the experience of himself or advice from others. Thirdly, we can get the probability of labels on each sample by this trained model. Finally, the distribution information selectively cooperates with the probability of labels on testing samples. We select six popular deep learning models on three real datasets for the evaluation. The experimental results show that our method can increase the accuracy of classification tasks, which is obviously higher than state-of-art methods.
文章引用:温俊芳, 宋庆增. 基于用户指导的深度学习分类系统[J]. 计算机科学与应用, 2022, 12(3): 707-718. https://doi.org/10.12677/CSA.2022.123072

参考文献

[1] Kim, M., Han, D. and Rhee, J.-K.K. (2021) Multiview Variational Deep Learning with Application to Practical Indoor Localization. IEEE Internet of Things Journal, 8, 12375-12383. [Google Scholar] [CrossRef
[2] Li, J.L., Luo, G.Y., Cheng, N., Yuan, Q., Wu, Z.H., Gao, S. and Liu, Z.H. (2019) An End-to-End Load Balancer Based on Deep Learning for Vehicular Network Traffic Control. IEEE Internet of Things Journal, 6, 953-966. [Google Scholar] [CrossRef
[3] Wu, Y.F., Mendis, G.J. and Wei, J. (2021) DDLPF: A Practical Decentralized Deep Learning Paradigm for Internet-of-Things Applications. IEEE Internet of Things Journal, 8, 9740-9752. [Google Scholar] [CrossRef
[4] Jin, G., Liu, F., Wu, H. and Song, Q. (2020) Deep Learn-ing-Based Framework for Expansion, Recognition and Classification of Underwater Acoustic Signal. Journal of Experi-mental & Theoretical Artificial Intelligence, 32, 205-218. [Google Scholar] [CrossRef
[5] Jain, D.K., et al. (2020) Multi Angle Optimal Pattern-Based Deep Learning for Automatic Facial Expression Recognition. Pattern Recognition Letters, 139, 157-165. [Google Scholar] [CrossRef
[6] Bakhshipour, A. (2021) Cascading Feature Filtering and Boosting Algorithm for Plant Type Classification Based on Image Features. IEEE Access, 9, 82021-82030. [Google Scholar] [CrossRef
[7] Derrouz, H., El Bouziady, A., Ait Abdelali, H., Thami, R.O.H., El Fkihi, S. and Bourzeix, F. (2019) Moroccan Video Intelligent Transport System: Vehicle Type Classification Based on Three-Dimensional and Two-Dimensional Features. IEEE Access, 7, 72528-72537. [Google Scholar] [CrossRef
[8] Liao, J.S. and Wang, L.G. (2020) Adaptive Hyperspectral Image Classification Based on the Fusion of Manifolds Filter and Spatial Correlation Features. IEEE Access, 8, 90390-90409. [Google Scholar] [CrossRef
[9] Ahn, S.M. (2016) Deep Learning Architec-tures and Applications. Journal of Intelligence & Information Systems, 22, 127-142. [Google Scholar] [CrossRef
[10] Sharma, K., Alsadoon, A., Prasad, P., Al-Dala’In, T. and Pham, D. (2020) A Novel Solution of Using Deep Learning for Left Ventricle Detection: Enhanced Feature Extraction. Com-puter Methods and Programs in Biomedicine, 197, Article ID: 105751. [Google Scholar] [CrossRef] [PubMed]
[11] Dai, Z.W. and Heckel, R. (2019) Channel Normalization in Con-volutional Neural Network Avoids Vanishing Gradients. CoRR abs/1907.09539.
[12] Ho-Phuoc, T. (2018) CIFAR10 to Compare Visual Recognition Performance between Deep Neural Networks and Humans. CoRR abs/1811.07270.
[13] Su, J., Vargas, D.V. and Kouichi, S. (2019) One Pixel Attack for Fooling Deep Neural Networks. IEEE Transactions on Evolutionary Computation, 23, 828-841.
[14] Wu, D.X., Xu, J. and Liu, H. (2020) Analysis of the Influence of Stylized-CIFAR10 Dataset on ResNet. ML4CS 2020, Guangzhou, 8-10 October 2020, 416-426. [Google Scholar] [CrossRef
[15] Termritthikun, C., et al. (2020) An Improved Residual Net-work Model for Image Recognition Using a Combination of Snapshot Ensembles and the Cutout Technique. Multimedia Tools and Applications, 79, 1475-1495. [Google Scholar] [CrossRef
[16] Chen, J. and Liu, Z. (2020) Mask Dynamic Routing to Com-bined Model of Deep Capsule Network and U-Net. IEEE Transactions on Neural Networks and Learning Systems, 31, 2653-2664. [Google Scholar] [CrossRef
[17] Sharma, N., Jain, V. and Mishra, A. (2018) An Analysis of Convolutional Neural Networks for Image Classification. Procedia Computer Science, 132, 377-384. [Google Scholar] [CrossRef
[18] Wang, P., Cheng, J., Hao, F., Wang, L. and Feng, W. (2020) Embedded Adaptive Cross-Modulation Neural Network for Few-Shot Learning. Neural Computing and Applications, 32, 5505-5515. [Google Scholar] [CrossRef
[19] Xiang, W., et al. (2020) FMixCutMatch for Semi-Supervised Deep Learning. Neural Networks, 133, 166-176. [Google Scholar] [CrossRef] [PubMed]
[20] Zhang, L.L., et al. (2019) Scheduled Sampling for One-Shot Learning via Matching Network. Pattern Recognition, 96, Article ID: 106962. [Google Scholar] [CrossRef
[21] Lee, Y., Hwang, J.W., Lee, S., Bae, Y. and Park, J. (2019) An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection. 2019 IEEE/CVF Confer-ence on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, 16-17 June 2019, 752-760. [Google Scholar] [CrossRef
[22] Qu, Z., Mei, J., Liu, L. and Zhou, D.-Y. (2020) Crack Detection of Concrete Pavement with Cross-Entropy Loss Function and Improved VGG16 Network Model. IEEE Access, 8, 54564-54573. [Google Scholar] [CrossRef
[23] Wang, S., Liu, Y., Qing, Y., Wang, C., Lan, T. and Yao, R. (2020) Detection of Insulator Defects with Improved ResNeSt and Region Proposal Network. IEEE Access, 8, 184841-184850. [Google Scholar] [CrossRef
[24] Feng, X., Gao, X. and Luo, L. (2021) X-sdd: A New Benchmark for Hot Rolled Steel Strip Surface Defects Detection. Symmetry, 13, 706. [Google Scholar] [CrossRef
[25] Zhao, S.F., Qiu, L.C., Qi, P. and Sun, Y. (2020) A Novel Image Clas-sification Model Jointing Attention and ResNet for Scratch. 16th International Wireless Communications and Mobile Computing Conference, IWCMC 2020, Limassol, 15-19 June 2020, 1498-1503. [Google Scholar] [CrossRef
[26] Zhang, Z., Liang, X., Xu, D., Xie, Y. and Cao, G. (2018) A Sparse-View CT Reconstruction Method Based on Combination of Densenet and Deconvolution. IEEE Transactions on Medical Imaging, 37, 1407-1417. [Google Scholar] [CrossRef
[27] Khodja, A., Zheng, Z.L., Mo, J.S.Z., Zhang, D.W. and Chen, L.Y. (2021) Rain to Rain: Learning Real Rain Removal without Ground Truth. IEEE Access, 9, 57325-57337. [Google Scholar] [CrossRef
[28] Zaatour, R., Bouzidi, S. and Zagrouba, E. (2020) Unsuper-vised Image-Adapted Local Fisher Discriminant Analysis to Reduce Hyperspectral Images without Ground Truth. IEEE Transactions on Geoscience and Remote Sensing, 58, 7931-7941. [Google Scholar] [CrossRef
[29] Leo, L.M. and Reddy, T.K. (2020) Dental Caries Classification System Using Deep Learning Based Convolutional Neural Network. Journal of Computational and Theoretical Nano-science, 17, 4660-4665. [Google Scholar] [CrossRef
[30] Song, D., Vold, A., Madan, K. and Schilder, F. (2021) Multi-Label Legal Document Classification: A Deep Learning-Based Approach with Label-Attention and Domain-Specific Pre-Training. Information Systems, 106, Article ID: 101718. [Google Scholar] [CrossRef
[31] Chen, Y.T., Liu, L.W., Tao, J.J., Chen, X., Xia, R.L., Zhang, Q., Xiong, J., Yang, K. and Xie, J.B. (2021) The Image Annota-tion Algorithm Using Convolutional Features from Intermediate Layer of Deep Learning. Multimedia Tools and Applica-tions, 80, 4237-4261. [Google Scholar] [CrossRef
[32] Saraee, E., Jalal, M. and Betke, M. (2020) Visual Complexity Analysis Using Deep Intermediate-Layer Features. Computer Vision and Image Understanding, 195, Article ID: 102949. [Google Scholar] [CrossRef
[33] Lim, G., Cheng, Y., Hsu, W. and Lee, M.L. (2016) Integrated Optic Disc and Cup Segmentation with Deep Learning. IEEE International Conference on Tools with Artificial Intelligence, San Jose, 6-8 November 2016, 162-169. [Google Scholar] [CrossRef
[34] Song, W., Li, W., Hua, Z. and Zhu, F. (2021) A New Deep Au-to-Encoder Using Multiscale Reconstruction Errors and Weight Update Correlation. Information Sciences, 559, 130-152. [Google Scholar] [CrossRef
[35] Jin, G., Hu, Y., Jiao, Y., Wen, J. and Song, Q. (2021) Improving the Performance of Deep Learning Model-Based Classification by the Analysis of Local Probability. Complexity, 2021, Arti-cle ID: 5534385. [Google Scholar] [CrossRef