基于混合属性模糊相似度的k-近邻分类器
k-NN Classifier Based on Hybrid-Attribute Fuzzy Similarity
DOI: 10.12677/hjdm.2026.162004, PDF,    科研立项经费支持
作者: 秦少芬, 曹梦雪, 陈继强*:河北工程大学数理科学与工程学院,河北 邯郸
关键词: 混合数据模糊相似度分类器Mixed Data Fuzzy Similarity Classifier
摘要: 在医学诊断等实际应用中,广泛存在着数值型、区间型与分类型属性共存的混合数据分类问题。现有方法往往难以充分融合与利用此类异构数据的原始信息,导致分类器性能不佳,无法满足实际应用中对精度与稳健性的要求。为此,文章提出一种基于混合属性模糊相似度的分类器。首先,针对混合数据结构,构建适配属性的模糊相似度;进而基于乘积t-范数,建立一种能够统一处理多类属性的模糊相似度度量。其次,在此基础上设计混合属性模糊相似度分类器,以更有效地利用数据的内在结构与语义信息进行分类。最后,为验证所提分类方法的有效性,将其与最大正区域分类器、线性支持向量机、多层感知机等5种代表性分类器进行对比实验。结果验证了新方法在多个数据集上的优越性能,为混合数据分类问题提供了一种有效的新途径。
Abstract: In practical applications such as medical diagnosis, there exists a widespread problem of classifying mixed data with coexisting numerical, interval, and categorical attributes. Existing methods often fail to fully fuse and utilize the original information of such heterogeneous data, leading to limited classification performance, and thus cannot meet the requirements for accuracy and robustness in practical applications. To this end, this paper proposes a classifier based on fuzzy similarity for mixed-attribute data. First, aiming at the mixed data structure, a fuzzy similarity adapted to the attributes is constructed, and then a fuzzy similarity measure capable of uniformly processing multiple types of attributes is built based on the product t-norm. In practical applications such as medical diagnosis, there exists a widespread problem of classifying mixed data with coexisting numerical, interval, and categorical attributes. Existing methods often fail to fully fuse and utilize the original information of such heterogeneous data, which leads to limited classification performance and thus cannot meet the requirements for accuracy and robustness in practical applications. Second, on this basis, a fuzzy similarity classifier for mixed attributes is designed to more effectively utilize the inherent structure and semantic information of the data for classification. Finally, to verify the effectiveness of the proposed classification method, it is compared with five representative classifiers, such as the novel classifier based on maximal positive region, linear support vector machine, and multi-layer perceptron. The results verify the superior performance of the new method on multiple datasets, providing an effective new approach for the mixed data classification problem.
文章引用:秦少芬, 曹梦雪, 陈继强. 基于混合属性模糊相似度的k-近邻分类器[J]. 数据挖掘, 2026, 16(2): 34-47. https://doi.org/10.12677/hjdm.2026.162004

参考文献

[1] Sekar, J. and Aruchamy, P. (2025) A Novel Approach for Heart Disease Prediction Using Hybridized AITH2O Algorithm and SANFIS Classifier. Network: Computation in Neural Systems, 36, 109-147. [Google Scholar] [CrossRef] [PubMed]
[2] Salem, H., Shams, M.Y., Elzeki, O.M., Abd Elfattah, M., F. Al-Amri, J. and Elnazer, S. (2022) Fine-Tuning Fuzzy KNN Classifier Based on Uncertainty Membership for the Medical Diagnosis of Diabetes. Applied Sciences, 12, Article No. 950. [Google Scholar] [CrossRef
[3] Höglinger, G.U., Adler, C.H., Berg, D., Klein, C., Outeiro, T.F., Poewe, W., et al. (2024) A Biological Classification of Parkinson’s Disease: The Synneurge Research Diagnostic Criteria. The Lancet Neurology, 23, 191-204. [Google Scholar] [CrossRef] [PubMed]
[4] Khan, S.U.R., Bilal, O., Mistry, S., Deb, N., Mahmud, M. and Bhuyan, M. (2025) KDLight: A Lightweight Knowledge Distillation Framework for Medical Image Classification. 2025 International Joint Conference on Neural Networks (IJCNN), Rome, 30 June-5 July 2025, 1-8. [Google Scholar] [CrossRef
[5] Xing, W. and Bei, Y. (2020) Medical Health Big Data Classification Based on KNN Classification Algorithm. IEEE Access, 8, 28808-28819. [Google Scholar] [CrossRef
[6] Guo, X. (2024) Research on Systemic Financial Risk Early Warning Based on Integrated Classification Algorithm. 2024 IEEE 2nd International Conference on Electrical, Automation and Computer Engineering (ICEACE), Changchun, 26-28 December 2024, 1586-1591. [Google Scholar] [CrossRef
[7] Tong, L. and Tong, G. (2022) A Novel Financial Risk Early Warning Strategy Based on Decision Tree Algorithm. Scientific Programming, 2022, Article ID: 4648427. [Google Scholar] [CrossRef
[8] Hong, S., Wu, H., Xu, X. and Xiong, W. (2022) Early Warning of Enterprise Financial Risk Based on Decision Tree Algorithm. Computational Intelligence and Neuroscience, 2022, Article ID: 9182099. [Google Scholar] [CrossRef] [PubMed]
[9] Wu, H., Triebe, M.J. and Sutherland, J.W. (2023) A Transformer-Based Approach for Novel Fault Detection and Fault Classification/Diagnosis in Manufacturing: A Rotary System Application. Journal of Manufacturing Systems, 67, 439-452. [Google Scholar] [CrossRef
[10] Ragab, A., Ghezzaz, H. and Amazouz, M. (2022) Decision Fusion for Reliable Fault Classification in Energy-Intensive Process Industries. Computers in Industry, 138, Article ID: 103640. [Google Scholar] [CrossRef
[11] Eye, A.V. and Clogg, C.C. (1996) Categorical Variables in Developmental Research: Methods of Analysis. Elsevier.
[12] Lantz, B. (2015) Machine Learning with R. Packt Publishing.
[13] 张焕炯, 王国胜, 钟义信. 基于汉明距离的文本相似度计算[J]. 计算机工程与应用, 2001(19): 21-22.
[14] Mumtaz, S. and Giese, M. (2021) Hierarchy-Based Semantic Embeddings for Single-Valued & Multi-Valued Categorical Variables. Journal of Intelligent Information Systems, 58, 613-640. [Google Scholar] [CrossRef
[15] Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A.V. and Gulin, A. (2018) CatBoost: Unbiased Boosting with Categorical Features. NIPS’18: Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montréal, 3-8 December 2018, 6639-6649.
[16] Billard, L. and Le‐Rademacher, J. (2012) Principal Component Analysis for Interval Data. WIREs Computational Statistics, 4, 535-540. [Google Scholar] [CrossRef
[17] Ishibuchi, H., Tanaka, H. and Okada, H. (1993) An Architecture of Neural Networks with Interval Weights and Its Application to Fuzzy Regression Analysis. Fuzzy Sets and Systems, 57, 27-39. [Google Scholar] [CrossRef
[18] Guo, C. and Liu, Y. (2015) A Feature Selection Method for Symbolic Interval Data. Operations Research and Management Science, 24, 67.
[19] Dai, J., Liu, Y., Chen, J. and Liu, X. (2020) Fast Feature Selection for Interval-Valued Data through Kernel Density Estimation Entropy. International Journal of Machine Learning and Cybernetics, 11, 2607-2624. [Google Scholar] [CrossRef
[20] Alencar, G.T., Santos, R.C. and Neves, A. (2022) Euclidean Distance-Based Method for Fault Detection and Classification in Transmission Lines. Journal of Control, Automation and Electrical Systems, 33, 1466-1476. [Google Scholar] [CrossRef
[21] Magyar, B., Kenyeres, A., Tóth, S., Hajdu, I. and Horváth, R. (2022) Spatial Outlier Detection on Discrete GNSS Velocity Fields Using Robust Mahalanobis-Distance-Based Unsupervised Classification. GPS Solutions, 26, Article No. 145. [Google Scholar] [CrossRef
[22] Cai, B., Xiong, P. and Tian, S. (2023) Center Contrastive Loss for Metric Learning.
[23] Wang, C., Wang, C., Qian, Y. and Leng, Q. (2024) Feature Selection Based on Weighted Fuzzy Rough Sets. IEEE Transactions on Fuzzy Systems, 32, 4027-4037. [Google Scholar] [CrossRef
[24] Dubois, D. and Prade, H. (1990) Rough Fuzzy Sets and Fuzzy Rough Sets. International Journal of General Systems, 17, 191-209. [Google Scholar] [CrossRef
[25] 胡宝清. 模糊理论基础[M]. 第2版. 武汉: 武汉大学出版社, 2010.
[26] Santambrogio, F. (2015) Optimal Transport for Applied Mathematicians. Springer.
[27] Ma, L., Bian, W. and Xue, X. (2024) Point Clouds Matching Based on Discrete Optimal Transport. IEEE Transactions on Image Processing, 33, 5650-5662. [Google Scholar] [CrossRef] [PubMed]
[28] Liang, P., Lei, D., Chin, K. and Hu, J. (2022) Feature Selection Based on Robust Fuzzy Rough Sets Using Kernel-Based Similarity and Relative Classification Uncertainty Measures. Knowledge-Based Systems, 255, Article ID: 109795. [Google Scholar] [CrossRef
[29] Pawlak, Z. (1982) Rough Sets. International Journal of Computer & Information Sciences, 11, 341-356. [Google Scholar] [CrossRef
[30] Khakbiz, M., Shahmoradi, M.R., Akhlaghi, F. and Soroush, K. (2025) AI-Enhanced Support Vector Machine Framework for Nanoparticle Size and Surface Nanotopography Analysis. Particuology, 106, 156-173. [Google Scholar] [CrossRef
[31] 余建航. 基于粗糙集的几类广义信息系统知识发现与决策方法研究[D]: [博士学位论文]. 哈尔滨: 哈尔滨工业大学, 2020.
[32] Liu, P., Munir, M., Mahmood, T. and Ullah, K. (2019) Some Similarity Measures for Interval-Valued Picture Fuzzy Sets and Their Applications in Decision Making. Information, 10, Article No. 369. [Google Scholar] [CrossRef
[33] Yang, X., Huang, P., An, L., Feng, P., Wei, B., He, P., et al. (2022) A Growing Model-Based OCSVM for Abnormal Student Activity Detection from Daily Campus Consumption. New Generation Computing, 40, 915-933. [Google Scholar] [CrossRef
[34] An, S., Zhao, E., Wang, C., Guo, G., Zhao, S. and Li, P. (2023) Relative Fuzzy Rough Approximations for Feature Selection and Classification. IEEE Transactions on Cybernetics, 53, 2200-2210. [Google Scholar] [CrossRef] [PubMed]
[35] Pan, F., Wang, B., Hu, X. and Perrizo, W. (2004) Comprehensive Vertical Sample-Based KNN/LSVM Classification for Gene Expression Analysis. Journal of Biomedical Informatics, 37, 240-248. [Google Scholar] [CrossRef] [PubMed]
[36] Zhang, R., Wang, L., Cheng, S. and Song, S. (2023) Mlp-Based Classification of COVID-19 and Skin Diseases. Expert Systems with Applications, 228, Article ID: 120389. [Google Scholar] [CrossRef] [PubMed]
[37] Tarakci, F. and Ozkan, I.A. (2021) Comparison of Classification Performance of kNN and WKNN Algorithms. Selcuk University Journal of Engineering Sciences, 20, 32-37.
[38] 周鹏, 伊静, 朱振方, 等. 面向不平衡分类的固定半径最近邻逐步竞争算法(FRNNPC) [J]. 山东大学学报(理学版), 2019, 54(3): 102-109.
[39] Demšar, J. (2006) Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research, 7, 1-30.