一种基于特征加权的K-Means算法研究
A K-Means Algorithm Based on Feature Weighting
摘要:
聚类分析是将研究对象分为相对同质的群组的统计分析技术,聚类分析的核心就是发现有用的对象簇。K-means聚类算法由于具有出色的速度和良好的可扩展性,一直备受广大学者的关注。然而,传统的K-means算法,未考虑各个属性对于最终聚类结果的影响差异性,这使得聚类的精度有一定的影响。针对上述问题,本文提出一种改进的特征加权算法。改进算法通过采用信息熵和ReliefF特征选择算法对特征进行加权选择,修正聚类对象间的距离函数,使算法达到更准确更高效的聚类效果。仿真实验结果表明,与传统的K-means算法相比,改进后的算法聚类结果稳定,聚类的精度有明显提升。
Abstract:
Cluster analysis is a statistical analysis technique that divides the research objects into relatively homogeneous groups. The core of cluster analysis is to find useful clusters of objects. K-means clustering algorithm has been receiving much attention from scholars because of its excellent speed and good scalability. However, the traditional K-means algorithm does not consider the influence of each attribute on the final clustering result, which makes the accuracy of clustering have a certain impact. In response to the above problems, this thesis proposes an improved feature weighting algorithm. The improved algorithm uses the information entropy and ReliefF feature selection algorithm to weight the features and correct the distance function between clustering objects, so that the algorithm can achieve more accurate and efficient clustering effect. The simulation results show that compared with the traditional K-means algorithm, the improved algorithm clustering results are stable, and the accuracy of clustering is significantly improved.
参考文献
|
[1]
|
Alexandropoulos, A., Plessas, F. and Birbas, M. (2010) A Dynamic DFI-Compatible Strobe Qualification System for Double Data Rate (DDR) Physical Interfaces. IEEE International Conference on Electronics, Athens, 12-15 December 2010, 277-280. [Google Scholar] [CrossRef]
|
|
[2]
|
卓金武, 周英. 量化投资: MATLAB数据挖掘技术与实践[M]. 北京: 电子工业出版社, 2017: 217-224.
|
|
[3]
|
刘铭, 吴冲. 基于特征权重量化的相似度计算方法[J]. 计算机学报, 2015, 38(7): 1420-1433.
|
|
[4]
|
Li, J. and Gao, X.B. (2006) A New Feature Weighted Fuzzy Clustering Algorithm. Proceedings of SPIE, The Inter-national Society for Optical Engineering, 3641, 412-420.
|
|
[5]
|
Meng, Q. (2015) An Improved Clustering Algorithm Based on Fea-ture-Weight Learning. Journal of Information and Computational Science, 12, 3519-3526. [Google Scholar] [CrossRef]
|
|
[6]
|
Shang, S.T. and Shi, M.Y. (2016) Improved Feature Weight Algorithm and Its Ap-plication to Text Classification. Mathematical Problems in Engineering, 2016, Article ID: 7819626. [Google Scholar] [CrossRef]
|
|
[7]
|
杨玉梅. 基于信息熵改进的K-means动态聚类算法[J]. 重庆邮电大学学报(自然科学版), 2016, 28(2): 254-259.
|
|
[8]
|
菅小艳, 韩素青. 不平衡数据集上的Relief特征选择算法[J]. 数据采集与处理, 2016, 31(4): 838-844.
|
|
[9]
|
UCI Machine Learning Repository: Data Sets [DB]. http://archive.ics.uci.edu/ml/datasets.html
|