改进二进制沙丘猫群优化特征选择算法
Improved Binary Sand Cat Swarm Optimization Feature Selection Algorithm
摘要: 特征选择在机器学习的分类任务中被广泛应用,选择出的特征子集会直接影响后续学习算法的性能。针对沙丘猫群优化算法(SCSO)全局搜索能力弱、收敛速度慢问题,本文提出一种改进的二进制沙丘猫群优化特征选择算法。首先改进控制沙丘猫在搜索阶段和攻击阶段转换参数的调整方法,使用两阶段的改进收敛因子策略代替线性递减策略,以提升算法的全局搜索能力。其次受PSO算法位置更新公式的启发,引入社会学习因子和认知学习因子策略,提高算法的收敛速度。为了验证新提出算法在求解特征选择问题上的性能,本文选择了4种经典算法在8个UCI数据集上进行了对比测试,实验结果表明新提出算法的性能优于对比算法。
Abstract: Feature selection is widely used in classification tasks of machine learning, and the selected feature sets directly affect the performance of subsequent learning algorithms. Aiming at the issues of weak global search ability and slow convergence speed of Sand Cat Swarm Optimization (SCSO), an improved binary sand cat swarm optimization feature selection algorithm is proposed in this paper. Firstly, the adjustment method of controlling the transition parameters of sand cat in the search phase and attack phase is improved.This method employs a two-stage improved convergence factor strategy, replacingthe linear decrement strategy, aiming to enhance the algorithm’s global search capability. Secondly, inspired by the position update formula of the PSO algorithm, social learning factor and cognitive learning factor strategies are introduced to improve the convergence speed of the algorithm. In order to verify the performance of the newly proposed algorithm in solving the feature selection problem, this study conducted comparative tests on eight UCI datasets using four classical algorithms. The experimental results demonstrate that the performance of the newly proposed algorithm outperforms the compared algorithms.
文章引用:周子航, 王丽娜. 改进二进制沙丘猫群优化特征选择算法[J]. 计算机科学与应用, 2023, 13(10): 1855-1869. https://doi.org/10.12677/CSA.2023.1310184

参考文献

[1] Wang, L., Qian, Y., et al. (2019) Feature Selection Using Lebesgue and Entropy Measures for Incomplete Neighborhood Decision Systems. Knowledge-Based Systems, 186, Article ID: 104942. [Google Scholar] [CrossRef
[2] 刘艳, 程璐, 孙林. 基于KS检验和邻域粗糙集的特征选择方法[J]. 河南师范大学学报: 自然科学版, 2019, 47(2): 21-28.
[3] Jin, Z., Teng, S., Zhang, J., et al. (2022) Struc-tural Damage Recognition Based on Filtered Feature Selection and Convolutional Neural Network. International Journal of Structural Stability and Dynamics, 22, Article ID: 2250134. [Google Scholar] [CrossRef
[4] Zheng, K., Wang, X., Wu, B., et al. (2020) Feature Subset Se-lection Combining Maximal Information Entropy and Maximal Information Coefficient. Applied Intelligence, 50, 487-501. [Google Scholar] [CrossRef
[5] Wang, J. and Zhang, L. (2021) Discriminant Mutual Information for Text Feature Selection. In: International Conference on Database Systems for Advanced Applications, Springer, Cham, 136-151. [Google Scholar] [CrossRef
[6] Wei, J., Zhang, R., Yu, Z., et al. (2017) A BPSO-SVM Algo-rithm Based on Memory Renewal and Enhanced Mutation Mechanisms for Feature Selection. Applied Soft Computing, 58, 176-192. [Google Scholar] [CrossRef
[7] 徐明, 羊洋, 龙文. 解决高维优化和特征选择的多策略改进正弦余弦算法[J]. 科学技术与工程, 2023, 23(13): 5632-5640.
[8] Mao, Y. and Yang, Y. (2019) A Wrapper Feature Subset Selection Method Based on Randomized Search and Multilayer Structure. BioMed Research In-ternational, 2019, Article ID: 9864213. [Google Scholar] [CrossRef] [PubMed]
[9] Katoch, S., Chauhan, S.S. and Kumar, V. (2021) A Review on Genetic Algorithm: Past, Present, and Future. Multimedia Tools and Applications, 80, 8091-8126. [Google Scholar] [CrossRef] [PubMed]
[10] Abualigah, L., Shehab, M., Alshinwan, M., et al. (2021) Ant Lion Optimizer: A Comprehensive Survey of Its Variants and Applications. Archives of Computational Methods in Engineering, 28, 1397-1416. [Google Scholar] [CrossRef
[11] Jain, M., Saihjpal, V., Singh, N., et al. (2022) An Overview of Variants and Advancements of PSO Algorithm. Applied Sciences, 12, Article No. 8392. [Google Scholar] [CrossRef
[12] 徐明, 龙文. 基于多策略融合灰狼优化算法的特征选择方法[J]. 科学技术与工程, 2021, 21(20): 8544-8551.
[13] 路雪刚, 张雪花, 张梦桃. 基于改进鲸鱼优化算法的畜禽废弃物运输路径优化问题[J]. 科学技术与工程, 2022, 22(25): 11120-11129.
[14] Panda, M., Das, B. and Pati, B. (2020) Global Path Planning for Multiple AUVs Using GWO. Archives of Control Sciences, 30, 77-100.
[15] Seyyedabbasi, A. and Kiani, F. (2022) Sand Cat Swarm Optimization: A Nature-Inspired Algorithm to Solve Global Optimization Problems. Engineering with Computers, 39, 2627-2651. [Google Scholar] [CrossRef
[16] Arai, K. (2022) Improved ISODATA Clustering Method with Parameter Estimation Based on Genetic Algorithm. International Journal of Advanced Computer Science and Applications, 13, 187-193. [Google Scholar] [CrossRef
[17] Jovanovic, D., Marjanovic, M., Antonijevic, M., et al. (2022) Feature Selection by Improved Sand Cat Swarm Optimizer for Intrusion Detection. 2022 International Confer-ence on Artificial Intelligence in Everything (AIE), Nicosia, 2-4 August 2022, 685-690. [Google Scholar] [CrossRef
[18] 王泽昆, 贺毅朝, 李焕哲, 等. 基于新颖S型转换函数的二进制粒子群优化算法求解具有单连续变量的背包问题[J]. 计算机应用, 2021, 41(2): 461-469.
[19] Bharti, K.K. and Singh, P.K. (2016) Opposition Chaotic Fitness Mutation Based Adaptive Inertia Weight BPSO for Feature Selection in Text Clustering. Applied Soft Computing, 43, 20-34. [Google Scholar] [CrossRef
[20] Emary, E., Zawbaa, H.M. and Hassanien, A.E. (2016) Binary Grey Wolf Optimization Approaches for Feature Selection. Neuro-computing, 172, 371-381. [Google Scholar] [CrossRef