基于SICA罚的变量选择及应用
Variable Selection and Application Based on SICA Penalty
DOI: 10.12677/SA.2021.101014, PDF,    科研立项经费支持
作者: 吕鹏飞, 项 超, 王延新：宁波工程学院，浙江 宁波
关键词: SICA罚；变量选择；参数估计；线性模型；BIC准则；SICA Penalty； Variable Selection； Parameter Estimation； Linear Model； BIC Criteria
摘要: 高维数据的变量选择一直是统计学领域的热门研究方向。本文研究SICA罚估计在线性模型变量选择中的应用，结合LLA (Local linear approximation)和坐标下降算法给出一种有效的迭代算法，并提出BIC准则选择正则化参数。实际数据的分析表明，与其他变量选择方法相比较，SICA方法在参数估计精度和变量选择方面具有较好的表现。
Abstract: Variable selection of high-dimensional data has always been a hot research direction in the field of statistics. In this paper, we study the application of SICA penalty estimation in variable selection of linear model, give an effective iterative algorithm combined with LLA (local linear approximation) and coordinate descent algorithm, and propose BIC criterion to select regularization parameters. The analysis of actual data shows that SICA method has better performance in parameter estimation accuracy and variable selection compared with other variable selection methods.
文章引用：吕鹏飞, 项超, 王延新. 基于SICA罚的变量选择及应用[J]. 统计学与应用, 2021, 10(1): 145-150. https://doi.org/10.12677/SA.2021.101014

参考文献

[1] Vinod, H.D. (2020) What’s the Big Idea? Ridge Regression and Regularisation, 17, 41-41.
[Google Scholar] [CrossRef] 
[2] 曾津, 周建军. 高维数据变量选择方法综述[J]. 数理统计与管理, 2017(4): 678-692.
[3] 王大荣, 张忠占. 线性回归模型中变量选择方法综述[J]. 数理统计与管理, 2010(4): 615-627.
[4] 李根, 邹国华, 张新雨.高维模型选择方法综述[J]. 数理统计与管理, 2012, 31(4): 640-658.
[5] Breiman, L. (1995) Better Subset Regression Using the Nonnegative Garrote. Technometrics, 37, 373-384.
[Google Scholar] [CrossRef] 
[6] Yuan, M. and Lin, Y. (2007) On the Nonnegative Garrote Estimator. Journal of the Royal Statistical Society (Series B), 69, 143-161.
[Google Scholar] [CrossRef] 
[7] Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society (Series B), 58, 267-288.
[Google Scholar] [CrossRef] 
[8] Fan, J.Q. and Li, R.Z. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360.
[Google Scholar] [CrossRef] 
[9] Zhang, C.-H. (2010) Nearly Unbiased Variable Selection under Minimax Concave Penalty. Annals of Statistics, 38, 894-942.
[Google Scholar] [CrossRef] 
[10] Lv, J.C. and Fan, Y.Y. (2009) A Unified Approach to Model Selection and Sparse Recovery Using Regularized Least Squares. Annals of Statistics, 37, 3498-3528.
[Google Scholar] [CrossRef] 
[11] 严奇琪, 王延新. 高维部分线性小波模型中的变量选择[J]. 宁波工程学院学报, 2018(2): 13-18.
[12] Akaike, H. (1973) Information Theory and an Extension of the Maximum Likelihood Principle. In: Petrov, B.N. and Csaki, F., Eds., International Symposium on Information Theory, Budapest, 267-281.
[13] 张肖萍, 吴炜明, 王延新. 高维数据变量选择中MCP正则化参数选择研究[J]. 统计学与应用, 2019, 8(6): 852-858.

为你推荐