交叉验证法在模型选择中的应用——以OLS和RR为例
Application of Cross-Validation in Model Selection—Take OLS and RR as Examples
摘要:
文章回顾了交叉验证法的起源及发展,对已有研究成果进行总结和归纳。在此基础上,选择其中较为常用的留一交叉验证法对实例进行模型选择。分别采用最小二乘估计法和岭回归法对乙炔的反应数据进行分析,建立相应的模型,并对所建立的模型进行选择,同时探讨选择的合理性及现实性。
Abstract:
This paper reviews the origin and
development of cross-validation, and summarizes the previous research results.
On this basis, leave-one-out cross-validation is used to solve some problems
for model selection. OLS and RR were used to analyze the reaction of acetylene
data, establishing appropriate models and selecting the optimal model. At the
same time, the rationality and reality of the model selection were discussed.
参考文献
|
[1]
|
Larson, S.C. (1931) The Shrinkage of the Coefficient of Multiple Correlation. Journal of Educational Psychology, 22, 45-55. [Google Scholar] [CrossRef]
|
|
[2]
|
Stone, M. (1974) Cross-Validatory Choice and Assessment of Sta-tistical Prediction. Journal of the Royal Statistical Society: Series B (Methodological), 36, 111-147. [Google Scholar] [CrossRef]
|
|
[3]
|
Geisser, S. (1974) A Predictive Approach to the Random Effect Model. Biometrika, 61, 101-107. [Google Scholar] [CrossRef]
|
|
[4]
|
Geisser, S. (1975) The Predictive Sample Reuse Method with Ap-plications. Journal of the American Statistical Association, 70, 320-328. [Google Scholar] [CrossRef]
|
|
[5]
|
Devroye, L.P. and Wagner, T.J. (1979) Distribution-Free Performance Bounds for Potential Function Rules. IEEE Transactions on Information Theory, 25, 601-604. [Google Scholar] [CrossRef]
|
|
[6]
|
Shao, J. (1993) Linear Model Selection by Cross-Validation. Journal of the American Statistical Association, 88, 486-494. [Google Scholar] [CrossRef]
|
|
[7]
|
Dietterich, T. (1998) Approximate Statisitical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10, 1895-1924. [Google Scholar] [CrossRef] [PubMed]
|
|
[8]
|
Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Applications to Nonorthogonal Problems. Technometrics, 12, 69-82. [Google Scholar] [CrossRef]
|
|
[9]
|
Celisse, A. (2008) Model Selection in Density Estimation via Cross-Validation. Density Estimation, 14, 1-39.
|