基于独立但不同分布样本的系数正则化回归算法的研究
Analysis of Coefficient Regularized Regression with Non-Identically and Independently Sampling
摘要: 本文分析了基于独立但不同分布样本的系数正则化回归学习算法。全文的框架不同于以往的经典核学习方法,核函数不再要求满足半正定性;对于样本输出,令其满足弱化的矩假设条件。文章使用积分算子的方法得到了满意的与容量无关的误差界,最后通过选取合适的正则化参数得到较为满意的学习率。
Abstract:
This paper considers the error analysis of coefficient regularization with non-identically and independently sampling. The framework under investigation is different from classical kernel learning. The kernel function no longer satisfies the positive semidefiniteness; we carry out the error analysis with output sample values satisfying a generalized moment hypothesis. Satisfactory capacity independently error bounds are derived by the techniques of integral operator for this learning algorithm, finally, a satisfactory learning rate is obtained by selecting appropriate regularization parameters.
参考文献
|
[1]
|
郭芹, 孙红卫. 基于弱相关抽样的系数正则化的一致性分析[J]. 济南大学学报(自然科学版), 2010, 24(1): 99-103.
|
|
[2]
|
Sun, H.W. and Wu, Q. (2011) Least Square Regression with Indefinite Kernels and Coefficient Regularization. Applied and Computational Harmonic Analysis, 30, 96-109. [Google Scholar] [CrossRef]
|
|
[3]
|
Nie, W.L. and Wang, C. (2016) Error Analysis of ERM Algorithm with Unbounded and Non-Identical Sampling. Journal of Applied Mathematics and Physics, 4, 156-168. [Google Scholar] [CrossRef]
|
|
[4]
|
Chu, X.R. and Sun, H.W. (2013) Regularized Least Square Regression with Unbounded and Dependent Sampling. Abstract and Applied Analysis, 2013, 900-914.
|
|
[5]
|
Chu, X.R. and Sun, H.W. (2012) Coefficient Regularization with Unbounded Sampling. Journal of Computational Information Systems, 8, 1613-1621.
|
|
[6]
|
Gao, Q. and Ye, P.X. (2016) Coefficient-Based Regularized Regression with Dependent and Unbounded Sampling. International Journal of Wavelets, Multiresolution and Information Processing, 14, No. 5.
[Google Scholar] [CrossRef]
|
|
[7]
|
Vapnik, V. (1979) Estimation of Dependent Based on Empirical Data. Nauka, Moscow.
|
|
[8]
|
Sun, H.W. and Guo, Q. (2011) Coefficient Regularized Regression with Non-IID Sampling. International Journal of Computer Mathematics, 88, 3113-3125. [Google Scholar] [CrossRef]
|
|
[9]
|
Cai, J. (2013) Coefficient-Based Regression with Non-Identical Unbounded Sampling. Abstract and Applied Analysis, 2013, Article ID: 134727. [Google Scholar] [CrossRef]
|