基于独立但不同分布样本的系数正则化回归算法的研究
Analysis of Coefficient Regularized Regression with Non-Identically and Independently Sampling
摘要: 本文分析了基于独立但不同分布样本的系数正则化回归学习算法。全文的框架不同于以往的经典核学习方法,核函数不再要求满足半正定性;对于样本输出,令其满足弱化的矩假设条件。文章使用积分算子的方法得到了满意的与容量无关的误差界,最后通过选取合适的正则化参数得到较为满意的学习率。
Abstract: This paper considers the error analysis of coefficient regularization with non-identically and independently sampling. The framework under investigation is different from classical kernel learning. The kernel function no longer satisfies the positive semidefiniteness; we carry out the error analysis with output sample values satisfying a generalized moment hypothesis. Satisfactory capacity independently error bounds are derived by the techniques of integral operator for this learning algorithm, finally, a satisfactory learning rate is obtained by selecting appropriate regularization parameters.
文章引用:常欣欣, 王鑫. 基于独立但不同分布样本的系数正则化回归算法的研究[J]. 应用数学进展, 2021, 10(10): 3254-3260. https://doi.org/10.12677/AAM.2021.1010341

参考文献

[1] 郭芹, 孙红卫. 基于弱相关抽样的系数正则化的一致性分析[J]. 济南大学学报(自然科学版), 2010, 24(1): 99-103.
[2] Sun, H.W. and Wu, Q. (2011) Least Square Regression with Indefinite Kernels and Coefficient Regularization. Applied and Computational Harmonic Analysis, 30, 96-109.
[Google Scholar] [CrossRef
[3] Nie, W.L. and Wang, C. (2016) Error Analysis of ERM Algorithm with Unbounded and Non-Identical Sampling. Journal of Applied Mathematics and Physics, 4, 156-168.
[Google Scholar] [CrossRef
[4] Chu, X.R. and Sun, H.W. (2013) Regularized Least Square Regression with Unbounded and Dependent Sampling. Abstract and Applied Analysis, 2013, 900-914.
[5] Chu, X.R. and Sun, H.W. (2012) Coefficient Regularization with Unbounded Sampling. Journal of Computational Information Systems, 8, 1613-1621.
[6] Gao, Q. and Ye, P.X. (2016) Coefficient-Based Regularized Regression with Dependent and Unbounded Sampling. International Journal of Wavelets, Multiresolution and Information Processing, 14, No. 5.
[Google Scholar] [CrossRef
[7] Vapnik, V. (1979) Estimation of Dependent Based on Empirical Data. Nauka, Moscow.
[8] Sun, H.W. and Guo, Q. (2011) Coefficient Regularized Regression with Non-IID Sampling. International Journal of Computer Mathematics, 88, 3113-3125.
[Google Scholar] [CrossRef
[9] Cai, J. (2013) Coefficient-Based Regression with Non-Identical Unbounded Sampling. Abstract and Applied Analysis, 2013, Article ID: 134727.
[Google Scholar] [CrossRef