加速失效模型下大规模生存数据的分布式模型平均
Distributed Model Averaging for Large-Scale Survival Data under Accelerated Failure Time Models
DOI: 10.12677/sa.2026.159220, PDF,    科研立项经费支持
作者: 梅一平, 邢玉展, 陈晓静, 孔泽滢, 陈晓林*:曲阜师范大学统计与数据科学学院,山东 济宁
关键词: 加速失效模型;分布式模型平均;大规模数据;右删失;Accelerated Failure Time Model; Distributed Model Averaging; Large-Scale Data; Right Censoring
摘要: 大规模分布式数据的出现,给传统统计分析带来了巨大挑战,也使得分布式统计分析近年来成为统计研究中的热点问题。分布式模型平均方法虽能有效处理大规模数据中的模型不确定性问题,但据作者了解,现有文献仅研究了完全数据的场景,尚未涉及生存数据的分布式模型平均。针对大规模分布式右删失生存数据,利用逆概率删失加权技术,本文提出了加速失效模型下的两种分布式Mallows类型的模型平均方法。两种方法分别采用单轮型估计算法与替代最小二乘的迭代型估计算法进行备选模型的回归系数估计,但在权重选择上均统一采用局部最优权重的简单平均策略。本文通过数值模拟实验验证了所提方法的有效性,并将所提方法用到了实际数据分析。结果表明,所提方法在保持与基于全数据方法相近预测精度的同时,显著提升了计算效率。
Abstract: The emergence of massive distributed data imposes significant challenges to traditional statistical approaches, and also makes distributed statistical learning a hot topic in recent years. Although distributed model averaging methods can effectively handle model uncertainty in these large-scale datas, to the best of our knowledge, existing relevant literature has only investigated the scenarios with complete data and has not yet covered survival data. For the massive distributed survival data with rightly censoring responses, we propose two distributed Mallows-type model averaging methods using the technique of inverse probability of censoring weighting under the accelerated failure time model. These two methods differ in the estimation of the coefficient vector of candidate models—one employs a one-round algorithm while the other uses an iterative algorithm based on surrogate least squares—but both adopt a simple averaging strategy based on locally optimal weights for weight aggregation. The effectiveness of the proposed methods is validated through numerical simulation studies, and the methods are also applied to a real data analysis. The results show that the proposed approaches maintain the prediction accuracy similar to that of full-data methods and yield a marked improvement in computational time.
文章引用:梅一平, 邢玉展, 陈晓静, 孔泽滢, 陈晓林. 加速失效模型下大规模生存数据的分布式模型平均[J]. 统计学与应用, 2026, 15(9): 217-226. https://doi.org/10.12677/sa.2026.159220

参考文献

[1] Gao, Y., Liu, W., Wang, H., Wang, X., Yan, Y. and Zhang, R. (2022) A Review of Distributed Statistical Inference. Statistical Theory and Related Fields, 6, 89-99.
https://doi.org/10.1080/24754269.2021.1974158
[2] Li, X., Gao, Y., Chang, H., Huang, D., Ma, Y., Pan, R., et al. (2024) A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques. Statistical Theory and Related Fields, 8, 163-185.
https://doi.org/10.1080/24754269.2024.2343151
[3] Hansen, B.E. (2007) Least Squares Model Averaging. Econometrica, 75, 1175-1189.
https://doi.org/10.1111/j.1468-0262.2007.00785.x
[4] Zhang, X., Yu, D., Zou, G. and Liang, H. (2016) Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models. Journal of the American Statistical Association, 111, 1775-1790.
https://doi.org/10.1080/01621459.2015.1115762
[5] Feng, Y., Liu, Q., Yao, Q. and Zhao, G. (2022) Model Averaging for Nonlinear Regression Models. Journal of Business & Economic Statistics, 40, 785-798.
https://doi.org/10.1080/07350015.2020.1870477
[6] Lu, X. and Su, L. (2015) Jackknife Model Averaging for Quantile Regressions. Journal of Econometrics, 188, 40-58.
https://doi.org/10.1016/j.jeconom.2014.11.005
[7] Ando, T. and Li, K. (2014) A Model-Averaging Approach for High-Dimensional Regression. Journal of the American Statistical Association, 109, 254-265.
https://doi.org/10.1080/01621459.2013.838168
[8] Wei, Y., Wang, Q. and Liu, W. (2021) Model Averaging for Linear Models with Responses Missing at Random. Annals of the Institute of Statistical Mathematics, 73, 535-553.
https://doi.org/10.1007/s10463-020-00759-y
[9] He, B., Liu, Y., Wu, Y., Yin, G. and Zhao, X. (2020) Functional Martingale Residual Process for High-Dimensional Cox Regression with Model Averaging. Journal of Machine Learning Research, 21, 1-37.
[10] Liang, Z., Chen, X. and Zhou, Y. (2022) Mallows Model Averaging Estimation for Linear Regression Model with Right Censored Data. Acta Mathematicae Applicatae Sinica, English Series, 38, 5-23.
https://doi.org/10.1007/s10255-022-1054-z
[11] He, B., Ma, S., Zhang, X. and Zhu, L. (2023) Rank-Based Greedy Model Averaging for High-Dimensional Survival Data. Journal of the American Statistical Association, 118, 2658-2670.
https://doi.org/10.1080/01621459.2022.2070070
[12] Fang, F., Yin, X. and Zhang, Q. (2018) Divide and Conquer Algorithms for Model Averaging with Massive Data. Journal of Systems Science and Mathematical Sciences, 38, 764-776. (In Chinese)
[13] Zhang, H., Liu, Z. and Zou, G. (2023) Least Squares Model Averaging for Distributed Data. Journal of Machine Learning Research, 24, 1-59.
[14] Xia, X., He, S. and Pang, N. (2025) Communication-Efficient Model Averaging Prediction for Massive Data with Asymptotic Optimality. Statistical Papers, 66, 1-45.
https://doi.org/10.1007/s00362-025-01664-3
[15] Song, M., Qu, T., Zhao, Z. and Zou, G. (2026) Optimal Distributed Model Averaging for Multivariate Additive Model. Journal of Systems Science and Complexity, 39, 309-333.
https://doi.org/10.1007/s11424-025-5054-y
[16] Zhang, Y., Chen, X. and Xing, Y. (2025) Distributed Focused Information Criterion and Focused Frequentist Model Averaging for Massive Data. Statistica Sinica.
https://www3.stat.sinica.edu.tw/ss_newpaper/SS-2025-0060_na.pdf
[17] Zhang, X., Zou, G., Liang, H. and Carroll, R.J. (2020) Parsimonious Model Averaging with a Diverging Number of Parameters. Journal of the American Statistical Association, 115, 972-984.
https://doi.org/10.1080/01621459.2019.1604363
[18] Jordan, M.I., Lee, J.D. and Yang, Y. (2019) Communication-Efficient Distributed Statistical Inference. Journal of the American Statistical Association, 114, 668-681.
https://doi.org/10.1080/01621459.2018.1429274
[19] Fan, J., Guo, Y. and Wang, K. (2023) Communication-Efficient Accurate Statistical Estimation. Journal of the American Statistical Association, 118, 1000-1010.
https://doi.org/10.1080/01621459.2021.1969238
[20] Shamir, O., Srebro, N. and Zhang, T. (2014) Communication-Efficient Distributed Optimization Using an Approximate Newton-Type Method. Proceedings of the 31st International Conference on Machine Learning, Proceedings of Machine Learning Research, 32, 1000-1008.