MCMC算法及其应用
MCMC Algorithm and Its Application
摘要:
本文主要介绍了马尔可夫链蒙特卡罗方法(MCMC),主要是Metropolis方法、Hasting方法和Gibbs方法。介绍了这些算法的基本步骤,同时利用马尔可夫链的收敛性,讨论了算法的误差,并对算法进行改进。最后,给出了极限性质一些简单的应用。本文主要分为六部分:第一部分介绍了马尔可夫链的性质。第二部分主要介绍了Metropolis-Hasting (M-H)算法及推广,介绍了两种特殊的MCMC算法,即Metropolis算法和Hasting算法以及算法的实现过程。第三部分介绍了建议概率分布的改进,降低了误差,提高了收敛性。第四部介绍了Gibbs算法以及贝叶斯模型。第五部分给出了实例与应用,同时在众多方法中找到一个合适的实施方法。最后一部分,也就是第六部分进行了总结。
Abstract:
This paper mainly introduces the Markov Chain Monte Carlo Method (MCMC), which is mainly the Metropolis method, Hasting method and Gibbs method. The basic steps of these algorithms are in-troduced. At the same time, the convergence of Markov chain is used, the error of the algorithm is discussed, and the algorithm is improved. Finally, some simple applications of the limit properties are given. This paper is divided into six parts: The first part introduces the nature of the Markov chain. The second part introduces the Metropolis-Hasting (M-H) algorithm and promotion, and in-troduces two special MCMC algorithms, namely Metropolis algorithm and Hasting algorithm and algorithm implementation process. The third part introduces the improvement of the proposed probability distribution, which reduces the error and improves the convergence. The fourth part introduces the Gibbs algorithm and the Bayesian model. The fifth part gives examples and appli-cations, and finds a suitable implementation method among many methods. The last part, the sixth part, is summarized.
参考文献
|
[1]
|
Hasting, W. (1970) Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika, 57, 97-109. [Google Scholar] [CrossRef]
|
|
[2]
|
刘军. 科学计算中的蒙特卡罗策略[M]. 北京: 高等教育出版社, 2005.
|
|
[3]
|
Rubinstein, R. (1981) Simulation and Monte Carlo Method. John Wiley, New York.
|
|
[4]
|
Chib, S. and Greenberg, E. (1995) Understanding the Metropolis-Hasting Algorithm. Taylor and Francis, 49, 327-335.
|
|
[5]
|
Tierney, L. (1994) Markov Chains for Exploring Posterior Distributions. The Annals of Statistics, 22, 1701-1728. [Google Scholar] [CrossRef]
|
|
[6]
|
Andrieu, C. (2003) An Introduction to MCMC for Machine Learning. Machine Learning, 50, 5-43. [Google Scholar] [CrossRef]
|
|
[7]
|
Brooks, S., Gelman, A. and Jones, L. (2011) Handbook of Markov Chain Monte Carlo. A Chapman and Hall Book.
|
|
[8]
|
Roberts, G. (2004) General State Space Markov Chains and MCMC Algorithms. Probability Surveys, 1, 20-71. [Google Scholar] [CrossRef]
|
|
[9]
|
Liang, F. and Liu, C. (2010) Advanced Markov Chain Monte Carlo Methods. John and Sons Ltd. Publication. [Google Scholar] [CrossRef]
|
|
[10]
|
康崇禄. 蒙特卡罗方法理论和应用[M]. 北京: 科学出版社, 2014.
|
|
[11]
|
肖柳青. 随机模拟方法与应用[M]. 北京: 北京大学出版社, 2014.
|
|
[12]
|
张波. 应用随机过程[M]. 北京: 中国人民大学出版社, 2017.
|
|
[13]
|
Dagpunar, J. (2007) Simulation and Monte Carlo: With Applications in Finance and MCMC. John Wiley and Sons Ltd.
|
|
[14]
|
Lyas, A. (2016) Importance Sampling for Least-Square Monte Carlo Methods. Degree Project in Mathematics.
|