基于非光滑约束的Langevin算法
Langevin Algorithms Based on Non-Smooth Constraints
DOI: 10.12677/AAM.2024.131018, PDF,    国家自然科学基金支持
作者: 曹嘉锋:浙江师范大学数学科学学院,浙江 金华;李春晔*, 王 薇:嘉兴学院数据科学学院,浙江 嘉兴
关键词: 贝叶斯推断蒙特卡罗全变差随机微分方程高斯测度Bayesian Inference Monte Carlo Total Variation Stochastic Differential Equation Gaussian Measure
摘要: 贝叶斯推断求解反问题越来越流行,得益于它对解不确定性的诠释。在解决实际问题中,算法的计算时间受到一定的关注,而基于Langevin方程的算法利用了一阶导数信息,具有采样效率高的优点,在采样算法中被广泛使用。对于含有急剧跳跃先验信息的图像问题,贝叶斯框架下先验的选取尤为重要,而TV正则化方法等非光滑约束可以很好刻画先验信息。本文回顾了非光滑约束与高斯先验相结合的混合先验,同时重述了近端Langevin算法,并在此基础上提出了基于非光滑约束的对偶Langevin算法。最后应用于CT成像问题,数值结果表明,我们提出算法是有效的,能够更好地利用非光滑约束刻画解。
Abstract: Bayesian inference for solving inverse problems is becoming increasingly popular, thanks to its in-terpretation of solution uncertainty. In solving practical problems, the computational time of algo-rithms has received certain attention, and algorithms based on Langevin equation utilize first-order derivative information, which has the advantage of high sampling efficiency and is widely used in sampling algorithms. For image problems with sharp jump prior information, the selection of prior information in the Bayesian framework is particularly important, and non-smooth constraints such as TV regularization methods can effectively characterize prior information. This article reviews the hybrid prior combining non-smooth constraints with Gaussian prior, while reiterating the proximal Langevin algorithm, and proposes a dual Langevin algorithm based on non-smooth constraints. Fi-nally, it is applied to the CT imaging problem, and numerical results show that our proposed algo-rithm is effective and can better utilize non-smooth constraints to characterize the solution.
文章引用:曹嘉锋, 李春晔, 王薇. 基于非光滑约束的Langevin算法[J]. 应用数学进展, 2024, 13(1): 149-158. https://doi.org/10.12677/AAM.2024.131018

参考文献

[1] 程晋, 刘继军, 张波. 偏微分方程反问题: 模型、算法和应用[J]. 中国科学: 数学, 2019, 49(4): 643-666.
[2] Engl, H., Hanke, M. and Neubauer, A. (1996) Regularization of Inverse Problems. Springer, New York.
[3] Burger, M. and Osher, S. (2004) Convergence Rates of Convex Variational Regularization. Inverse Problems, 20, 1411-1421. [Google Scholar] [CrossRef
[4] Yao, Z., Hu, Z. and Li, J. (2016) A TV-Gaussian Prior for Infi-nite-Dimensional Bayesian Inverse Problems and Its Numerical Implementations. Inverse Problems, 32, 075006. [Google Scholar] [CrossRef
[5] Cotter, S.L., Roberts, G.O., Stuart, A.M. and White, D. (2023) MCMC Methods for Functions: Modifying Old Algorithms to Make Them Faster. Statistical Science, 28, 424-446. [Google Scholar] [CrossRef
[6] Lassas, M. and Siltanen, S. (2004) Can One Use Total Variation Prior for Edge-Preserving Bayesian Inversion? Inverse Problems, 20, 1537. [Google Scholar] [CrossRef
[7] Durmus, A., Majewski, S. and Miasojedow, B. (2019) Analysis of Langevin Monte Carlo via Convex Optimization. The Journal of Machine Learning Research, 20, 2666-2711.
[8] Durmus, A., Moulines, E. and Pereyra, M. (2018) Efficient Bayesian Computation by Proximal Mar-kov Chain Monte carlo: When Langevin Meets Moreau. SIAM Journal on Imaging Sciences, 11, 473-506. [Google Scholar] [CrossRef
[9] Dalalyan, A.S. (2017) Theoretical Guarantees for Approximate Sam-pling from Smooth and Log-Concave Densities. Journal of the Royal Statistical Society Series B: Statistical Methodology, 79, 651-676. [Google Scholar] [CrossRef
[10] Bonettini, S. and Ruggiero, V. (2012) On the Convergence of Primal-Dual Hybrid Gradient Algorithms for Total Variation Image Restoration. Journal of Mathematical Imaging and Vision, 44, 236-253. [Google Scholar] [CrossRef
[11] Jin, Q. and Wang, W. (2013) Landweber Iteration of Kaczmarz Type with General Non-Smooth Convex Penalty Functionals. Inverse Problems, 29, 085011. [Google Scholar] [CrossRef
[12] Zhong, M., Wang, W. and Jin, Q. (2019) Regularization of Inverse Problems by Two-Point Gradient Methods in Banach Spaces. Numerische Mathematik, 143, 713-747. [Google Scholar] [CrossRef
[13] 金其年, 王薇. Banach 空间中求解线性反问题的对偶梯度流方法[J]. 中国科学: 数学, 2023, 53(10): 1377-1396.
[14] Zhong, M., Wang, W. and Zhu, K. (2022) On the Asymp-totical Regularization with Convex Constraints for Nonlinear Ill-Posed Problems. Applied Mathematics Letters, 133, 108247. [Google Scholar] [CrossRef
[15] Hansen, P.C. and Saxild-Hansen, M. (2012) AIR Tools—A MATLAB Package of Algebraic Iterative Reconstruction Methods. Journal of Computational and Applied Mathematics, 236, 2167-2178. [Google Scholar] [CrossRef
[16] Zhu, M. and Chan, T. (2008) An Efficient Primal-Dual Hybrid Gradient Algorithm for Total Variation Image Restoration. Ucla Cam Report, 34, 8-34.