一种新的MBFGS算法
A New MBFGS Algorithm
DOI: 10.12677/AAM.2022.118630, PDF,   
作者: 郑轶天:长沙理工大学数学与统计学院,湖南 长沙
关键词: 非线性搜索拟牛顿法全局收敛性Nonlinear Search Quasi Newton Method Global Convergence
摘要: 本文在MBFGS算法的研究基础上,对该算法进行推广,形成了一种新的MBFGS算法。同时,研究了其全局收敛性并给出相关证明。一些数值实验表明,这种改进的MBFGS方法对于给定的测试问题是有效的。对于一些无约束优化问题,新的MBFGS算法平均比单调或传统的非单调格式的BFGS方法使用更少的函数和梯度求值。
Abstract: Based on the research of MBFGS algorithm, this algorithm is extended to form a new MBFGS algo-rithm. At the same time, its convergence is studied and the relevant proof is given. Some numerical experiments show that the improved MBFGS method is effective for a given test problem. For some unconstrained op-timization problems, the new MBFGS algorithm uses less function and gradient evaluation than the mono-tone or traditional non monotone BFGS method.
文章引用:郑轶天. 一种新的MBFGS算法[J]. 应用数学进展, 2022, 11(8): 5981-5985. https://doi.org/10.12677/AAM.2022.118630

参考文献

[1] Grippo, L., Lampariello, F. and Lucidi, S. (1986) A Nonmonotone Line Search Technique for Newton’s Method. SIAM Journal on Numerical Analysis, 23,707-716. [Google Scholar] [CrossRef
[2] Zhang, H. and Hager, W.W. (2004) A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization. SIAM journal on Optimization, 14, 1043-1056. [Google Scholar] [CrossRef
[3] Yu, Z. and Pu, D. (2008) A New Nonmonotone Line Search Technique for Unconstrained Optimization. Journal of Computational and Applied Mathe-matics, 219, 134-144. [Google Scholar] [CrossRef
[4] Zhou, W. and Zhang, L. (2009) Global Con-vergence of the Nonmonotone MBFGS Method for Nonconvex Unconstrained Minimization. Journal of Computational and Applied Mathematics, 223, 40-47. [Google Scholar] [CrossRef
[5] Moré, J.J., Garbow, B.S. and Hillstrom, K.E. (1981) Testing Un-constrained Optimization Software. ACM Transactions on Mathematical Software, 7, 17-41. [Google Scholar] [CrossRef
[6] Byrd, R.H. and Nocedal, J. (1989) A Tool for the Analysis of Qua-si-Newton Methods with Application to Unconstrained Minimization. SIAM Journal on Numerical Analysis, 26, 727-739. [Google Scholar] [CrossRef
[7] Dai, Y.H. (2002) On the Nonmonotone Line Search. Journal of Optimization Theory and Applications, 112, 315-330. [Google Scholar] [CrossRef
[8] Li, D. and Fukushima, M. (1999) A Globally and Superlinearly Convergent Gauss—Newton-Based BFGS Method for Symmetric Nonlinear Equations. SIAM Journal on numerical Analysis, 37, 152-172. [Google Scholar] [CrossRef
[9] Dai, Y.H. (2002) Convergence Properties of the BFGS Algo-ritm. SIAM Journal on Optimization, 13, 693-701. [Google Scholar] [CrossRef
[10] Dai, Y.H. (2002) A Nonmonotone Conjugate Gradient Algo-rithm for Unconstrained Optimization. Journal of System Science and Complexity, 15, 139-145.
[11] Grippo, L., Lam-pariello, F. and Lucidi, S. (1989) A Truncated Newton Method with Nonmonotone Line Search for Unconstrained Opti-mization. Journal of Optimization Theory and Applications, 60, 401-419. [Google Scholar] [CrossRef