无约束优化问题的牛顿谱梯度法
Newton Spectral Gradient Method of Unconstrained Optimization Problems
摘要: 本文在Newton法和最速下降法的组合方法的基础上提出求解无约束优化问题的Newton法与谱梯度法的组合方法,该方法有效地应用于目标函数的Hessian矩阵不正定或初始点不接近极小点的问题,并利用非单调线搜索求解步长。在较温和的条件下建立了该方法的全局收敛性和超线性收敛性,并且数值实验证明了该算法具有很好的数值实验效果。
Abstract: Based on the Newton method and the combination of the steepest descent method, Newton method and spectral gradient method are combined to solve unconstrained optimization prob-lems. This method is effectively applied to the problem that the Hessian matrix of the objective function is not positive definite or the initial point is not close to the minimum point, and the non-monotone line search is used to solve the step size. The global convergence and superlinear convergence of this method are established under relatively mild conditions, and the numerical experiments show that the algorithm has good numerical experimental results.
文章引用:宋婷霞, 宇振盛. 无约束优化问题的牛顿谱梯度法[J]. 运筹与模糊学, 2020, 10(1): 65-73. https://doi.org/10.12677/ORF.2020.101008

参考文献

[1] An, H.B., Mo, Z.Y. and Liu, X.P.J. (2007) A Choice of Forcing Terms in Inexact Newton Method. Journal of Computational and Applied Mathematics, 200, 47-60. [Google Scholar] [CrossRef
[2] 唐声平. 非线性偏微分方程多解计算的加速增广部分牛顿法[D]: [硕士学位论文]. 长沙: 湖南师范大学, 2017.
[3] Qi, L. and Sun, J.J. (1993) A Nonsmooth Version of Newton’s Method. Mathematical Programming, 58, 353-367. [Google Scholar] [CrossRef
[4] Li, Y.J. and Li, D.H.J. (2009) Truncated Regularized Newton Method for Convexminimizations. Computational Optimization & Applications, 43, 119-131. [Google Scholar] [CrossRef
[5] Mccrae, B. and Stacey, K. (1987) More Test Examples for Nonlinear Programming Codes. Springer, Berlin, 1-271.
[6] Barzilai, J. and Borwein, J.M.J. (1988) Two-Point Step Size Gradient Methods. IMA Journal of Numerical Analysis, 8, 141-148. [Google Scholar] [CrossRef
[7] Grippo, L. and Lucidi, F.L.J. (1986) A Nonmonotone Line Search Technique for Newton’s Method. SIAM Journal on Numerical Analysis, 23, 707-716. [Google Scholar] [CrossRef
[8] Grippo, L., Lampariello, F. and Lucidi, S.J. (1991) A Class of Non-monotone Stabilization Method in Unconstrained Optimization. Numerische Mathematik, 59, 779-805. [Google Scholar] [CrossRef
[9] Grippo, L, and Sciandrone, M.J. (2002) Nonmonotone Globalization Techniques for the Barzilai-Borwein Gradient Method. Computational Optimization and Applications, 23, 143-169. [Google Scholar] [CrossRef
[10] Raydan, M. (1997) The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem. Society for Industrial and Applied Mathematics, 7, 26-33. [Google Scholar] [CrossRef
[11] Dai, Y.H., Huang, Y. and Liu, X.W.J. (2019) A Family of Spectral Gradient Methods for Optimization. Computational Optimization and Applications, 74, 43-65. [Google Scholar] [CrossRef
[12] Sun, D., Womersley, R.S. and Qi, H.J. (2002) A Feasible Semismooth Asymptotically Newton Method for Mixed Complementarity Problems. Mathematical Programming, 94, 167-187. [Google Scholar] [CrossRef
[13] Dai, Y.-H.J. (2002) R-Linear Convergence of the Barzilai and Borwein Gradient Method. IMA Journal of Numerical Analysis, 22, 1-10. [Google Scholar] [CrossRef