求解双层规划问题的光滑化牛顿方法
A Smoothing Newton Method for Bilevel Programming Problems
摘要: 考虑一类具有特殊结构的双层规划问题,其上层问题无约束,而下层问题为凸优化问题。首先,通过引入下层问题的值函数,将原问题转化为单层优化问题(VP)。在部分平稳性条件下,通过将值函数约束惩罚到目标函数,进一步得到问题(VP)的部分精确罚问题。随后,在一定的约束规范条件下,推导出该罚问题的最优性条件,并利用光滑障碍增广拉格朗日函数方法处理其中的互补约束条件,从而将问题转化为超定方程组进行求解。针对该方程组,采用经典的高斯牛顿法进行求解,并理论证明了当障碍参数趋近于零时算法的收敛性。最后,基于BOLIB库中的小规模问题开展数值实验,将所提算法与LM算法、拟牛顿法等方法的计算结果进行对比分析,实验结果表明了该算法的有效性。
Abstract: Consider a class of bilevel programming problems with a special structure, where the upper-level problem is unconstrained and the lower-level problem is a convex optimization problem. First, by introducing the value function of the lower-level problem, the original problem is reformulated into a single-level optimization problem (VP). Under the partial calmness condition, an exact penalty problem for (VP) is further derived by penalizing the value function constraint into the objective function. Subsequently, under certain constraint qualifications, optimality conditions for the penalized problem are established. The complementary constraints in the optimality conditions are handled using a smoothing barrier augmented Lagrangian function method, transforming the problem into an overdetermined system of equations. To solve this system, the classical Gauss-Newton method is employed, and the convergence of the algorithm is theoretically proven as the barrier parameter tends to zero. Finally, numerical experiments are conducted on small-scale problems from the BOLIB library. The proposed algorithm is compared with the LM algorithm, the Quasi-Newton method, and other approaches. The experimental results demonstrate the effectiveness of the proposed algorithm.
文章引用:李晓夏. 求解双层规划问题的光滑化牛顿方法[J]. 应用数学进展, 2025, 14(9): 141-156. https://doi.org/10.12677/aam.2025.149408

参考文献

[1] Luo, Z.Q., Pang, J.S. and Ralph, D. (1996) Mathematical Programs with Equilibrium Constraints. Cambridge University Press. [Google Scholar] [CrossRef
[2] 吴昌龙, 罗华伟, 秦正斌, 等. 基于双层规划的电网侧储能配置算法研究[J]. 低压电器, 2021(4): 85-93.
[3] 邵举平, 周将军, 孙延安. “碳中和”背景下基于演化博弈与双层规划的供应链减排动力研究[J]. 运筹与管理, 2023, 32(12): 79-85.
[4] Zhang, Y., Sun, L., Sun, W., Ma, F., Xiao, R., Wu, Y., et al. (2024) Bilevel Optimal Infrastructure Planning Method for the Inland Battery Swapping Stations and Battery-Powered Ships. Tsinghua Science and Technology, 29, 1323-1340. [Google Scholar] [CrossRef
[5] Vicente, L., Savard, G. and Júdice, J. (1994) Descent Approaches for Quadratic Bilevel Programming. Journal of Optimization Theory and Applications, 81, 379-399. [Google Scholar] [CrossRef
[6] Dempe, S. and Dutta, J. (2012) Is Bilevel Programming a Special Case of a Mathematical Program with Complementarity Constraints. Mathematical Programming, 131, 37-48. [Google Scholar] [CrossRef
[7] Dempe, S. and Zemkoho, A.B. (2013) The Bilevel Programming Problem: Reformulations, Constraint Qualifications and Optimality Conditions. Mathematical Programming, 138, 447-473. [Google Scholar] [CrossRef
[8] Dempe, S. and Franke, S. (2019) Solution of Bilevel Optimization Problems Using the KKT Approach. Optimization, 68, 1471-1489. [Google Scholar] [CrossRef
[9] Ye, J.J., Zhu, D.L. and Zhu, Q.J. (1997) Exact Penalization and Necessary Optimality Conditions for Generalized Bilevel Programming Problems. SIAM Journal on Optimization, 7, 481-507. [Google Scholar] [CrossRef
[10] Scheel, H. and Scholtes, S. (2000) Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity. Mathematics of Operations Research, 25, 1-22. [Google Scholar] [CrossRef
[11] Ye, J.J. and Zhang, J. (2014) Enhanced Karush-Kuhn-Tucker Conditions for Mathematical Programs with Equilibrium Constraints. Journal of Optimization Theory and Applications, 163, 777-794. [Google Scholar] [CrossRef
[12] Liu, X., Perakis, G. and Sun, J. (2006) A Robust SQP Method for Mathematical Programs with Linear Complementarity Constraints. Computational Optimization and Applications, 34, 5-33. [Google Scholar] [CrossRef
[13] Lampariello, L. and Sagratella, S. (2020) Numerically Tractable Optimistic Bilevel Problems. Computational Optimization and Applications, 76, 277-303. [Google Scholar] [CrossRef
[14] Dempe, S., Dinh, N., Dutta, J. and Pandit, T. (2021) Simple Bilevel Programming and Extensions. Mathematical Programming, 188, 227-253. [Google Scholar] [CrossRef
[15] Outrata, J.V. (1990) On the Numerical Solution of a Class of Stackelberg Problems. Zeitschrift fur Operations Research, 34, 255-277.
[16] Ye, J.J. and Zhu, D.L. (1995) Optimality Conditions for Bilevel Programming Problems. Optimization, 33, 9-27. [Google Scholar] [CrossRef
[17] Lin, G., Xu, M. and Ye, J.J. (2014) On Solving Simple Bilevel Programs with a Nonconvex Lower Level Program. Mathematical Programming, 144, 277-305. [Google Scholar] [CrossRef
[18] Sun, D. and Qi, L. (1999) On NCP-Functions. Computational Optimization and Applications, 13, 201-220. [Google Scholar] [CrossRef
[19] Fischer, A., Zemkoho, A.B. and Zhou, S. (2022) Semismooth Newton-Type Method for Bilevel Optimization: Global Convergence and Extensive Numerical Experiments. Optimization Methods and Software, 37, 1770-1804. [Google Scholar] [CrossRef
[20] Jolaoso, L.O., Mehlitz, P. and Zemkoho, A.B. (2024) A Fresh Look at Nonsmooth Levenberg-Marquardt Methods with Applications to Bilevel Optimization. Optimization, 2024, 1-48. [Google Scholar] [CrossRef
[21] Rockafellar, R.T. and Wets, R.J-B. (1998) Variational Analysis. Springer.
[22] Liu, X.W. and Dai, Y.H. (2020) A Globally Convergent Primal-Dual Interior-Point Relaxation Method for Nonlinear Programs. Mathematics of Computation, 89, 1301-1329. [Google Scholar] [CrossRef
[23] Liu, X.W., Dai, Y.H. and Huang, Y.K. (2022) A Primal-Dual Interior-Point Relaxation Method with Global and Rapidly Local Convergence for Nonlinear Programs. Mathematical Methods of Operations Research, 96, 351-382. [Google Scholar] [CrossRef
[24] Fliege, J., Tin, A. and Zemkoho, A. (2021) Gauss-Newton-Type Methods for Bilevel Optimization. Computational Optimization and Applications, 78, 793-824. [Google Scholar] [CrossRef
[25] Tin, A. and Zemkoho, A.B. (2023) Levenberg-Marquardt Method and Partial Exact Penalty Parameter Selection in Bilevel Optimization. Optimization and Engineering, 24, 1343-1385. [Google Scholar] [CrossRef
[26] 唐江花. 求解非线性方程组的信赖域算法[J]. 吉林化工学院学报, 2021, 38(5): 85-89.
[27] Vater, N. and Borzì, A. (2025) Convergence of a Quasi-Newton Method for Solving Systems of Nonlinear Underdetermined Equations. Computational Optimization and Applications, 91, 973-996. [Google Scholar] [CrossRef
[28] Zhou, S.L., Zemkoho, A.B. and Tin, A. (2020) BOLIB: Bilevel Optimization Library of Test Problems. In: Springer Optimization and Its Applications, Springer, 563-580. [Google Scholar] [CrossRef
[29] Dolan, E.D. and Moré, J.J. (2002) Benchmarking Optimization Software with Performance Profiles. Mathematical Programming, 91, 201-213. [Google Scholar] [CrossRef
[30] Fliege, J., Tin, A. and Zemkoho, A.B. (2020) Supplementary Material for Gauss-Newton-Type Methods for Bilevel Optimization. School of Mathematical Sciences, University of Southampton.