自适应损失平衡物理信息神经网络算法求解几类偏微分方程的数值解
Self-Adaptive Loss Balanced Physics Informed Neural Networks Algorithmfor Solving Numerical Solutions of Several Classes of Partial Differential Equations
摘要: 物理信息神经网络(PINN)作为将物理定律与深度学习相结合的新型计算方法,受到广泛关注。物理信息神经网络的应用已初显成效,但如何提高其有限的精度仍是PINN面临的重大挑战。自适应损失平衡物理信息神经网络(lbPINN)通过建立高斯概率模型,为每个损失项设置自适应权重来定义自适应损失函数,解决了传统物理信息神经网络在求解偏微分方程时面临的损失函数权重分配难题。本研究通过应用PINN和lbPINN两种算法系统求解一维热传导方程、二维泊松方程、一维线性对流方程及一维电报方程,数值实验表明lbPINN相比于经典的PINN表现出更优的性能,相对L2误差有不同程度的降低,证实了lbPINN在求解这几类偏微分方程中表现出更高的精确度和有效性。
Abstract: Physics-Informed Neural Networks (PINN), as a novel computational method integrating physical laws with deep learning, have garnered widespread attention. While PINN have demonstrated initial successes in applications, improving their limited accuracy remains a significant challenge. The Self-adaptive Loss Balanced Physics-Informed Neural Networks (lbPINN) addresses the difficulty of loss function weight allocation in solving partial differential equations faced by traditional PINN by establishing a Gaussian probability model and assigning adaptive weights to each loss term, thereby defining an adaptive loss function. In this study, both PINN and lbPINN algorithms were systematically applied to solve the one-dimensional heat equation, and one-dimensional telegraph equation. Numerical experiments show that, compared to the classical PINN, lbPINN exhibits superior performance, with varying degrees of reduction in relative L2 errors. This confirms that lbPINN demonstrates higher accuracy and effectiveness in solving these classes of partial differential equations.
文章引用:胡家强, 白通拉嘎. 自适应损失平衡物理信息神经网络算法求解几类偏微分方程的数值解[J]. 应用数学进展, 2026, 15(5): 484-499. https://doi.org/10.12677/aam.2026.155245

参考文献

[1] Avalos, G. and Triggiani, R. (2013) Rational Decay Rates for a PDE Heat-Structure Interaction: Afrequency Domain Approach. Evolution Equations and Control Theory, 2, 233-253. [Google Scholar] [CrossRef
[2] Ostashev, V.E., Wilson, D.K., Liu, L., Aldridge, D.F., Symons, N.P. and Marlin, D. (2005) Equations for Finite-Difference, Time-Domain Simulation of Sound Propagation in Moving Inhomogeneous Media and Numerical Implementation. The Journal of the Acoustical Society of America, 117, 503-517. [Google Scholar] [CrossRef] [PubMed]
[3] Zhang, S., Gu, W., Zhang, X., Lu, H., Yu, R., Qiu, H., et al. (2023) Dynamic Modeling and Simulation of Integrated Electricity and Gas Systems. IEEE Transactions on Smart Grid, 14, 1011-1026. [Google Scholar] [CrossRef
[4] Abdulla, S.O., Abdulazeez, S.T. and Modanli, M. (2023) Comparison of Third-Order Fractional Partial Differential Equation Based on the Fractional Operators Using the Explicit Finite Difference Method. Alexandria Engineering Journal, 70, 37-44. [Google Scholar] [CrossRef
[5] Taha Abdulazeez, S. and Modanli, M. (2022) Solutions of Fractional Order Pseudo-Hyperbolic Telegraph Partial Differential Equations Using Finite Difference Method. Alexandria Engineering Journal, 61, 12443-12451. [Google Scholar] [CrossRef
[6] Chung, M., Krueger, J. and Liu, H. (2023) Least-Squares Finite Element Method for Ordinary Differential Equations. Journal of Computational and Applied Mathematics, 418, Article 114660. [Google Scholar] [CrossRef
[7] Wei, Y., Zhao, Y., Shi, Z., Wang, F. and Tang, Y. (2018) Spatial High Accuracy Analysis of FEM for Two-Dimensional Multi-Term Time-Fractional Diffusion-Wave Equations. Acta Mathematicae Applicatae Sinica, English Series, 34, 828-841. [Google Scholar] [CrossRef
[8] Baker, N.A., Alexander, F., Bremer, T., et al. (2019) Workshop Report on Basic Research Needs for Scientific Machine Learning: Core Technologies for Artificial Intelligence. USDOE Office of Science (SC), Washington, DC (United States). [Google Scholar] [CrossRef
[9] Baydin A.G., Pearlmutter, B.A., Radul, A.A., et al. (2018) Automatic Differentiation in Machine Learning: A Survey. Journal of Machine Learning Research, 18, 1-43.
[10] 张海斌, 薛毅. 自动微分的基本思想与实现[J]. 北京工业大学学报, 2005, 31(3): 332-336.
[11] Hornik, K., Stinchcombe, M. and White, H. (1989) Multilayer Feedforward Networks Are Universal Approximators. Neural Networks, 2, 359-366. [Google Scholar] [CrossRef
[12] Raissi, M., Perdikaris, P. and Karniadakis, G.E. (2019) Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. Journal of Computational Physics, 378, 686-707. [Google Scholar] [CrossRef
[13] Wang, L. and Yan, Z. (2021) Data-Driven Rogue Waves and Parameter Discovery in the Defocusing Nonlinear Schrödinger Equation with a Potential Using the PINN Deep Learning. Physics Letters A, 404, Article 127408. [Google Scholar] [CrossRef
[14] Yu, J., Lu, L., Meng, X. and Karniadakis, G.E. (2022) Gradient-Enhanced Physics-Informed Neural Networks for Forward and Inverse PDE Problems. Computer Methods in Applied Mechanics and Engineering, 393, Article 114823. [Google Scholar] [CrossRef
[15] D. Jagtap, A. and Em Karniadakis, G. (2020) Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations. Communications in Computational Physics, 28, 2002-2041. [Google Scholar] [CrossRef
[16] Wang, H., Lu, L., Song, S. and Huang, G. (2023) Learning Specialized Activation Functions for Physics-Informed Neural Networks. Communications in Computational Physics, 34, 869-906. [Google Scholar] [CrossRef
[17] Jagtap, A.D., Shin, Y., Kawaguchi, K. and Karniadakis, G.E. (2022) Deep Kronecker Neural Networks: A General Framework for Neural Networks with Adaptive Activation Functions. Neurocomputing, 468, 165-180. [Google Scholar] [CrossRef
[18] Lu, L., Meng, X., Mao, Z. and Karniadakis, G.E. (2021) DeepXDE: A Deep Learning Library for Solving Differential Equations. SIAM Review, 63, 208-228. [Google Scholar] [CrossRef
[19] Xiang, Z., Peng, W., Liu, X. and Yao, W. (2022) Self-Adaptive Loss Balanced Physics-Informed Neural Networks. Neurocomputing, 496, 11-34. [Google Scholar] [CrossRef
[20] 张焕, 张庆, 于纪言. 激活函数的发展综述及其性质分析[J]. 西华大学学报(自然科学版), 2021, 40(4): 1-10.
[21] Jagtap, A.D., Kawaguchi, K. and Karniadakis, G.E. (2020) Adaptive Activation Functions Accelerate Convergence in Deep and Physics-Informed Neural Networks. Journal of Computational Physics, 404, Article 109136. [Google Scholar] [CrossRef
[22] 史加荣, 王丹, 尚凡华, 张鹤于. 随机梯度下降算法研究进展[J]. 自动化学报, 2021, 47(9): 2103-2119.
[23] 董文静, 赵月爱. 基于卷积网络的Adam算法的改进[J]. 太原师范学院学报(自然科学版), 2023, 22(3): 5-12.
[24] 赵睿颖. 用于深度学习的一种改进L-BFGS算法[J]. 首都师范大学学报(自然科学版), 2021, 42(5): 8-14.
[25] Cipolla, R., Gal, Y. and Kendall, A. (2018) Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 7482-7491. [Google Scholar] [CrossRef