基于梯度增强物理信息神经网络的一维弱噪声随机Burgers方程求解
Solution of One-Dimensional Stochastic Burgers Equation by Gradient-Enhanced Physics-Informed Neural Networks with Weak Noise
DOI: 10.12677/pm.2024.146261, PDF,   
作者: 王 蓉, 刘宏业:上海理工大学光电信息与计算机工程学院,上海
关键词: PINNs梯度增强Burgers方程弱噪声精度PINNS Gradient-Enhanced Burgers Equation Weak-Noise Accuracy
摘要: 物理信息神经网络PINNs (Physics-Informed Neural Networks, PINNs)因其良好的可解释性和泛化能力,被当作求解偏微分方程的一类通用逼近器。传统PINNs通过在损失函数中引入方程残差,将方程所携带的物理先验信息编译至网络中,但在求解实际问题时往往需要数量足够大的训练数据集,其输出才具有较好的网络表现力和求解精度。针对一维弱噪声随机Burgers方程,提出梯度增强的物理信息神经网络(Gradient-enhanced Physics-Informed Neural Networks, G-PINNs),采用方程导数的残差作为一种优化的软约束指导网络迭代更新,理论分析PINNs与G-PINNs两种网络架构寻找方程计算域内最优解的能力。改变数据集的噪声比例和配置点数量,评估两种网络架构拟合一维Burgers方程解结构的性能差异。数值算例表明,G-PINNs在无噪声、1%、3%和5%弱噪声下求解一维Burgers方程的精度分别提高了约80%、44%、31%、和20%。相较于传统PINNs,当迭代次数相同时G-PINNs在无噪声与弱噪声的情况下均能在更少的数据集上拟合一维Burgers方程的解结构,获得精度更高的预测解。
Abstract: Physics-Informed Neural Networks (PINNs) are regarded as a general approximator for solving partial differential equations because of their good interpretability and generalization ability. Traditional PINNs compile the physical prior information carried by the equation into the network by introducing the residual of the equation into the loss function. However, when solving practical problems, it often requires a large number of training datasets to achieve better network performance and solution accuracy. For one-dimensional weak noise random Burgers equation, Gradient-enhanced Physics-Informed Neural Networks (G-PINNs) are proposed. The residual of the derivative of the equation is used as an optimization soft constraint to guide the iterative updating of the network. The ability of PINNs and G-PINNs network architectures to find the optimal solution in the computational domain of the equation is analyzed theoretically. The noise ratio and the number of configuration points of the dataset were changed to evaluate the performance difference of the two network architectures in fitting the solution structure of the one-dimensional Burgers equation. Numerical examples show that the accuracy of G-PINNs in solving one-dimensional Burgers equation with no noise, 1%, 3% and 5% weak noise is improved by about 80%, 44%, 31% and 20%, respectively. Compared with traditional PINNs, G-PINNs can fit the solution structure of one-dimensional Burgers equation on fewer datasets with no noise and weak noise, and obtain a more accurate predictive solution with the same number of iterations.
文章引用:王蓉, 刘宏业. 基于梯度增强物理信息神经网络的一维弱噪声随机Burgers方程求解[J]. 理论数学, 2024, 14(6): 426-439. https://doi.org/10.12677/pm.2024.146261

参考文献

[1] Alwehebi, F., Hobiny, A. and Maturi, D. (2023) Variational Iteration Method for Solving Time Fractional Burgers Equation Using Maple. Applied Mathematics, 14, 336-348. [Google Scholar] [CrossRef
[2] Ohkitani, K. and Dowker, M. (2012) Numerical Study on Comparison of Navier-Stokes and Burgers Equations. Physics of Fluids, 24, Article ID: 055113. [Google Scholar] [CrossRef
[3] Sirignano, J. and Spiliopoulos, K. (2018) DGM: A Deep Learning Algorithm for Solving Partial Differential Equations. Journal of Computational Physics, 375, 1339-1364. [Google Scholar] [CrossRef
[4] Xu, H., Zhang, D. and Zeng, J. (2021) Deep-Learning of Parametric Partial Differential Equations from Sparse and Noisy Data. Physics of Fluids, 33, Article ID: 037132. [Google Scholar] [CrossRef
[5] 韩忠华. Kriging模型及代理优化算法研究进展[J]. 航空学报, 2016, 37(11): 3197-3225.
[6] 孙斌, 姚海涛, 刘婷. 基于高斯过程回归的短期风速预测[J]. 中国电机工程学报, 2012, 32(29): 104-109.
[7] Roska, T., Chua, L.O., Wolf, D., Kozek, T., Tetzlaff, R. and Puffer, F. (1995) Simulating Nonlinear Waves and Partial Differential Equations via CNN. I. Basic Techniques. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, 42, 807-815. [Google Scholar] [CrossRef
[8] Long, Z., Lu, Y., Ma, X. and Dong, B. (2018) PDE-Net: Learning PDEs from Data. International Conference on Machine Learning (PMLR), Stockholm, 10-15 July 2018, 3208-3216.
[9] Long, Z., Lu, Y. and Dong, B. (2019) PDE-Net 2.0: Learning PDEs from Data with a numeric-Symbolic Hybrid Deep Network. Journal of Computational Physics, 399, Article ID: 108925. [Google Scholar] [CrossRef
[10] Regazzoni, F., Dede, L. and Quarteroni, A. (2019) Machine Learning for Fast and Reliable Solution of Time-Dependent Differential Equations. Journal of Computational Physics, 397, Article ID: 108852. [Google Scholar] [CrossRef
[11] Schaeffer, H. and McCalla, S.G. (2017) Sparse Model Selection via Integral Terms. Physical Review E, 96, Article ID: 023302. [Google Scholar] [CrossRef
[12] 陈庆强, 王文剑, 姜高霞. 基于数据分布的标签噪声过滤[J]. 清华大学学报(自然科学版), 2019, 59(4): 262-269.
[13] 陈倩, 杨旻, 魏鹏飞. 标签带噪声数据的重加权半监督分类方法[J]. 烟台大学学报(自然科学与工程版), 2019, 32(3): 205-209.
[14] Raissi, M., Perdikaris, P. and Karniadakis, G.E. (2019) Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. Journal of Computational Physics, 378, 686-707. [Google Scholar] [CrossRef
[15] Bai, G., Koley, U., Mishra, S. and Molinaro, R. (2021) Physics Informed Neural Networks (PINNs) for Approximating Nonlinear Dispersive PDEs. [Google Scholar] [CrossRef
[16] 唐明健, 唐和生. 基于物理信息的深度学习求解矩形薄板力学正反问题[J]. 计算力学学报, 2022, 39(1): 120-128.
[17] Cai, S., Mao, Z., Wang, Z., Yin, M. and Karniadakis, G.E. (2021) Physics-Informed Neural Networks (PINNs) for Fluid Mechanics: A Review. Acta Mechanica Sinica, 37, 1727-1738. [Google Scholar] [CrossRef
[18] Rasht‐Behesht, M., Huber, C., Shukla, K. and Karniadakis, G.E. (2022) Physics‐Informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions. Journal of Geophysical Research: Solid Earth, 127, e2021JB023120. [Google Scholar] [CrossRef
[19] Burgers, J.M. (1948) A Mathematical Model Illustrating the Theory of Turbulence. Advances in Applied Mechanics, 1, 171-199. [Google Scholar] [CrossRef
[20] Hopf, E. (1950) The Partial Differential Equation ut + uux = μxx. Communications on Pure and Applied mathematics, 3, 201-230. [Google Scholar] [CrossRef
[21] Meng, X., Yang, L., Mao, Z., Águila Ferrandis, J. and Karniadakis, G.E. (2022) Learning Functional Priors and Posteriors from Data and Physics. Journal of Computational Physics, 457, Article ID: 111073. [Google Scholar] [CrossRef
[22] Vadyala, S.R., Betgeri, S.N. and Betgeri, N.P. (2022) Physics-Informed Neural Network Method for Solving One-Dimensional Advection Equation Using PyTorch. Array, 13, Article ID: 100110. [Google Scholar] [CrossRef
[23] 刘金国, 许开来. 自动微分及其在物理模拟中的应用[J]. 物理学报, 2021, 70(14): 97-107.
[24] 张钰, 刘建伟, 左信. 多任务学习[J]. 计算机学报, 2020, 43(7): 1340-1378.
[25] Knowles, I. and Renka, R.J. (2014) Methods for Numerical Differentiation of Noisy Data. Electronic Journal of Differential Equations, 21, 235-246.
[26] 蒲削锟. 标签噪声下的故障诊断算法研究[D]: [硕士学位论文]. 杭州: 浙江大学, 2023: 27-39.