物理信息编码解码卷积长短期记忆网络求解时变偏微分方程
Physics-Informed Encoder-Decoder Network Based on ConvLSTM for Solving Time-Dependent Partial Differential Equations
DOI: 10.12677/AAM.2024.132069, PDF,    科研立项经费支持
作者: 辛江涛, 贾宏恩, 牛瑞萍*:太原理工大学数学学院,山西 太原
关键词: 卷积转置卷积ConvLSTM物理信息网络有限差分Convolution Transposed Convolution ConvLSTM Physics Informed Network Finite Difference
摘要: 本文基于ConvLSTM,构建了一种编码–解码的物理信息深度学习网络框架(PIED-Net),用于求解含时域的偏微分方程。首先,PIED-Net基于卷积网络提取图像信息中不同层次的空间特征,并使用转置卷积对提取的特征进行表达,实现从图像中学习物理约束的空间信息。为了保证时域信息的连续性,PIED-Net采用ConvLSTM模块,有效地捕捉输入序列的时序关系,提高在预测时间步骤中网络的精度。其次,控制方程、边界和初始条件被用来构建损失函数,并利用有限差分方法来计算各阶导数,进一步提高网络的准确性和稳定性。最后,将所提出的PIED-Net网络框架用来求解2D Burgers方程和2Dflowmixing方程。数值实验结果表明,该网络框架在求解含时域的偏微分方程方面具有出色的精度和运算效率。这为利用深度学习方法解决物理问题提供了一种新的途径。
Abstract: This article presents PIED-Net, a deep learning network framework based on ConvLSTM, for solving time-domain partial differential equations. First, convolutional networks are used to extract spatial features at different levels from image data and transpose convolutions are used to represent these features, enabling the learning of spatial information constrained by physics. ConvLSTM modules are utilized to effectively capture the temporal relationships of neighboring sequences to maintain temporal continuity, and enhance the accuracy of the network in predicting time steps. Besides, governing equations, boundary and initial conditions are employed to construct the loss function, and the finite difference method is employed to calculate derivatives of various orders, further en-hancing the accuracy and stability of the network. Finally, the proposed PIED-Net framework is ap-plied to solve 2D Burgers’ and 2D flow mixing equations, respectively. Numerical experimental re-sults demonstrate that this network framework exhibits outstanding accuracy and computational efficiency in solving time-dependent partial differential equations, presenting a new deep-learning approach for physical problems.
文章引用:辛江涛, 贾宏恩, 牛瑞萍. 物理信息编码解码卷积长短期记忆网络求解时变偏微分方程[J]. 应用数学进展, 2024, 13(2): 714-722. https://doi.org/10.12677/AAM.2024.132069

参考文献

[1] Raissi, M., Perdikaris, P. and Karniadakis, G. (2019) Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. Journal of Computational Physics, 378, 686-707. [Google Scholar] [CrossRef
[2] Zang, Y., Bao, G., Ye, X. and Zhou, H.M. (2020) Weak Adversarial Networks for High-Dimensional Partial Differential Equations. Journal of Computational Physics, 411, Article ID: 109409. [Google Scholar] [CrossRef
[3] Weinan, E. and Yu, B. (2018) The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems. Communica-tions in Mathematics and Statistics, 6, 1-12. [Google Scholar] [CrossRef
[4] Sirignano, J. and Spiliopoulos, K. (2018) DGM: A Deep Learning Algorithm for Solving Partial Differential Equations. Journal of Com-putational Physics, 375, 1339-1364. [Google Scholar] [CrossRef
[5] Lyu, L., Zhang, Z., Chen, M., et al. (2022) MIM: A Deep Mixed Residual Method for Solving High-Order Partial Differential Equations. Journal of Computational Physics, 452, Article ID: 110930. [Google Scholar] [CrossRef
[6] 孙靖威. 基于深度学习求解偏微分方程的研究[D]: [硕士学位论文]. 天津: 天津师范大学, 2023.
[7] 曹瑞, 刘燕斌, 裔扬. 基于物理信息机器学习的复杂系统长时间演化分析[J/OL]. 控制理论与应用: 1-10. http://kns.cnki.net/kcms/detail/44.1240.TP.20230928.0938.072.html, 2024-02-29.
[8] Long, Z., Lu, Y. and Dong, B. (2019) PDE-Net 2.0: Learning PDEs from Data with a Numeric-Symbolic Hybrid Deep Network. Journal of Computa-tional Physics, 399, Article ID: 108925. [Google Scholar] [CrossRef
[9] Mo, S., Zhu, Y., Zabaras, N., et al. (2019) Deep Convolutional Encoder-Decoder Networks for Uncertainty Quantification of Dynamic Multiphase Flow in Heterogeneous Media. Water Resources Research, 55, 703-728. [Google Scholar] [CrossRef
[10] Zhu, Y. and Zabaras, N. (2018) Bayesian Deep Convolutional En-coder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification. Journal of Computational Physics, 366, 415-447. [Google Scholar] [CrossRef
[11] Zhu, Y., Zabaras, N., Koutsourelakis, P.S. and Perdikaris, P. (2019) Physics-Constrained Deep Learning for High Dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data. Journal of Computational Physics, 394, 56-81. [Google Scholar] [CrossRef
[12] Gao, H., Sun, L. and Wang, J.X. (2021) PhyGeoNet: Phys-ics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Ir-regular Domain. Journal of Computational Physics, 428, Article ID: 110079. [Google Scholar] [CrossRef
[13] Geneva, N. and Zabaras, N. (2020) Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks. Journal of Computational Physics, 403, Article ID: 109056. [Google Scholar] [CrossRef
[14] Shi, X., Chen, Z., Wang, H., et al. (2015) Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting. Advances in Neural Information Processing Systems, 28.
[15] Rao, C., Sun, H. and Liu, Y. (2021) Hard Encoding of Physics for Learning Spatiotemporal Dynamics. arXiv: 2105.00557.
[16] Ren, P., Rao, C., Liu, Y., et al. (2022) PhyCRNet: Physics-Informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs. Computer Methods in Applied Mechanics and Engineering, 389, Article ID: 114399. [Google Scholar] [CrossRef
[17] Mavi, A., Bekar, A.C., Haghighat, E. and Madenci, E. (2023) An Unsupervised Latent/Output Physics-Informed Convolutional-LSTM Network for Solving Partial Differential Equations Using Peridynamic Differential Operator. Computer Methods in Applied Mechanics and Engineering, 407, Article ID: 115944. [Google Scholar] [CrossRef