Gradient-optimized physics-informed neural networks (GOPINNs): a deep learning method for solving the complex modified KdV equation

被引:59
作者
Li, Jiaheng [1 ]
Chen, Junchao [2 ,3 ]
Li, Biao [1 ]
机构
[1] Ningbo Univ, Sch Math & Stat, Ningbo 315211, Peoples R China
[2] Lishui Univ, Dept Math, Lishui 323000, Peoples R China
[3] Lishui Univ, Inst Nonlinear Anal, Lishui 323000, Peoples R China
基金
中国国家自然科学基金;
关键词
Physics-informed neural networks; Gradient optimization; Complex modified KdV equation; Rational wave solution; Soliton molecules solution; MODELS;
D O I
10.1007/s11071-021-06996-x
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Recently, the physics-informed neural networks (PINNs) have received more and more attention because of their ability to solve nonlinear partial differential equations via only a small amount of data to quickly obtain data-driven solutions with high accuracy. However, despite their remarkable promise in the early stage, their unbalanced back-propagation gradient calculation leads to drastic oscillations in the gradient value during model training, which is prone to unstable prediction accuracy. Based on this, we develop a gradient optimization algorithm, which proposes a new neural network structure and balances the interaction between different terms in the loss function during model training by means of gradient statistics, so that the newly proposed network architecture is more robust to gradient fluctuations. In this paper, we take the complex modified KdV equation as an example and use the gradient-optimized PINNs (GOPINNs) deep learning method to obtain data-driven rational wave solution and soliton molecules solution. Numerical results show that the GOPINNs method effectively smooths the gradient fluctuations and reproduces the dynamic behavior of these data-driven solutions better than the original PINNs method. In summary, our work provides new insights for optimizing the learning performance of neural networks and improves the prediction accuracy by a factor of 10 to 30 when solving the complex modified KdV equation.
引用
收藏
页码:781 / 792
页数:12
相关论文
共 39 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning
    Alipanahi, Babak
    Delong, Andrew
    Weirauch, Matthew T.
    Frey, Brendan J.
    [J]. NATURE BIOTECHNOLOGY, 2015, 33 (08) : 831 - +
  • [3] [Anonymous], 2018, ARXIV180804327
  • [4] Solving Huxley equation using an improved PINN method
    Bai, Yuexing
    Chaolu, Temuer
    Bilige, Sudao
    [J]. NONLINEAR DYNAMICS, 2021, 105 (04) : 3439 - 3450
  • [5] Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations
    E, Weinan
    Han, Jiequn
    Jentzen, Arnulf
    [J]. COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2017, 5 (04) : 349 - 380
  • [6] Data-driven femtosecond optical soliton excitations and parameters discovery of the high-order NLSE using the PINN
    Fang, Yin
    Wu, Gang-Zhou
    Wang, Yue-Yue
    Dai, Chao-Qing
    [J]. NONLINEAR DYNAMICS, 2021, 105 (01) : 603 - 616
  • [7] Glorot X, 2010, P 13 INT C ARTIFICIA, P249
  • [8] Solving high-dimensional partial differential equations using deep learning
    Han, Jiequn
    Jentzen, Arnulf
    Weinan, E.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2018, 115 (34) : 8505 - 8510
  • [9] Few-cycle optical rogue waves: Complex modified Korteweg-de Vries equation
    He, Jingsong
    Wang, Lihong
    Li, Linjing
    Porsezian, K.
    Erdelyi, R.
    [J]. PHYSICAL REVIEW E, 2014, 89 (06):
  • [10] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778