Finite Difference Neural Networks: Fast Prediction of Partial Differential Equations

  title={Finite Difference Neural Networks: Fast Prediction of Partial Differential Equations},
  author={Zheng Shi and Nur Sila Gulgec and Albert S. Berahas and Shamim N. Pakzad and Martin Tak{\'a}c},
  journal={2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA)},
  • Zheng Shi, Nur Sila Gulgec, M. Takác
  • Published 2 June 2020
  • Computer Science, Mathematics
  • 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA)
Discovering the underlying behavior of complex systems is an important topic in many science and engineering disciplines. In this paper, we propose a novel neural network framework, finite difference neural networks (FD-Net), to learn partial differential equations from data. Specifically, our proposed finite difference inspired network is designed to learn the underlying governing partial differential equations from trajectory data, and to iteratively estimate the future dynamical behavior… 
Learning time-dependent PDE solver using Message Passing Graph Neural Networks
A discretization and domain invariant neural network time-dependent PDE solver based on message passing graph neural nets (MPGNN) which is trained on a sample domain with different discretizations, although the underlying physics remains to be the same.
Accelerated Training of Physics Informed Neural Networks (PINNs) using Meshless Discretizations
This work presents a new technique for the accelerated training of PINNs that combines modern scientific computing techniques with machine learning: discretely-trained PINNs (DT-PINNs), and shows that fp64 DT- PINNs offer a superior cost-accuracy profloating-point to fp32 vanilla-pinNs, opening the door to a new paradigm of leveraging scienti fiC computing techniques to support machine learning.


Learning partial differential equations via data discovery and sparse optimization
  • H. Schaeffer
  • Computer Science
    Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
  • 2017
This work develops a learning algorithm to identify the terms in the underlying partial differential equations and to approximate the coefficients of the terms only using data, which uses sparse optimization in order to perform feature selection and parameter estimation.
Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial
Neural Ordinary Differential Equations
This work shows how to scalably backpropagate through any ODE solver, without access to its internal operations, which allows end-to-end training of ODEs within larger models.
Data-driven discovery of partial differential equations
The sparse regression method is computationally efficient, robust, and demonstrated to work on a variety of canonical problems spanning a number of scientific domains including Navier-Stokes, the quantum harmonic oscillator, and the diffusion equation.
PDE-Net: Learning PDEs from Data
Numerical experiments show that the PDE-Net has the potential to uncover the hidden PDE of the observed dynamics, and predict the dynamical behavior for a relatively long time, even in a noisy environment.
Deep Learning the Physics of Transport Phenomena
We have developed a new data-driven paradigm for the rapid inference, modeling and simulation of the physics of transport phenomena by deep learning. Using conditional generative adversarial networks
Automated reverse engineering of nonlinear dynamical systems
This work introduces for the first time a method that can automatically generate symbolic equations for a nonlinear coupled dynamical system directly from time series data, applicable to any system that can be described using sets of ordinary nonlinear differential equations.
Numerical solution of partial differential equations
Numerical solution of PDEs is rich and active field of modern applied mathematics. The steady growth of the subject is stimulated by everincreasing demands from the natural sciences, engineering and