# Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations

@article{Arbabi2020LinkingML, title={Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations}, author={Hassan Arbabi and J. E. Bunder and Giovanni Samaey and Anthony J. Roberts and Ioannis G. Kevrekidis}, journal={ArXiv}, year={2020}, volume={abs/2008.11276} }

The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential operators requires extensive spatiotemporal data. For learning coarse-scale PDEs from computational fine-scale simulation data, the training data collection process can be prohibitively expensive. We propose to transformatively facilitate this training data… Expand

#### 11 Citations

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

- Mathematics, Computer Science
- ArXiv
- 2021

This work proposes a novel PINN scheme that solves the PDE sequentially over successive time segments using a single neural network while satisfying the already obtained solution for all previous time segments, and uses the Cahn Hilliard and Allen Cahn equations to illustrate the advantages. Expand

Coarse-grained and Emergent Distributed Parameter Systems from Data

- Computer Science, Mathematics
- 2021 American Control Conference (ACC)
- 2021

This work explores the derivation of distributed parameter system evolution laws (and in particular, partial differential operators and associated partial differential equations, PDEs) from spatiotemporal data through the use of manifold learning techniques in conjunction with neural network learning algorithms. Expand

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

- Physics
- Journal of Computational Physics
- 2021

In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in a multiscale tissue. The classical… Expand

Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients

- Mathematics, Computer Science
- Computer Methods in Applied Mechanics and Engineering
- 2021

It is shown that a feedforward neural network with a single hidden layer with sigmoidal functions and fixed, random, internal weights and biases can be used to compute accurately a collocation solution, thus avoiding the time-consuming training phase. Expand

Global and local reduced models for interacting, heterogeneous agents.

- Physics, Medicine
- Chaos
- 2021

A data-driven coarse-graining methodology for discovering reduced models of coupled, heterogeneous agents that can be equally well reproduced by an all-to-all coupled and by a locally coupled model of the same agents. Expand

Non-intrusive reduced-order models for parametric partial differential equations via data-driven operator inference

- Computer Science, Mathematics
- ArXiv
- 2021

This work formulates a new approach to reduced modeling of parameterized, timedependent partial differential equations (PDEs) using Operator Inference, a scientific machine learning framework combining data-driven learning and physics-based modeling that can be solved rapidly to map parameter values to approximate PDE solutions. Expand

On the Correspondence between Gaussian Processes and Geometric Harmonics

- Computer Science, Mathematics
- ArXiv
- 2021

The correspondence between Gaussian process regression and Geometric Harmonics is discussed, providing alternative interpretations of uncertainty in terms of error estimation, or leading towards accelerated Bayesian Optimization due to dimensionality reduction. Expand

Operator Compression with Deep Neural Networks

- Computer Science, Mathematics
- ArXiv
- 2021

This paper proposes to directly approximate the coefficient-to-surrogate map with a neural network to enable large compression ratios and the online computation of a surrogate based on simple forward passes through the network is substantially accelerated compared to classical numerical upscaling approaches. Expand

Physics-informed machine learning

- 2021

Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into… Expand

Physics-informed machine learning

- 2021

| Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into… Expand

#### References

SHOWING 1-10 OF 57 REFERENCES

Coarse-scale PDEs from fine-scale observations via machine learning

- Computer Science, Mathematics
- Chaos
- 2020

A data-driven framework for the identification of unavailable coarse-scale PDEs from microscopic observations via machine-learning algorithms using Gaussian processes, artificial neural networks, and/or diffusion maps is introduced. Expand

Learning data-driven discretizations for partial differential equations

- Medicine, Mathematics
- Proceedings of the National Academy of Sciences
- 2019

Data-driven discretization is proposed, a method for learning optimized approximations to PDEs based on actual solutions to the known underlying equations that uses neural networks to estimate spatial derivatives. Expand

Data-driven discovery of partial differential equations

- Medicine, Computer Science
- Science Advances
- 2017

The sparse regression method is computationally efficient, robust, and demonstrated to work on a variety of canonical problems spanning a number of scientific domains including Navier-Stokes, the quantum harmonic oscillator, and the diffusion equation. Expand

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

- Computer Science
- J. Comput. Phys.
- 2019

Abstract We introduce physics-informed neural networks – neural networks that are trained to solve supervised learning tasks while respecting any given laws of physics described by general nonlinear… Expand

An Emergent Space for Distributed Data With Hidden Internal Order Through Manifold Learning

- Computer Science, Medicine
- IEEE Access
- 2018

This work validates this “emergent space” reconstruction for time series sampled without space labels in known PDEs, and discusses how data-driven “spatial” coordinates can be extracted in ways invariant to the nature of the measuring instrument. Expand

Hidden physics models: Machine learning of nonlinear partial differential equations

- Computer Science, Mathematics
- J. Comput. Phys.
- 2018

Abstract While there is currently a lot of enthusiasm about “big data”, useful data is usually “small” and expensive to acquire. In this paper, we present a new paradigm of learning partial… Expand

Variational system identification of the partial differential equations governing the physics of pattern-formation: Inference under varying fidelity and noise

- Physics
- Computer Methods in Applied Mechanics and Engineering
- 2019

Abstract We present a contribution to the field of system identification of partial differential equations (PDEs), with emphasis on discerning between competing mathematical models of pattern-forming… Expand

Emergent Spaces for Coupled Oscillators

- Physics, Computer Science
- Frontiers in Computational Neuroscience
- 2020

A systematic, data-driven approach to discovering “bespoke” coarse variables based on manifold learning algorithms and an extension of the coarse-graining methodology which enables us to learn evolution equations for the discovered coarse variables via an artificial neural network architecture templated on numerical time integrators (initial value solvers). Expand

Variational Physics-Informed Neural Networks For Solving Partial Differential Equations

- Computer Science, Mathematics
- ArXiv
- 2019

A Petrov-Galerkin version of PINNs based on the nonlinear approximation of deep neural networks (DNNs) by incorporating the variational form of the problem into the loss function of the network and constructing a VPINN, effectively reducing the training cost in VPINNs while increasing their accuracy compared to PINNs that essentially employ delta test functions. Expand

Equation-Free, Coarse-Grained Multiscale Computation: Enabling Mocroscopic Simulators to Perform System-Level Analysis

- Mathematics
- 2003

We present and discuss a framework for computer-aided multiscale analysis, which enables models at a fine (microscopic/stochastic) level of description to perform modeling tasks at a coarse… Expand