# A Framework for Machine Learning of Model Error in Dynamical Systems

@article{Levine2021AFF, title={A Framework for Machine Learning of Model Error in Dynamical Systems}, author={Matthew E. Levine and Andrew M. Stuart}, journal={ArXiv}, year={2021}, volume={abs/2107.06658} }

The development of data-informed predictive models for dynamical systems is of widespread interest in many disciplines. We present a unifying framework for blending mechanistic and machine-learning approaches to identify dynamical systems from noisily and partially observed data. We compare pure data-driven learning with hybrid models which incorporate imperfect domain knowledge, referring to the discrepancy between an assumed truth model and the imperfect mechanistic model as model error. Our…

## Figures from this paper

## 7 Citations

### Closed-form discovery of structural errors in models of chaotic systems by integrating Bayesian sparse regression and data assimilation

- PhysicsArXiv
- 2021

This work introduces a framework named MEDIDA: Model Error Discovery with Interpretability and Data Assimilation, and demonstrates the excellent performance of MEDIDA in discovering different types of structural/parametric model errors, representing different type of missing physics, using noise-free and noisy observations.

### Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case.

- Computer ScienceChaos
- 2022

This work introduces a framework named MEDIDA: Model Error Discovery with Interpretability and Data Assimilation, and demonstrates the excellent performance of MEDIDA in discovering different types of structural/parametric model errors, representing different type of missing physics, using noise-free and noisy observations.

### Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effects

- Computer Science
- 2022

This work introduces a discrepancy modeling framework to resolve deterministic model-measurement mismatch with two distinct approaches: (i) by learning a model for the evolution of systematic state-space residual, and (ii) by discovering a models for the missing deterministic physics.

### Learning to Control an Unstable System with One Minute of Data: Leveraging Gaussian Process Differentiation in Predictive Control

- Computer Science2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- 2021

This work shows how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized approximation of the true continuous dynamics that can be integrated with model predictive control.

### Enhancing geophysical flow machine learning performance via scale separation

- Environmental ScienceNonlinear Processes in Geophysics
- 2021

Abstract. Recent advances in statistical and machine learning have opened the possibility of forecasting the behaviour of chaotic systems using recurrent neural networks. In this article we…

### Robust Hybrid Learning With Expert Augmentation

- Computer ScienceArXiv
- 2022

It is shown why expert augmentation improves generalization and the practical benefits of augmented hybrid models on a set of controlled experiments, modelling dynamical systems described by ordinary and partial differential equations.

### Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations

- Computer ScienceChaos
- 2021

It is shown that the combination of random feature maps and data assimilation, called RAFDA, outperforms standardrandom feature maps for which the dynamics is learned using batch data.

### Quantum Mechanics for Closure of Dynamical Systems

- Physics
- 2022

. We propose a scheme for data-driven parameterization of unresolved dimensions of dynamical systems based on the mathematical framework of quantum mechanics and Koopman operator theory. Given a…

### A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic

- Computer ScienceArXiv
- 2022

A survey of ML applications in SD&V analyses, shedding light on the current state of implementation and emerging opportunities and considers the role of Digital Twins and Physics Guided ML to overcome current challenges and power future research progress.

### Ensemble‐Based Experimental Design for Targeting Data Acquisition to Inform Climate Models

- Environmental ScienceJournal of Advances in Modeling Earth Systems
- 2022

A new ensemble-based parallel algorithm to automatically target data acquisition to regions and times that maximize the uncertainty reduction, or information gain, about GCM parameters, is constructed.

## References

SHOWING 1-10 OF 184 REFERENCES

### Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems

- Computer Science
- 2018

This work puts forth a machine learning approach for identifying nonlinear dynamical systems from data that combines classical tools from numerical analysis with powerful nonlinear function approximators to distill the mechanisms that govern the evolution of a given data-set.

### Machine Learning for Prediction with Missing Dynamics

- Computer ScienceJ. Comput. Phys.
- 2021

### Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model

- Computer ScienceChaos
- 2018

A general method is proposed that leverages the advantages of these two approaches by combining a knowledge-based model and a machine learning technique to build a hybrid forecasting scheme, and is able to accurately predict for a much longer period of time than either its machine-learning component or its model-based component alone.

### Learning Latent Dynamics for Partially-Observed Chaotic Systems

- Computer ScienceChaos
- 2020

This paper introduces a framework based on the data-driven identification of an augmented state-space model using a neural-network-based representation for dynamical systems for which some components are never observed, with an emphasis on forecasting applications and long-term asymptotic patterns.

### Augmenting physical models with deep networks for complex dynamics forecasting

- Computer ScienceICLR
- 2021

The APHYNITY framework is introduced, a principled approach for augmenting incomplete physical dynamics described by differential equations with deep data-driven models and can efficiently leverage approximate physical models to accurately forecast the evolution of the system and correctly identify relevant physical parameters.

### Machine-learning error models for approximate solutions to parameterized systems of nonlinear equations

- Computer ScienceComputer Methods in Applied Mechanics and Engineering
- 2019

### Applying Machine Learning to Improve Simulations of a Chaotic Dynamical System Using Empirical Error Correction

- Environmental ScienceJournal of advances in modeling earth systems
- 2019

A framework using machine learning together with physically‐derived models is tested, and it is shown that the approach yields models that are stable and that give both improved skill in initialized predictions and better long‐term climate statistics.

### Systems biology informed deep learning for inferring parameters and hidden dynamics

- Computer SciencebioRxiv
- 2019

This work has developed a new systems-biology-informed deep learning algorithm that incorporates the system of ordinary differential equations into the neural networks and effectively add constraints to the optimization algorithm, which makes the method robust to noisy and sparse measurements.

### EM-like Learning Chaotic Dynamics from Noisy and Partial Observations

- Computer ScienceArXiv
- 2019

Through numerical experiments, the ability of the proposed schemes to recover and reproduce the hidden chaotic dynamics, including their Lyapunov characteristic exponents, when classic machine learning approaches fail is demonstrated.

### Modeling of missing dynamical systems: deriving parametric models using a nonparametric framework

- Computer Science
- 2019

This paper considers modeling missing dynamics with a nonparametric non-Markovian model, constructed using the theory of kernel embedding of conditional distributions on appropriate reproducing kernel Hilbert spaces (RKHS), equipped with orthonormal basis functions, and shows that the success of various parametric modeling approaches that were proposed in various domains of applications can be understood through the RKHS representations.