Kernel-based prediction of non-Markovian time series

@article{Gilani2021KernelbasedPO,
  title={Kernel-based prediction of non-Markovian time series},
  author={Faheem Gilani and Dimitrios Giannakis and John Harlim},
  journal={Physica D: Nonlinear Phenomena},
  year={2021},
  volume={418},
  pages={132829}
}

Figures and Tables from this paper

Manifold-based time series forecasting

TLDR
The proposed procedure combines manifold denoising techniques with a simple nonparametric prediction by local averaging and demonstrates a very reasonable performance for real-life econometric time series.

Memory-Based Reduced Modelling and Data-Based Estimation of Opinion Spreading

TLDR
It is demonstrated that the inclusion of memory terms significantly improves the prediction quality on examples with different network topologies, and it is shown how to estimate a nonlinear autoregressive model (NAR) with memory from data given by a time series of opinion percentages.

Nonequilibrium Statistical Mechanics of Optimally Predicting Partially Observed Complex Systems

Only a subset of degrees of freedom are typically accessible or measurable in real-world systems. As a consequence, the proper setting for empirical modeling is that of partially-observed systems.

Nonequilibrium Statistical Mechanics and Optimal Prediction of Partially-Observed Complex Systems

TLDR
This framework provides a unified implicit-explicit modeling framework for predicting partially-observed systems, with hybrid physics-informed machine learning methods combining implicit and explicit aspects.

A Data-Driven Statistical-Stochastic Model for Effective Ensemble Forecast of Complex Turbulent Systems

TLDR
A system of statistical-stochastic equations to predict the response of the mean and variance statistics under perturbations of the initial condition and external forcing is proposed and extended to a semi-parametric parameterization with a residual Long-Short-Term-Memory neural network architecture.

Learning Stochastic Dynamics with Statistics-Informed Neural Network

TLDR
Numerical simulation results demonstrate that a well-trained SINN can reliably approximate both Markovian and non-Markovian stochastic dynamics, and shows that the obtained reduced-order model can be trained on temporally coarse-grained data and hence is well suited for rare-event simulations.

Ensemble forecasts in reproducing kernel Hilbert space family: dynamical systems in Wonderland

A methodological framework for ensemble-based estimation and simulation of high dimensional dynamical systems such as the oceanic or atmospheric flows is proposed. To that end, the dynamical system

Machine learning-based statistical closure models for turbulent dynamical systems

  • D. QiJ. Harlim
  • Computer Science
    Philosophical Transactions of the Royal Society A
  • 2022
TLDR
Numerically, it is shown that the ML closure model can accurately predict the long-time statistical responses subjected to various time-dependent external forces that have larger maximum forcing amplitudes and are not in the training dataset.

Data-driven modelling of nonlinear dynamics by polytope projections and memory

We present a numerical method to model dynamical systems from data. We use the recently introduced method Scalable Probabilistic Approximation (SPA) to project points from a Euclidean space to convex

Data-driven modelling of nonlinear dynamics by barycentric coordinates and memory

We present a numerical method to model dynamical systems from data. We use the recently introduced method Scalable Probabilistic Approximation (SPA) to project points from a Euclidean space to convex

References

SHOWING 1-10 OF 61 REFERENCES

Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniques

Analog Forecasting with Dynamics-Adapted Kernels

TLDR
A suite of forecasting methods which improve traditional analog forecasting by combining ideas from kernel methods developed in harmonic analysis and machine learning and state-space reconstruction for dynamical systems are introduced.

Modeling of missing dynamical systems: deriving parametric models using a nonparametric framework

TLDR
This paper considers modeling missing dynamics with a nonparametric non-Markovian model, constructed using the theory of kernel embedding of conditional distributions on appropriate reproducing kernel Hilbert spaces (RKHS), equipped with orthonormal basis functions, and shows that the success of various parametric modeling approaches that were proposed in various domains of applications can be understood through the RKHS representations.

Machine Learning for Prediction with Missing Dynamics

Data-driven spectral decomposition and forecasting of ergodic dynamical systems

  • D. Giannakis
  • Mathematics
    Applied and Computational Harmonic Analysis
  • 2019

Kernel Analog Forecasting: Multiscale Test Problems

TLDR
Kernel analog forecasting methods are studied from the perspective of data generated by multiscale dynamical systems to provide guidance for the interpretation of data-driven prediction methods when used in practice.

Optimal prediction with memory

Data-Driven Discovery of Closure Models

TLDR
This work presents a framework of operator inference to extract the governing dynamics of closure from data in a compact, non-Markovian form and examines observability of the closure in terms of the resolved dynamics.

A priori estimation of memory effects in reduced-order models of nonlinear systems using the Mori–Zwanzig formalism

TLDR
A method to estimate the memory kernel a priori, using full-order solution snapshots, and results on the Burgers and Kuramoto–Sivashinsky equations demonstrate that the proposed technique can provide valuable information about the memory Kernel.

Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism

...