scholarly journals Kernel Embedding Based Variational Approach for Low-Dimensional Approximation of Dynamical Systems

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Wenchong Tian ◽  
Hao Wu

Abstract Transfer operators such as Perron–Frobenius and Koopman operator play a key role in modeling and analysis of complex dynamical systems, which allow linear representations of nonlinear dynamics by transforming the original state variables to feature spaces. However, it remains challenging to identify the optimal low-dimensional feature mappings from data. The variational approach for Markov processes (VAMP) provides a comprehensive framework for the evaluation and optimization of feature mappings based on the variational estimation of modeling errors, but it still suffers from a flawed assumption on the transfer operator and therefore sometimes fails to capture the essential structure of system dynamics. In this paper, we develop a powerful alternative to VAMP, called kernel embedding based variational approach for dynamical systems (KVAD). By using the distance measure of functions in the kernel embedding space, KVAD effectively overcomes theoretical and practical limitations of VAMP. In addition, we develop a data-driven KVAD algorithm for seeking the ideal feature mapping within a subspace spanned by given basis functions, and numerical experiments show that the proposed algorithm can significantly improve the modeling accuracy compared to VAMP.

Author(s):  
A. J. Roberts

AbstractThe new motion of embedding a centre manifold in some higher-dimensional manifold leads to a practical approach to the rational low-dimensional approximation of a wide class of dynamical systems; it also provides a simple geometric picture for these approximations. In particular, I consider the problem of finding an approximate, but accurate, description of the evolution of a two-dimensional planform of convection. Inspired by a simple example, the straightforward adiabatic iteration is proposed to estimate an embedding manifold and arguments are presented for its effectiveness. Upon applying the procedure to a model convective planform problem I find that the resulting approximations perform remarkably well–much better than the traditional Swift-Hohenberg approximation for planform evolution.


Mathematics ◽  
2021 ◽  
Vol 9 (9) ◽  
pp. 949
Author(s):  
Keita Hara ◽  
Masaki Inoue

In this paper, we address the data-driven modeling of a nonlinear dynamical system while incorporating a priori information. The nonlinear system is described using the Koopman operator, which is a linear operator defined on a lifted infinite-dimensional state-space. Assuming that the L2 gain of the system is known, the data-driven finite-dimensional approximation of the operator while preserving information about the gain, namely L2 gain-preserving data-driven modeling, is formulated. Then, its computationally efficient solution method is presented. An application of the modeling method to feedback controller design is also presented. Aiming for robust stabilization using data-driven control under a poor training dataset, we address the following two modeling problems: (1) Forward modeling: the data-driven modeling is applied to the operating data of a plant system to derive the plant model; (2) Backward modeling: L2 gain-preserving data-driven modeling is applied to the same data to derive an inverse model of the plant system. Then, a feedback controller composed of the plant and inverse models is created based on internal model control, and it robustly stabilizes the plant system. A design demonstration of the data-driven controller is provided using a numerical experiment.


2011 ◽  
Vol 11 (02n03) ◽  
pp. 569-591 ◽  
Author(s):  
HOONG CHIEH YEONG ◽  
JUN HYUN PARK ◽  
N. SRI NAMACHCHIVAYA

The study of random dynamical systems involves understanding the evolution of state variables that contain uncertainties and that are usually hidden, or not directly observable. Therefore, state variables have to be estimated and updated based on system models using information from observational data, which themselves are noisy, in the sense that they contain uncertainties and disturbances due to imperfections in observational devices and disturbances in the environment within which data are being collected. The development of efficient data assimilation methods for integrating observational data in predicting the evolution of random state variables is thus an important aspect in the study of random dynamical systems. In this paper, we consider a particle filtering approach to nonlinear filtering in multiscale dynamical systems. Particle filtering methods [1–3] utilizes ensembles of particles to represent the conditional density of state variables using particle positions, distributed over a sample space. The distribution of an ensemble of particles is updated using observational data to obtain the best representation of the conditional density of the state variables of interest. On the other hand, homogenization theory [4, 5], allows us to estimate the coarse-grained (slow) dynamics of a multiscale system on a larger timescale without having to explicitly study the fast variable evolution on a small timescale. The results of filter convergence presented in [6] shows the convergence of the filter of the actual state variable to a homogenized solution to the original multiscale system, and thus we develop a particle filtering scheme for multiscale random dynamical systems that utilizes this convergence result. This particle filtering method is called the Homogenized Hybird Particle Filter, and it incorporates a multiscale computation scheme, the Heterogeneous Multiscale Method developed in [7], with the novel branching particle filter described in [8–10]. By incorporating a multiscale scheme based on homogenization of the original system, estimation of the coarse-grained dynamics using observational data is performed over a larger timescale, thus resulting in computational time and cost reduction in terms of the evolution of the state variables as well as functional evaluations for the filtering aspect. We describe the theory behind this combined scheme and its general algorithm, concluded with an application to the Lorenz-96 [11] atmospheric model that mimics midlatitude geophysical dynamics with microscopic convective processes.


Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-16 ◽  
Author(s):  
J. Nathan Kutz ◽  
J. L. Proctor ◽  
S. L. Brunton

We consider the application of Koopman theory to nonlinear partial differential equations and data-driven spatio-temporal systems. We demonstrate that the observables chosen for constructing the Koopman operator are critical for enabling an accurate approximation to the nonlinear dynamics. If such observables can be found, then the dynamic mode decomposition (DMD) algorithm can be enacted to compute a finite-dimensional approximation of the Koopman operator, including its eigenfunctions, eigenvalues, and Koopman modes. We demonstrate simple rules of thumb for selecting a parsimonious set of observables that can greatly improve the approximation of the Koopman operator. Further, we show that the clear goal in selecting observables is to place the DMD eigenvalues on the imaginary axis, thus giving an objective function for observable selection. Judiciously chosen observables lead to physically interpretable spatio-temporal features of the complex system under consideration and provide a connection to manifold learning methods. Our method provides a valuable intermediate, yet interpretable, approximation to the Koopman operator that lies between the DMD method and the computationally intensive extended DMD (EDMD). We demonstrate the impact of observable selection, including kernel methods, and construction of the Koopman operator on several canonical nonlinear PDEs: Burgers’ equation, the nonlinear Schrödinger equation, the cubic-quintic Ginzburg-Landau equation, and a reaction-diffusion system. These examples serve to highlight the most pressing and critical challenge of Koopman theory: a principled way to select appropriate observables.


Sign in / Sign up

Export Citation Format

Share Document