Particle Filters in a Multiscale Environment: Homogenized Hybrid Particle Filter

2011 ◽  
Vol 78 (6) ◽  
Author(s):  
Jun H. Park ◽  
N. Sri Namachchivaya ◽  
Hoong Chieh Yeong

State estimation of random dynamical systems with noisy observations has been an important problem in many areas of science and engineering. Efficient new algorithms to estimate the present and future state of a dynamic signal based upon corrupted, distorted, and possibly partial observations of the signal are required. Since the true state is usually hidden and evolves according to its own dynamics, the objective of this work is to get an optimal estimation of the true state via noisy observations. The theory of filtering provides a recursive procedure for estimating an evolving signal or state from a noisy observation process. We consider a particle filter approach for nonlinear filtering in multiscale dynamical systems. Particle filters represent the posterior conditional distribution of the state variables by a system of particles, which evolves and adapts recursively as new information becomes available. Particle filters suffer from computational inefficiency when applied to high dimensional problems. In practice, large numbers of particles may be required to provide adequate approximations in higher dimensional poblems. In several high dimensional applications, after a sequence of updates, the particle system will often collapse to a single point. With the help of rigorous dimensional reduction methods, particle filters could regain their versatility. Based on our theoretical developments (Park, J. H., Sri Namachchivaya, N., and Sowers, R. B., 2008, “A Problem in Stochastic Averaging of Nonlinear Filters,” Stochastics Dyn., 8(3), pp. 543–560; Park, J. H., Sowers, R. B., and Sri Namachchivaya, N., 2010, “Dimensional Reduction in Nonlinear Filtering,” Nonlinearity, 23(2), pp. 305–324), we devise an efficient particle filter algorithm, which is applicable to high dimensional multiscale nonlinear filtering problems. In this paper, we present the homogenized hybrid particle filtering method that combines homogenization of random dynamical systems, reduced order nonlinear filtering, and particle methods.

2011 ◽  
Vol 11 (02n03) ◽  
pp. 569-591 ◽  
Author(s):  
HOONG CHIEH YEONG ◽  
JUN HYUN PARK ◽  
N. SRI NAMACHCHIVAYA

The study of random dynamical systems involves understanding the evolution of state variables that contain uncertainties and that are usually hidden, or not directly observable. Therefore, state variables have to be estimated and updated based on system models using information from observational data, which themselves are noisy, in the sense that they contain uncertainties and disturbances due to imperfections in observational devices and disturbances in the environment within which data are being collected. The development of efficient data assimilation methods for integrating observational data in predicting the evolution of random state variables is thus an important aspect in the study of random dynamical systems. In this paper, we consider a particle filtering approach to nonlinear filtering in multiscale dynamical systems. Particle filtering methods [1–3] utilizes ensembles of particles to represent the conditional density of state variables using particle positions, distributed over a sample space. The distribution of an ensemble of particles is updated using observational data to obtain the best representation of the conditional density of the state variables of interest. On the other hand, homogenization theory [4, 5], allows us to estimate the coarse-grained (slow) dynamics of a multiscale system on a larger timescale without having to explicitly study the fast variable evolution on a small timescale. The results of filter convergence presented in [6] shows the convergence of the filter of the actual state variable to a homogenized solution to the original multiscale system, and thus we develop a particle filtering scheme for multiscale random dynamical systems that utilizes this convergence result. This particle filtering method is called the Homogenized Hybird Particle Filter, and it incorporates a multiscale computation scheme, the Heterogeneous Multiscale Method developed in [7], with the novel branching particle filter described in [8–10]. By incorporating a multiscale scheme based on homogenization of the original system, estimation of the coarse-grained dynamics using observational data is performed over a larger timescale, thus resulting in computational time and cost reduction in terms of the evolution of the state variables as well as functional evaluations for the filtering aspect. We describe the theory behind this combined scheme and its general algorithm, concluded with an application to the Lorenz-96 [11] atmospheric model that mimics midlatitude geophysical dynamics with microscopic convective processes.


2009 ◽  
Vol 137 (12) ◽  
pp. 4089-4114 ◽  
Author(s):  
Peter Jan van Leeuwen

Abstract The application of particle filters in geophysical systems is reviewed. Some background on Bayesian filtering is provided, and the existing methods are discussed. The emphasis is on the methodology, and not so much on the applications themselves. It is shown that direct application of the basic particle filter (i.e., importance sampling using the prior as the importance density) does not work in high-dimensional systems, but several variants are shown to have potential. Approximations to the full problem that try to keep some aspects of the particle filter beyond the Gaussian approximation are also presented and discussed.


2017 ◽  
Vol 49 (1) ◽  
pp. 24-48 ◽  
Author(s):  
Alexandros Beskos ◽  
Dan Crisan ◽  
Ajay Jasra ◽  
Kengo Kamatani ◽  
Yan Zhou

Abstract We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in ℝd with large d. For low-dimensional problems, one of the most popular numerical procedures for consistent inference is the class of approximations termed particle filters or sequential Monte Carlo methods. However, in high dimensions, standard particle filters (e.g. the bootstrap particle filter) can have a cost that is exponential in d for the algorithm to be stable in an appropriate sense. We develop a new particle filter, called the space‒time particle filter, for a specific family of state-space models in discrete time. This new class of particle filters provides consistent Monte Carlo estimates for any fixed d, as do standard particle filters. Moreover, when there is a spatial mixing element in the dimension of the state vector, the space‒time particle filter will scale much better with d than the standard filter for a class of filtering problems. We illustrate this analytically for a model of a simple independent and identically distributed structure and a model of an L-Markovian structure (L≥ 1, L independent of d) in the d-dimensional space direction, when we show that the algorithm exhibits certain stability properties as d increases at a cost 𝒪(nNd2), where n is the time parameter and N is the number of Monte Carlo samples, which are fixed and independent of d. Our theoretical results are also supported by numerical simulations on practical models of complex structures. The results suggest that it is indeed possible to tackle some high-dimensional filtering problems using the space‒time particle filter that standard particle filters cannot handle.


2009 ◽  
Vol 09 (02) ◽  
pp. 205-215 ◽  
Author(s):  
XIANFENG MA ◽  
ERCAI CHEN

The topological pressure is defined for subadditive sequence of potentials in bundle random dynamical systems. A variational principle for the topological pressure is set up in a very weak condition. The result may have some applications in the study of multifractal analysis for random version of nonconformal dynamical systems.


2009 ◽  
Vol 19 (09) ◽  
pp. 2823-2869 ◽  
Author(s):  
Z. E. MUSIELAK ◽  
D. E. MUSIELAK

Studies of nonlinear dynamical systems with many degrees of freedom show that the behavior of these systems is significantly different as compared with the behavior of systems with less than two degrees of freedom. These findings motivated us to carry out a survey of research focusing on the behavior of high-dimensional chaos, which include onset of chaos, routes to chaos and the persistence of chaos. This paper reports on various methods of generating and investigating nonlinear, dissipative and driven dynamical systems that exhibit high-dimensional chaos, and reviews recent results in this new field of research. We study high-dimensional Lorenz, Duffing, Rössler and Van der Pol oscillators, modified canonical Chua's circuits, and other dynamical systems and maps, and we formulate general rules of high-dimensional chaos. Basic techniques of chaos control and synchronization developed for high-dimensional dynamical systems are also reviewed.


2003 ◽  
Vol 67 (2) ◽  
Author(s):  
Ying-Cheng Lai ◽  
Zonghua Liu ◽  
Lora Billings ◽  
Ira B. Schwartz

Sign in / Sign up

Export Citation Format

Share Document