On the infinitesimal characterization of monotone stopping problems in continuous time

Author(s):  
A. Irle
Keyword(s):  
Author(s):  
Yves Achdou ◽  
Jiequn Han ◽  
Jean-Michel Lasry ◽  
Pierre-Louis Lions ◽  
Benjamin Moll

Abstract We recast the Aiyagari-Bewley-Huggett model of income and wealth distribution in continuous time. This workhorse model – as well as heterogeneous agent models more generally – then boils down to a system of partial differential equations, a fact we take advantage of to make two types of contributions. First, a number of new theoretical results: (i) an analytic characterization of the consumption and saving behavior of the poor, particularly their marginal propensities to consume; (ii) a closed-form solution for the wealth distribution in a special case with two income types; (iii) a proof that there is a unique stationary equilibrium if the intertemporal elasticity of substitution is weakly greater than one. Second, we develop a simple, efficient and portable algorithm for numerically solving for equilibria in a wide class of heterogeneous agent models, including – but not limited to – the Aiyagari-Bewley-Huggett model.


2020 ◽  
Vol 52 (4) ◽  
pp. 1249-1283
Author(s):  
Masatoshi Kimura ◽  
Tetsuya Takine

AbstractThis paper considers ergodic, continuous-time Markov chains $\{X(t)\}_{t \in (\!-\infty,\infty)}$ on $\mathbb{Z}^+=\{0,1,\ldots\}$ . For an arbitrarily fixed $N \in \mathbb{Z}^+$ , we study the conditional stationary distribution $\boldsymbol{\pi}(N)$ given the Markov chain being in $\{0,1,\ldots,N\}$ . We first characterize $\boldsymbol{\pi}(N)$ via systems of linear inequalities and identify simplices that contain $\boldsymbol{\pi}(N)$ , by examining the $(N+1) \times (N+1)$ northwest corner block of the infinitesimal generator $\textbf{\textit{Q}}$ and the subset of the first $N+1$ states whose members are directly reachable from at least one state in $\{N+1,N+2,\ldots\}$ . These results are closely related to the augmented truncation approximation (ATA), and we provide some practical implications for the ATA. Next we consider an extension of the above results, using the $(K+1) \times (K+1)$ ( $K > N$ ) northwest corner block of $\textbf{\textit{Q}}$ and the subset of the first $K+1$ states whose members are directly reachable from at least one state in $\{K+1,K+2,\ldots\}$ . Furthermore, we introduce new state transition structures called (K, N)-skip-free sets, using which we obtain the minimum convex polytope that contains $\boldsymbol{\pi}(N)$ .


1982 ◽  
Vol 19 (3) ◽  
pp. 692-694 ◽  
Author(s):  
Mark Scott ◽  
Barry C. Arnold ◽  
Dean L. Isaacson

Characterizations of strong ergodicity for Markov chains using mean visit times have been found by several authors (Huang and Isaacson (1977), Isaacson and Arnold (1978)). In this paper a characterization of uniform strong ergodicity for a continuous-time non-homogeneous Markov chain is given. This extends the characterization, using mean visit times, that was given by Isaacson and Arnold.


Author(s):  
Andrew White ◽  
Guoming Zhu ◽  
Jongeun Choi

In this paper, the input covariance constraint (ICC) control problem is solved by a convex optimization with linear matrix inequality (LMI) constraints. The ICC control problem is an optimal control problem that is concerned with finding the best output performance possible subject to multiple constraints on the input covariance matrices. The contribution of this paper is the characterization of the control synthesis LMIs used to solve the ICC control problem. To demonstrate the effectiveness of the proposed approach a numerical example is solved with the control synthesis LMIs. Both discrete and continuous-time problems are considered.


1996 ◽  
Vol 21 (17) ◽  
pp. 1342 ◽  
Author(s):  
David O. Caplan ◽  
Gregory S. Kanter ◽  
Prem Kumar

Sign in / Sign up

Export Citation Format

Share Document