scholarly journals A sparse Markov chain approximation of LQ-type stochastic control problems

2016 ◽  
Vol 6 (3) ◽  
pp. 363-389 ◽  
Author(s):  
Ralf Banisch ◽  
Carsten Hartmann
1978 ◽  
Vol 15 (4) ◽  
pp. 842-847 ◽  
Author(s):  
A. Federgruen ◽  
A. Hordijk ◽  
H. C. Tijms

In this paper we consider a set of denumerable stochastic matrices where the parameter set is a compact metric space. We give a number of simultaneous recurrence conditions on the stochastic matrices and establish equivalences between these conditions. The results obtained generalize corresponding results in Markov chain theory to a considerable extent and have applications in stochastic control problems.


1978 ◽  
Vol 15 (04) ◽  
pp. 842-847 ◽  
Author(s):  
A. Federgruen ◽  
A. Hordijk ◽  
H. C. Tijms

In this paper we consider a set of denumerable stochastic matrices where the parameter set is a compact metric space. We give a number of simultaneous recurrence conditions on the stochastic matrices and establish equivalences between these conditions. The results obtained generalize corresponding results in Markov chain theory to a considerable extent and have applications in stochastic control problems.


2021 ◽  
Vol 53 (2) ◽  
pp. 335-369
Author(s):  
Christian Meier ◽  
Lingfei Li ◽  
Gongqiu Zhang

AbstractWe develop a continuous-time Markov chain (CTMC) approximation of one-dimensional diffusions with sticky boundary or interior points. Approximate solutions to the action of the Feynman–Kac operator associated with a sticky diffusion and first passage probabilities are obtained using matrix exponentials. We show how to compute matrix exponentials efficiently and prove that a carefully designed scheme achieves second-order convergence. We also propose a scheme based on CTMC approximation for the simulation of sticky diffusions, for which the Euler scheme may completely fail. The efficiency of our method and its advantages over alternative approaches are illustrated in the context of bond pricing in a sticky short-rate model for a low-interest environment and option pricing under a geometric Brownian motion price model with a sticky interior point.


Sign in / Sign up

Export Citation Format

Share Document