Optimal Stopping Problems for a Family of Continuous-Time Markov Processes

2021 ◽  
pp. 57-86
Author(s):  
Héctor Jasso-Fuentes ◽  
Jose-Luis Menaldi ◽  
Fidel Vásquez-Rojas
Keyword(s):  
Markov Processes ◽  
Optimal Stopping ◽  
Continuous Time ◽  
Optimal Stopping Problems

scholarly journals On the Novikov-Shiryaev Optimal Stopping Problems in Continuous Time

2005 ◽  
Vol 10 (0) ◽  
pp. 146-154 ◽  
Author(s):  
Andreas Kyprianou ◽  
Budhi Surya
Keyword(s):  
Optimal Stopping ◽  
Continuous Time ◽  
Optimal Stopping Problems

Optimal stopping with random intervention times

2002 ◽  
Vol 34 (01) ◽  
pp. 141-157 ◽  
Author(s):  
Paul Dupuis ◽  
Hui Wang
Keyword(s):  
Optimal Stopping ◽  
Continuous Time ◽  
Value Function ◽  
Value Functions ◽  
Optimal Exercise Boundary ◽  
Exercise Boundary ◽  
Time Optimal ◽  
Optimal Stopping Problems ◽  
Necessary And Sufficient ◽  
The Value Function

We consider a class of optimal stopping problems where the ability to stop depends on an exogenous Poisson signal process - we can only stop at the Poisson jump times. Even though the time variable in these problems has a discrete aspect, a variational inequality can be obtained by considering an underlying continuous-time structure. Depending on whether stopping is allowed at t = 0, the value function exhibits different properties across the optimal exercise boundary. Indeed, the value function is only 𝒞 0 across the optimal boundary when stopping is allowed at t = 0 and 𝒞 2 otherwise, both contradicting the usual 𝒞 1 smoothness that is necessary and sufficient for the application of the principle of smooth fit. Also discussed is an equivalent stochastic control formulation for these stopping problems. Finally, we derive the asymptotic behaviour of the value functions and optimal exercise boundaries as the intensity of the Poisson process goes to infinity or, roughly speaking, as the problems converge to the classical continuous-time optimal stopping problems.

scholarly journals A finite exact algorithm to solve a dice game

2016 ◽  
Vol 53 (1) ◽  
pp. 91-105
Author(s):  
Fabián Crocce ◽  
Ernesto Mordecki
Keyword(s):  
Optimal Stopping ◽  
Continuous Time ◽  
Optimal Strategy ◽  
Exact Algorithm ◽  
Critical Threshold ◽  
Control Processes ◽  
Optimal Stopping Problems ◽  
Continuous Time Processes ◽  
Markov Control Processes ◽  
Markov Control

Abstract We provide an algorithm to find the value and an optimal strategy of the Ten Thousand dice game solitaire variant in the framework of Markov control processes. Once an optimal critical threshold is found, the set of nonstopping states of the game becomes finite and the solution is found by a backwards algorithm that gives the values for each one of these states of the game. The algorithm is finite and exact. The strategy to find the critical threshold comes from the continuous pasting condition used in optimal stopping problems for continuous-time processes with jumps.

General optimal stopping theorems for semi-Markov processes

1993 ◽  
Vol 25 (4) ◽  
pp. 825-846 ◽  
Author(s):  
Frans A. Boshuizen ◽  
José M. Gouweleeuw
Keyword(s):  
Markov Processes ◽  
Optimal Stopping ◽  
Stopping Time ◽  
General Setting ◽  
The State ◽  
Shock Models ◽  
Special Cases ◽  
Optimal Stopping Problems ◽  
The Times ◽  
Semi Markov Processes

In this paper, optimal stopping problems for semi-Markov processes are studied in a fairly general setting. In such a process transitions are made from state to state in accordance with a Markov chain, but the amount of time spent in each state is random. The times spent in each state follow a general renewal process. They may depend on the present state as well as on the state into which the next transition is made.Our goal is to maximize the expected net return, which is given as a function of the state at time t minus some cost function. Discounting may or may not be considered. The main theorems (Theorems 3.5 and 3.11) are expressions for the optimal stopping time in the undiscounted and discounted case. These theorems generalize results of Zuckerman [16] and Boshuizen and Gouweleeuw [3]. Applications are given in various special cases.The results developed in this paper can also be applied to semi-Markov shock models, as considered in Taylor [13], Feldman [6] and Zuckerman [15].

scholarly journals Optimal stopping problems for some Markov processes

2012 ◽  
Vol 22 (3) ◽  
pp. 1243-1265 ◽  
Author(s):  
Mamadou Cissé ◽  
Pierre Patie ◽  
Etienne Tanré
Keyword(s):  
Markov Processes ◽  
Optimal Stopping ◽  
Optimal Stopping Problems

Optimal stopping with random intervention times

2002 ◽  
Vol 34 (1) ◽  
pp. 141-157 ◽  
Author(s):  
Paul Dupuis ◽  
Hui Wang
Keyword(s):  
Optimal Stopping ◽  
Continuous Time ◽  
Value Function ◽  
Value Functions ◽  
Optimal Exercise Boundary ◽  
Exercise Boundary ◽  
Time Optimal ◽  
Optimal Stopping Problems ◽  
Necessary And Sufficient ◽  
The Value Function

We consider a class of optimal stopping problems where the ability to stop depends on an exogenous Poisson signal process - we can only stop at the Poisson jump times. Even though the time variable in these problems has a discrete aspect, a variational inequality can be obtained by considering an underlying continuous-time structure. Depending on whether stopping is allowed att= 0, the value function exhibits different properties across the optimal exercise boundary. Indeed, the value function is only𝒞0across the optimal boundary when stopping is allowed att= 0 and𝒞2otherwise, both contradicting the usual𝒞1smoothness that is necessary and sufficient for the application of the principle of smooth fit. Also discussed is an equivalent stochastic control formulation for these stopping problems. Finally, we derive the asymptotic behaviour of the value functions and optimal exercise boundaries as the intensity of the Poisson process goes to infinity or, roughly speaking, as the problems converge to the classical continuous-time optimal stopping problems.

scholarly journals Value Function and Optimal Rule on the Optimal Stopping Problem for Continuous-Time Markov Processes

2017 ◽  
Vol 2017 ◽  
pp. 1-10
Author(s):  
Lu Ye
Keyword(s):  
Explicit Formula ◽  
Markov Processes ◽  
Optimal Stopping ◽  
Continuous Time ◽  
Value Function ◽  
Broad Class ◽  
Stopping Time ◽  
Optimal Stopping Problem ◽  
Optimal Rule ◽  
Reward Functions

This paper considers the optimal stopping problem for continuous-time Markov processes. We describe the methodology and solve the optimal stopping problem for a broad class of reward functions. Moreover, we illustrate the outcomes by some typical Markov processes including diffusion and Lévy processes with jumps. For each of the processes, the explicit formula for value function and optimal stopping time is derived. Furthermore, we relate the derived optimal rules to some other optimal problems.

Sign in / Sign up

Export Citation Format

Share Document