A risk-sensitive maximum principle for a Markov regime-switching jump-diffusion system and applications

2018 ◽  
Vol 24 (3) ◽  
pp. 985-1013 ◽  
Author(s):  
Zhongyang Sun ◽  
Isabelle Kemajou-Brown ◽  
Olivier Menoukeu-Pamen
Keyword(s):  
Optimal Control ◽  
Maximum Principle ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Regime Switching ◽  
Jump Diffusion ◽  
Management Problem ◽  
Markov Regime Switching ◽  
Risk Sensitive ◽  
Jump Diffusion Model

In this paper, we derive a general stochastic maximum principle for a risk-sensitive type optimal control problem of Markov regime-switching jump-diffusion model. The results are obtained via a logarithmic transformation and the relationship between adjoint variables and the value function. We apply the results to study both a linear-quadratic optimal control problem and a risk-sensitive benchmarked asset management problem for Markov regime-switching models. In the latter case, the optimal control is of feedback form and is given in terms of solutions to a Markov regime-switching Riccatti equation and an ordinary Markov regime-switching differential equation.

scholarly journals Numerical Optimal Control of HIV Transmission in Octave/MATLAB

2019 ◽  
Vol 25 (1) ◽  
pp. 1 ◽  
Author(s):  
Carlos Campos ◽  
Cristiana J. Silva ◽  
Delfim F. M. Torres
Keyword(s):  
Optimal Control ◽  
Maximum Principle ◽  
Differential Equations ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Ordinary Differential Equations ◽  
Fourth Order ◽  
Optimal Control Problems ◽  
Control Problems ◽  
Initial Value

We provide easy and readable GNU Octave/MATLAB code for the simulation of mathematical models described by ordinary differential equations and for the solution of optimal control problems through Pontryagin’s maximum principle. For that, we consider a normalized HIV/AIDS transmission dynamics model based on the one proposed in our recent contribution (Silva, C.J.; Torres, D.F.M. A SICA compartmental model in epidemiology with application to HIV/AIDS in Cape Verde. Ecol. Complex. 2017, 30, 70–75), given by a system of four ordinary differential equations. An HIV initial value problem is solved numerically using the ode45 GNU Octave function and three standard methods implemented by us in Octave/MATLAB: Euler method and second-order and fourth-order Runge–Kutta methods. Afterwards, a control function is introduced into the normalized HIV model and an optimal control problem is formulated, where the goal is to find the optimal HIV prevention strategy that maximizes the fraction of uninfected HIV individuals with the least HIV new infections and cost associated with the control measures. The optimal control problem is characterized analytically using the Pontryagin Maximum Principle, and the extremals are computed numerically by implementing a forward-backward fourth-order Runge–Kutta method. Complete algorithms, for both uncontrolled initial value and optimal control problems, developed under the free GNU Octave software and compatible with MATLAB are provided along the article.

Sign in / Sign up

Export Citation Format

Share Document