A sufficient stochastic maximum principle for a kind of recursive optimal control problem with obstacle constraint

2018 ◽  
Vol 114 ◽  
pp. 27-30 ◽  
Author(s):  
Jianhui Huang ◽  
Haiyang Wang ◽  
Zhen Wu

2014 ◽  
Vol 2014 ◽  
pp. 1-12
Author(s):  
Qingmeng Wei

We focus on the fully coupled forward-backward stochastic differential equations with jumps and investigate the associated stochastic optimal control problem (with the nonconvex control and the convex state constraint) along with stochastic maximum principle. To derive the necessary condition (i.e., stochastic maximum principle) for the optimal control, first we transform the fully coupled forward-backward stochastic control system into a fully coupled backward one; then, by using the terminal perturbation method, we obtain the stochastic maximum principle. Finally, we study a linear quadratic model.



2019 ◽  
Vol 25 (1) ◽  
pp. 1 ◽  
Author(s):  
Carlos Campos ◽  
Cristiana J. Silva ◽  
Delfim F. M. Torres

We provide easy and readable GNU Octave/MATLAB code for the simulation of mathematical models described by ordinary differential equations and for the solution of optimal control problems through Pontryagin’s maximum principle. For that, we consider a normalized HIV/AIDS transmission dynamics model based on the one proposed in our recent contribution (Silva, C.J.; Torres, D.F.M. A SICA compartmental model in epidemiology with application to HIV/AIDS in Cape Verde. Ecol. Complex. 2017, 30, 70–75), given by a system of four ordinary differential equations. An HIV initial value problem is solved numerically using the ode45 GNU Octave function and three standard methods implemented by us in Octave/MATLAB: Euler method and second-order and fourth-order Runge–Kutta methods. Afterwards, a control function is introduced into the normalized HIV model and an optimal control problem is formulated, where the goal is to find the optimal HIV prevention strategy that maximizes the fraction of uninfected HIV individuals with the least HIV new infections and cost associated with the control measures. The optimal control problem is characterized analytically using the Pontryagin Maximum Principle, and the extremals are computed numerically by implementing a forward-backward fourth-order Runge–Kutta method. Complete algorithms, for both uncontrolled initial value and optimal control problems, developed under the free GNU Octave software and compatible with MATLAB are provided along the article.



Sign in / Sign up

Export Citation Format

Share Document