scholarly journals Near Optimality of Linear Delayed Doubly Stochastic Control Problem

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Jie Xu ◽  
Ruiqiang Lin
Keyword(s):  
Optimal Control ◽  
Time Delay ◽  
Control Problem ◽  
Delay System ◽  
Necessary Condition ◽  
Linear Quadratic ◽  
The Maximum Principle ◽  
Doubly Stochastic ◽  
Convex Control ◽  
Near Optimality

In this paper, we study a kind of near optimal control problem which is described by linear quadratic doubly stochastic differential equations with time delay. We consider the near optimality for the linear delayed doubly stochastic system with convex control domain. We discuss the case that all the time delay variables are different. We give the maximum principle of near optimal control for this kind of time delay system. The necessary condition for the control to be near optimal control is deduced by Ekeland’s variational principle and some estimates on the state and the adjoint processes corresponding to the system.

scholarly journals Delayed Stochastic Linear-Quadratic Control Problem and Related Applications

2012 ◽  
Vol 2012 ◽  
pp. 1-22 ◽  
Author(s):  
Li Chen ◽  
Zhen Wu ◽  
Zhiyong Yu
Keyword(s):  
Optimal Control ◽  
Differential Equations ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Stochastic Differential Equations ◽  
Backward Stochastic Differential Equations ◽  
Delay System ◽  
Linear Quadratic ◽  
Stochastic Linear System ◽  
And Control

We discuss a quadratic criterion optimal control problem for stochastic linear system with delay in both state and control variables. This problem will lead to a kind of generalized forward-backward stochastic differential equations (FBSDEs) with Itô’s stochastic delay equations as forward equations and anticipated backward stochastic differential equations as backward equations. Especially, we present the optimal feedback regulator for the time delay system via a new type of Riccati equations and also apply to a population optimal control problem.

scholarly journals A Maximum Principle for Controlled Time-Symmetric Forward-Backward Doubly Stochastic Differential Equation with Initial-Terminal Sate Constraints

2012 ◽  
Vol 2012 ◽  
pp. 1-29 ◽  
Author(s):  
Shaolin Ji ◽  
Qingmeng Wei ◽  
Xiumin Zhang
Keyword(s):  
Differential Equation ◽  
Optimal Control ◽  
Maximum Principle ◽  
Stochastic Differential Equation ◽  
State Constraints ◽  
Terminal State ◽  
Necessary Condition ◽  
Variation Principle ◽  
Linear Quadratic ◽  
Doubly Stochastic

We study the optimal control problem of a controlled time-symmetric forward-backward doubly stochastic differential equation with initial-terminal state constraints. Applying the terminal perturbation method and Ekeland’s variation principle, a necessary condition of the stochastic optimal control, that is, stochastic maximum principle, is derived. Applications to backward doubly stochastic linear-quadratic control models are investigated.

scholarly journals Optimal Control of a Nonlinear Time-Delay System in Batch Fermentation Process

2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Yongsheng Yu
Keyword(s):  
Optimal Control ◽  
Time Delay ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Batch Process ◽  
Delay System ◽  
High Yield ◽  
Time Delay System ◽  
Control Variables ◽  
Terminal Time

The main control goal in batch process is to get a high yield of products. In this paper, to maximize the yield of 1,3-propanediol (1,3-PD) in bioconversion of glycerol to 1,3-PD, we consider an optimal control problem involving a nonlinear time-delay system. The control variables in this problem include the initial concentrations of biomass and glycerol and the terminal time of the batch process. By a time-scaling transformation, we transcribe the optimal control problem into a new one with fixed terminal time, which yields a new nonlinear system with variable time-delay. The gradients of the cost and constraint functionals with respect to the control variables are derived using the costate method. Then, a gradient-based optimization method is developed to solve the optimal control problem. Numerical results show that the yield of 1,3-PD at the terminal time is increased considerably compared with the experimental data.

scholarly journals Maximum Principle for Near-Optimality of Mean-Field FBSDEs

2020 ◽  
Vol 2020 ◽  
pp. 1-16
Author(s):  
Ruijing Li ◽  
Chaozhu Hu
Keyword(s):  
Optimal Control ◽  
Variational Principle ◽  
Maximum Principle ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Reduction Method ◽  
Mean Field ◽  
Linear Quadratic ◽  
Necessary And Sufficient ◽  
Near Optimality

The present paper concerns with a near-optimal control problem for systems governed by mean-field forward-backward stochastic differential equations (FBSDEs) with mixed initial-terminal conditions. Utilizing Ekeland’s variational principle as well as the reduction method, the necessary and sufficient near-optimality conditions are established in the form of Pontryagin’s type. The results are obtained under restriction on the convexity of the control domain. As an application, a linear-quadratic stochastic control problem is solved explicitly.

scholarly journals The Optimal Control Problem with State Constraints for Fully Coupled Forward-Backward Stochastic Systems with Jumps

2014 ◽  
Vol 2014 ◽  
pp. 1-12
Author(s):  
Qingmeng Wei
Keyword(s):  
Optimal Control ◽  
Maximum Principle ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Stochastic Systems ◽  
Stochastic Maximum Principle ◽  
Quadratic Model ◽  
Necessary Condition ◽  
Linear Quadratic ◽  
Fully Coupled

We focus on the fully coupled forward-backward stochastic differential equations with jumps and investigate the associated stochastic optimal control problem (with the nonconvex control and the convex state constraint) along with stochastic maximum principle. To derive the necessary condition (i.e., stochastic maximum principle) for the optimal control, first we transform the fully coupled forward-backward stochastic control system into a fully coupled backward one; then, by using the terminal perturbation method, we obtain the stochastic maximum principle. Finally, we study a linear quadratic model.

scholarly journals The Delayed Doubly Stochastic Linear Quadratic Optimal Control Problem

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Yan Chen ◽  
Jie Xu
Keyword(s):  
Optimal Control ◽  
Control System ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Riccati Equation ◽  
Control Variable ◽  
Linear Quadratic ◽  
Linear Quadratic Optimal Control ◽  
Doubly Stochastic ◽  
Quadratic Optimal Control

In this paper, the delayed doubly stochastic linear quadratic optimal control problem is discussed. It deduces the expression of the optimal control for the general delayed doubly stochastic control system which contained time delay both in the state variable and in the control variable at the same time and proves its uniqueness by using the classical parallelogram rule. The paper is concerned with the generalized matrix value Riccati equation for a special delayed doubly stochastic linear quadratic control system and aims to give the expression of optimal control and value function by the solution of the Riccati equation.

scholarly journals Convergence results for an averaged LQR problem with applications to reinforcement learning

2021 ◽  
Author(s):  
Andrea Pesare ◽  
Michele Palladino ◽  
Maurizio Falcone
Keyword(s):  
Optimal Control ◽  
Reinforcement Learning ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Current System ◽  
Numerical Test ◽  
Linear Quadratic ◽  
Linear Quadratic Optimal Control ◽  
Lqr Problem ◽  
Quadratic Optimal Control

AbstractIn this paper, we will deal with a linear quadratic optimal control problem with unknown dynamics. As a modeling assumption, we will suppose that the knowledge that an agent has on the current system is represented by a probability distribution $$\pi $$ π on the space of matrices. Furthermore, we will assume that such a probability measure is opportunely updated to take into account the increased experience that the agent obtains while exploring the environment, approximating with increasing accuracy the underlying dynamics. Under these assumptions, we will show that the optimal control obtained by solving the “average” linear quadratic optimal control problem with respect to a certain $$\pi $$ π converges to the optimal control driven related to the linear quadratic optimal control problem governed by the actual, underlying dynamics. This approach is closely related to model-based reinforcement learning algorithms where prior and posterior probability distributions describing the knowledge on the uncertain system are recursively updated. In the last section, we will show a numerical test that confirms the theoretical results.

scholarly journals A Type of Time-Symmetric Stochastic System and Related Games

Symmetry ◽  
2021 ◽  
Vol 13 (1) ◽  
pp. 118
Author(s):  
Qingfeng Zhu ◽  
Yufeng Shi ◽  
Jiaqiang Wen ◽  
Hui Zhang
Keyword(s):  
Nash Equilibrium ◽  
Time Delay ◽  
Differential Equations ◽  
Equilibrium Point ◽  
Stochastic Differential Equations ◽  
Stochastic System ◽  
Stochastic Systems ◽  
Necessary Condition ◽  
Nash Equilibrium Point ◽  
Doubly Stochastic

This paper is concerned with a type of time-symmetric stochastic system, namely the so-called forward–backward doubly stochastic differential equations (FBDSDEs), in which the forward equations are delayed doubly stochastic differential equations (SDEs) and the backward equations are anticipated backward doubly SDEs. Under some monotonicity assumptions, the existence and uniqueness of measurable solutions to FBDSDEs are obtained. The future development of many processes depends on both their current state and historical state, and these processes can usually be represented by stochastic differential systems with time delay. Therefore, a class of nonzero sum differential game for doubly stochastic systems with time delay is studied in this paper. A necessary condition for the open-loop Nash equilibrium point of the Pontriagin-type maximum principle are established, and a sufficient condition for the Nash equilibrium point is obtained. Furthermore, the above results are applied to the study of nonzero sum differential games for linear quadratic backward doubly stochastic systems with delay. Based on the solution of FBDSDEs, an explicit expression of Nash equilibrium points for such game problems is established.

scholarly journals Two Inverse Problems Solution by Feedback Tracking Control

Axioms ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 137
Author(s):  
Vladimir Turetsky
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Feedback Linearization ◽  
Linear Quadratic ◽  
Linear Quadratic Optimal Control ◽  
Linear Quadratic Tracking ◽  
Ill Posed ◽  
Quadratic Optimal Control ◽  
Quadratic Tracking

Two inverse ill-posed problems are considered. The first problem is an input restoration of a linear system. The second one is a restoration of time-dependent coefficients of a linear ordinary differential equation. Both problems are reformulated as auxiliary optimal control problems with regularizing cost functional. For the coefficients restoration problem, two control models are proposed. In the first model, the control coefficients are approximated by the output and the estimates of its derivatives. This model yields an approximating linear-quadratic optimal control problem having a known explicit solution. The derivatives are also obtained as auxiliary linear-quadratic tracking controls. The second control model is accurate and leads to a bilinear-quadratic optimal control problem. The latter is tackled in two ways: by an iterative procedure and by a feedback linearization. Simulation results show that a bilinear model provides more accurate coefficients estimates.

Sign in / Sign up

Export Citation Format

Share Document