scholarly journals Dynamic Analysis of a Two-Language Competitive Model with Control Strategies

2013 ◽  
Vol 2013 ◽  
pp. 1-13 ◽  
Author(s):  
Lin-Fei Nie ◽  
Zhi-Dong Teng ◽  
Juan J. Nieto ◽  
Il Hyo Jung
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Numerical Simulations ◽  
Control Strategy ◽  
Sufficient Conditions ◽  
Positive Order ◽  
State Dependent ◽  
Competitive Model ◽  
The Impact

The dynamic behavior of a two-language competitive model is analyzed systemically in this paper. By the linearization and the Bendixson-Dulac theorem on dynamical system, some sufficient conditions on the globally asymptotical stability of the trivial equilibria and the existence and the stability of the positive equilibrium of this model are presented. Nextly, in order to protect the endangered language, an optimal control problem relative to this model is explored. We derive some necessary conditions to solve the optimal control problem and present some numerical simulations using a Runge-Kutta fourth-order method. Finally, the languages competitive model is extended to this model assessing the impact of state-dependent pulse control strategy. Using the Poincaré map, differential inequality, and method of qualitative analysis, we prove the existence and stability of positive order-1 periodic solution for this control model. Numerical simulations are carried out to illustrate the main results and the feasibility of state-dependent impulsive control strategy.

Some Sufficiency Conditions for Pareto-Optimal Control

1973 ◽  
Vol 95 (4) ◽  
pp. 356-361 ◽  
Author(s):  
G. Leitmann ◽  
W. Schmitendorf
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Pareto Optimality ◽  
Optimal Control Theory ◽  
Cooperative Games ◽  
Sufficient Conditions ◽  
Pareto Optimal ◽  
Vector Valued ◽  
Sufficiency Conditions

We consider the optimal control problem with vector-valued criterion (including cooperative games) and seek Pareto-optimal (noninferior) solutions. Scalarization results, together with modified sufficiency theorems from optimal control theory, are used to deduce sufficient conditions for Pareto-optimality. The utilization of these conditions is illustrated by various examples.

scholarly journals Impulsive Control for Continuous-Time Markov Decision Processes

2015 ◽  
Vol 47 (1) ◽  
pp. 106-127 ◽  
Author(s):  
François Dufour ◽  
Alexei B. Piunovskiy
Keyword(s):  
Optimal Control ◽  
Control Problem ◽  
Markov Decision Processes ◽  
Control Strategy ◽  
Continuous Time ◽  
Sufficient Conditions ◽  
Decision Processes ◽  
Optimal Control Strategy ◽  
Optimality Equation ◽  
Markov Decision

In this paper our objective is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite time horizon discounted cost. The continuous-time controlled process is shown to be nonexplosive under appropriate hypotheses. The so-called Bellman equation associated to this control problem is studied. Sufficient conditions ensuring the existence and the uniqueness of a bounded measurable solution to this optimality equation are provided. Moreover, it is shown that the value function of the optimization problem under consideration satisfies this optimality equation. Sufficient conditions are also presented to ensure on the one hand the existence of an optimal control strategy, and on the other hand the existence of a ε-optimal control strategy. The decomposition of the state space into two disjoint subsets is exhibited where, roughly speaking, one should apply a gradual action or an impulsive action correspondingly to obtain an optimal or ε-optimal strategy. An interesting consequence of our previous results is as follows: the set of strategies that allow interventions at time t = 0 and only immediately after natural jumps is a sufficient set for the control problem under consideration.

Optimal bounded control of stochastically excited strongly nonlinear vibro-impact system

2020 ◽  
pp. 107754632092989
Author(s):  
Xudong Gu ◽  
Zichen Deng ◽  
Rongchun Hu
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Control Strategy ◽  
Adjoint Equation ◽  
Kolmogorov Equation ◽  
Adjoint Variable ◽  
Bounded Control ◽  
Strongly Nonlinear ◽  
System Energy

An optimal bounded control strategy for strongly nonlinear vibro-impact systems under stochastic excitations with actuator saturation is proposed. First, the impact effect is incorporated in an equivalent equation by using a nonsmooth transformation. Under the assumption of light damping and weak random perturbation, the system energy is a slowly varying process. By using the stochastic averaging of envelope for strongly nonlinear systems, the partially averaged Itô stochastic differential equation for system energy can be derived. The optimal control problem is transformed from the original optimal control problem for the state variables to an equivalent optimal control problem for the system energy, which decreases the dimensions of the optimal control problem. Then, based on stochastic maximum principle, an adjoint equation for the adjoint variable and the maximum condition of partially averaged control problem are established. For infinite time-interval ergodic control, the adjoint variable is assumed to be a stationary process and the adjoint equation can be further simplified. Finally, the probability density function of the system energy and other statistics of the optimally controlled system are derived by calculating the associated Fokker–Plank–Kolmogorov equation. For comparison, the bang–bang control is also investigated and the control results are compared to show the advantages of the developed control strategy.

scholarly journals Impulsive Control for Continuous-Time Markov Decision Processes

2015 ◽  
Vol 47 (01) ◽  
pp. 106-127 ◽  
Author(s):  
François Dufour ◽  
Alexei B. Piunovskiy
Keyword(s):  
Optimal Control ◽  
Control Problem ◽  
Markov Decision Processes ◽  
Control Strategy ◽  
Continuous Time ◽  
Sufficient Conditions ◽  
Decision Processes ◽  
Optimal Control Strategy ◽  
Optimality Equation ◽  
Markov Decision

In this paper our objective is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite time horizon discounted cost. The continuous-time controlled process is shown to be nonexplosive under appropriate hypotheses. The so-called Bellman equation associated to this control problem is studied. Sufficient conditions ensuring the existence and the uniqueness of a bounded measurable solution to this optimality equation are provided. Moreover, it is shown that the value function of the optimization problem under consideration satisfies this optimality equation. Sufficient conditions are also presented to ensure on the one hand the existence of an optimal control strategy, and on the other hand the existence of a ε-optimal control strategy. The decomposition of the state space into two disjoint subsets is exhibited where, roughly speaking, one should apply a gradual action or an impulsive action correspondingly to obtain an optimal or ε-optimal strategy. An interesting consequence of our previous results is as follows: the set of strategies that allow interventions at time t = 0 and only immediately after natural jumps is a sufficient set for the control problem under consideration.

An optimal control problem for a system of linear hyperbolic differential equations with constant coefficients

2015 ◽  
Vol 22 (2) ◽  
Author(s):  
Hamlet F. Guliyev ◽  
Vera B. Nazarova
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Fourth Order ◽  
Hyperbolic Equations ◽  
Sufficient Conditions ◽  
Constant Coefficients ◽  
Gradient Of The Functional ◽  
Necessary And Sufficient ◽  
Hyperbolic Differential Equations

AbstractIn this paper, an optimal control problem is considered for a system of fourth order hyperbolic equations with constant coefficients. The gradient of the functional is calculated and the necessary and sufficient conditions of optimality in the form of an integral inequality are derived.

scholarly journals On an optimal control problem involving second order hyperbolic systems with boundary controls

1983 ◽  
Vol 27 (1) ◽  
pp. 139-148 ◽  
Author(s):  
K.G. Choo ◽  
K.L. Teo ◽  
Z.S. Wu
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Hyperbolic Systems ◽  
Sufficient Conditions ◽  
Second Order ◽  
Optimal Controls ◽  
Convergence Properties ◽  
Boundary Controls ◽  
Necessary And Sufficient

In this paper, we consider an optimal control problem involving second-order hyperbolic systems with boundary controls. Necessary and sufficient conditions are derived and a result on the existence of optimal controls is obtained. Also, a computational algorithm which generated minimizing sequences of controls is devised and the convergence properties of the algorithm are investigated.

Fast Online-Implementable Sub-Optimal Energy Management of a Power-Split Hybrid Electric Vehicle

2013 ◽  
Author(s):  
Jian Dong ◽  
Rui Cheng ◽  
Zuomin Dong ◽  
Curran Crawford
Keyword(s):  
Optimal Control ◽  
Optimal Control Problem ◽  
Control Problem ◽  
Real Time ◽  
Electric Vehicle ◽  
Energy Management ◽  
Control Strategy ◽  
Hybrid Electric Vehicle ◽  
Hybrid Powertrain ◽  
Power Split

The current focus of HEV controller design is on the development of real-time implementable energy management strategies that can approximate the global optimal solution closely. In this work, the Toyota Prius power-split hybrid powertrain is used as a case study for developing online energy management strategy for hybrid electric vehicle. The power-split hybrid powertrain combines the advantages of both the series and parallel hybrid powertrain and has been appealing to the auto-makers in the past years. The addition of two additional electric machines and a Planetary Gear Sets (PGS) allows more flexibility in terms of control at some cost of complexity. A forward-looking dynamic model of the power-split powertrain system is developed and implemented in Simulink first. An optimal control problem is formulated, which is further reduced to an optimal control problem with a single-variable objective function and a single-state subject to both dynamic constraint and boundary constraint. The reduced optimal control problem is then solved by an on-line (real-time) implementable approach based on Pontryagin’s Minimum Principal (PMP), where the costate p is adapted based on SOC feedback. Simulation results on standard driving cycles are compared using the proposed optimal control strategy and a rule-based control strategy. The results have shown significant improvement in fuel economy comparing to the baseline vehicle model, and the proposed online (real-time) PMP control algorithm with an adaptive costate p is very close to the optimal PMP solution with a constant costate. The proposed optimal control has a fast computation speed and calculates the optimal decision “dynamically” without the necessity of knowing future driving cycle information and can be practically implemented in real-time.

Sign in / Sign up

Export Citation Format

Share Document