Some examples of the optimal control of diffusions with partial observation and non-gaussian initial condition

Author(s):  
U. G. Haussmann
Author(s):  
Ajay Jasra ◽  
Arnaud Doucet

In this paper, we show how to use sequential Monte Carlo methods to compute expectations of functionals of diffusions at a given time and the gradients of these quantities w.r.t. the initial condition of the process. In some cases, via the exact simulation of the diffusion, there is no time discretization error, otherwise the methods use Euler discretization. We illustrate our approach on both high- and low-dimensional problems from optimal control and establish that our approach substantially outperforms standard Monte Carlo methods typically adopted in the literature. The methods developed here are appropriate for solving a certain class of partial differential equations as well as for option pricing and hedging.


2018 ◽  
Vol 21 (6) ◽  
pp. 1439-1470 ◽  
Author(s):  
Xiuwen Li ◽  
Yunxiang Li ◽  
Zhenhai Liu ◽  
Jing Li

Abstract In this paper, a sensitivity analysis of optimal control problem for a class of systems described by nonlinear fractional evolution inclusions (NFEIs, for short) on Banach spaces is investigated. Firstly, the nonemptiness as well as the compactness of the mild solutions set S(ζ) (ζ being the initial condition) for the NFEIs are obtained, and we also present an extension Filippov’s theorem and whose proof differs from previous work only in some technical details. Finally, the optimal control problems described by NFEIs depending on the initial condition ζ and the parameter η are considered and the sensitivity properties of the optimal control problem are also established.


2012 ◽  
Vol 2012 ◽  
pp. 1-12 ◽  
Author(s):  
Yeşim Saraç ◽  
Murat Subaşı

We use the initial condition on the state variable of a hyperbolic problem as control function and formulate a control problem whose solution implies the minimization at the final time of the distance measured in a suitable norm between the solution of the problem and given targets. We prove the existence and the uniqueness of the optimal solution and establish the optimality condition. An iterative algorithm is constructed to compute the required optimal control as limit of a suitable subsequence of controls. An iterative procedure is implemented and used to numerically solve some test problems.


2012 ◽  
Vol 2012 ◽  
pp. 1-18
Author(s):  
Louadj Kahina ◽  
Aidene Mohamed

The theory of control analyzes the proprieties of commanded systems. Problems of optimal control (OC) have been intensively investigated in the world literature for over forty years. During this period, series of fundamental results have been obtained, among which should be noted the maximum principle (Pontryagin et al., 1962) and dynamic programming (Bellman, 1963). For many of the problems of the optimal control theory (OCT), adequate solutions are found (Bryson and Yu-chi, 1969, Lee and Markus, 1967, Gabasov and Kirillova, 1977, 1978, 1980). Results of the theory were taken up in various fields of science, engineering, and economics. The present paper aims at extending the constructive methods of Balashevich et al., (2000) that were developed for the problems of optimal control with the bounded initial state is not fixed are considered.


Author(s):  
Olha Milchenko

A non-linear optimal control problem for a hyperbolic system of first order equations on a line in the case of degeneracy of the initial condition line is considered. This problem describes many natural, economic and social processes, in particular, the optimality of the Slutsky demand, the theory of bio-population, etc. The research is based on the method of characteristics and the use of nonstandard variations of the increment of target functional, which leads to the construction of efficient computational algorithms.


Sign in / Sign up

Export Citation Format

Share Document