On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming

1983 ◽  
Vol 10 (1) ◽  
pp. 367-377 ◽  
Author(s):  
I. Capuzzo Dolcetta
2020 ◽  
Vol 26 ◽  
pp. 109
Author(s):  
Manil T. Mohan

In this work, we consider the controlled two dimensional tidal dynamics equations in bounded domains. A distributed optimal control problem is formulated as the minimization of a suitable cost functional subject to the controlled 2D tidal dynamics equations. The existence of an optimal control is shown and the dynamic programming method for the optimal control of 2D tidal dynamics system is also described. We show that the feedback control can be obtained from the solution of an infinite dimensional Hamilton-Jacobi equation. The non-differentiability and lack of smoothness of the value function forced us to use the method of viscosity solutions to obtain a solution of the infinite dimensional Hamilton-Jacobi equation. The Bellman principle of optimality for the value function is also obtained. We show that a viscosity solution to the Hamilton-Jacobi equation can be used to derive the Pontryagin maximum principle, which give us the first order necessary conditions of optimality. Finally, we characterize the optimal control using the adjoint variable.


2020 ◽  
Vol 23 (3) ◽  
pp. 306-311
Author(s):  
Yu. Kurochkin ◽  
Dz. Shoukavy ◽  
I. Boyarina

The immobility of the center of mass in spaces of constant curvature is postulated based on its definition obtained in [1]. The system of two particles which interact through a potential depending only on the distance between particles on a three-dimensional sphere is considered. The Hamilton-Jacobi equation is formulated and its solutions and trajectory equations are found. It was established that the reduced mass of the system depends on the relative distance.


Author(s):  
Jennifer Coopersmith

Hamilton’s genius was to understand what were the true variables of mechanics (the “p − q,” conjugate coordinates, or canonical variables), and this led to Hamilton’s Mechanics which could obtain qualitative answers to a wider ranger of problems than Lagrangian Mechanics. It is explained how Hamilton’s canonical equations arise, why the Hamiltonian is the “central conception of all modern theory” (quote of Schrödinger’s), what the “p − q” variables are, and what phase space is. It is also explained how the famous conservation theorems arise (for energy, linear momentum, and angular momentum), and the connection with symmetry. The Hamilton-Jacobi Equation is derived using infinitesimal canonical transformations (ICTs), and predicts wavefronts of “common action” spreading out in (configuration) space. An analogy can be made with geometrical optics and Huygen’s Principle for the spreading out of light waves. It is shown how Hamilton’s Mechanics can lead into quantum mechanics.


Author(s):  
Razvan Gabriel Iagar ◽  
Philippe Laurençot

A classification of the behaviour of the solutions f(·, a) to the ordinary differential equation (|f′|p-2f′)′ + f - |f′|p-1 = 0 in (0,∞) with initial condition f(0, a) = a and f′(0, a) = 0 is provided, according to the value of the parameter a > 0 when the exponent p takes values in (1, 2). There is a threshold value a* that separates different behaviours of f(·, a): if a > a*, then f(·, a) vanishes at least once in (0,∞) and takes negative values, while f(·, a) is positive in (0,∞) and decays algebraically to zero as r→∞ if a ∊ (0, a*). At the threshold value, f(·, a*) is also positive in (0,∞) but decays exponentially fast to zero as r→∞. The proof of these results relies on a transformation to a first-order ordinary differential equation and a monotonicity property with respect to a > 0. This classification is one step in the description of the dynamics near the extinction time of a diffusive Hamilton–Jacobi equation with critical gradient absorption and fast diffusion.


Sign in / Sign up

Export Citation Format

Share Document