Reinforcement learning-based NMPC for tracking control of ASVs: Theory and experiments

2022 ◽  
Vol 120 ◽  
pp. 105024
Author(s):  
Andreas B. Martinsen ◽  
Anastasios M. Lekkas ◽  
Sébastien Gros
Keyword(s):  
Reinforcement Learning ◽  
Tracking Control ◽  
Theory And Experiments

scholarly journals A Hybrid Tracking Control Strategy for Nonholonomic Wheeled Mobile Robot Incorporating Deep Reinforcement Learning Approach

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 15592-15602
Author(s):  
Xueshan Gao ◽  
Rui Gao ◽  
Peng Liang ◽  
Qingfang Zhang ◽  
Rui Deng ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
Mobile Robot ◽  
Control Strategy ◽  
Tracking Control ◽  
Wheeled Mobile Robot ◽  
Learning Approach

scholarly journals Online Optimal Control of Robotic Systems with Single Critic NN-Based Reinforcement Learning

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Xiaoyi Long ◽  
Zheng He ◽  
Zhongyuan Wang
Keyword(s):  
Optimal Control ◽  
Reinforcement Learning ◽  
Tracking Control ◽  
Learning Algorithm ◽  
Tracking Error ◽  
Adaptive Dynamic Programming ◽  
Robotic Systems ◽  
Control Synthesis ◽  
Optimal Tracking ◽  
Optimal Tracking Control

This paper suggests an online solution for the optimal tracking control of robotic systems based on a single critic neural network (NN)-based reinforcement learning (RL) method. To this end, we rewrite the robotic system model as a state-space form, which will facilitate the realization of optimal tracking control synthesis. To maintain the tracking response, a steady-state control is designed, and then an adaptive optimal tracking control is used to ensure that the tracking error can achieve convergence in an optimal sense. To solve the obtained optimal control via the framework of adaptive dynamic programming (ADP), the command trajectory to be tracked and the modified tracking Hamilton-Jacobi-Bellman (HJB) are all formulated. An online RL algorithm is the developed to address the HJB equation using a critic NN with online learning algorithm. Simulation results are given to verify the effectiveness of the proposed method.

Sign in / Sign up

Export Citation Format

Share Document