scholarly journals Path following method for AUV based on Q-Learning and RBF neural network

Author(s):  
Zeyu Li ◽  
Weidong Liu ◽  
Le Li ◽  
Wenbo Zhang ◽  
Liwei Guo

In the underwater docking process, the oscillation on AUV velocity brings extra challenge on AUV path following. A Q-learning based Sliding Mode Control (SMC) method to increase the path following performances is proposed. Firstly, AUV guidance law is designed to reduce the path following error. Heading and depth sliding mode controllers are designed to track the guidance law. Then, according to AUV velocity, tracking error and the first derivative, the control parameters of SMC are optimized via Q-learning network. RBF neural network is built to accelerate the offline learning rate. Finally, numerical simulations are made to investigate the characteristics of the present method. Comparisons are made between the trained Q-learning based SMC and the traditional SMC. The results show the effectiveness of the present method.

2022 ◽  
pp. 1-20
Author(s):  
G. Wu ◽  
K. Zhang ◽  
Z. Han

Abstract In order to intercept a highly manoeuvering target with an ideal impact angle in the three-dimensional space, this paper promises to probe into the problem of three-dimensional terminal guidance. With the goal of the highly target acceleration and short terminal guidance time, a guidance law, based on the advanced fast non-singular terminal sliding mode theory, is designed to quickly converge the line-of-sight (LOS) angle and the LOS angular rate within a finite time. In the design process, the target acceleration is regarded as an unknown boundary external disturbance of the guidance system, and the RBF neural network is used to estimate it. In order to improve the estimation accuracy of RBF neural network and accelerate its convergence, the parameters of RBF neural network are adjusted online in real time. At the same time, an adaptive law is designed to compensate the estimation error of the RBF neural network, which improves the convergence speed of the guidance system. Theoretical analysis demonstrates that the state and the sliding manifold of the guidance system converge in finite time. According to Lyapunov theory, the stability of the system can be guaranteed by online adjusting the parameters of RBF neural network and adaptive parameters. The numerical simulation results verify the effectiveness and superiority of the proposed guidance law.


Author(s):  
Zongxuan Li ◽  
Renxiang Bu ◽  
Hugan Zhang

To address the unmeasured velocity, external disturbance and internal model uncertainty for following the path of an under-actuated ship, the paper presents a sliding mode control method based on the radial basis function(RBF) neural network and the velocity observer. To enhance the RBF performance of approximating the unknown, an arc tangent function was exploited in the RBF neural network to update its weight values. Then, the nonlinear observer was built via the hyperbolic tangent function to deal with the unmeasured velocity of the ship. Furthermore, in order to avoid overshoots when the ship is moving to its way points, the virtual paths of a variable circle based on the turning angle were designed at the joints of the path of the ship to enhance its path following capability. Finally, the simulation results show that the sliding mode controller designed in the paper can force the ship to follow accurately the reference path in case of time-varying disturbances without measured velocity and enhance the path following performance of the ship and the accuracy of the RBF neural network, thus demonstrating its effectiveness.


2021 ◽  
Vol 9 (10) ◽  
pp. 1055
Author(s):  
Hugan Zhang ◽  
Xianku Zhang ◽  
Renxiang Bu

In the process of ship navigation, due to the characteristics of large inertia and large time delay, overshoot can easily occur in the process of path following. Once the ship deviates from the waypoint, it is prone to grounding and collision. Considering this problem, a sliding mode control algorithm based on position prediction using the radial basis function (RBF) neural network is proposed. The desired heading angle is designed according to a backstepping algorithm. The hyperbolic tangent function is used to design the sliding surface, and the course is controlled by sliding mode control. The second-order Taylor expansion is used to predict the future position, the current error and future error functions are constructed, and the total errors are fed back to the desired heading angle. In the sliding mode control system, the RBF neural network is used to approximate the total unknown term, and a velocity observer is introduced to obtain the surge velocity and sway velocity. To verify the effectiveness of the algorithm, the mathematical model group (MMG) model is used for simulation. The simulation results show the effectiveness and superiority of the designed controller. Therefore, the RBF neural network sliding mode controller based on predicted position has robustness for ship path following.


2021 ◽  
Vol 2021 ◽  
pp. 1-19
Author(s):  
Gang Wu ◽  
Ke Zhang

Given the resolution of the guidance for intercepting highly maneuvering targets, a novel finite-time convergent guidance law is proposed, which takes the following conditions into consideration, including the impact angle constraint, the guidance command input saturation constraint, and the autopilot second-order dynamic characteristics. Firstly, based on the nonsingular terminal sliding mode control theory, a finite-time convergent nonsingular terminal sliding mode surface is designed. On the back of the backstepping control method, the virtual control law appears. A nonlinear first-order filter is constructed so as to address the “differential expansion” problem in traditional backstepping control. By designing an adaptive auxiliary system, the guidance command input saturation problem is dealt with. The RBF neural network disturbance observer is used for estimating the unknown boundary external disturbances of the guidance system caused by the target acceleration. The parameters of the RBF neural network are adjusted online in real time, for the purpose of improving the estimation accuracy of the RBF neural network disturbance observer and accelerating its convergence characteristics. At the same time, an adaptive law is designed to compensate the estimation error of the RBF neural network disturbance observer. Then, the Lyapunov stability theory is used to prove the finite-time stability of the guidance law. Finally, numerical simulations verify the effectiveness and superiority of the proposed guidance law.


2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Xin Zhang ◽  
Wenbo Xu ◽  
Wenru Lu

This study aimed to improve the position tracking accuracy of the single joint of the manipulator when the manipulator model information is uncertain. The study is based on the theory of fractional calculus, radial basis function (RBF) neural network control, and iterative sliding mode control, and the RBF neural network fractional-order iterative sliding mode control strategy is proposed. First, the stability analysis of the proposed control strategy is carried out through the Lyapunov function. Second, taking the two-joint manipulator as an example, simulation comparison and analysis are carried out with iterative sliding mode control strategy, fractional-order iterative sliding mode reaching law control strategy, and fractional-order iterative sliding mode surface control strategy. Finally, through simulation experiments, the results show that the RBF neural network fractional-order iterative sliding mode control strategy can effectively improve the joints’ tracking and control accuracy, reduce the position tracking error, and effectively suppress the chattering caused by the sliding mode control. It is proved that the proposed control strategy can ensure high-precision position tracking when the information of the manipulator model is uncertain.


Author(s):  
Renqiang Wang ◽  
Qinrong Li ◽  
Shengze Miao ◽  
Keyin Miao ◽  
Hua Deng

Abstract: The purpose of this paper was to design an intelligent controller of ship motion based on sliding mode control with a Radial Basis Function (RBF) neural network optimized by the genetic algorithm and expansion observer. First, the improved genetic algorithm based on the distributed genetic algorithm with adaptive fitness and adaptive mutation was used to automatically optimize the RBF neural network. Then, with the compensation designed by the RBF neural network, anti-saturation control was realized. Additionally, the intelligent control algorithm was introduced by Sliding Mode Control (SMC) with the stability theory. A comparative study of sliding mode control integrated with the RBF neural network and proportional–integral–derivative control combined with the fuzzy optimization model showed that the stabilization time of the intelligent control system was 43.75% faster and the average overshoot was reduced by 52% compared with the previous two attempts. Background: It was known that the Proportional-Integral-Derivative (PID) control and self-adaptation control cannot really solve the problems of frequent disturbance from external wind and waves, as well as the problems with ship nonlinearity and input saturation. So, the previous ship motion controller should be transformed by advanced intelligent technology, on the basis of referring to the latest relevant patent design methods. Objective: An intelligent controller of ship motion was designed based on optimized Radial Basis Function Neural Network (RBFNN) in the presence of non-linearity, uncertainty, and limited input. Methods: The previous ship motion controller was remodeled based on Sliding Mode Control (SMC) with RBFNN optimized by improved genetic algorithm and expansion observer. The intelligent control algorithm integrated with genetic neural network solved the problem of system model uncertainty, limited control input, and external interference. Distributed genetic with adaptive fitness and adaptive mutation method guaranteed the adequacy of search and the global optimal convergence results, which enhanced the approximation ability of RBFNN. With the compensation designed by the optimized RBFNN, it was realized anti-saturation control. The chattering caused by external disturbance in SMC controller was reduced by the expansion observer. Results: A comparative study with RBFNN-SMC control and fuzzy-PID control, the stabilization time of the intelligent control system was 43.75% faster, the average overshoot was reduced by 52%, compared to the previous two attempts. Conclusion: The intelligent control algorithm succeed in dealing with the problems of nonlinearity, uncertainty, input saturation, and external interference. The intelligent control algorithm can be applied into research and development ship steering system, which would be created a new patent.


2021 ◽  
pp. 002029402110211
Author(s):  
Tao Chen ◽  
Damin Cao ◽  
Jiaxin Yuan ◽  
Hui Yang

This paper proposes an observer-based adaptive neural network backstepping sliding mode controller to ensure the stability of switched fractional order strict-feedback nonlinear systems in the presence of arbitrary switchings and unmeasured states. To avoid “explosion of complexity” and obtain fractional derivatives for virtual control functions continuously, the fractional order dynamic surface control (DSC) technology is introduced into the controller. An observer is used for states estimation of the fractional order systems. The sliding mode control technology is introduced to enhance robustness. The unknown nonlinear functions and uncertain disturbances are approximated by the radial basis function neural networks (RBFNNs). The stability of system is ensured by the constructed Lyapunov functions. The fractional adaptive laws are proposed to update uncertain parameters. The proposed controller can ensure convergence of the tracking error and all the states remain bounded in the closed-loop systems. Lastly, the feasibility of the proposed control method is proved by giving two examples.


Electronics ◽  
2021 ◽  
Vol 10 (7) ◽  
pp. 831
Author(s):  
Izzat Al-Darraji ◽  
Dimitrios Piromalis ◽  
Ayad A. Kakei ◽  
Fazal Qudus Khan ◽  
Milos Stojemnovic ◽  
...  

Aerial Robot Arms (ARAs) enable aerial drones to interact and influence objects in various environments. Traditional ARA controllers need the availability of a high-precision model to avoid high control chattering. Furthermore, in practical applications of aerial object manipulation, the payloads that ARAs can handle vary, depending on the nature of the task. The high uncertainties due to modeling errors and an unknown payload are inversely proportional to the stability of ARAs. To address the issue of stability, a new adaptive robust controller, based on the Radial Basis Function (RBF) neural network, is proposed. A three-tier approach is also followed. Firstly, a detailed new model for the ARA is derived using the Lagrange–d'Alembert principle. Secondly, an adaptive robust controller, based on a sliding mode, is designed to manipulate the problem of uncertainties, including modeling errors. Last, a higher stability controller, based on the RBF neural network, is implemented with the adaptive robust controller to stabilize the ARAs, avoiding modeling errors and unknown payload issues. The novelty of the proposed design is that it takes into account high nonlinearities, coupling control loops, high modeling errors, and disturbances due to payloads and environmental conditions. The model was evaluated by the simulation of a case study that includes the two proposed controllers and ARA trajectory tracking. The simulation results show the validation and notability of the presented control algorithm.


Sign in / Sign up

Export Citation Format

Share Document