scholarly journals Target Search Control of AUV in Underwater Environment With Deep Reinforcement Learning

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 96549-96559 ◽  
Author(s):  
Xiang Cao ◽  
Changyin Sun ◽  
Mingzhong Yan
Author(s):  
Ahmed Ali Saihood ◽  
Laith Alzubaidi

The wireless sensor networks have been developed and extended to more expanded environments, and the underwater environment needs to develop more applications in different fields, such as sea animals monitoring, predict the natural disasters, and data exchanging between underwater and ground environments. The underwater environment has almost the same infrastructure and functions with ground environment with some limitations, such as processing, communications, and battery limits. In terms of battery limits, many techniques have been proposed; in this chapter, the authors will focus in deep reinforcement learning techniques.


2020 ◽  
Vol 1549 ◽  
pp. 022104
Author(s):  
Xudong Qin ◽  
Xiaomao Li ◽  
Yuan Liu ◽  
Rui Zhou ◽  
Jiajia Xie

2018 ◽  
Vol 2018 ◽  
pp. 1-13 ◽  
Author(s):  
Jianjun Ni ◽  
Liu Yang ◽  
Pengfei Shi ◽  
Chengming Luo

Multi-AUV cooperative target search problem in unknown 3D underwater environment is not only a research hot spot but also a challenging task. To complete this task, each autonomous underwater vehicle (AUV) needs to move quickly without collision and cooperate with other AUVs to find the target. In this paper, an improved dolphin swarm algorithm- (DSA-) based approach is proposed, and the search problem is divided into three stages, namely, random cruise, dynamic alliance, and team search. In the proposed approach, the Levy flight method is used to provide a random walk for AUV to detect the target information in the random cruise stage. Then the self-organizing map (SOM) neural network is used to build dynamic alliances in real time. Finally, an improved DSA algorithm is presented to realize the team search. Furthermore, some simulations are conducted, and the results show that the proposed approach is capable of guiding multi-AUVs to achieve the target search task in unknown 3D underwater environment efficiently.


IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 117227-117245 ◽  
Author(s):  
Chunxue Wu ◽  
Bobo Ju ◽  
Yan Wu ◽  
Xiao Lin ◽  
Naixue Xiong ◽  
...  

2018 ◽  
Vol 150 ◽  
pp. 1-11 ◽  
Author(s):  
Xiang Cao ◽  
Hongbing Sun ◽  
Gene Eu Jan

Decision ◽  
2016 ◽  
Vol 3 (2) ◽  
pp. 115-131 ◽  
Author(s):  
Helen Steingroever ◽  
Ruud Wetzels ◽  
Eric-Jan Wagenmakers

Sign in / Sign up

Export Citation Format

Share Document