Towards autonomous data ferry route design through reinforcement learning

Author(s):  
Daniel Henkel ◽  
Timothy X. Brown
2021 ◽  
Author(s):  
Subrata Bhowmik

Abstract Optimal route selection for the subsea pipeline is a critical task for the pipeline design process, and the route selected can significantly affect the overall project cost. Therefore, it is necessary to design the routes to be economical and safe. On-bottom stability (OBS) and fixed obstacles like existing crossings and free spans are the main factors that affect the route selection. This article proposes a novel hybrid optimization method based on a typical Machine Learning algorithm for designing an optimal pipeline route. The proposed optimal route design is compared with one of the popular multi-objective optimization method named Genetic Algorithm (GA). The proposed pipeline route selection method uses a Reinforcement Learning (RL) algorithm, a particular type of machine learning method to train a pipeline system that would optimize the route selection of subsea pipelines. The route optimization tool evaluates each possible route by incorporating Onbottom stability criteria based on DNVGL-ST-109 standard and other constraints such as the minimum pipeline route length, static obstacles, pipeline crossings, and free-span section length. The cost function in the optimization method simultaneously handles the minimization of length and cost of mitigating procedures. Genetic Algorithm, a well established optimization method, has been used as a reference to compare the optimal route with the result from the proposed Reinforcement Learning based optimization method. Three different case studies are performed for finding the optimal route selection using the Reinforcement Learning (RL) approach considering the OBS criteria into its cost function and compared with the Genetic Algorithm (GA). The RL method saves upto 20% pipeline length for a complex problem with 15 crossings and 31 free spans. The RL optimization method provides the optimal routes, considering different aspects of the design and the costs associated with the various factors to stabilize a pipeline (mattress, trenching, burying, concrete coating, or even employing a more massive pipe with additional steel wall thickness). OBS criteria significantly influence the best route, indicating that the tool can reduce the pipeline's design time and minimize installation and operational costs of the pipeline. Conventionally the pipeline route optimization is performed by a manual process where the minimum roule length and static obstacles are considered to find an optimum route. The engineering is then performed to fulfill the criteria of this route, and this approach may not lead to an optimized engineering cost. The proposed Reinforced Learning method for route optimization is a mixed type, faster, and cost-efficient approach. It significantly minimizes the pipeline's installation and operational costs up to 20% of the conventional route selection process.


2021 ◽  
pp. 1-13
Author(s):  
Usama Abdur Rahman ◽  
C. Jayakumar

Wireless visual sensor networks (WVSNs) have emerged as a strategic inter disciplinary category of WSN with its visual sensor based intelligence that has garnered considerable attention. The growing demand for energy efficient and maximized life time networks in highly critical applications like surveillance, military and medicine has opened up more prospects as well as challenges in the deployment of WVSNs. Multi-hop communication in WVSN results in overloading of intermediate sensor nodes due to its dual function in the network which results in hotspot effect. This can be mitigated with the help of mobile sinks and rendezvous points based route design. But mobile sinks has to visit every cluster head to gather data which results in longer traversal path and higher latency and power consumption related issues if not addressed properly will impact the performance of the network. Our objective is to analyze and determine the optimal trajectory for mobile sink node traversal with the help of a high quality transmission architecture integrated with reinforcement learning and isolation forest based anomaly detection to propose an energy efficient meta-heuristic approach to enhance the performance of network by reducing the latency and securing the network against possible attacks.


Decision ◽  
2016 ◽  
Vol 3 (2) ◽  
pp. 115-131 ◽  
Author(s):  
Helen Steingroever ◽  
Ruud Wetzels ◽  
Eric-Jan Wagenmakers

Sign in / Sign up

Export Citation Format

Share Document