Reinforcement learning-based dynamic position control of mobile node for ocean sensor networks

In this paper, a novel dynamic position control (PC) approach for mobile nodes (MNs) is proposed for ocean sensor networks (OSNs) which directly utilizes a neural network to represent a PC strategy. The calculation of position estimation no longer needs to be carried out in the proposed scheme, so the localization error is eliminated. In addition, reinforcement learning is used to train the PC strategy, so that the MN can learn a more highly accurate and fast response control strategy. Moreover, to verify its applicability to the real-world environment, we conducted field experiment deployment in OSNs consisting of a MN designed by us and some fixed nodes. The experimental results demonstrate the effectiveness of our proposed control scheme with impressive improvements on PC accuracy by more than 53% and response speed by more than 15%.

Two-Phase Robust Target Localization in Ocean Sensor Networks Using Received Signal Strength Measurements

Target localization plays a vital role in ocean sensor networks (OSNs), in which accurate position information is not only a critical need of ocean observation but a necessary condition for the implementation of ocean engineering. Compared with other range-based localization technologies in OSNs, the received signal strength (RSS)-based localization technique has attracted widespread attention due to its low cost and synchronization-free nature. However, maintaining relatively good accuracy in an environment as dynamic and complex as the ocean remains challenging. One of the most damaging factors that degrade the localization accuracy is the uncertainty in transmission power. Besides the equipment loss, the uncertain factors in the fickle ocean environment may result in a significant deviation between the standard rated transmission power and the usable transmission power. The difference between the rated and actual transmission power would lead to an extra error when it comes to the localization in OSNs. In this case, a method that can locate the target without needing prior knowledge of the transmission power is proposed. The method relies on a two-phase procedure in which the location information and the transmission power are jointly estimated. First, the original nonconvex localization problem is transformed into an alternating non-negativity-constrained least square framework with the unknown transmission power (UT-ANLS). Under this framework, a two-stage optimization method based on interior point method (IPM) and majorization-minimization tactic (MMT) is proposed to search for the optimal solution. In the first stage, the barrier function method is used to limit the optimization scope to find an approximate solution to the problem. However, it is infeasible to approach the constraint boundary due to its intrinsic error. Then, in the second stage, the original objective is converted into a surrogate function consisting of a convex quadratic and concave term. The solution obtained by IPM is considered the initial guess of MMT to jointly estimate both the location and transmission power in the iteration. In addition, in order to evaluate the performance of IPM-MM, the Cramer Rao lower bound (CRLB) is derived. Numerical simulation results demonstrate that IPM-MM achieves better performance than the others in different scenarios.

A Robust, Non-Cooperative Localization Algorithm in the Presence of Outlier Measurements in Ocean Sensor Networks

As an important means of multidimensional observation on the sea, ocean sensor networks (OSNs) could meet the needs of comprehensive information observations in large-scale and multifactor marine environments. In what concerns OSNs, accurate location information is the basis of the data sets. However, because of the multipath effect—signal shadowing by waves and unintentional or malicious attacks—outlier measurements occur frequently and inevitably, which directly degrades the localization accuracy. Therefore, increasing localization accuracy in the presence of outlier measurements is a critical issue that needs to be urgently tackled in OSNs. In this case, this paper proposed a robust, non-cooperative localization algorithm (RNLA) using received signal strength indication (RSSI) in the presence of outlier measurements in OSNs. We firstly formulated the localization problem using a log-normal shadowing model integrated with a first order Taylor series. Nevertheless, the problem was infeasible to solve, especially in the presence of outlier measurements. Hence, we then converted the localization problem into the optimization problem using squared range and weighted least square (WLS), albeit in a nonconvex form. For the sake of an accurate solution, the problem was then transformed into a generalized trust region subproblem (GTRS) combined with robust functions. Although GTRS was still a nonconvex framework, the solution could be acquired by a bisection approach. To ensure global convergence, a block prox-linear (BPL) method was incorporated with the bisection approach. In addition, we conducted the Cramer–Rao low bound (CRLB) to evaluate RNLA. Simulations were carried out over variable parameters. Numerical results showed that RNLA outperformed the other algorithms under outlier measurements, notwithstanding that the time for RNLA computation was a little bit more than others in some conditions.