A Q-Learning-based Decision Making Scheme for Application Reconfiguration in Sensor Networks

2007 ◽  
Author(s):  
Dongmei Zhang ◽  
Huadong Ma
Keyword(s):  
Decision Making ◽  
Sensor Networks ◽  
Q Learning ◽  
Application Reconfiguration

Q-Learning-Based Optimized Routing in Biomedical Wireless Sensor Networks

2016 ◽  
Vol 63 (1) ◽  
pp. 89-97 ◽  
Author(s):  
Jose Anand ◽  
J. Raja Paul Perinbam ◽  
D. Meganathan
Keyword(s):  
Wireless Sensor Networks ◽  
Sensor Networks ◽  
Wireless Sensor ◽  
Q Learning

scholarly journals Improved Q-Learning Algorithm Based on Approximate State Matching in Agricultural Plant Protection Environment

Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 737
Author(s):  
Fengjie Sun ◽  
Xianchang Wang ◽  
Rui Zhang
Keyword(s):  
Decision Making ◽  
Reinforcement Learning ◽  
Optimal Policy ◽  
Feasible Solution ◽  
Learning Algorithm ◽  
Plant Protection ◽  
Agricultural Plant ◽  
Q Learning ◽  
Aerial Vehicle ◽  
Optimal Action

An Unmanned Aerial Vehicle (UAV) can greatly reduce manpower in the agricultural plant protection such as watering, sowing, and pesticide spraying. It is essential to develop a Decision-making Support System (DSS) for UAVs to help them choose the correct action in states according to the policy. In an unknown environment, the method of formulating rules for UAVs to help them choose actions is not applicable, and it is a feasible solution to obtain the optimal policy through reinforcement learning. However, experiments show that the existing reinforcement learning algorithms cannot get the optimal policy for a UAV in the agricultural plant protection environment. In this work we propose an improved Q-learning algorithm based on similar state matching, and we prove theoretically that there has a greater probability for UAV choosing the optimal action according to the policy learned by the algorithm we proposed than the classic Q-learning algorithm in the agricultural plant protection environment. This proposed algorithm is implemented and tested on datasets that are evenly distributed based on real UAV parameters and real farm information. The performance evaluation of the algorithm is discussed in detail. Experimental results show that the algorithm we proposed can efficiently learn the optimal policy for UAVs in the agricultural plant protection environment.

scholarly journals Packet Flow Based Reinforcement Learning MAC Protocol for Underwater Acoustic Sensor Networks

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2284
Author(s):  
Ibrahim B. Alhassan ◽  
Paul D. Mitchell
Keyword(s):  
Sensor Networks ◽  
Mac Protocol ◽  
Propagation Delay ◽  
Basic Function ◽  
Acoustic Sensor ◽  
Underwater Acoustic Sensor Networks ◽  
Medium Access ◽  
Underwater Acoustic ◽  
Q Learning ◽  
Acoustic Sensor Networks

Medium access control (MAC) is one of the key requirements in underwater acoustic sensor networks (UASNs). For a MAC protocol to provide its basic function of efficient sharing of channel access, the highly dynamic underwater environment demands MAC protocols to be adaptive as well. Q-learning is one of the promising techniques employed in intelligent MAC protocol solutions, however, due to the long propagation delay, the performance of this approach is severely limited by reliance on an explicit reward signal to function. In this paper, we propose a restructured and a modified two stage Q-learning process to extract an implicit reward signal for a novel MAC protocol: Packet flow ALOHA with Q-learning (ALOHA-QUPAF). Based on a simulated pipeline monitoring chain network, results show that the protocol outperforms both ALOHA-Q and framed ALOHA by at least 13% and 148% in all simulated scenarios, respectively.

Sign in / Sign up

Export Citation Format

Share Document