Constrained Markov Decision Process Modeling for Optimal Sensing of Cardiac Events in Mobile Health

Author(s):  
Bing Yao ◽  
Yun Chen ◽  
Hui Yang
2016 ◽  
Vol 250 (3) ◽  
pp. 925-938 ◽  
Author(s):  
Reza Pourmoayed ◽  
Lars Relund Nielsen ◽  
Anders Ringgaard Kristensen

2015 ◽  
Vol 2015 ◽  
pp. 1-10 ◽  
Author(s):  
Yingqi Yin ◽  
Fengye Hu ◽  
Ling Cen ◽  
Yu Du ◽  
Lu Wang

As an important part of the Internet of Things (IOT) and the special case of device-to-device (D2D) communication, wireless body area network (WBAN) gradually becomes the focus of attention. Since WBAN is a body-centered network, the energy of sensor nodes is strictly restrained since they are supplied by battery with limited power. In each data collection, only one sensor node is scheduled to transmit its measurements directly to the access point (AP) through the fading channel. We formulate the problem of dynamically choosing which sensor should communicate with the AP to maximize network lifetime under the constraint of fairness as a constrained markov decision process (CMDP). The optimal lifetime and optimal policy are obtained by Bellman equation in dynamic programming. The proposed algorithm defines the limiting performance in WBAN lifetime under different degrees of fairness constraints. Due to the defect of large implementation overhead in acquiring global channel state information (CSI), we put forward a distributed scheduling algorithm that adopts local CSI, which saves the network overhead and simplifies the algorithm. It was demonstrated via simulation that this scheduling algorithm can allocate time slot reasonably under different channel conditions to balance the performances of network lifetime and fairness.


Sign in / Sign up

Export Citation Format

Share Document