Joint Beam Training and Data Transmission Control for mmWave Delay-Sensitive Communications: A Parallel Reinforcement Learning Approach

Author(s):  
Wanlu Lei ◽  
Deyou Zhang ◽  
Yu Ye ◽  
Chenguang Lu
2017 ◽  
Vol 2017 ◽  
pp. 1-7 ◽  
Author(s):  
Jihun Moon ◽  
Yujin Lim

In smart city applications, huge numbers of devices need to be connected in an autonomous manner. 3rd Generation Partnership Project (3GPP) specifies that Machine Type Communication (MTC) should be used to handle data transmission among a large number of devices. However, the data transmission rates are highly variable, and this brings about a congestion problem. To tackle this problem, the use of Access Class Barring (ACB) is recommended to restrict the number of access attempts allowed in data transmission by utilizing strategic parameters. In this paper, we model the problem of determining the strategic parameters with a reinforcement learning algorithm. In our model, the system evolves to minimize both the collision rate and the access delay. The experimental results show that our scheme improves system performance in terms of the access success rate, the failure rate, the collision rate, and the access delay.


2020 ◽  
Vol 17 (10) ◽  
pp. 129-141
Author(s):  
Yiwen Nie ◽  
Junhui Zhao ◽  
Jun Liu ◽  
Jing Jiang ◽  
Ruijin Ding

Sign in / Sign up

Export Citation Format

Share Document