Scheduling and Power Control for Wireless Multicast Systems via Deep Reinforcement Learning

Multicasting in wireless systems is a natural way to exploit the redundancy in user requests in a content centric network. Power control and optimal scheduling can significantly improve the wireless multicast network’s performance under fading. However, the model-based approaches for power control and scheduling studied earlier are not scalable to large state spaces or changing system dynamics. In this paper, we use deep reinforcement learning, where we use function approximation of the Q-function via a deep neural network to obtain a power control policy that matches the optimal policy for a small network. We show that power control policy can be learned for reasonably large systems via this approach. Further, we use multi-timescale stochastic optimization to maintain the average power constraint. We demonstrate that a slight modification of the learning algorithm allows tracking of time varying system statistics. Finally, we extend the multi-time scale approach to simultaneously learn the optimal queuing strategy along with power control. We demonstrate the scalability, tracking and cross-layer optimization capabilities of our algorithms via simulations. The proposed multi-time scale approach can be used in general large state-space dynamical systems with multiple objectives and constraints, and may be of independent interest.

Mitigating Broadcasting Storm Using Multihead Nomination Clustering in Vehicular Content Centric Networks

Vehicles are highly mobile nodes; therefore, they frequently change their topology. To maintain a stable connection with the server in high-speed vehicular networks, the handover process is restarted again to satisfy the content requests. To satisfy the requested content, a vehicular-content-centric network (VCCN) is proposed. The proposed scheme adopts in-network caching instead of destination-based routing to satisfy the requests. In this regard, various routing protocols have been proposed to increase the communication efficiency of VCCN. Despite disruptive communication links due to head vehicle mobility, the vehicles create a broadcasting storm that increases communication delay and packet drop fraction. To address the issues mentioned above in the VCCN, we proposed a multihead nomination clustering scheme. It extends the hello packet header to get the vehicle information from the cluster vehicles. The novel cluster information table (CIT) has been proposed to maintain several nominated head vehicles of a cluster on roadside units (RSUs). In disruptive communication links due to the head vehicle’s mobility, the RSU nominates the new head vehicle using CIT entries, resulting in the elimination of the broadcasting storm effect on disruptive communication links. Finally, the proposed scheme increases the successful communication rate, decreases the communication delay, and ensures a high cache success ratio on an increasing number of vehicles.