Intelligent Resource Allocation for Massive Internet of Things Traffic
The Internet of Things (IoT) is considered a major trend in computing and in specific areas such as Smart Cities, Smart Grid, Industry 4.0, and mobile applications based on 5G. Typically, this set of technologies requires the orchestration of heterogeneous resources that are allocated over distinct infrastructures such as Cloud Computing, Cloud of Things, Datacenters, and network backbones. Consistent with this demand, the PSIoT-Orch framework was designed to orchestrate massive IoT traffic and to allocate network resources between Aggregators and Consumers in a Publish / Subscribe strategy. This dissertation aims to build an intelligent module for PSIoT-Orch that is capable of handling data types with different transmission requirements, aiming at the efficient use of a limited communication link. The proposed component uses Reinforcement Learning, more specifically, the SARSA algorithm to dynamically adjust the available bandwidth according to transmission priority. This solution, named PSIoT-SARSA, is validated in a simulation environment under the statistical methods of Analysis of Variance and Response Surface Analysis and, at the end of the study, it is observed that it obtained promising results. The contributions are focused on gathering an approach that allows allocating bandwidth in an intelligent way, allowing efficient scheduling of the IoT flow, in the scenario of the Smart Grid.