An Intelligent Offloading System Based on Multiagent Reinforcement Learning

Intelligent vehicles have provided a variety of services; there is still a great challenge to execute some computing-intensive applications. Edge computing can provide plenty of computing resources for intelligent vehicles, because it offloads complex services from the base station (BS) to the edge computing nodes. Before the selection of the computing node for services, it is necessary to clarify the resource requirement of vehicles, the user mobility, and the situation of the mobile core network; they will affect the users’ quality of experience (QoE). To maximize the QoE, we use multiagent reinforcement learning to build an intelligent offloading system; we divide this goal into two suboptimization problems; they include global node scheduling and independent exploration of agents. We apply the improved Kuhn–Munkres (KM) algorithm to node scheduling and make full use of existing edge computing nodes; meanwhile, we guide intelligent vehicles to the potential areas of idle computing nodes; it can encourage their autonomous exploration. Finally, we make some performance evaluations to illustrate the effectiveness of our constructed system on the simulated dataset.

Energy-Efficient Connected-Coverage Scheme in Wireless Sensor Networks

In the wireless sensor network, the lifetime of the network can be prolonged by improving the efficiency of limited energy. Existing works achieve better energy utilization, either through node scheduling or routing optimization. In this paper, an efficient solution combining node scheduling with routing protocol optimization is proposed in order to improve the network lifetime. Firstly, to avoid the redundant coverage, a node scheduling scheme that is based on a genetic algorithm is proposed to find the minimum number of sensor nodes to monitor all target points. Subsequently, the algorithm prolongs the lifetime of the network through choosing redundant sleep nodes to replace the dead node. Based on the obtained minimum coverage set, a new routing protocol, named Improved-Distributed Energy-Efficient Clustering (I-DEEC), is proposed. When considering the energy and the distance of the sensor node to the sink, a new policy choosing the cluster head is proposed. To make the energy load more balanced, uneven clusters are constructed. Meanwhile, the data communication way of sensor nodes around the sink is also optimized. The simulation results show that the proposed sensor node scheduling algorithm can reduce the number of redundant sensor nodes, while the I-DEEC routing protocol can improve the energy efficiency of data transmission. The lifetime of the network is greatly extended.