Deep Reinforcement Learning Based Routing Scheduling Scheme for Joint Optimization of Energy Consumption and Network Throughput

2021 ◽  
pp. 88-97
Author(s):  
Binbin Ye ◽  
Wei Luo ◽  
Ruikun Wang ◽  
Zhiqun Gu ◽  
Rentao Gu
Keyword(s):  
Reinforcement Learning ◽  
Energy Consumption ◽  
Network Throughput ◽  
Joint Optimization ◽  
Scheduling Scheme

scholarly journals Computation offloading through mobile vehicles in IoT-edge-cloud network

2020 ◽  
Vol 2020 (1) ◽  
Author(s):  
Jun Long ◽  
Yueyi Luo ◽  
Xiaoyu Zhu ◽  
Entao Luo ◽  
Mingfeng Huang
Keyword(s):  
Reinforcement Learning ◽  
Energy Consumption ◽  
Low Cost ◽  
Computation Offloading ◽  
Mobile Edge Computing ◽  
Challenging Problem ◽  
Learning Technique ◽  
Cloud Network ◽  
The City ◽  
Task Offloading

AbstractWith the developing of Internet of Things (IoT) and mobile edge computing (MEC), more and more sensing devices are widely deployed in the smart city. These sensing devices generate various kinds of tasks, which need to be sent to cloud to process. Usually, the sensing devices do not equip with wireless modules, because it is neither economical nor energy saving. Thus, it is a challenging problem to find a way to offload tasks for sensing devices. However, many vehicles are moving around the city, which can communicate with sensing devices in an effective and low-cost way. In this paper, we propose a computation offloading scheme through mobile vehicles in IoT-edge-cloud network. The sensing devices generate tasks and transmit the tasks to vehicles, then the vehicles decide to compute the tasks in the local vehicle, MEC server or cloud center. The computation offloading decision is made based on the utility function of the energy consumption and transmission delay, and the deep reinforcement learning technique is adopted to make decisions. Our proposed method can make full use of the existing infrastructures to implement the task offloading of sensing devices, the experimental results show that our proposed solution can achieve the maximum reward and decrease delay.

Joint Optimization Offloading Strategy of Execution Time and Energy Consumption of Mobile Edge Computing

2021 ◽  
Vol 18 (5) ◽  
Author(s):  
Qingzhu Wang ◽  
Xiaoyun Cui
Keyword(s):  
Energy Consumption ◽  
Mobile Devices ◽  
Execution Time ◽  
Optimal Solution ◽  
Computation Offloading ◽  
Joint Optimization ◽  
Random Strategy ◽  
Fitness Value ◽  
Cloud Server ◽  
Time And Energy

As mobile devices become more and more powerful, applications generate a large number of computing tasks, and mobile devices themselves cannot meet the needs of users. This article proposes a computation offloading model in which execution units including mobile devices, edge server, and cloud server. Previous studies on joint optimization only considered tasks execution time and the energy consumption of mobile devices, and ignored the energy consumption of edge and cloud server. However, edge server and cloud server energy consumption have a significant impact on the final offloading decision. This paper comprehensively considers execution time and energy consumption of three execution units, and formulates task offloading decision as a single-objective optimization problem. Genetic algorithm with elitism preservation and random strategy is adopted to obtain optimal solution of the problem. At last, simulation experiments show that the proposed computation offloading model has lower fitness value compared with other computation offloading models.

scholarly journals Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control

2021 ◽  
Vol 8 ◽  
Author(s):  
Huan Zhao ◽  
Junhua Zhao ◽  
Ting Shu ◽  
Zibin Pan
Keyword(s):  
Reinforcement Learning ◽  
Energy Consumption ◽  
Hybrid Model ◽  
Learning Process ◽  
Energy Cost ◽  
Air Conditioning ◽  
Electricity Price ◽  
Learning Efficiency ◽  
Model Based ◽  
Model Free

Buildings account for a large proportion of the total energy consumption in many countries and almost half of the energy consumption is caused by the Heating, Ventilation, and air-conditioning (HVAC) systems. The model predictive control of HVAC is a complex task due to the dynamic property of the system and environment, such as temperature and electricity price. Deep reinforcement learning (DRL) is a model-free method that utilizes the “trial and error” mechanism to learn the optimal policy. However, the learning efficiency and learning cost are the main obstacles of the DRL method to practice. To overcome this problem, the hybrid-model-based DRL method is proposed for the HVAC control problem. Firstly, a specific MDPs is defined by considering the energy cost, temperature violation, and action violation. Then the hybrid-model-based DRL method is proposed, which utilizes both the knowledge-driven model and the data-driven model during the whole learning process. Finally, the protection mechanism and adjusting reward methods are used to further reduce the learning cost. The proposed method is tested in a simulation environment using the Australian Energy Market Operator (AEMO) electricity price data and New South Wales temperature data. Simulation results show that 1) the DRL method can reduce the energy cost while maintaining the temperature satisfactory compared to the short term MPC method; 2) the proposed method improves the learning efficiency and reduces the learning cost during the learning process compared to the model-free method.

scholarly journals Scalarized Q Multi-Objective Reinforcement Learning for Area Coverage Control and Light Control Implementation

2018 ◽  
Vol 16 (2) ◽  
pp. 72-82
Author(s):  
Akkhachai Phuphanin ◽  
Wipawee Usaha
Keyword(s):  
Reinforcement Learning ◽  
Energy Consumption ◽  
Area Coverage ◽  
Coverage Area ◽  
Lighting Control ◽  
Multi Objective ◽  
Coverage Control ◽  
Control Schemes ◽  
Multi Agent ◽  
Testbed Experiments

Coverage control is crucial for the deployment of wireless sensor networks (WSNs). However, most coverage control schemes are based on single objective optimization such as coverage area only, which do not consider other contradicting objectives such as energy consumption, the number of working nodes, wasteful overlapping areas. This paper proposes on a Multi-Objective Optimization (MOO) coverage control called Scalarized Q Multi-Objective Reinforcement Learning (SQMORL). The two objectives are to achieve the maximize area coverage and to minimize the overlapping area to reduce energy consumption. Performance evaluation is conducted for both simulation and multi-agent lighting control testbed experiments. Simulation results show that SQMORL can obtain more efficient area coverage with fewer working nodes than other existing schemes.  The hardware testbed results show that SQMORL algorithm can find the optimal policy with good accuracy from the repeated runs.

An Advanced Wireless Sensor Networks Design for Energy-Efficient Applications Using Condition-Based Access Protocol

2021 ◽  
pp. 171-186
Author(s):  
Vijendra Babu D. ◽  
K. Nagi Reddy ◽  
K. Butchi Raju ◽  
A. Ratna Raju
Keyword(s):  
Energy Efficiency ◽  
Wireless Sensor Networks ◽  
Energy Consumption ◽  
Energy Efficient ◽  
Network Throughput ◽  
Wireless Sensor ◽  
Sleep Mode ◽  
Medium Access ◽  
Access Protocol ◽  
Battery Lifetime

A modern wireless sensor and its development majorly depend on distributed condition maintenance protocol. The medium access and its computing have been handled by multi hope sensor mechanism. In this investigation, WSN networks maintenance is balanced through condition-based access (CBA) protocol. The CBA is most useful for real-time 4G and 5G communication to handle internet assistance devices. The following CBA mechanism is energy efficient to increase the battery lifetime. Due to sleep mode and backup mode mechanism, this protocol maintains its energy efficiency as well as network throughput. Finally, 76% of the energy consumption and 42.8% of the speed of operation have been attained using CBI WSN protocol.

scholarly journals Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 146264-146272 ◽  
Author(s):  
Han Qie ◽  
Dianxi Shi ◽  
Tianlong Shen ◽  
Xinhai Xu ◽  
Yuan Li ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
Path Planning ◽  
Joint Optimization ◽  
Target Assignment ◽  
Multi Agent ◽  
Multi Uav
Sign in / Sign up

Export Citation Format

Share Document