Power Flow Adjustment for Smart Microgrid Based on Edge Computing and Deep Reinforcement Learning

Author(s):  
Tianjiao Pu ◽  
Fei Jiao ◽  
Yifan Cao ◽  
Zhicheng Liu ◽  
Chao Qiu ◽  
...  

Abstract As one of the core components that improve transportation, generation, delivery, and electricity consumption in terms of protection and reliability, smart grid can provide full visibility and universal control of power assets and services, provide resilience to system anomalies and enable new ways to supply and trade resources in a coordinated manner. In current power grids, a large number of power supply and demand components, sensing and control devices generate lots of requirements, e.g., data perception, information transmission, business processing and real-time control, while existing centralized cloud computing paradigm is hard to address issues and challenges such as rapid response and local autonomy. Specifically, the trend of micro grid computing is one of the key challenges in smart grid, because a lot of in the power grid, diverse, adjustable supply components and more complex, optimization of difficulty is also relatively large, whereas traditional, manual, centralized methods are often dependent on expert experience, and requires a lot of manpower. Furthermore, the application of edge intelligence to power flow adjustment in smart grid is still in its infancy. In order to meet this challenge, we propose a power control framework combining edge computing and machine learning, which makes full use of edge nodes to sense network state and power control, so as to achieve the goal of fast response and local autonomy. Furthermore, we design and implement parameters such as state, action and reward by using deep reinforcement learning to make intelligent control decisions, aiming at the problem that flow calculation often does not converge. The simulation results demonstrate the effectiveness of our method with successful dynamic power flow calculating and stable operation under various power conditions.

Author(s):  
Tianjiao Pu ◽  
Xinying Wang ◽  
Yifan Cao ◽  
Zhicheng Liu ◽  
Chao Qiu ◽  
...  

AbstractIn current power grids, a massive amount of power equipment raises various emerging requirements, e.g., data perception, information transmission, and real-time control. The existing cloud computing paradigm is stubborn to address issues and challenges such as rapid response and local autonomy. Microgrids contain diverse and adjustable power components, making the power system complex and difficult to optimize. The existing traditional adjusting methods are manual and centralized, which requires many human resources with expert experience. The adjustment method based on edge intelligence can effectively leverage ubiquitous computing capacities to provide distributed intelligent solutions with lots of research issues to be reckoned with. To address this challenge, we consider a power control framework combining edge computing and reinforcement learning, which makes full use of edge nodes to sense network state and control power equipment to achieve the goal of fast response and local autonomy. Additionally, we focus on the non-convergence problem of power flow calculation, and combine deep reinforcement learning and multi-agent methods to realize intelligent decisions, with designing the model such as state, action, and reward. Our method improves the efficiency and scalability compared with baseline methods. The simulation results demonstrate the effectiveness of our method with intelligent adjusting and stable operation under various conditions.


2014 ◽  
Vol 521 ◽  
pp. 444-448 ◽  
Author(s):  
Yan Kai Guo ◽  
Bing Qi ◽  
Song Song Chen ◽  
Ming Zhong

The double pressures of resources and environment have brought the global power industry into the era of Smart Grid. In order to better promote the development of Demand Response of Smart Grid and to offer new regulation resources for the safe and stable operation of electric power system, OpenADR, the Open Automated Demand Response Communications Specification, has been discussed in detail, which aims at the problems of energy efficiency and the contradiction between power supply and demand. And a design scheme of Auto-DR system which introduces in detail the system architecture and the communications architecture based on OpenADR was proposed to realize the two-way communications between Utilities and end-users, and the problems such as the peak, the gap between supply and demand and the electricity structure management would be consequently solved. This scheme has a certain reference value to the Demand Side Management under the framework of Smart Grid.


2013 ◽  
Vol 756-759 ◽  
pp. 4471-4475
Author(s):  
Xu Sheng Liu ◽  
Ying He ◽  
Fu Chun Zhang ◽  
Guang Hua Yan ◽  
Run Ze Wu

Intelligent power utilization is an important part in the construction of smart grid, its outstanding characteristic is interaction between power grid and demand side. Based on the demand of family intelligent power utilization, this paper analyzes the significance of bilateral interaction system construction, proposes the design scheme of interactive family intelligent power utilization system to satisfy the users various and individual demands, designs intelligent display client software. The system integrating power flow, information flow and business flow is established in order to support new power supply and demand relationship between grid and users and ensure the QoE (Quality of Experience) and optimize the configuration of assets of power grid.


2020 ◽  
Vol 2020 ◽  
pp. 1-6 ◽  
Author(s):  
Bingxin Zhang ◽  
Guopeng Zhang ◽  
Weice Sun ◽  
Kun Yang

This paper proposes an efficient computation task offloading mechanism for mobile edge computing (MEC) systems. The studied MEC system consists of multiple user equipment (UEs) and multiple radio interfaces. In order to maximize the number of UEs benefitting from the MEC, the task offloading and power control strategy for a UE is optimized in a joint manner. However, the problem of finding the optimal solution is NP-hard. We then reformulate the problem as a Markov decision process (MDP) and develop a reinforcement learning- (RL-) based algorithm to solve the MDP. Simulation results show that the proposed RL-based algorithm achieves a near-optimal performance compared to the exhaustive search algorithm, and it also outperforms the received signal strength- (RSS-) based method no matter from the standpoint of the system (as it leads to a larger number of beneficial UEs) or an individual (as it generates a lower computation overhead for a UE).


Author(s):  
L Ye ◽  
Z M Xiang ◽  
Y Yang ◽  
Y L Zhu ◽  
C Zhang ◽  
...  

2014 ◽  
Vol 134 (2) ◽  
pp. 145-152
Author(s):  
Ryuichi Ogahara ◽  
Yuki Kawaura ◽  
Shinichi Iwamoto ◽  
Naohiro Kamikawa ◽  
Masayuki Namba

Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3635 ◽  
Author(s):  
Guoming Zhang ◽  
Xiaoyu Ji ◽  
Yanjie Li ◽  
Wenyuan Xu

As a critical component in the smart grid, the Distribution Terminal Unit (DTU) dynamically adjusts the running status of the entire smart grid based on the collected electrical parameters to ensure the safe and stable operation of the smart grid. However, as a real-time embedded device, DTU has not only resource constraints but also specific requirements on real-time performance, thus, the traditional anomaly detection method cannot be deployed. To detect the tamper of the program running on DTU, we proposed a power-based non-intrusive condition monitoring method that collects and analyzes the power consumption of DTU using power sensors and machine learning (ML) techniques, the feasibility of this approach is that the power consumption is closely related to the executing code in CPUs, that is when the execution code is tampered with, the power consumption changes accordingly. To validate this idea, we set up a testbed based on DTU and simulated four types of imperceptible attacks that change the code running in ARM and DSP processors, respectively. We generate representative features and select lightweight ML algorithms to detect these attacks. We finally implemented the detection system on the windows and ubuntu platform and validated its effectiveness. The results show that the detection accuracy is up to 99.98% in a non-intrusive and lightweight way.


Sign in / Sign up

Export Citation Format

Share Document