LSTM-Aided Reinforcement Learning for Energy Management in Microgrid with Energy Storage and EV Charging

Author(s):  
Tongjie Cao ◽  
Zhirong Shen ◽  
Guanglin Zhang
Energy ◽  
2020 ◽  
Vol 193 ◽  
pp. 116622 ◽  
Author(s):  
Bassey Etim Nyong-Bassey ◽  
Damian Giaouris ◽  
Charalampos Patsios ◽  
Simira Papadopoulou ◽  
Athanasios I. Papadopoulos ◽  
...  

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4898
Author(s):  
Sangyoon Lee ◽  
Le Xie ◽  
Dae-Hyun Choi

This paper proposes a privacy-preserving energy management of a shared energy storage system (SESS) for multiple smart buildings using federated reinforcement learning (FRL). To preserve the privacy of energy scheduling of buildings connected to the SESS, we present a distributed deep reinforcement learning (DRL) framework using the FRL method, which consists of a global server (GS) and local building energy management systems (LBEMSs). In the framework, the LBEMS DRL agents share only a randomly selected part of their trained neural network for energy consumption models with the GS without consumer’s energy consumption data. Using the shared models, the GS executes two processes: (i) construction and broadcast of a global model of energy consumption to the LBEMS agents for retraining their local models and (ii) training of the SESS DRL agent’s energy charging and discharging from and to the utility and buildings. Simulation studies are conducted using one SESS and three smart buildings with solar photovoltaic systems. The results demonstrate that the proposed approach can schedule the charging and discharging of the SESS and an optimal energy consumption of heating, ventilation, and air conditioning systems in smart buildings under heterogeneous building environments while preserving the privacy of buildings’ energy consumption.


2022 ◽  
Vol 9 ◽  
Author(s):  
Yangqing Dan ◽  
Shuran Liu ◽  
Yanwei Zhu ◽  
Hailian Xie

Along with the rapid increase in the number of electric vehicles, more and more EV charging stations tend to have charging infrastructure, rooftop photovoltaic and energy storage all together for energy saving and emission reduction. Compared with individual design for each of the components in such kind of systems, an integrated design can result in higher efficiency, increased reliability, and lower total capital cost. This paper mainly focuses on the tertiary control strategy for dynamic state operation, such as PV generation fluctuation and random arrival/leave of EVs. The tertiary control aims to achieve stable operation under dynamic states, as well as to optimize the energy flow in the station to realize maximal operational benefits with constraints such as peak/valley price of electricity, state of discharge limitation of battery, etc. In this paper, four energy management functions in tertiary control level are proposed, and their performance is verified by simulations. By using prediction of PV power and EV load in the following 72 h, a novel tertiary control logic is proposed to optimize PVC and ESC power flow by changing their droop characteristics, so that minimum operational cost for the station can be achieved. Furthermore, a sensitivity analysis is conducted for three parameters, including ES battery capacity, weather influence, and PV and EV load prediction error. The results from sensitivity analysis indicate that ES battery capacity and weather condition lead to a great impact on the operational cost of the integrated charging station, while a typical prediction error of PV power and EV load will not influence the optimization result significantly.


Sign in / Sign up

Export Citation Format

Share Document