scholarly journals Reinforcement Learning for Energy-Storage Systems in Grid-Connected Microgrids: An Investigation of Online vs. Offline Implementation

Energies ◽  
2021 ◽  
Vol 14 (18) ◽  
pp. 5688
Author(s):  
Khawaja Haider Ali ◽  
Marvin Sigalo ◽  
Saptarshi Das ◽  
Enrico Anderlini ◽  
Asif Ali Tahir ◽  
...  

Grid-connected microgrids consisting of renewable energy sources, battery storage, and load require an appropriate energy management system that controls the battery operation. Traditionally, the operation of the battery is optimised using 24 h of forecasted data of load demand and renewable energy sources (RES) generation using offline optimisation techniques, where the battery actions (charge/discharge/idle) are determined before the start of the day. Reinforcement Learning (RL) has recently been suggested as an alternative to these traditional techniques due to its ability to learn optimal policy online using real data. Two approaches of RL have been suggested in the literature viz. offline and online. In offline RL, the agent learns the optimum policy using predicted generation and load data. Once convergence is achieved, battery commands are dispatched in real time. This method is similar to traditional methods because it relies on forecasted data. In online RL, on the other hand, the agent learns the optimum policy by interacting with the system in real time using real data. This paper investigates the effectiveness of both the approaches. White Gaussian noise with different standard deviations was added to real data to create synthetic predicted data to validate the method. In the first approach, the predicted data were used by an offline RL algorithm. In the second approach, the online RL algorithm interacted with real streaming data in real time, and the agent was trained using real data. When the energy costs of the two approaches were compared, it was found that the online RL provides better results than the offline approach if the difference between real and predicted data is greater than 1.6%.

Energies ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 3183
Author(s):  
Michaela Makešová ◽  
Michaela Valentová

Reaching climate neutrality by 2050 is one of the main long-term objectives of the European Union climate and energy policy, and renewable energy sources (RES) are integral parts of this transition. RES development results in many effects, direct and indirect, linked to each other, societal, local and individual, i.e., “multiple impacts of RES” (MI RES). These effects need to be carefully assessed and evaluated to obtain the full picture of energy field transformation and its context, and enable further development of RES. Nevertheless, the MI RES concept is often presented misleadingly and its scope varies throughout the literature. This paper provides a literature overview of the methodologies of this concept and presents a new concept of MI RES, respecting the difference between effects resulting from the implementation of RES and ultimate multiple impacts. We have summarized the effects into four groups: economic, social, environmental, and technical, which all lead to group of ultimate multiple impacts. Finally, we provide the complex overview of all MI RES and present the framework, which is used to analyze the multiple impacts and effects of RES and to show how the RES development leads and contributes to these impacts and effects. The concept is recommended to be considered in designing a robust energy policy by decision-makers.


2020 ◽  
Vol 184 ◽  
pp. 01070
Author(s):  
Ayani Nandi ◽  
Vikram Kumar Kamboj

Daily load demand for industrial, residential and commercial sectors are changing day by day. Also, inclusion of e-mobility has totally effected the operations of realistic power sector. Hence, to meet this time varying load demand with minimum production cost is very challenging. The proposed research work focuses on the mathematical formulation of profit based unit commitment problem of realistic power system considering the impact of battery electric vehicles, hybrid electric vehicles and plug in electric vehicles and its solution using Intensify Harris Hawks Optimizer (IHHO). The coordination of plants with each other is named as Unit commitment of plants in which the most economical patterns of the generating station is taken so as to gain low production cost with higher reliability. But with the increase in industrialization has affected the environment badly so to maintain the balance between the generation and environment a new thinking of generating low cost power with high reliability by causing less harm to environment i.e. less emission of flue gases is adopted by considering renewable energy sources.


Energies ◽  
2020 ◽  
Vol 13 (5) ◽  
pp. 1136 ◽  
Author(s):  
Nikolaos Sifakis ◽  
Tryfon Daras ◽  
Theocharis Tsoutsos

In this paper is provided a systematic, in-depth, behavioral analysis of renewable energy sources cooperatives’ members. The analysis proved that in, on hand, there was a noticeable difference in the portion of affection of each proposed intervention on the actual energy consumption, which may be to even ten times more in some cases, and on the other hand, the difference in energy consumption between the analyzed groups was noticeable as well. So, implementing energy efficiency interventions of various types, such as technical support, special tariffs, energy generation schemes, and smart meters, seems to lead to substantial energy reductions to even more than 10%, cumulatively, and reduces the environmental footprint. Additionally, the majority of energy efficiency interventions applied by the renewable energy sources cooperatives are proved to be effective in achieving their primary goal, sensitizing members, and leading them to a more efficient energy consumption behavior (“greener”). The results of the analysis showed that each proposed intervention had played a different but nonetheless significant role in the diminishing of the energy consumption of the members and that there was a noticeable difference in energy consumption between the analyzed groups. The results of the analysis demonstrated more than 22 GWh totally in green consumption, and almost 4500 tons of CO2 saved.


Water ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 1508 ◽  
Author(s):  
Rafael González Perea ◽  
Aida Mérida García ◽  
Irene Fernández García ◽  
Emilio Camacho Poyato ◽  
Pilar Montesinos ◽  
...  

Climate change, water scarcity and higher energy requirements and electric tariff compromises the continuity of the irrigated agriculture. Precision agriculture (PA) or renewable energy sources which are based on communication and information technologies and a large amount of data are key to ensuring this economic activity and guaranteeing food security at the global level. Several works which are based on the use of PA and renewable energy sources have been developed in order to optimize different variables of irrigated agriculture such as irrigation scheduling. However, the large amount of technologies and sensors that these models need to be implemented are still far from being easily accessible and usable by farmers. In this way, a middleware called Real time Smart Solar Irrigation Manager (RESSIM) has been developed in this work and implemented in MATLABTM with the aim to provide to farmers a user-friendly tool for the daily making decision process of irrigation scheduling using a smart photovoltaic irrigation management module. RESSIM middleware was successfully tested in a real field during a full irrigation season of olive trees using a real smart photovoltaic irrigation system.


2018 ◽  
Vol 55 (2) ◽  
pp. 3-10
Author(s):  
A. Obushevs ◽  
A. Mutule

Abstract The paper focuses on the application of synchrophasor measurements that present unprecedented benefits compared to SCADA systems in order to facilitate the successful transformation of the Nordic-Baltic-and-European electric power system to operate with large amounts of renewable energy sources and improve situational awareness of the power system. The article describes new functionalities of visualisation tools to estimate a grid inertia level in real time with monitoring results between Nordic and Baltic power systems.


Sign in / Sign up

Export Citation Format

Share Document