Proof-of-concept of a reinforcement learning framework for wind farm energy capture maximization in time-varying wind

2021 ◽  
Vol 13 (4) ◽  
pp. 043305
Author(s):  
P. Stanfel ◽  
K. Johnson ◽  
C. J. Bay ◽  
J. King
2011 ◽  
Vol 2011 ◽  
pp. 1-12 ◽  
Author(s):  
Karim El-Laithy ◽  
Martin Bogdan

An integration of both the Hebbian-based and reinforcement learning (RL) rules is presented for dynamic synapses. The proposed framework permits the Hebbian rule to update the hidden synaptic model parameters regulating the synaptic response rather than the synaptic weights. This is performed using both the value and the sign of the temporal difference in the reward signal after each trial. Applying this framework, a spiking network with spike-timing-dependent synapses is tested to learn the exclusive-OR computation on a temporally coded basis. Reward values are calculated with the distance between the output spike train of the network and a reference target one. Results show that the network is able to capture the required dynamics and that the proposed framework can reveal indeed an integrated version of Hebbian and RL. The proposed framework is tractable and less computationally expensive. The framework is applicable to a wide class of synaptic models and is not restricted to the used neural representation. This generality, along with the reported results, supports adopting the introduced approach to benefit from the biologically plausible synaptic models in a wide range of intuitive signal processing.


2021 ◽  
pp. 1-1
Author(s):  
Syed Khurram Mahmud ◽  
Yuanwei Liu ◽  
Yue Chen ◽  
Kok Keong Chai

Author(s):  
Zhongyou Wu ◽  
Yaoyu Li

Real-time optimization of wind farm energy capture for below rated wind speed is critical for reducing the levelized cost of energy (LCOE). Performance of model based control and optimization techniques can be significantly limited by the difficulty in obtaining accurate turbine and farm models in field operation, as well as the prohibitive cost for accurate wind measurements. The Nested-Loop Extremum Seeking Control (NLESC), recently proposed as a model free method has demonstrated its great potential in wind farm energy capture optimization. However, a major limitation of previous work is the slow convergence, for which a primary cause is the low dither frequencies used by upwind turbines, primarily due to wake propagation delay through the turbine array. In this study, NLESC is enhanced with the predictor based delay compensation proposed by Oliveira and Krstic [1], which allows the use of higher dither frequencies for upwind turbines. The convergence speed can thus be improved, increasing the energy capture consequently. Simulation study is performed for a cascaded three-turbine array using the SimWindFarm platform. Simulation results show the improved energy capture of the wind turbine array under smooth and turbulent wind conditions, even up to 10% turbulence intensity. The impact of the proposed optimization methods on the fatigue loads of wind turbine structures is also evaluated.


Sign in / Sign up

Export Citation Format

Share Document