Jointly learning variational data assimilation models and solvers for geophysical dynamics

Author(s):  
Ronan Fablet ◽  
Bertrand Chapron ◽  
Lucas Drumetz ◽  
Etienne Memin ◽  
Olivier Pannekoucke ◽  
...  

<p>This paper addresses representation learning for the resolution of inverse problems  with geophysical dynamics. Among others, examples of inverse problems of interest include space-time interpolation, short-term forecasting, conditional simulation w.r.t. available observations, downscaling problems… From a methodological point of view, we rely on a variational data assimilation framework. Data assimilation (DA) aims to reconstruct the time evolution of some state given a series of  observations, possibly noisy and irregularly-sampled. Here, we investigate DA from a machine learning point of view backed by an underlying variational representation.  Using automatic differentiation tools embedded in deep learning frameworks, we introduce end-to-end neural network architectures for variational data assimilation. It comprises two key components: a variational model and a gradient-based solver both implemented as neural networks. A key feature of the proposed end-to-end learning architecture is that we may train the neural networks models using both supervised and unsupervised strategies. We first illustrate applications to the reconstruction of Lorenz-63 and Lorenz-96 systems from partial and noisy observations. Whereas the gain issued from the supervised learning setting emphasizes the relevance of groundtruthed observation dataset for real-world case-studies, these results also suggest new means to design data assimilation models from data. Especially, they suggest that learning task-oriented representations of the underlying dynamics may be beneficial. We further discuss applications to short-term forecasting and sampling design along with preliminary results for the reconstruction of sea surface currents from satellite altimetry data. </p><p>This abstract is supported by a preprint available online: https://arxiv.org/abs/2007.12941</p>

Data ◽  
2018 ◽  
Vol 3 (4) ◽  
pp. 43 ◽  
Author(s):  
Mesbaholdin Salami ◽  
Farzad Movahedi Sobhani ◽  
Mohammad Ghazizadeh

The databases of Iran’s electricity market have been storing large sizes of data. Retail buyers and retailers will operate in Iran’s electricity market in the foreseeable future when smart grids are implemented thoroughly across Iran. As a result, there will be very much larger data of the electricity market in the future than ever before. If certain methods are devised to perform quick search in such large sizes of stored data, it will be possible to improve the forecasting accuracy of important variables in Iran’s electricity market. In this paper, available methods were employed to develop a new technique of Wavelet-Neural Networks-Particle Swarm Optimization-Simulation-Optimization (WT-NNPSO-SO) with the purpose of searching in Big Data stored in the electricity market and improving the accuracy of short-term forecasting of electricity supply and demand. The electricity market data exploration approach was based on the simulation-optimization algorithms. It was combined with the Wavelet-Neural Networks-Particle Swarm Optimization (Wavelet-NNPSO) method to improve the forecasting accuracy with the assumption Length of Training Data (LOTD) increased. In comparison with previous techniques, the runtime of the proposed technique was improved in larger sizes of data due to the use of metaheuristic algorithms. The findings were dealt with in the Results section.


2021 ◽  
Vol 13 (18) ◽  
pp. 3584
Author(s):  
Peng Liu ◽  
Yi Yang ◽  
Yu Xin ◽  
Chenghai Wang

A moderate precipitation event occurring in northern Xinjiang, a region with a continental climate with little rainfall, and in leeward slope areas influenced by topography is important but rarely studied. In this study, the performance of lightning data assimilation is evaluated in the short-term forecasting of a moderate precipitation event along the western margin of the Junggar Basin and eastern Jayer Mountain. Pseudo-water vapor observations driven by lightning data are assimilated in both single and cycling analysis experiments of the Weather Research and Forecast (WRF) three-dimensional variational (3DVAR) system. Lightning data assimilation yields a larger increment in the relative humidity in the analysis field at the observed lightning locations, and the largest increment is obtained in the cycling analysis experiment. Due to the increase in water vapor content in the analysis field, more suitable thermal and dynamic conditions for moderate precipitation are obtained on the leeward slope, and the ice-phase and raindrop particle contents increase in the forecast field. Lightning data assimilation significantly improves the short-term leeward slope moderate precipitation prediction along the western margin of the Junggar Basin and provides the best forecast skill in cycling analysis experiments.


Sign in / Sign up

Export Citation Format

Share Document