Fast data assimilation (FDA): Data assimilation by machine learning for faster optimize model state

2021 ◽  
pp. 101323
Author(s):  
Pin Wu ◽  
Xuting Chang ◽  
Junwu Sun ◽  
Wenjie Zhang ◽  
Rossella Arcucci ◽  
...  
2021 ◽  
Vol 25 (3) ◽  
pp. 931-944
Author(s):  
Johann M. Lacerda ◽  
Alexandre A. Emerick ◽  
Adolfo P. Pires

2021 ◽  
pp. 101525
Author(s):  
Caterina Buizza ◽  
César Quilodrán Casas ◽  
Philip Nadler ◽  
Julian Mack ◽  
Stefano Marrone ◽  
...  

Author(s):  
Alban Farchi ◽  
Patrick Laloyaux ◽  
Massimo Bonavita ◽  
Marc Bocquet

<p>Recent developments in machine learning (ML) have demonstrated impressive skills in reproducing complex spatiotemporal processes. However, contrary to data assimilation (DA), the underlying assumption behind ML methods is that the system is fully observed and without noise, which is rarely the case in numerical weather prediction. In order to circumvent this issue, it is possible to embed the ML problem into a DA formalism characterised by a cost function similar to that of the weak-constraint 4D-Var (Bocquet et al., 2019; Bocquet et al., 2020). In practice ML and DA are combined to solve the problem: DA is used to estimate the state of the system while ML is used to estimate the full model. </p><p>In realistic systems, the model dynamics can be very complex and it may not be possible to reconstruct it from scratch. An alternative could be to learn the model error of an already existent model using the same approach combining DA and ML. In this presentation, we test the feasibility of this method using a quasi geostrophic (QG) model. After a brief description of the QG model model, we introduce a realistic model error to be learnt. We then asses the potential of ML methods to reconstruct this model error, first with perfect (full and noiseless) observation and then with sparse and noisy observations. We show in either case to what extent the trained ML models correct the mid-term forecasts. Finally, we show how the trained ML models can be used in a DA system and to what extent they correct the analysis.</p><p>Bocquet, M., Brajard, J., Carrassi, A., and Bertino, L.: Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models, Nonlin. Processes Geophys., 26, 143–162, 2019</p><p>Bocquet, M., Brajard, J., Carrassi, A., and Bertino, L.: Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization, Foundations of Data Science, 2 (1), 55-80, 2020</p><p>Farchi, A., Laloyaux, P., Bonavita, M., and Bocquet, M.: Using machine learning to correct model error in data assimilation and forecast applications, arxiv:2010.12605, submitted. </p>


2020 ◽  
Vol 584 ◽  
pp. 124692 ◽  
Author(s):  
Peijun Li ◽  
Yuanyuan Zha ◽  
Liangsheng Shi ◽  
Chak-Hau Michael Tso ◽  
Yonggen Zhang ◽  
...  

2014 ◽  
Vol 71 (2) ◽  
pp. 483-495 ◽  
Author(s):  
Hailiang Du ◽  
Leonard A. Smith

Abstract Data assimilation and state estimation for nonlinear models is a challenging task mathematically. Performing this task in real time, as in operational weather forecasting, is even more challenging as the models are imperfect: the mathematical system that generated the observations (if such a thing exists) is not a member of the available model class (i.e., the set of mathematical structures admitted as potential models). To the extent that traditional approaches address structural model error at all, most fail to produce consistent treatments. This results in questionable estimates both of the model state and of its uncertainty. A promising alternative approach is proposed to produce more consistent estimates of the model state and to estimate the (state dependent) model error simultaneously. This alternative consists of pseudo-orbit data assimilation with a stopping criterion. It is argued to be more efficient and more coherent than one alternative variational approach [a version of weak-constraint four-dimensional variational data assimilation (4DVAR)]. Results that demonstrate the pseudo-orbit data assimilation approach can also outperform an ensemble Kalman filter approach are presented. Both comparisons are made in the context of the 18-dimensional Lorenz96 flow and the two-dimensional Ikeda map. Many challenges remain outside the perfect model scenario, both in defining the goals of data assimilation and in achieving high-quality state estimation. The pseudo-orbit data assimilation approach provides a new tool for approaching this open problem.


Sign in / Sign up

Export Citation Format

Share Document