scholarly journals An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part III: Antarctic Applications with Advanced Research WRF Using Real Data

2013 ◽  
Vol 141 (8) ◽  
pp. 2721-2739 ◽  
Author(s):  
Chengsi Liu ◽  
Qingnong Xiao
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Real Data ◽  
Variational Data Assimilation ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Short Period ◽  
Inflation Factor

Abstract A four-dimensional ensemble-based variational data assimilation (4DEnVar) algorithm proposed in Part I of the 4DEnVar series (denoted En4DVar in Part I, but here we refer to it as 4DEnVar according to WMO conference recommendation to differentiate it from En4DVar algorithm using adjoint model) uses a flow-dependent background error covariance calculated from ensemble forecasts and performs 4DVar optimization based on an incremental approach and a preconditioning algorithm. In Part II, the authors evaluated 4DEnVar with observing system simulation experiments (OSSEs) using the Advanced Research Weather Research and Forecasting Model (ARW-WRF, hereafter WRF). The current study extends the 4DEnVar to assimilate real observations for a cyclone in the Antarctic and the Southern Ocean in October 2007. The authors performed an intercomparison of four different WRF variational approaches for the case, including three-dimensional variational data assimilation (3DVar), first guess at the appropriate time (FGAT), and ensemble-based three-dimensional (En3DVar) and four-dimensional (4DEnVar) variational data assimilations. It is found that all data assimilation approaches produce positive impacts in this case. Applying the flow-dependent background error covariance in En3DVar and 4DEnVar yields forecast skills superior to those with the homogeneous and isotropic background error covariance in 3DVar and FGAT. In addition, the authors carried out FGAT and 4DEnVar 3-day cycling and 72-h forecasts. The results show that 4DEnVar produces a better performance in the cyclone prediction. The inflation factor on 4DEnVar can effectively improve the 4DEnVar analysis. The authors also conducted a short period (10-day lifetime of the cyclone in the domain) of analysis/forecast intercomparison experiments using 4DEnVar, FGAT, and 3DVar. The 4DEnVar scheme demonstrates overall superior and robust performance.

An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test

2008 ◽  
Vol 136 (9) ◽  
pp. 3363-3373 ◽  
Author(s):  
Chengsi Liu ◽  
Qingnong Xiao ◽  
Bin Wang
Keyword(s):  
Data Assimilation ◽  
Preliminary Test ◽  
Background Field ◽  
Variational Data Assimilation ◽  
Water Model ◽  
Observation Error ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance

Abstract Applying a flow-dependent background error covariance (𝗕 matrix) in variational data assimilation has been a topic of interest among researchers in recent years. In this paper, an ensemble-based four-dimensional variational (En4DVAR) algorithm, designed by the authors, is presented that uses a flow-dependent background error covariance matrix constructed by ensemble forecasts and performs 4DVAR optimization to produce a balanced analysis. A great advantage of this En4DVAR design over standard 4DVAR methods is that the tangent linear and adjoint models can be avoided in its formulation and implementation. In addition, it can be easily incorporated into variational data assimilation systems that are already in use at operational centers and among the research community. A one-dimensional shallow water model was used for preliminary tests of the En4DVAR scheme. Compared with standard 4DVAR, the En4DVAR converges well and can produce results that are as good as those with 4DVAR but with far less computation cost in its minimization. In addition, a comparison of the results from En4DVAR with those from other data assimilation schemes [e.g., 3DVAR and ensemble Kalman filter (EnKF)] is made. The results show that the En4DVAR yields an analysis that is comparable to the widely used variational or ensemble data assimilation schemes and can be a promising approach for real-time applications. In addition, experiments were carried out to test the sensitivities of EnKF and En4DVAR, whose background error covariance is estimated from the same ensemble forecasts. The experiments indicated that En4DVAR obtained reasonably sound analysis even with larger observation error, higher observation frequency, and more unbalanced background field.

scholarly journals THE INFLUENCE OF BACKGROUND ERROR COVARIANCE OF GSI THREE-DIMENSIONAL VARIATIONAL DATA ASSIMILATION ON METEOROLOGY AND AEROSOL PREDICTION

2018 ◽  
Vol XLII-3/W5 ◽  
pp. 17-23
Author(s):  
Y. Hu ◽  
M. Zhang ◽  
Y. Liang ◽  
L. Ye ◽  
D. Zhao ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Small Scale ◽  
Length Scale ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Horizontal Length ◽  
Mean Square Errors

<p><strong>Abstract.</strong> Background error covariance (BEC) plays a key role in a variational data assimilation system. It determines variable analysis increments by spreading information from observation points. In order to test the influence of BEC on the GSI data assimilation and prediction of aerosol in Beijing-Tianjin-Hebei, a regional BEC is calculated using one month series of numerical forecast fields of November 2017 based on the National Meteorological Center (NMC) method, and compared with the global BEC.The results show that the standard deviation of stream function of the regional BEC is larger than that of the global BEC. And the horizontal length-scale of the regional BEC is smaller than that of the global BEC, white the vertical length-scale of the regional BEC is similar with that of the global BEC. The increments of the assimilation experiment with the regional BEC present more small scale information than that with the global BEC. The forecast skill of the experiment with the regional BEC is higher than that with the global BEC in the stations of Beijing, Tianjin, Chengde and Taiyuan, and the average root-mean-square errors (RMSE) reduces by over 13.4%.</p>

scholarly journals Background error covariance with balance constraints for aerosol species and applications in variational data assimilation

2016 ◽  
Vol 9 (8) ◽  
pp. 2623-2638 ◽  
Author(s):  
Zengliang Zang ◽  
Zilong Hao ◽  
Yi Li ◽  
Xiaobin Pan ◽  
Wei You ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Statistical Regression ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Balance Analysis ◽  
Cross Correlations ◽  
Data Assimilation System

Abstract. Balance constraints are important for background error covariance (BEC) in data assimilation to spread information between different variables and produce balance analysis fields. Using statistical regression, we develop a balance constraint for the BEC of aerosol variables and apply it to a three-dimensional variational data assimilation system in the WRF/Chem model; 1-month forecasts from the WRF/Chem model are employed for BEC statistics. The cross-correlations between the different species are generally high. The largest correlation occurs between elemental carbon and organic carbon with as large as 0.9. After using the balance constraints, the correlations between the unbalanced variables reduce to less than 0.2. A set of data assimilation and forecasting experiments is performed. In these experiments, surface PM2.5 concentrations and speciated concentrations along aircraft flight tracks are assimilated. The analysis increments with the balance constraints show spatial distributions more complex than those without the balance constraints, which is a consequence of the spreading of observation information across variables due to the balance constraints. The forecast skills with the balance constraints show substantial and durable improvements from the 2nd hour to the 16th hour compared with the forecast skills without the balance constraints. The results suggest that the developed balance constraints are important for the aerosol assimilation and forecasting.

scholarly journals Generalized background error covariance matrix model (GEN_BE v2.0)

2015 ◽  
Vol 8 (3) ◽  
pp. 669-696 ◽  
Author(s):  
G. Descombes ◽  
T. Auligné ◽  
F. Vandenberghe ◽  
D. M. Barker ◽  
J. Barré
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Chemical Species ◽  
Variational Data Assimilation ◽  
Control Variables ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Impact

Abstract. The specification of state background error statistics is a key component of data assimilation since it affects the impact observations will have on the analysis. In the variational data assimilation approach, applied in geophysical sciences, the dimensions of the background error covariance matrix (B) are usually too large to be explicitly determined and B needs to be modeled. Recent efforts to include new variables in the analysis such as cloud parameters and chemical species have required the development of the code to GENerate the Background Errors (GEN_BE) version 2.0 for the Weather Research and Forecasting (WRF) community model. GEN_BE allows for a simpler, flexible, robust, and community-oriented framework that gathers methods used by some meteorological operational centers and researchers. We present the advantages of this new design for the data assimilation community by performing benchmarks of different modeling of B and showing some of the new features in data assimilation test cases. As data assimilation for clouds remains a challenge, we present a multivariate approach that includes hydrometeors in the control variables and new correlated errors. In addition, the GEN_BE v2.0 code is employed to diagnose error parameter statistics for chemical species, which shows that it is a tool flexible enough to implement new control variables. While the generation of the background errors statistics code was first developed for atmospheric research, the new version (GEN_BE v2.0) can be easily applied to other domains of science and chosen to diagnose and model B. Initially developed for variational data assimilation, the model of the B matrix may be useful for variational ensemble hybrid methods as well.

scholarly journals The “ABC-DA system” (v1.4): a variational data assimilation system for convective scale assimilation research with a study of the impact of a balance constraint

2020 ◽  
Author(s):  
Ross Noel Bannister
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Variational Data Assimilation ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Convective Scale ◽  
Data Assimilation System ◽  
Assimilation System

Abstract. Following the development of the simplified atmospheric convective-scale "toy" model (the ABC model, named after its three key parameters: the pure gravity wave frequency, A, the controller of the acoustic wave speed, B, and the constant of proportionality between pressure and density perturbations, C), this paper introduces its associated variational data assimilation system, ABC-DA. The purpose of ABC-DA is to permit quick and efficient research into data assimilation methods suitable for convective scale systems. The system can also be used as an aid to teach and demonstrate data assimilation principles. ABC-DA is flexible, configurable and is efficient enough to be run on a personal computer. The system can run a number of assimilation methods (currently 3DVar and 3DFGAT have been implemented), with user configurable observation networks. Observation operators for direct observations and wind speeds are part of the system, although these can be expanded relatively easily. A key feature of any data assimilation system is how it specifies the background error covariance matrix. ABC-DA uses a control variable transform method to allow this to be done efficiently. This version of ABC-DA mirrors many operational configurations, by modelling multivariate error covariances with uncorrelated control parameters, and spatial error covariances with special uncorrelated spatial patterns separately for each parameter. The software developed (amongst other things) does model runs, calibration tasks associated with the background error covariance matrix, testing and diagnostic tasks, single data assimilation runs, multi-cycle assimilation/forecast experiments, and has associated visualisation software. As a demonstration, the system is used to tackle a scientific question concerning the role of geostrophic balance (GB) to model background error covariances between mass and wind fields. This question arises because, although GB is a very useful mechanism that is successfully exploited in larger scale assimilation systems, its use is questionable at convective scales due to the typically larger Rossby numbers where GB is not so relevant. A series of identical twin experiments is done in cycled assimilation configurations. One experiment exploits GB to represent mass-wind covariances in a mirror of an operational set-up (with use of an additional vertical regression (VR) step, as used operationally). This experiment performs badly where assimilation error accumulates over time. Two further experiments are done: one that does not use GB, and another that does but without the VR step. Turning off GB impairs the performance, and turning off VR improves the performance in general. It is concluded that there is scope to further improve the way that the background error covariance matrices are calibrated, with some directions discussed.

scholarly journals Generalized Background Error covariance matrix model (GEN_BE v2.0)

2014 ◽  
Vol 7 (4) ◽  
pp. 4291-4352
Author(s):  
G. Descombes ◽  
T. Auligné ◽  
F. Vandenberghe ◽  
D. M. Barker
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Chemical Species ◽  
Variational Data Assimilation ◽  
Control Variables ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Impact

Abstract. The specification of state background error statistics is a key component of data assimilation since it affects the impact observations will have on the analysis. In the variational data assimilation approach, applied in geophysical sciences, the dimensions of the background error covariance matrix (B) are usually too large to be explicitly determined and B needs to be modeled. Recent efforts to include new variables in the analysis such as cloud parameters and chemical species have required the development of the code to GENerate the Background Errors (GEN_BE) version 2.0 for the Weather Research and Forecasting (WRF) community model to allow for a simpler, flexible, robust, and community-oriented framework that gathers methods used by meteorological operational centers and researchers. We present the advantages of this new design for the data assimilation community by performing benchmarks and showing some of the new features on data assimilation test cases. As data assimilation for clouds remains a challenge, we present a multivariate approach that includes hydrometeors in the control variables and new correlated errors. In addition, the GEN_BE v2.0 code is employed to diagnose error parameter statistics for chemical species, which shows that it is a tool flexible enough to involve new control variables. While the generation of the background errors statistics code has been first developed for atmospheric research, the new version (GEN_BE v2.0) can be easily extended to other domains of science and be chosen as a testbed for diagnostic and new modeling of B. Initially developed for variational data assimilation, the model of the B matrix may be useful for variational ensemble hybrid methods as well.

scholarly journals Tests of an Ensemble Kalman Filter for Mesoscale and Regional-Scale Data Assimilation. Part III: Comparison with 3DVAR in a Real-Data Case Study

2008 ◽  
Vol 136 (2) ◽  
pp. 522-540 ◽  
Author(s):  
Zhiyong Meng ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Regional Scale ◽  
Warm Season ◽  
Real Data ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Scale Data

Abstract The feasibility of using an ensemble Kalman filter (EnKF) for mesoscale and regional-scale data assimilation has been demonstrated in the authors’ recent studies via observing system simulation experiments (OSSEs) both under a perfect-model assumption and in the presence of significant model error. The current study extends the EnKF to assimilate real-data observations for a warm-season mesoscale convective vortex (MCV) event on 10–12 June 2003. Direct comparison between the EnKF and a three-dimensional variational data assimilation (3DVAR) system, both implemented in the Weather Research and Forecasting model (WRF), is carried out. It is found that the EnKF consistently performs better than the 3DVAR method by assimilating either individual or multiple data sources (i.e., sounding, surface, and wind profiler) for this MCV event. Background error covariance plays an important role in the performance of both the EnKF and the 3DVAR system. Proper covariance inflation and the use of different combinations of physical parameterization schemes in different ensemble members (the so-called multischeme ensemble) can significantly improve the EnKF performance. The 3DVAR system can benefit substantially from using short-term ensembles to improve the prior estimate (with the ensemble mean). Noticeable improvement is also achieved by including some flow dependence in the background error covariance of 3DVAR.

scholarly journals The ABC-DA system (v1.4): a variational data assimilation system for convective-scale assimilation research with a study of the impact of a balance constraint

2020 ◽  
Vol 13 (8) ◽  
pp. 3789-3816
Author(s):  
Ross Noel Bannister
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Variational Data Assimilation ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Convective Scale ◽  
Data Assimilation System ◽  
Assimilation System

Abstract. Following the development of the simplified atmospheric convective-scale “toy” model (the ABC model, named after its three key parameters: the pure gravity wave frequency A, the controller of the acoustic wave speed B, and the constant of proportionality between pressure and density perturbations C), this paper introduces its associated variational data assimilation system, ABC-DA. The purpose of ABC-DA is to permit quick and efficient research into data assimilation methods suitable for convective-scale systems. The system can also be used as an aid to teach and demonstrate data assimilation principles. ABC-DA is flexible and configurable, and is efficient enough to be run on a personal computer. The system can run a number of assimilation methods (currently 3DVar and 3DFGAT have been implemented), with user configurable observation networks. Observation operators for direct observations and wind speeds are part of the current system, and these can, for example, be expanded relatively easily to include operators for Doppler winds. A key feature of any data assimilation system is how it specifies the background error covariance matrix. ABC-DA uses a control variable transform method to allow this to be done efficiently. This version of ABC-DA mirrors many operational configurations by modelling multivariate error covariances with uncorrelated control parameters, each with special uncorrelated spatial patterns. The software developed performs (amongst other things) model runs, calibration tasks associated with the background error covariance matrix, testing and diagnostic tasks, single data assimilation runs, and multi-cycle assimilation/forecast experiments, and it also has associated visualisation software. As a demonstration, the system is used to tackle a scientific question concerning the role of geostrophic balance (GB) to model background error covariances between mass and wind fields. This question arises because although GB is a very useful mechanism that is successfully exploited in larger-scale assimilation systems, its use is questionable at convective scales due to the typically larger Rossby numbers where GB is not so relevant. A series of identical twin experiments is done in cycled assimilation configurations. One experiment exploits GB to represent mass–wind covariances in a mirror of an operational set-up (with use of an additional vertical regression (VR) step, as used operationally). This experiment performs badly where error accumulates over time. Two further experiments are done: one that does not use GB and another that does but without the VR step. Turning off GB impairs the performance, and turning off VR improves the performance in general. It is concluded that there is scope to further improve the way that the background error covariance matrices are represented at convective scale. Ideas for further possible developments of ABC-DA are discussed.

Sign in / Sign up

Export Citation Format

Share Document