Development of Convective-Scale Static Background Error Covariance within GSI-Based Hybrid EnVar System for Direct Radar Reflectivity Data Assimilation

2021 ◽  
Author(s):  
Yongming Wang ◽  
Xuguang Wang
Keyword(s):  
Sampling Errors ◽  
Background Error ◽  
3 Dimensional ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Convective Scale ◽  
Cross Correlations ◽  
Horizontal Momentum ◽  
Reflectivity Data ◽  
Static Background

AbstractA convective-scale static background-error covariance (BEC) matrix is further developed to include the capability of direct reflectivity assimilation and evaluated within the GSI-based 3-dimensional variational (3DVar) and hybrid ensemble-variational (EnVar) methods. Specific developments are summarized as follows: 1) Control variables (CVs) are extended to include reflectivity, vertical velocity, and all hydrometeor types. Various horizontal momentum and moisture CV options are included. 2) Cross-correlations between all CVs are established. 3) A storm intensity-dependent binning method is adopted to separately calculate static error matrices for clear-air and storms with varying intensities. The resultant static BEC matrices are simultaneously applied at proper locations guided by the observed reflectivity. 4) The EnVar is extended to adaptively incorporate static BECs based on the quality of ensemble covariances.Evaluation and examination of the new static BECs are first performed on the 8 May 2003 Oklahoma City supercell. Detailed diagnostics and 3DVar examinations suggest zonal/meridian winds and pseudo-relative humidity are selected horizontal momentum and moisture CVs for direct reflectivity assimilation, respectively; inclusion of cross-correlations favors to spinup and maintain the analyzed storms; application of binning improves characteristics and persistence of the simulated storm. Relative to an experiment using the full ensemble BECs (Exp-PureEnVar), incorporating static BECs in hybrid EnVar reduces spinup time and better analyzes reflectivity distributions while the background ensemble is deficient in sampling errors. Compared to both pure 3DVar and Exp-PureEnVar, hybrid EnVar better predicts reflectivity distributions and better maintains strong mesocyclone. Further examination through the 20 May 2013 Oklahoma supercells confirms these results and additionally demonstrates the effectiveness of adaptive hybridization.

scholarly journals Relationships among Four-Dimensional Hybrid Ensemble–Variational Data Assimilation Algorithms with Full and Approximate Ensemble Covariance Localization

2016 ◽  
Vol 144 (2) ◽  
pp. 591-606 ◽  
Author(s):  
Chengsi Liu ◽  
Ming Xue
Keyword(s):  
Data Assimilation ◽  
Linear Model ◽  
Control Variable ◽  
Adjoint Model ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Covariance Term ◽  
Observation Space ◽  
Static Background

Abstract Ensemble–variational data assimilation algorithms that can incorporate the time dimension (four-dimensional or 4D) and combine static and ensemble-derived background error covariances (hybrid) are formulated in general forms based on the extended control variable and the observation-space-perturbation approaches. The properties and relationships of these algorithms and their approximated formulations are discussed. The main algorithms discussed include the following: 1) the standard ensemble 4DVar (En4DVar) algorithm incorporating ensemble-derived background error covariance through the extended control variable approach, 2) the 4DEnVar neglecting the time propagation of the extended control variable (4DEnVar-NPC), 3) the 4D ensemble–variational algorithm based on observation space perturbation (4DEnVar), and 4) the 4DEnVar with no propagation of covariance localization (4DEnVar-NPL). Without the static background error covariance term, none of the algorithms requires the adjoint model except for En4DVar. Costly applications of the tangent linear model to localized ensemble perturbations can be avoided by making the NPC and NPL approximations. It is proven that En4DVar and 4DEnVar are mathematically equivalent, while 4DEnVar-NPC and 4DEnVar-NPL are mathematically equivalent. Such equivalences are also demonstrated by single-observation assimilation experiments with a 1D linear advection model. The effects of the non-flow-following or stationary localization approximations are also examined through the experiments. All of the above algorithms can include the static background error covariance term to establish a hybrid formulation. When the static term is included, all algorithms will require a tangent linear model and an adjoint model. The first guess at appropriate time (FGAT) approximation is proposed to avoid the tangent linear and adjoint models. Computational costs of the algorithms are also discussed.

scholarly journals A Comparison of Hybrid Ensemble Transform Kalman Filter–Optimum Interpolation and Ensemble Square Root Filter Analysis Schemes

2007 ◽  
Vol 135 (3) ◽  
pp. 1055-1076 ◽  
Author(s):  
Xuguang Wang ◽  
Thomas M. Hamill ◽  
Jeffrey S. Whitaker ◽  
Craig H. Bishop
Keyword(s):  
Ensemble Size ◽  
Hybrid Scheme ◽  
Background Error ◽  
Background Error Covariance ◽  
Optimum Interpolation ◽  
Error Covariance ◽  
Analysis Scheme ◽  
Ensemble Transform Kalman Filter ◽  
Square Root Filter ◽  
Static Background

Abstract A hybrid ensemble transform Kalman filter (ETKF)–optimum interpolation (OI) analysis scheme is described and compared with an ensemble square root filter (EnSRF) analysis scheme. A two-layer primitive equation model was used under perfect-model assumptions. A simplified observation network was used, and the OI method utilized a static background error covariance constructed from a large inventory of historical forecast errors. The hybrid scheme updated the ensemble mean using a hybridized ensemble and static background-error covariance. The ensemble perturbations in the hybrid scheme were updated by the ETKF scheme. The EnSRF ran parallel data assimilation cycles for each member and serially assimilated the observations. The EnSRF background-error covariance was estimated fully from the ensemble. For 50-member ensembles, the analyses from the hybrid scheme were as accurate or nearly as accurate as those from the EnSRF, depending on the norm. For 20-member ensembles, the analyses from the hybrid scheme were more accurate than analyses from the EnSRF under certain norms. Both hybrid and EnSRF analyses were more accurate than the analyses from the OI. Further reducing the ensemble size to five members, the EnSRF exhibited filter divergence, whereas the analyses from the hybrid scheme were still better than those updated by the OI. Additionally, the hybrid scheme was less prone to spurious gravity wave activity than the EnSRF, especially when the ensemble size was small. Maximal growth in the ETKF ensemble perturbation space exceeded that in the EnSRF ensemble perturbation space. The relationship of the ETKF ensemble variance to the analysis error variance, a measure of a spread–skill relationship, was similar to that of the EnSRF ensemble. The hybrid scheme can be implemented in a reasonably straightforward manner in the operational variational frameworks, and the computational cost of the hybrid is expected to be much less than the EnSRF in the operational settings.

scholarly journals Extraction of wind and temperature information from hybrid 4D-Var assimilation of stratospheric ozone using NAVGEM

2018 ◽  
Vol 18 (4) ◽  
pp. 2999-3026 ◽  
Author(s):  
Douglas R. Allen ◽  
Karl W. Hoppel ◽  
David D. Kuhl
Keyword(s):  
Stratospheric Ozone ◽  
Vertical Axis ◽  
Background Error ◽  
Background Error Covariance ◽  
Geostrophic Balance ◽  
Error Covariance ◽  
Stratospheric Wind ◽  
The Tropics ◽  
The Impact ◽  
Static Background

Abstract. Extraction of wind and temperature information from stratospheric ozone assimilation is examined within the context of the Navy Global Environmental Model (NAVGEM) hybrid 4-D variational assimilation (4D-Var) data assimilation (DA) system. Ozone can improve the wind and temperature through two different DA mechanisms: (1) through the “flow-of-the-day” ensemble background error covariance that is blended together with the static background error covariance and (2) via the ozone continuity equation in the tangent linear model and adjoint used for minimizing the cost function. All experiments assimilate actual conventional data in order to maintain a similar realistic troposphere. In the stratosphere, the experiments assimilate simulated ozone and/or radiance observations in various combinations. The simulated observations are constructed for a case study based on a 16-day cycling truth experiment (TE), which is an analysis with no stratospheric observations. The impact of ozone on the analysis is evaluated by comparing the experiments to the TE for the last 6 days, allowing for a 10-day spin-up. Ozone assimilation benefits the wind and temperature when data are of sufficient quality and frequency. For example, assimilation of perfect (no applied error) global hourly ozone data constrains the stratospheric wind and temperature to within ∼ 2 m s−1 and ∼ 1 K. This demonstrates that there is dynamical information in the ozone distribution that can potentially be used to improve the stratosphere. This is particularly important for the tropics, where radiance observations have difficulty constraining wind due to breakdown of geostrophic balance. Global ozone assimilation provides the largest benefit when the hybrid blending coefficient is an intermediate value (0.5 was used in this study), rather than 0.0 (no ensemble background error covariance) or 1.0 (no static background error covariance), which is consistent with other hybrid DA studies. When perfect global ozone is assimilated in addition to radiance observations, wind and temperature error decreases of up to ∼ 3 m s−1 and ∼ 1 K occur in the tropical upper stratosphere. Assimilation of noisy global ozone (2 % errors applied) results in error reductions of ∼ 1 m s−1 and ∼ 0.5 K in the tropics and slightly increased temperature errors in the Northern Hemisphere polar region. Reduction of the ozone sampling frequency also reduces the benefit of ozone throughout the stratosphere, with noisy polar-orbiting data having only minor impacts on wind and temperature when assimilated with radiances. An examination of ensemble cross-correlations between ozone and other variables shows that a single ozone observation behaves like a potential vorticity (PV) “charge”, or a monopole of PV, with rotation about a vertical axis and vertically oriented temperature dipole. Further understanding of this relationship may help in designing observation systems that would optimize the impact of ozone on the dynamics.

scholarly journals The “ABC-DA system” (v1.4): a variational data assimilation system for convective scale assimilation research with a study of the impact of a balance constraint

2020 ◽  
Author(s):  
Ross Noel Bannister
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Variational Data Assimilation ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Convective Scale ◽  
Data Assimilation System ◽  
Assimilation System

Abstract. Following the development of the simplified atmospheric convective-scale "toy" model (the ABC model, named after its three key parameters: the pure gravity wave frequency, A, the controller of the acoustic wave speed, B, and the constant of proportionality between pressure and density perturbations, C), this paper introduces its associated variational data assimilation system, ABC-DA. The purpose of ABC-DA is to permit quick and efficient research into data assimilation methods suitable for convective scale systems. The system can also be used as an aid to teach and demonstrate data assimilation principles. ABC-DA is flexible, configurable and is efficient enough to be run on a personal computer. The system can run a number of assimilation methods (currently 3DVar and 3DFGAT have been implemented), with user configurable observation networks. Observation operators for direct observations and wind speeds are part of the system, although these can be expanded relatively easily. A key feature of any data assimilation system is how it specifies the background error covariance matrix. ABC-DA uses a control variable transform method to allow this to be done efficiently. This version of ABC-DA mirrors many operational configurations, by modelling multivariate error covariances with uncorrelated control parameters, and spatial error covariances with special uncorrelated spatial patterns separately for each parameter. The software developed (amongst other things) does model runs, calibration tasks associated with the background error covariance matrix, testing and diagnostic tasks, single data assimilation runs, multi-cycle assimilation/forecast experiments, and has associated visualisation software. As a demonstration, the system is used to tackle a scientific question concerning the role of geostrophic balance (GB) to model background error covariances between mass and wind fields. This question arises because, although GB is a very useful mechanism that is successfully exploited in larger scale assimilation systems, its use is questionable at convective scales due to the typically larger Rossby numbers where GB is not so relevant. A series of identical twin experiments is done in cycled assimilation configurations. One experiment exploits GB to represent mass-wind covariances in a mirror of an operational set-up (with use of an additional vertical regression (VR) step, as used operationally). This experiment performs badly where assimilation error accumulates over time. Two further experiments are done: one that does not use GB, and another that does but without the VR step. Turning off GB impairs the performance, and turning off VR improves the performance in general. It is concluded that there is scope to further improve the way that the background error covariance matrices are calibrated, with some directions discussed.

scholarly journals Background error covariance with balance constraints for aerosol species and applications in data assimilation

2015 ◽  
Vol 8 (11) ◽  
pp. 10053-10088
Author(s):  
Z. Zang ◽  
Z. Hao ◽  
Y. Li ◽  
X. Pan ◽  
W. You ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Elemental Carbon ◽  
Statistical Regression ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Balance Analysis ◽  
Forecasting System ◽  
Cross Correlations ◽  
The Impact

Abstract. Balance constraints are important for a background error covariance (BEC) in data assimilation to spread information between different variables and produce balance analysis fields. Using statistical regression, we develop the balance constraint for the BEC of aerosol variables and apply it to a data assimilation and forecasting system for the WRF/Chem model. One-month products from the WRF/Chem model are employed for BEC statistics with the NMC method. The cross-correlations among the original variables are generally high. The highest correlation between elemental carbon and organic carbon without balance constraints is approximately 0.9. However, the correlations for the unbalanced variables are less than 0.2 with the balance constraints. Data assimilation and forecasting experiments for evaluating the impact of balance constraints are performed with the observations of the surface PM2.5 concentrations and speciated concentrations along an aircraft flight track. The speciated increments of the experiment with balance constraints are more coincident than the speciated increments of the experiment without balance constraints, for the observation information can spread across variables by balance constraints in the former experiment. The forecast results of the experiment with balance constraints show significant and durable improvements from the 3rd hour to the 18th hour compared with the forecast results of the experiment without the balance constraints. However, the forecasts of these two experiments are similar during the first 3 h. The results suggest that the balance constraint is significantly positive for the aerosol assimilation and forecasting.

Direct Assimilation of Radar Reflectivity Data Using 3DVAR: Treatment of Hydrometeor Background Errors and OSSE Tests

2019 ◽  
Vol 147 (1) ◽  
pp. 17-29 ◽  
Author(s):  
Chengsi Liu ◽  
Ming Xue ◽  
Rong Kong
Keyword(s):  
Three Dimensional ◽  
Error Variance ◽  
Radar Reflectivity ◽  
Temperature Dependent ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Homogeneous Background ◽  
Reflectivity Data ◽  
Error Profiles

Despite the well-known importance of background error covariance in data assimilation, not much study has been focused on its impact on the assimilation of radar reflectivity within a three-dimensional variational (3DVar) framework. In this study, it is shown that unphysical analysis increments of hydrometeors are produced when using vertically homogeneous background error variance. This issue cannot be fully solved by using the so-called hydrometeor classification in the reflectivity observation operator. Alternatively, temperature-dependent background error profiles for hydrometeor control variables are proposed. With such a treatment, the vertical background error profiles are specified to be temperature dependent, allowing for more physical partitioning of radar-observed precipitation information among the liquid and ice hydrometeors. The 3DVar analyses using our treatment are compared with those using constant background error or “hydrometeor classification” through observing system simulation experiments with a simulated supercell storm. Results show that 1) 3DVar with constant hydrometeor background errors produces unphysical rainwater at the high levels and unphysical snow at the low levels; 2) the hydrometeor classification approach reduces unphysical rainwater and snow at those levels, but the analysis increments are still unphysically spread in the vertical by the background error covariance when the vertically invariant background errors are used; and 3) the temperature-dependent background error profiles enable physically more reasonable analyses of liquid and ice hydrometeors from reflectivity assimilation.

scholarly journals Background error covariance with balance constraints for aerosol species and applications in variational data assimilation

2016 ◽  
Vol 9 (8) ◽  
pp. 2623-2638 ◽  
Author(s):  
Zengliang Zang ◽  
Zilong Hao ◽  
Yi Li ◽  
Xiaobin Pan ◽  
Wei You ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Statistical Regression ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Balance Analysis ◽  
Cross Correlations ◽  
Data Assimilation System

Abstract. Balance constraints are important for background error covariance (BEC) in data assimilation to spread information between different variables and produce balance analysis fields. Using statistical regression, we develop a balance constraint for the BEC of aerosol variables and apply it to a three-dimensional variational data assimilation system in the WRF/Chem model; 1-month forecasts from the WRF/Chem model are employed for BEC statistics. The cross-correlations between the different species are generally high. The largest correlation occurs between elemental carbon and organic carbon with as large as 0.9. After using the balance constraints, the correlations between the unbalanced variables reduce to less than 0.2. A set of data assimilation and forecasting experiments is performed. In these experiments, surface PM2.5 concentrations and speciated concentrations along aircraft flight tracks are assimilated. The analysis increments with the balance constraints show spatial distributions more complex than those without the balance constraints, which is a consequence of the spreading of observation information across variables due to the balance constraints. The forecast skills with the balance constraints show substantial and durable improvements from the 2nd hour to the 16th hour compared with the forecast skills without the balance constraints. The results suggest that the developed balance constraints are important for the aerosol assimilation and forecasting.

scholarly journals The ABC-DA system (v1.4): a variational data assimilation system for convective-scale assimilation research with a study of the impact of a balance constraint

2020 ◽  
Vol 13 (8) ◽  
pp. 3789-3816
Author(s):  
Ross Noel Bannister
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Variational Data Assimilation ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Convective Scale ◽  
Data Assimilation System ◽  
Assimilation System

Abstract. Following the development of the simplified atmospheric convective-scale “toy” model (the ABC model, named after its three key parameters: the pure gravity wave frequency A, the controller of the acoustic wave speed B, and the constant of proportionality between pressure and density perturbations C), this paper introduces its associated variational data assimilation system, ABC-DA. The purpose of ABC-DA is to permit quick and efficient research into data assimilation methods suitable for convective-scale systems. The system can also be used as an aid to teach and demonstrate data assimilation principles. ABC-DA is flexible and configurable, and is efficient enough to be run on a personal computer. The system can run a number of assimilation methods (currently 3DVar and 3DFGAT have been implemented), with user configurable observation networks. Observation operators for direct observations and wind speeds are part of the current system, and these can, for example, be expanded relatively easily to include operators for Doppler winds. A key feature of any data assimilation system is how it specifies the background error covariance matrix. ABC-DA uses a control variable transform method to allow this to be done efficiently. This version of ABC-DA mirrors many operational configurations by modelling multivariate error covariances with uncorrelated control parameters, each with special uncorrelated spatial patterns. The software developed performs (amongst other things) model runs, calibration tasks associated with the background error covariance matrix, testing and diagnostic tasks, single data assimilation runs, and multi-cycle assimilation/forecast experiments, and it also has associated visualisation software. As a demonstration, the system is used to tackle a scientific question concerning the role of geostrophic balance (GB) to model background error covariances between mass and wind fields. This question arises because although GB is a very useful mechanism that is successfully exploited in larger-scale assimilation systems, its use is questionable at convective scales due to the typically larger Rossby numbers where GB is not so relevant. A series of identical twin experiments is done in cycled assimilation configurations. One experiment exploits GB to represent mass–wind covariances in a mirror of an operational set-up (with use of an additional vertical regression (VR) step, as used operationally). This experiment performs badly where error accumulates over time. Two further experiments are done: one that does not use GB and another that does but without the VR step. Turning off GB impairs the performance, and turning off VR improves the performance in general. It is concluded that there is scope to further improve the way that the background error covariance matrices are represented at convective scale. Ideas for further possible developments of ABC-DA are discussed.

Impact of AMSU-A Radiances in a Column Ensemble Kalman Filter

2018 ◽  
Vol 146 (12) ◽  
pp. 3949-3976 ◽  
Author(s):  
Herschel L. Mitchell ◽  
P. L. Houtekamer ◽  
Sylvain Heilliette
Keyword(s):  
Covariance Matrix ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Microwave Sounding Unit ◽  
The Matrix ◽  
Microwave Sounding ◽  
Background Temperature ◽  
The Difference

Abstract A column EnKF, based on the Canadian global EnKF and using the RTTOV radiative transfer (RT) model, is employed to investigate issues relating to the EnKF assimilation of Advanced Microwave Sounding Unit-A (AMSU-A) radiance measurements. Experiments are performed with large and small ensembles, with and without localization. Three different descriptions of background temperature error are considered: 1) using analytical vertical modes and hypothetical spectra, 2) using the vertical modes and spectrum of a covariance matrix obtained from the global EnKF after 2 weeks of cycling, and 3) using the vertical modes and spectrum of the static background error covariance matrix employed to initiate a global data assimilation cycle. It is found that the EnKF performs well in some of the experiments with background error description 1, and yields modest error reductions with background error description 3. However, the EnKF is virtually unable to reduce the background error (even when using a large ensemble) with background error description 2. To analyze these results, the different background error descriptions are viewed through the prism of the RT model by comparing the trace of the matrix , where is the RT model and is the background error covariance matrix. Indeed, this comparison is found to explain the difference in the results obtained, which relates to the degree to which deep modes are, or are not, present in the different background error covariances. The results suggest that, after 2 weeks of cycling, the global EnKF has virtually eliminated all background error structures that can be “seen” by the AMSU-A radiances.

Sign in / Sign up

Export Citation Format

Share Document