scholarly journals Implementing Hybrid Background Error Covariance into the LETKF with Attenuation-based Localization: Experiments with a Simplified AGCM

2021 ◽  
Keyword(s):  
Weather Prediction ◽  
Hybrid Approach ◽  
Localization Length ◽  
Atmospheric Model ◽  
Forecast Errors ◽  
Observation Error ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Optimal Localization

Abstract Recent numerical weather prediction systems have significantly improved medium-range forecasts by implementing hybrid background error covariance, for which climatological (static) and ensemble-based (flow-dependent) error covariance are combined. While the hybrid approach has been investigated mainly in variational systems, this study aims at exploring methods for implementing the hybrid approach for the local ensemble transform Kalman filter (LETKF). Following Kretchmer et al. (2015), the present study constructed hybrid background error covariance by adding collections of climatological perturbations to the forecast ensemble. In addition, this study proposes a new localization method that attenuates the ensemble perturbation (Z-localization) instead of inflating observation error variance (R-localization). A series of experiments with a simplified global atmospheric model revealed that the hybrid LETKF resulted in smaller forecast errors than the LETKF, especially in sparsely observed regions. Due to the larger ensemble enabled by the hybrid approach, optimal localization length scales for the hybrid LETKF were larger than those for the LETKF. With the LETKF, the Z-localization resulted in similar forecast errors as the R-localization. However, Z-localization has an advantage in enabling to apply different localization scales for flow-dependent perturbation and climatological static perturbations with the hybrid LETKF. The optimal localization for climatological perturbations was slightly larger than that for flow-dependent perturbations. This study proposes Optimal EigenDecomposition (OED) ETKF formulation to reduce computational costs. The computational expense of the OED ETKF formulation became significantly smaller than that of standard ETKF formulations as the number of climatological perturbations was increased beyond a few hundred.

scholarly journals Hybrid Background Error Covariances for a Limited-Area Deterministic Weather Prediction System

2020 ◽  
Vol 35 (3) ◽  
pp. 1051-1066
Author(s):  
Joël Bédard ◽  
Jean-François Caron ◽  
Mark Buehner ◽  
Seung-Jong Baek ◽  
Luc Fillion
Keyword(s):  
Weather Prediction ◽  
Localization Length ◽  
Added Value ◽  
Limited Area ◽  
Prediction System ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Impact ◽  
Dependent Error

Abstract This study introduces an experimental regional assimilation configuration for a 4D ensemble–variational (4D-EnVar) deterministic weather prediction system. A total of 16 assimilation experiments covering July 2014 are presented to assess both experimental regional climatological background error covariances and updates in the treatment of flow-dependent error covariances. The regional climatological background error covariances are estimated using statistical correlations between variables instead of using balance operators. These error covariance estimates allow the analyses to fit more closely with the assimilated observations than when using the lower-resolution global background error covariances (due to shorter correlation scales), and the ensuing forecasts are significantly improved. The use of ensemble-based background error covariances is also improved by reducing vertical and horizontal localization length scales for the flow-dependent background error covariance component. Also, reducing the number of ensemble members employed in the deterministic analysis (from 256 to 128) reduced computational costs by half without degrading the accuracy of analyses and forecasts. The impact of the relative contributions of the climatological and flow-dependent background error covariance components is also examined. Results show that the experimental regional system benefits from giving a lower (higher) weight to climatological (flow-dependent) error covariances. When compared with the operational assimilation configuration of the continental prediction system, the proposed modifications to the background error covariances improve both surface and upper-air RMSE scores by nearly 1%. Still, the use of a higher-resolution ensemble to estimate flow-dependent background error covariances does not yet provide added value, although it is expected to allow for a better use of dense observations in the future.

scholarly journals The Impact of Assimilating Satellite Radiance Observations in the Copernicus European Regional Reanalysis (CERRA)

2021 ◽  
Vol 13 (3) ◽  
pp. 426
Author(s):  
Zheng Qi Wang ◽  
Roger Randriamampianina
Keyword(s):  
Weather Prediction ◽  
Deterministic System ◽  
Observation Error ◽  
Key Factors ◽  
Background Error ◽  
Current Configuration ◽  
Error Covariance ◽  
Regional Reanalysis ◽  
The Impact ◽  
European Regional

The assimilation of microwave and infrared (IR) radiance satellite observations within numerical weather prediction (NWP) models have been an important component in the effort of improving the accuracy of analysis and forecast. Such capabilities were implemented during the development of the high-resolution Copernicus European Regional Reanalysis (CERRA), funded by the Copernicus Climate Change Services (C3S). The CERRA system couples the deterministic system with the ensemble data assimilation to provide periodic updates of the background error covariance matrix. Several key factors for the assimilation of radiances were investigated, including appropriate use of variational bias correction (VARBC), surface-sensitive AMSU-A observations and observation error correlation. Twenty-one-day impact studies during the summer and winter seasons were conducted. Generally, the assimilation of radiances has a small impact on the analysis, while greater impacts are observed on short-range (12 and 24-h) forecasts with an error reduction of 1–2% for the mid and high troposphere. Although, the current configuration provided less accurate forecasts from 09 and 18 UTC analysis times. With the increased thinning distances and the rejection of IASI observation over land, the errors in the analyses and 3 h forecasts on geopotential height were reduced up to 2%.

An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test

2008 ◽  
Vol 136 (9) ◽  
pp. 3363-3373 ◽  
Author(s):  
Chengsi Liu ◽  
Qingnong Xiao ◽  
Bin Wang
Keyword(s):  
Data Assimilation ◽  
Preliminary Test ◽  
Background Field ◽  
Variational Data Assimilation ◽  
Water Model ◽  
Observation Error ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance

Abstract Applying a flow-dependent background error covariance (𝗕 matrix) in variational data assimilation has been a topic of interest among researchers in recent years. In this paper, an ensemble-based four-dimensional variational (En4DVAR) algorithm, designed by the authors, is presented that uses a flow-dependent background error covariance matrix constructed by ensemble forecasts and performs 4DVAR optimization to produce a balanced analysis. A great advantage of this En4DVAR design over standard 4DVAR methods is that the tangent linear and adjoint models can be avoided in its formulation and implementation. In addition, it can be easily incorporated into variational data assimilation systems that are already in use at operational centers and among the research community. A one-dimensional shallow water model was used for preliminary tests of the En4DVAR scheme. Compared with standard 4DVAR, the En4DVAR converges well and can produce results that are as good as those with 4DVAR but with far less computation cost in its minimization. In addition, a comparison of the results from En4DVAR with those from other data assimilation schemes [e.g., 3DVAR and ensemble Kalman filter (EnKF)] is made. The results show that the En4DVAR yields an analysis that is comparable to the widely used variational or ensemble data assimilation schemes and can be a promising approach for real-time applications. In addition, experiments were carried out to test the sensitivities of EnKF and En4DVAR, whose background error covariance is estimated from the same ensemble forecasts. The experiments indicated that En4DVAR obtained reasonably sound analysis even with larger observation error, higher observation frequency, and more unbalanced background field.

A Statistical Investigation of the Sensitivity of Ensemble-Based Kalman Filters to Covariance Filtering

2011 ◽  
Vol 139 (9) ◽  
pp. 3036-3051 ◽  
Author(s):  
Mikyoung Jun ◽  
Istvan Szunyogh ◽  
Marc G. Genton ◽  
Fuqing Zhang ◽  
Craig H. Bishop
Keyword(s):  
Covariance Matrix ◽  
Kernel Smoothing ◽  
Localization Length ◽  
Statistical Investigation ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Nonparametric Approach ◽  
Error Covariance ◽  
Sample Covariance

This paper investigates the effects of spatial filtering on the ensemble-based estimate of the background error covariance matrix in an ensemble-based Kalman filter (EnKF). In particular, a novel kernel smoothing method with variable bandwidth is introduced and its performance is compared to that of the widely used Gaspari–Cohn filter, which uses a fifth-order kernel function with a fixed localization length. Numerical experiments are carried out with the 40-variable Lorenz-96 model. The results of the experiments show that the nonparametric approach provides a more accurate estimate of the background error covariance matrix than the Gaspari–Cohn filter with any localization length. It is also shown that the Gaspari–Cohn filter tends to provide more accurate estimates of the covariance with shorter localization lengths. However, the analyses obtained by using longer localization lengths tend to be more accurate than those produced by using short localization lengths or the nonparametric approach. This seemingly paradoxical result is explained by showing that localization with longer localization lengths produces filtered estimates whose time mean is the most similar to the time mean of both the unfiltered estimate and the true covariance. This result suggests that a better metric of covariance filtering skill would be one that combined a measure of closeness to the sample covariance matrix for a very large ensemble with a measure of similarity between the climatological averages of the filtered and sample covariance.

scholarly journals Impact of different estimations of the background-error covariance matrix on climate reconstructions based on data assimilation

2018 ◽  
Author(s):  
Veronika Valler ◽  
Jörg Franke ◽  
Stefan Brönnimann
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Sampling Error ◽  
Localization Length ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Sample Covariance ◽  
Temporal Localization

Abstract. Data assimilation has been adapted in paleoclimatology to reconstruct past climate states. A key component of the assimilation system is the background-error covariance matrix, which controls how the information from observations spreads into the model space. In ensemble-based approaches, the background-error covariance matrix can be estimated from the ensemble. Due to the usually limited ensemble size, the background-error covariance matrix is subject to the so-called sampling error. We test different methods to reduce the effect of sampling error in a published paleo data assimilation setup. For this purpose, we conduct a set of experiments, where we assimilate early instrumental data and proxy records stored in trees, to investigate the effect of 1) the applied localization function and localization length scale; 2) multiplicative and additive inflation techniques; 3) temporal localization of monthly data, which applies if several time steps are estimated together in the same assimilation window. We find that the estimation of the background-error covariance matrix can be improved by additive inflation where the background-error covariance matrix is not only calculated from the sample covariance, but blended with a climatological covariance matrix. Implementing a temporal localization for monthly resolved data also led to a better reconstruction.

Cloud-dependent piecewise assimilation based on a hydrometeor-included background error covariance and its impact on regional Numerical Weather Prediction

2021 ◽  
Author(s):  
Deming Meng ◽  
Yaodeng Chen ◽  
Jun Li ◽  
Hongli Wang ◽  
Yuanbing Wang ◽  
...  
Keyword(s):  
Numerical Weather Prediction ◽  
Weather Prediction ◽  
Precipitation Forecast ◽  
Background Error ◽  
Single Observation ◽  
Numerical Weather ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Analysis Scheme ◽  
The Impact

AbstractThe background error covariance (B) behaves differently and needs to be carefully defined in cloudy areas due to larger uncertainties caused by models’ inability to correctly represent complex physical processes. This study proposes a new cloud-dependent B strategy by adaptively adjusting the hydrometeor-included B in the cloudy areas according to the cloud index (CI) derived from the satellite-based cloud products. The adjustment coefficient is determined by comparing the error statistics of B for the clear and cloudy areas based on the two-dimensional geographical masks. The comparison highlights the larger forecast errors and manifests the necessity of using appropriate B in cloudy areas. The cloud-dependent B is then evaluated by a series of single observation tests and three-week cycling assimilation and forecasting experiments. The single observation experiments confirm that the cloud-dependent B allows cloud dependency for the multivariate analysis increments and alleviates the discontinuities at the cloud mask borders by treating the CI as an exponent. The impact study on regional numerical weather prediction (NWP) demonstrates that the application of the cloud-dependent B reduces analyses and forecasts bias and increases precipitation forecast skills. Diagnostics of a heavy rainfall case indicate that the application of the cloud-dependent B enhances the moisture, wind, and hydrometeors analyses and forecasts, resulting in more accurate forecasts of accumulated precipitation. The cloud-dependent piecewise analysis scheme proposed herein is extensible, and a more precise definition of CI can improve the analysis, which deserves future investigation.

Retrieval of Moisture from Simulated GPS Slant-Path Water Vapor Observations Using 3DVAR with Anisotropic Recursive Filters

2007 ◽  
Vol 135 (4) ◽  
pp. 1506-1521 ◽  
Author(s):  
Haixia Liu ◽  
Ming Xue ◽  
R. James Purser ◽  
David F. Parrish
Keyword(s):  
Water Vapor ◽  
Weather Prediction ◽  
Three Dimensional ◽  
Background Error ◽  
Special Configuration ◽  
Background Error Covariance ◽  
Recursive Filters ◽  
Error Covariance ◽  
Slant Path ◽  
The Impact

Abstract Anisotropic recursive filters are implemented within a three-dimensional variational data assimilation (3DVAR) framework to efficiently model the effect of flow-dependent background error covariance. The background error covariance is based on an estimated error field and on the idea of Riishøjgaard. In the anisotropic case, the background error pattern can be stretched or flattened in directions oblique to the alignment of the grid coordinates and is constructed by applying, at each point, six recursive filters along six directions corresponding, in general, to a special configuration of oblique lines of the grid. The recursive filters are much more efficient than corresponding explicit filters used in an earlier study and are therefore more suitable for real-time numerical weather prediction. A set of analysis experiments are conducted at a mesoscale resolution to examine the effectiveness of the 3DVAR system in analyzing simulated global positioning system (GPS) slant-path water vapor observations from ground-based GPS receivers and observations from collocated surface stations. It is shown that the analyses produced with recursive filters are at least as good as those with corresponding explicit filters. In some cases, the recursive filters actually perform better. The impact of flow-dependent background errors modeled using the anisotropic recursive filters is also examined. The use of anisotropic filters improves the analysis, especially in terms of finescale structures. The analysis system is found to be effective in the presence of typical observational errors. The sensitivity of isotropic and anisotropic recursive-filter analyses to the decorrelation scales is also examined systematically.

scholarly journals Growth of Forecast Errors from Covariances Modeled by 4DVAR and ETKF Methods

2011 ◽  
Vol 139 (5) ◽  
pp. 1505-1518 ◽  
Author(s):  
Chiara Piccolo
Keyword(s):  
Weather Forecasting ◽  
Initial Conditions ◽  
Forecast Error ◽  
Forecast Errors ◽  
Model Errors ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Numerical Weather Forecasting ◽  
Ensemble Transform Kalman Filter

Numerical weather forecasting errors grow with time. Error growth results from the amplification of small perturbations due to atmospheric instability or from model deficiencies during model integration. In current NWP systems, the dimension of the forecast error covariance matrices is far too large for these matrices to be represented explicitly. They must be approximated. This paper focuses on comparing the growth of forecast error from covariances modeled by the Met Office operational four-dimensional variational data assimilation (4DVAR) and ensemble transform Kalman filter (ETKF) methods over a period of 24 h. The growth of forecast errors implied by 4DVAR is estimated by drawing a random sample of initial conditions from a Gaussian distribution with the standard deviations given by the background error covariance matrix and then evolving the sample forward in time using linearized dynamics. The growth of the forecast error modeled by the ETKF is estimated by propagating the full nonlinear model in time starting from initial conditions generated by an ETKF. This method includes model errors in two ways: by using an inflation factor and by adding model perturbations through a stochastic physics scheme. Finally, these results are compared with a benchmark of the climatological error. The forecast error predicted by the implicit evolution of 4DVAR does not grow, regardless of the dataset used to generate the static background error covariance statistics. The forecast error predicted by the ETKF grows more rapidly because the ETKF selects balanced initial perturbations, which project onto rapidly growing modes. Finally, in both cases it is not possible to disentangle the contribution of the initial condition error from the model error.

scholarly journals Impact of different estimations of the background-error covariance matrix on climate reconstructions based on data assimilation

2019 ◽  
Vol 15 (4) ◽  
pp. 1427-1441 ◽  
Author(s):  
Veronika Valler ◽  
Jörg Franke ◽  
Stefan Brönnimann
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Sampling Error ◽  
Localization Length ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Sample Covariance ◽  
Temporal Localization

Abstract. Data assimilation has been adapted in paleoclimatology to reconstruct past climate states. A key component of some assimilation systems is the background-error covariance matrix, which controls how the information from observations spreads into the model space. In ensemble-based approaches, the background-error covariance matrix can be estimated from the ensemble. Due to the usually limited ensemble size, the background-error covariance matrix is subject to the so-called sampling error. We test different methods to reduce the effect of sampling error in a published paleoclimate data assimilation setup. For this purpose, we conduct a set of experiments, where we assimilate early instrumental data and proxy records stored in trees, to investigate the effect of (1) the applied localization function and localization length scale; (2) multiplicative and additive inflation techniques; (3) temporal localization of monthly data, which applies if several time steps are estimated together in the same assimilation window. We find that the estimation of the background-error covariance matrix can be improved by additive inflation where the background-error covariance matrix is not only calculated from the sample covariance but blended with a climatological covariance matrix. Implementing a temporal localization for monthly resolved data also led to a better reconstruction.

Sign in / Sign up

Export Citation Format

Share Document