Diagnosis of observation, background and analysis-error statistics in observation space

2005 ◽  
Vol 131 (613) ◽  
pp. 3385-3396 ◽  
Author(s):  
G. Desroziers ◽  
L. Berre ◽  
B. Chapnik ◽  
P. Poli
2007 ◽  
Vol 135 (12) ◽  
pp. 4006-4029 ◽  
Author(s):  
C. A. Reynolds ◽  
M. S. Peng ◽  
S. J. Majumdar ◽  
S. D. Aberson ◽  
C. H. Bishop ◽  
...  

Abstract Adaptive observing guidance products for Atlantic tropical cyclones are compared using composite techniques that allow one to quantitatively examine differences in the spatial structures of the guidance maps and relate these differences to the constraints and approximations of the respective techniques. The guidance maps are produced using the ensemble transform Kalman filter (ETKF) based on ensembles from the National Centers for Environmental Prediction and the European Centre for Medium-Range Weather Forecasts (ECMWF), and total-energy singular vectors (TESVs) produced by ECMWF and the Naval Research Laboratory. Systematic structural differences in the guidance products are linked to the fact that TESVs consider the dynamics of perturbation growth only, while the ETKF combines information on perturbation evolution with error statistics from an ensemble-based data assimilation scheme. The impact of constraining the SVs using different estimates of analysis error variance instead of a total-energy norm, in effect bringing the two methods closer together, is also assessed. When the targets are close to the storm, the TESV products are a maximum in an annulus around the storm, whereas the ETKF products are a maximum at the storm location itself. When the targets are remote from the storm, the TESVs almost always indicate targets northwest of the storm, whereas the ETKF targets are more scattered relative to the storm location and often occur over the northern North Atlantic. The ETKF guidance often coincides with locations in which the ensemble-based analysis error variance is large. As the TESV method is not designed to consider spatial differences in the likely analysis errors, it will produce targets over well-observed regions, such as the continental United States. Constraining the SV calculation using analysis error variance values from an operational 3D variational data assimilation system (with stationary, quasi-isotropic background error statistics) results in a modest modulation of the target areas away from the well-observed regions, and a modest reduction of perturbation growth. Constraining the SVs using the ETKF estimate of analysis error variance produces SV targets similar to ETKF targets and results in a significant reduction in perturbation growth, due to the highly localized nature of the analysis error variance estimates. These results illustrate the strong sensitivity of SVs to the norm (and to the analysis error variance estimate used to define it) and confirm that discrepancies between target areas computed using different methods reflect the mathematical and physical differences between the methods themselves.


2022 ◽  
Vol 14 (2) ◽  
pp. 375
Author(s):  
Sina Voshtani ◽  
Richard Ménard ◽  
Thomas W. Walker ◽  
Amir Hakami

We applied the parametric variance Kalman filter (PvKF) data assimilation designed in Part I of this two-part paper to GOSAT methane observations with the hemispheric version of CMAQ to obtain the methane field (i.e., optimized analysis) with its error variance. Although the Kalman filter computes error covariances, the optimality depends on how these covariances reflect the true error statistics. To achieve more accurate representation, we optimize the global variance parameters, including correlation length scales and observation errors, based on a cross-validation cost function. The model and the initial error are then estimated according to the normalized variance matching diagnostic, also to maintain a stable analysis error variance over time. The assimilation results in April 2010 are validated against independent surface and aircraft observations. The statistics of the comparison of the model and analysis show a meaningful improvement against all four types of available observations. Having the advantage of continuous assimilation, we showed that the analysis also aims at pursuing the temporal variation of independent measurements, as opposed to the model. Finally, the performance of the PvKF assimilation in capturing the spatial structure of bias and uncertainty reduction across the Northern Hemisphere is examined, indicating the capability of analysis in addressing those biases originated, whether from inaccurate emissions or modelling error.


2020 ◽  
Author(s):  
Milija Zupanski

<p>High-dimensional ensemble data assimilation applications require error covariance localization in order to address the problem of insufficient degrees of freedom, typically accomplished using the observation-space covariance localization. However, this creates a challenge for vertically integrated observations, such as satellite radiances, aerosol optical depth, etc., since the exact observation location in vertical does not exist. For nonlinear problems, there is an implied inconsistency in iterative minimization due to using observation-space localization which effectively prevents finding the optimal global minimizing solution. Using state-space localization, however, in principal resolves both issues associated with observation space localization.</p><p> </p><p>In this work we present a new nonlinear ensemble data assimilation method that employs covariance localization in state space and finds an optimal analysis solution. The new method resembles “modified ensembles” in the sense that ensemble size is increased in the analysis, but it differs in methodology used to create ensemble modifications, calculate the analysis error covariance, and define the initial ensemble perturbations for data assimilation cycling. From a practical point of view, the new method is considerably more efficient and potentially applicable to realistic high-dimensional data assimilation problems. A distinct characteristic of the new algorithm is that the localized error covariance and minimization are global, i.e. explicitly defined over all state points. The presentation will focus on examining feasible options for estimating the analysis error covariance and for defining the initial ensemble perturbations.</p>


2021 ◽  
Author(s):  
Yuefei Zeng ◽  
Tijana Janjic ◽  
Yuxuan Feng ◽  
Ulrich Blahak ◽  
Alberto de Lozar ◽  
...  

Abstract. Assimilation of weather radar measurements including radar reflectivity and radial wind data has been operational at the Deutscher Wetterdienst, with a diagonal observation error (OE) covariance matrix. For an implementation of a full OE covariance matrix, the statistics of the OE have to be a priori estimated, for which the Desroziers method has been often used. However, the resulted statistics consists of contributions from different error sources and are difficult to interpret. In this work, we use an approach that is based on samples for truncation error in radar observation space to approximate the representation error due to unresolved scales and processes (RE) and compare its statistics with the OE statistics estimated by the Desroziers method. It is found that the statistics of the RE help the understanding of several important features in the variances and correlation length scales of the OE for both reflectivity and radial wind data and the other error sources from the microphysical scheme, radar observation operator and the superobbing technique may also contribute, for instance, to differences among different elevations and observation types. The statistics presented here can serve as a guideline for selecting which observations to assimilate and for assignment of the OE covariance matrix that can be diagonal or full and correlated.


2006 ◽  
Vol 134 (2) ◽  
pp. 618-637 ◽  
Author(s):  
Martin Charron ◽  
P. L. Houtekamer ◽  
Peter Bartello

Abstract The ensemble Kalman filter (EnKF) developed at the Meteorological Research Branch of Canada is used in the context of synthetic radial wind data assimilation at the mesoscale. A dry Boussinesq model with periodic boundary conditions is employed to provide a control run, as well as two ensembles of first guesses. Synthetic data, which are interpolated from the control run, are assimilated and simulate Doppler radar wind measurements. Nine “radars” with a range of 120 km are placed evenly on the horizontal 1000 km × 1000 km domain. These radars measure the radial wind with assumed Gaussian error statistics at each grid point within their range provided that there is sufficient upward motion (a proxy for precipitation). These data of radial winds are assimilated every 30 min and the assimilation period extends over 4 days. Results show that the EnKF technique with 2 × 50 members performed well in terms of reducing the analysis error for horizontal winds and temperature (even though temperature is not an observed variable) over a period of 4 days. However the analyzed vertical velocity shows an initial degradation. During the first 2 days of the assimilation period, the analysis error of the vertical velocity is greater when assimilating radar observations than when scoring forecasts initialized at t = 0 without assimilating any data. The type of assimilated data as well as the localization of the impact of the observations is thought to be the cause of this degradation of the analyzed vertical velocity. External gravity modes are present in the increments when localization is performed. This degradation can be eliminated by filtering the external gravity modes of the analysis increments. A similar set of experiments is realized in which the model dissipation coefficient is reduced by a factor of 10. This shows the level of sensitivity of the results to the kinetic energy power spectrum, and that the quality of the analyzed vertical wind is worse when dissipation is small.


2021 ◽  
Vol 149 (4) ◽  
pp. 1041-1054
Author(s):  
Amal El Akkraoui ◽  
David Carvalho ◽  
Ronald M. Errico ◽  
Nikki C. Privé ◽  
Michael G. Bosilovich

ABSTRACTDue to production time constraints, most reanalyses are produced in multiple parallel streams instead of a single continuous one. These streams cover separate segments of the reanalysis time period with short overlaps to allow reconstruction of the official record. A fundamental assumption justifying this approach is that the streams will be assimilating the same observations during the periods where they overlap, and so will eventually converge to a similar atmospheric state, making discontinuities at stream junctions negligible. This assumption is revisited in this work by examining the impact of analysis error on the differences between MERRA-2 overlapping streams in three historical periods. Comparison results are shown in terms of standard deviations of stream differences as well as the spectral decomposition of the variance of their differences. Residual differences were found at the end of each year of overlap, with larger values observed in the earlier segments of the presatellite era. By drawing parallels with analysis error statistics estimated from the GMAO OSSE system, these differences are shown to reflect the varying constraint of data with the varying observing network, and to further carry the imprint of errors that the data assimilation process is not able to mitigate. As such, they are unlikely to be reduced by longer spinup periods. The ability of data assimilation to ensure continuity in the parallel streams is put into question when the observing system coverage is inadequate or simply when the data assimilation system as a whole is suboptimal.


2021 ◽  
Vol 14 (8) ◽  
pp. 5735-5756
Author(s):  
Yuefei Zeng ◽  
Tijana Janjic ◽  
Yuxuan Feng ◽  
Ulrich Blahak ◽  
Alberto de Lozar ◽  
...  

Abstract. Assimilation of weather radar measurements including radar reflectivity and radial wind data has been operational at the Deutscher Wetterdienst, with a diagonal observation error (OE) covariance matrix. For an implementation of a full OE covariance matrix, the statistics of the OE have to be a priori estimated, for which the Desroziers method has been often used. However, the resulted statistics consists of contributions from different error sources and are difficult to interpret. In this work, we use an approach that is based on samples for truncation error in radar observation space to approximate the representation error due to unresolved scales and processes (RE) and compare its statistics with the OE statistics estimated by the Desroziers method. It is found that the statistics of the RE help the understanding of several important features in the variances and correlation length scales of the OE for both reflectivity and radial wind data and the other error sources from the microphysical scheme, radar observation operator and the superobbing technique may also contribute, for instance, to differences among different elevations and observation types. The statistics presented here can serve as a guideline for selecting which observations are assimilated and for assignment of the OE covariance matrix that can be diagonal or full and correlated.


Sign in / Sign up

Export Citation Format

Share Document