How is the Balance of a Forecast Ensemble Affected by Adaptive and Nonadaptive Localization Schemes?

2015 ◽  
Vol 143 (9) ◽  
pp. 3680-3699 ◽  
Author(s):  
Ross N. Bannister
Keyword(s):  
Forecast Error ◽  
Covariance Matrices ◽  
Error Statistics ◽  
Error Covariance ◽  
Localization Scheme ◽  
Adaptive Schemes ◽  
Convective Scale ◽  
Free Parameters ◽  
Hydrostatic Balance ◽  
First Time

Abstract This paper investigates the effect on balance of a number of Schur product–type localization schemes that have been designed with the primary function of reducing spurious far-field correlations in forecast error statistics. The localization schemes studied comprise a nonadaptive scheme (where the moderation matrix is decomposed in a spectral basis), and two adaptive schemes: a simplified version of Smoothed Ensemble Correlations Raised to a Power (SENCORP) and Ensemble Correlations Raised to a Power (ECO-RAP). The paper shows, the author believes for the first time, how the degree of balance (geostrophic and hydrostatic) implied by the error covariance matrices localized by these schemes can be diagnosed. Here it is considered that an effective localization scheme is one that reduces spurious correlations adequately, but also minimizes disruption of balance (where the “correct” degree of balance or imbalance is assumed to be possessed by the unlocalized ensemble). By varying free parameters that describe each scheme (e.g., the degree of truncation in the schemes that use the spectral basis, the “order” of each scheme, and the degree of ensemble smoothing), it is found that a particular configuration of the ECO-RAP scheme is best suited to the convective-scale system studied. According to the diagnostics this ECO-RAP configuration still weakens geostrophic and hydrostatic balance, but overall this is less so than for other schemes.

scholarly journals Multiscale Representation of Observation Error Statistics in Data Assimilation

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1460
Author(s):  
Vincent Chabot ◽  
Maëlle Nodet ◽  
Arthur Vidard
Keyword(s):  
Data Assimilation ◽  
Real Life ◽  
Covariance Matrices ◽  
Multiscale Modelling ◽  
Observation Error ◽  
Error Statistics ◽  
Life Data ◽  
Promising Tool ◽  
Error Covariance ◽  
Real Life Data

Accounting for realistic observation errors is a known bottleneck in data assimilation, because dealing with error correlations is complex. Following a previous study on this subject, we propose to use multiscale modelling, more precisely wavelet transform, to address this question. This study aims to investigate the problem further by addressing two issues arising in real-life data assimilation: how to deal with partially missing data (e.g., concealed by an obstacle between the sensor and the observed system), and how to solve convergence issues associated with complex observation error covariance matrices? Two adjustments relying on wavelets modelling are proposed to deal with those, and offer significant improvements. The first one consists of adjusting the variance coefficients in the frequency domain to account for masked information. The second one consists of a gradual assimilation of frequencies. Both of these fully rely on the multiscale properties associated with wavelet covariance modelling. Numerical results on twin experiments show that multiscale modelling is a promising tool to account for correlations in observation errors in realistic applications.

scholarly journals Efficient Adaptive Error Parameterizations for Square Root or Ensemble Kalman Filters: Application to the Control of Ocean Mesoscale Signals

2010 ◽  
Vol 138 (3) ◽  
pp. 932-950 ◽  
Author(s):  
Jean-Michel Brankart ◽  
Emmanuel Cosme ◽  
Charles-Emmanuel Testut ◽  
Pierre Brasseur ◽  
Jacques Verron
Keyword(s):  
Kalman Filter ◽  
Covariance Matrix ◽  
Error Estimates ◽  
Forecast Error ◽  
Observation Error ◽  
Square Root ◽  
Error Statistics ◽  
Error Covariance Matrix ◽  
Error Covariance ◽  
Optimal Estimates

Abstract In Kalman filter applications, an adaptive parameterization of the error statistics is often necessary to avoid filter divergence, and prevent error estimates from becoming grossly inconsistent with the real error. With the classic formulation of the Kalman filter observational update, optimal estimates of general adaptive parameters can only be obtained at a numerical cost that is several times larger than the cost of the state observational update. In this paper, it is shown that there exists a few types of important parameters for which optimal estimates can be computed at a negligible numerical cost, as soon as the computation is performed using a transformed algorithm that works in the reduced control space defined by the square root or ensemble representation of the forecast error covariance matrix. The set of parameters that can be efficiently controlled includes scaling factors for the forecast error covariance matrix, scaling factors for the observation error covariance matrix, or even a scaling factor for the observation error correlation length scale. As an application, the resulting adaptive filter is used to estimate the time evolution of ocean mesoscale signals using observations of the ocean dynamic topography. To check the behavior of the adaptive mechanism, this is done in the context of idealized experiments, in which model error and observation error statistics are known. This ideal framework is particularly appropriate to explore the ill-conditioned situations (inadequate prior assumptions or uncontrollability of the parameters) in which adaptivity can be misleading. Overall, the experiments show that, if used correctly, the efficient optimal adaptive algorithm proposed in this paper introduces useful supplementary degrees of freedom in the estimation problem, and that the direct control of these statistical parameters by the observations increases the robustness of the error estimates and thus the optimality of the resulting Kalman filter.

scholarly journals A Study of Rain Forecast Error Structure Based on Radar Observations over a Continental-Scale Spatial Domain

2016 ◽  
Vol 144 (8) ◽  
pp. 2871-2887
Author(s):  
Majid Fekri ◽  
M. K. Yau
Keyword(s):  
Forecast Error ◽  
Error Variance ◽  
Precipitation Forecast ◽  
Local Error ◽  
Error Statistics ◽  
Continental Scale ◽  
Error Covariance ◽  
Hourly Rainfall ◽  
Dependent Error

Abstract This study examines the univariate error covariances of hourly rainfall accumulations using two different NWP models and a mosaic of radar reflectivity over a continental-scale domain. The study focuses on two main areas. The focus of the first part of the paper is on the ensemble-based and the innovation-based error variance and correlation estimations. An ensemble of forecasts and a set of observations provide the basis for estimating the errors in two different ways. The results indicate that both ensemble- and innovation-based methods lead to comparable variance estimations, while the local error correlation estimates have larger differences due to the sensitivity of calculations to the gradient of the variance field. The second part of the paper uses innovations for identifying the errors. The focus of this part is on a prognostic method for estimating the error statistics from the background based on the Bayesian inference technique. The case study shows that the predictive model produces a similar result regarding the magnitude and the dispersion of variance in comparison with the innovation and ensemble-based variances. This study represents a step toward estimating local error variances and local error correlations to construct a nonhomogeneous and precipitation-dependent error covariance matrix of rainfall. These results will be used in a future paper in the design of a 2D-VAR Assimilation Method for Blending Extrapolated Radars (AMBER) with NWP precipitation forecast to form a precipitation nowcasting model.

scholarly journals Four-Dimensional Data Assimilation and Balanced Dynamics

2006 ◽  
Vol 63 (7) ◽  
pp. 1840-1858 ◽  
Author(s):  
Lisa J. Neef ◽  
Saroja M. Polavarapu ◽  
Theodore G. Shepherd
Keyword(s):  
Data Assimilation ◽  
Degrees Of Freedom ◽  
Forecast Error ◽  
Wave Mode ◽  
Slow Manifold ◽  
Error Statistics ◽  
Ensemble Kalman Filters ◽  
Error Covariance ◽  
Balanced Dynamics ◽  
Four Dimensional Data Assimilation

Abstract The problem of spurious excitation of gravity waves in the context of four-dimensional data assimilation is investigated using a simple model of balanced dynamics. The model admits a chaotic vortical mode coupled to a comparatively fast gravity wave mode, and can be initialized such that the model evolves on a so-called slow manifold, where the fast motion is suppressed. Identical twin assimilation experiments are performed, comparing the extended and ensemble Kalman filters (EKF and EnKF, respectively). The EKF uses a tangent linear model (TLM) to estimate the evolution of forecast error statistics in time, whereas the EnKF uses the statistics of an ensemble of nonlinear model integrations. Specifically, the case is examined where the true state is balanced, but observation errors project onto all degrees of freedom, including the fast modes. It is shown that the EKF and EnKF will assimilate observations in a balanced way only if certain assumptions hold, and that, outside of ideal cases (i.e., with very frequent observations), dynamical balance can easily be lost in the assimilation. For the EKF, the repeated adjustment of the covariances by the assimilation of observations can easily unbalance the TLM, and destroy the assumptions on which balanced assimilation rests. It is shown that an important factor is the choice of initial forecast error covariance matrix. A balance-constrained EKF is described and compared to the standard EKF, and shown to offer significant improvement for observation frequencies where balance in the standard EKF is lost. The EnKF is advantageous in that balance in the error covariances relies only on a balanced forecast ensemble, and that the analysis step is an ensemble-mean operation. Numerical experiments show that the EnKF may be preferable to the EKF in terms of balance, though its validity is limited by ensemble size. It is also found that overobserving can lead to a more unbalanced forecast ensemble and thus to an unbalanced analysis.

scholarly journals On the Sensitivity Equations of Four-Dimensional Variational (4D-Var) Data Assimilation

2008 ◽  
Vol 136 (8) ◽  
pp. 3050-3065 ◽  
Author(s):  
Dacian N. Daescu
Keyword(s):  
Data Assimilation ◽  
Forecast Error ◽  
Computational Effort ◽  
Water Model ◽  
Error Statistics ◽  
Background Error ◽  
Practical Applications ◽  
Error Covariance ◽  
Sensitivity Equations ◽  
The Impact

Abstract The equations of the forecast sensitivity to observations and to the background estimate in a four-dimensional variational data assimilation system (4D-Var DAS) are derived from the first-order optimality condition in unconstrained minimization. Estimation of the impact of uncertainties in the specification of the error statistics is considered by evaluating the sensitivity to the observation and background error covariance matrices. The information provided by the error covariance sensitivity analysis is used to identify the input components for which improved estimates of the statistical properties of the errors are of most benefit to the analysis and forecast. A close relationship is established between the sensitivities within each input pair data/error covariance such that once the observation and background sensitivities are available the evaluation of the sensitivity to the specification of the corresponding error statistics requires little additional computational effort. The relevance of the 4D-Var sensitivity equations to assess the data impact in practical applications is discussed. Computational issues are addressed and idealized 4D-Var experiments are set up with a finite-volume shallow-water model to illustrate the theoretical concepts. Time-dependent observation sensitivity and potential applications to improve the model forecast are presented. Guidance provided by the sensitivity fields is used to adjust a 4D-Var DAS to achieve forecast error reduction through assimilation of supplementary data and through an accurate specification of a few of the background error variances.

scholarly journals Plebański–Demiański solution of general relativity and its expressions quadratic and cubic in curvature: Analogies to electromagnetism

2015 ◽  
Vol 24 (10) ◽  
pp. 1550079 ◽  
Author(s):  
Jens Boos
Keyword(s):  
General Relativity ◽  
Electromagnetic Field ◽  
General Type ◽  
Coordinate Systems ◽  
Irreducible Decomposition ◽  
Asymptotically Flat ◽  
Type D ◽  
Curvature Invariants ◽  
Free Parameters ◽  
First Time

Analogies between gravitation and electromagnetism have been known since the 1950s. Here, we examine a fairly general type D solution — the exact seven parameter solution of Plebański–Demiański (PD) — to demonstrate these analogies for a physically meaningful spacetime. The two quadratic curvature invariants B2 - E2 and E⋅B are evaluated analytically. In the asymptotically flat case, the leading terms of E and B can be interpreted as gravitoelectric mass and gravitoelectric current of the PD solution, respectively, if there are no gravitomagnetic monopoles present. Furthermore, the square of the Bel–Robinson tensor reads (B2 + E2)2 for the PD solution, reminiscent of the square of the energy density in electrodynamics. By analogy to the energy–momentum 3-form of the electromagnetic field, we provide an alternative way to derive the recently introduced Bel–Robinson 3-form, from which the Bel–Robinson tensor can be calculated. We also determine the Kummer tensor, a tensor cubic in curvature, for a general type D solution for the first time, and calculate the pieces of its irreducible decomposition. The calculations are carried out in two coordinate systems: In the original polynomial PD coordinates and in a modified Boyer–Lindquist-like version introduced by Griffiths and Podolský (GP) allowing for a more straightforward physical interpretation of the free parameters.

scholarly journals Multivariate Error Covariance Estimates by Monte Carlo Simulation for Assimilation Studies in the Pacific Ocean

2005 ◽  
Vol 133 (8) ◽  
pp. 2310-2334 ◽  
Author(s):  
Anna Borovikov ◽  
Michele M. Rienecker ◽  
Christian L. Keppenne ◽  
Gregory C. Johnson
Keyword(s):  
Monte Carlo ◽  
Data Assimilation ◽  
Forecast Error ◽  
Independent Set ◽  
Velocity Fields ◽  
Optimal Interpolation ◽  
Model Errors ◽  
Error Statistics ◽  
Practical Applications ◽  
Monte Carlo Techniques

Abstract One of the most difficult aspects of ocean-state estimation is the prescription of the model forecast error covariances. The paucity of ocean observations limits our ability to estimate the covariance structures from model–observation differences. In most practical applications, simple covariances are usually prescribed. Rarely are cross covariances between different model variables used. Here a comparison is made between a univariate optimal interpolation (UOI) scheme and a multivariate OI algorithm (MvOI) in the assimilation of ocean temperature profiles. In the UOI case only temperature is updated using a Gaussian covariance function. In the MvOI, salinity, zonal, and meridional velocities as well as temperature are updated using an empirically estimated multivariate covariance matrix. Earlier studies have shown that a univariate OI has a detrimental effect on the salinity and velocity fields of the model. Apparently, in a sequential framework it is important to analyze temperature and salinity together. For the MvOI an estimate of the forecast error statistics is made by Monte Carlo techniques from an ensemble of model forecasts. An important advantage of using an ensemble of ocean states is that it provides a natural way to estimate cross covariances between the fields of different physical variables constituting the model-state vector, at the same time incorporating the model’s dynamical and thermodynamical constraints as well as the effects of physical boundaries. Only temperature observations from the Tropical Atmosphere–Ocean array have been assimilated in this study. To investigate the efficacy of the multivariate scheme, two data assimilation experiments are validated with a large independent set of recently published subsurface observations of salinity, zonal velocity, and temperature. For reference, a control run with no data assimilation is used to check how the data assimilation affects systematic model errors. While the performance of the UOI and MvOI is similar with respect to the temperature field, the salinity and velocity fields are greatly improved when the multivariate correction is used, as is evident from the analyses of the rms differences between these fields and independent observations. The MvOI assimilation is found to improve upon the control run in generating water masses with properties close to the observed, while the UOI fails to maintain the temperature and salinity structure.

scholarly journals Background Error in WRF Model

2020 ◽  
Vol 16 ◽  
Keyword(s):  
Data Assimilation ◽  
Physical Properties ◽  
Covariance Matrix ◽  
Numerical Weather Prediction ◽  
Weather Prediction ◽  
Wrf Model ◽  
Background Error ◽  
Numerical Weather ◽  
Error Covariance ◽  
First Time

WRF model have been tuned and tested over Georgia’s territory for years. First time in Georgia theprocess of data assimilation in Numerical weather prediction is developing. This work presents how forecasterror statistics appear in the data assimilation problem through the background error covariance matrix – B, wherethe variances and correlations associated with model forecasts are estimated. Results of modeling of backgrounderror covariance matrix for control variables using WRF model over Georgia with desired domain configurationare discussed and presented. The modeling was implemented in two different 3DVAR systems (WRFDA andGSI) and results were checked by pseudo observation benchmark cases using also default global and regional BEmatrixes. The mathematical and physical properties of the covariances are also reviewed.

scholarly journals Estimation of X-Band Polarimetric Radar Attenuation and Measurement Uncertainty Using a Variational Method

2014 ◽  
Vol 53 (4) ◽  
pp. 1099-1119 ◽  
Author(s):  
Wei-Yu Chang ◽  
Jothiram Vivekanandan ◽  
Tai-Chi Chen Wang
Keyword(s):  
Variational Method ◽  
Ad Hoc ◽  
Field Measurements ◽  
Correction Method ◽  
Southwest Monsoon ◽  
Covariance Matrices ◽  
Polarimetric Radar ◽  
Error Covariance ◽  
X Band ◽  
Radar Measurements

AbstractA variational algorithm for estimating measurement error covariance and the attenuation of X-band polarimetric radar measurements is described. It concurrently uses both the differential reflectivity ZDR and propagation phase ΦDP. The majority of the current attenuation estimation techniques use only ΦDP. A few of the ΦDP-based methods use ZDR as a constraint for verifying estimated attenuation. In this paper, a detailed observing system simulation experiment was used for evaluating the performance of the variational algorithm. The results were compared with a single-coefficient ΦDP-based method. Retrieved attenuation from the variational method is more accurate than the results from a single coefficient ΦDP-based method. Moreover, the variational method is less sensitive to measurement noise in radar observations. The variational method requires an accurate description of error covariance matrices. Relative weights between measurements and background values (i.e., mean value based on long-term DSD measurements in the variational method) are determined by their respective error covariances. Instead of using ad hoc values, error covariance matrices of background and radar measurement are statistically estimated and their spatial characteristics are studied. The estimated error covariance shows higher values in convective regions than in stratiform regions, as expected. The practical utility of the variational attenuation correction method is demonstrated using radar field measurements from the Taiwan Experimental Atmospheric Mobile-Radar (TEAM-R) during 2008’s Southwest Monsoon Experiment/Terrain-Influenced Monsoon Rainfall Experiment (SoWMEX/TiMREX). The accuracy of attenuation-corrected X-band radar measurements is evaluated by comparing them with collocated S-band radar measurements.

Sign in / Sign up

Export Citation Format

Share Document