E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model

2012 ◽  
Vol 140 (2) ◽  
pp. 587-600 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Prediction Model ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Coupled System ◽  
Limited Area ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Hybrid Data Assimilation

A hybrid data assimilation approach that couples the ensemble Kalman filter (EnKF) and four-dimensional variational (4DVar) methods is implemented for the first time in a limited-area weather prediction model. In this coupled system, denoted E4DVar, the EnKF and 4DVar systems run in parallel while feeding into each other. The multivariate, flow-dependent background error covariance estimated from the EnKF ensemble is used in the 4DVar minimization and the ensemble mean in the EnKF analysis is replaced by the 4DVar analysis, while updating the analysis perturbations for the next cycle of ensemble forecasts with the EnKF. Therefore, the E4DVar can obtain flow-dependent information from both the explicit covariance matrix derived from ensemble forecasts, as well as implicitly from the 4DVar trajectory. The performance of an E4DVar system is compared with the uncoupled 4DVar and EnKF for a limited-area model by assimilating various conventional observations over the contiguous United States for June 2003. After verifying the forecasts from each analysis against standard sounding observations, it is found that the E4DVar substantially outperforms both the EnKF and 4DVar during this active summer month, which featured several episodes of severe convective weather. On average, the forecasts produced from E4DVar analyses have considerably smaller errors than both of the stand-alone EnKF and 4DVar systems for forecast lead times up to 60 h.

scholarly journals Performance Characteristics of a Pseudo-Operational Ensemble Kalman Filter

2008 ◽  
Vol 136 (10) ◽  
pp. 3947-3963 ◽  
Author(s):  
Ryan D. Torn ◽  
Gregory J. Hakim
Keyword(s):  
Kalman Filter ◽  
Ensemble Kalman Filter ◽  
Prediction Models ◽  
North Pacific Ocean ◽  
Weather Prediction ◽  
Limited Area ◽  
Observation Data ◽  
Error Statistics ◽  
Ensemble Forecasts ◽  
Ensemble Mean

The 2-yr performance of a pseudo-operational (real time) limited-area ensemble Kalman filter (EnKF) based on the Weather Research and Forecasting Model is described. This system assimilates conventional observations from surface stations, rawinsondes, the Aircraft Communications Addressing and Reporting System (ACARS), and cloud motion vectors every 6 h on a domain that includes the eastern North Pacific Ocean and western North America. Ensemble forecasts from this system and deterministic output from operational numerical weather prediction models during this same period are verified against rawinsonde and surface observation data. Relative to operational forecasts, the forecast from the ensemble-mean analysis has slightly larger errors in wind and temperature but smaller errors in moisture, even though satellite radiances are not assimilated by the EnKF. Time-averaged correlations indicate that assimilating ACARS and cloud wind data with flow-dependent error statistics provides corrections to the moisture field in the absence of direct observations of that field. Comparison with a control experiment in which a deterministic forecast is cycled without observation assimilation indicates that the skill in the EnKF’s forecasts results from assimilating observations and not from lateral boundary conditions or the model formulation. Furthermore, the ensemble variance is generally in good agreement with the ensemble-mean error and the spread increases monotonically with forecast hour.

scholarly journals E3DVar: Coupling an Ensemble Kalman Filter with Three-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model and Comparison to E4DVar

2013 ◽  
Vol 141 (3) ◽  
pp. 900-917 ◽  
Author(s):  
Fuqing Zhang ◽  
Meng Zhang ◽  
Jonathan Poterjoy
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Lead Times ◽  
Limited Area ◽  
Model Errors ◽  
Mean Square Errors

Abstract This study examines the performance of a hybrid ensemble-variational data assimilation system (E3DVar) that couples an ensemble Kalman filter (EnKF) with the three-dimensional variational data assimilation (3DVar) system for the Weather Research and Forecasting (WRF) Model. The performance of E3DVar and the component EnKF and 3DVar systems are compared over the eastern United States for June 2003. Conventional sounding and surface observations as well as data from wind profilers, aircraft and ships, and cloud-tracked winds from satellites, are assimilated every 6 h during the experiments, and forecasts are verified using standard sounding observations. Forecasts with 12- to 72-h lead times are found to have noticeably smaller root-mean-square errors when initialized with the E3DVar system, as opposed to the EnKF, especially for the 12-h wind and moisture fields. The E3DVar system demonstrates similar performance as an EnKF, while using less than half the number of ensemble members, and is less sensitive to the use of a multiphysics ensemble to account for model errors. The E3DVar system is also compared with a similar hybrid method that replaces the 3DVar component with the WRF four-dimensional variational data assimilation (4DVar) method (denoted E4DVar). The E4DVar method demonstrated considerable improvements over E3DVar for nearly all model levels and variables at the shorter forecast lead times (12–48 h), but the forecast accuracies of all three ensemble-based methods (EnKF, E3DVar, and E4DVar) converge to similar results at longer lead times (60–72 h). Nevertheless, all methods that used ensemble information produced considerably better forecasts than the two methods that relied solely on static background error covariance (i.e., 3DVar and 4DVar).

scholarly journals An Ensemble Kalman Filter for Numerical Weather Prediction Based on Variational Data Assimilation: VarEnKF

2017 ◽  
Vol 145 (2) ◽  
pp. 617-635 ◽  
Author(s):  
Mark Buehner ◽  
Ron McTaggart-Cowan ◽  
Sylvain Heilliette
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Variational Approach ◽  
Variational Data Assimilation ◽  
Ensemble Prediction ◽  
Deterministic System ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Ensemble Mean

Several NWP centers currently employ a variational data assimilation approach for initializing deterministic forecasts and a separate ensemble Kalman filter (EnKF) system both for initializing ensemble forecasts and for providing ensemble background error covariances for the deterministic system. This study describes a new approach for performing the data assimilation step within a perturbed-observation EnKF. In this approach, called VarEnKF, the analysis increment is computed with a variational data assimilation approach both for the ensemble mean and for all of the ensemble perturbations. To obtain a computationally efficient algorithm, a much simpler configuration is used for the ensemble perturbations, whereas the configuration used for the ensemble mean is similar to that used for the deterministic system. Numerous practical benefits may be realized by using a variational approach for both deterministic and ensemble prediction, including improved efficiency for the development and maintenance of the computer code. Also, the use of essentially the same data assimilation algorithm would likely reduce the amount of numerical experimentation required when making system changes, since their impacts in the two systems would be very similar. The variational approach enables the use of hybrid background error covariances and may also allow the assimilation of a larger volume of observations. Preliminary tests with the Canadian global 256-member system produced significantly improved ensemble forecasts with VarEnKF as compared with the current EnKF and at a comparable computational cost. These improvements resulted entirely from changes to the ensemble mean analysis increment calculation. Moreover, because each ensemble perturbation is updated independently, VarEnKF scales perfectly up to a very large number of processors.

Limited-Area Ensemble-Based Data Assimilation

2011 ◽  
Vol 139 (7) ◽  
pp. 2025-2045 ◽  
Author(s):  
Zhiyong Meng ◽  
Fuqing Zhang
Keyword(s):  
Data Assimilation ◽  
Variational Methods ◽  
Prediction Models ◽  
Weather Prediction ◽  
Limited Area ◽  
Ensemble Kalman Filters ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Error Covariance ◽  
Numerical Weather Prediction Models

Abstract Ensemble-based data assimilation is a state estimation technique that uses short-term ensemble forecasts to estimate flow-dependent background error covariance and is best known by varying forms of ensemble Kalman filters (EnKFs). The EnKF has recently emerged as one of the primary alternatives to the variational data assimilation methods widely used in both global and limited-area numerical weather prediction models. In addition to comparing the EnKF with variational methods, this article reviews recent advances and challenges in the development and applications of the EnKF, including its hybrid with variational methods, in limited-area models that resolve weather systems from convective to meso- and regional scales.

Practical Ensemble-Based Approaches to Estimate Atmospheric Background Error Covariances for Limited-Area Deterministic Data Assimilation

2018 ◽  
Vol 146 (11) ◽  
pp. 3717-3733 ◽  
Author(s):  
Joël Bédard ◽  
Mark Buehner ◽  
Jean-François Caron ◽  
Seung-Jong Baek ◽  
Luc Fillion
Keyword(s):  
High Resolution ◽  
Data Assimilation ◽  
Low Cost ◽  
Time Windows ◽  
Weather Prediction ◽  
Limited Area ◽  
Ensemble Kalman Filters ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Northern United States

Abstract High-resolution flow-dependent background error covariances can allow for a better usage of dense observation networks in applications of data assimilation for numerical weather prediction. The generation of high-resolution ensembles, however, can be computationally cost prohibitive. In this study, practical and low-cost ensemble generation methods are presented and compared against both global and regional ensemble Kalman filters (G-EnKF and R-EnKF, respectively). The goal is to provide limited-area deterministic assimilation schemes with higher-resolution flow-dependent background error covariances that perform at least as well as those from the G-EnKF when assimilating the same observations. The low-cost methods are based on short-range regional ensemble forecasts initialized from 1) deterministic analysis plus balanced perturbations (filter free approach) and 2) a simplified ensemble square root filter (S-EnSRF), centered on deterministic analyses. The resulting ensembles from the different approaches are used within a 4D ensemble–variational (4D-EnVar) assimilation system covering most of Canada and the northern United States. Diagnostic results show that the mean is an important component of the ensembles. Results also show that the persistence of the homogeneous characteristics of the perturbations in the filter free approach makes this method unsuited for short assimilation time windows since some error structures take longer to develop. The S-EnSRF approach overcomes this limitation by recycling part of the prior perturbations. Results from 1-month assimilation experiments show that the S-EnSRF and R-EnKF experiments provide forecasts of similar quality to those from G-EnKF. Furthermore, results from precipitation verification indicate that the R-EnKF experiment provides the best precipitation accumulation predictions over 24-h periods.

Evaluation of Surface Analyses and Forecasts with a Multiscale Ensemble Kalman Filter in Regions of Complex Terrain

2011 ◽  
Vol 139 (6) ◽  
pp. 2008-2024 ◽  
Author(s):  
Brian C. Ancell ◽  
Clifford F. Mass ◽  
Gregory J. Hakim
Keyword(s):  
Kalman Filter ◽  
High Resolution ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Complex Terrain ◽  
Error Variance ◽  
Small Scale ◽  
Observation Error ◽  
Grid Spacing ◽  
Background Error

Abstract Previous research suggests that an ensemble Kalman filter (EnKF) data assimilation and modeling system can produce accurate atmospheric analyses and forecasts at 30–50-km grid spacing. This study examines the ability of a mesoscale EnKF system using multiscale (36/12 km) Weather Research and Forecasting (WRF) model simulations to produce high-resolution, accurate, regional surface analyses, and 6-h forecasts. This study takes place over the complex terrain of the Pacific Northwest, where the small-scale features of the near-surface flow field make the region particularly attractive for testing an EnKF and its flow-dependent background error covariances. A variety of EnKF experiments are performed over a 5-week period to test the impact of decreasing the grid spacing from 36 to 12 km and to evaluate new approaches for dealing with representativeness error, lack of surface background variance, and low-level bias. All verification in this study is performed with independent, unassimilated observations. Significant surface analysis and 6-h forecast improvements are found when EnKF grid spacing is reduced from 36 to 12 km. Forecast improvements appear to be a consequence of increased resolution during model integration, whereas analysis improvements also benefit from high-resolution ensemble covariances during data assimilation. On the 12-km domain, additional analysis improvements are found by reducing observation error variance in order to address representativeness error. Removing model surface biases prior to assimilation significantly enhances the analysis. Inflating surface wind and temperature background error variance has large impacts on analyses, but only produces small improvements in analysis RMS errors. Both surface and upper-air 6-h forecasts are nearly unchanged in the 12-km experiments. Last, 12-km WRF EnKF surface analyses and 6-h forecasts are shown to generally outperform those of the Global Forecast System (GFS), North American Model (NAM), and the Rapid Update Cycle (RUC) by about 10%–30%, although these improvements do not extend above the surface. Based on these results, future improvements in multiscale EnKF are suggested.

scholarly journals Scale-Dependent Representation of the Information Content of Observations in the Global Ensemble Kalman Filter Data Assimilation

2016 ◽  
Vol 144 (8) ◽  
pp. 2927-2945
Author(s):  
Nedjeljka Žagar ◽  
Jeffrey Anderson ◽  
Nancy Collins ◽  
Timothy Hoar ◽  
Kevin Raeder ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Information Content ◽  
Ensemble Kalman Filter ◽  
Large Scale ◽  
Variance Reduction ◽  
Weather Prediction ◽  
Current Data ◽  
Model Framework ◽  
The Tropics

Abstract Global data assimilation systems for numerical weather prediction (NWP) are characterized by significant uncertainties in tropical analysis fields. Furthermore, the largest spread of global ensemble forecasts in the short range on all scales is in the tropics. The presented results suggest that these properties hold even in the perfect-model framework and the ensemble Kalman filter data assimilation with a globally homogeneous network of wind and temperature profiles. The reasons for this are discussed by using the modal analysis, which provides information about the scale dependency of analysis and forecast uncertainties and information about the efficiency of data assimilation to reduce the prior uncertainties in the balanced and inertio-gravity dynamics. The scale-dependent representation of variance reduction of the prior ensemble by the data assimilation shows that the peak efficiency of data assimilation is on the synoptic scales in the midlatitudes that are associated with quasigeostrophic dynamics. In contrast, the variance associated with the inertia–gravity modes is less successfully reduced on all scales. A smaller information content of observations on planetary scales with respect to the synoptic scales is discussed in relation to the large-scale tropical uncertainties that current data assimilation methodologies do not address successfully. In addition, it is shown that a smaller reduction of the large-scale uncertainties in the prior state for NWP in the tropics than in the midlatitudes is influenced by the applied radius for the covariance localization.

scholarly journals Impact of surface data assimilation using an ensemble Kalman filter technique on the improvement of weather prediction

2019 ◽  
Vol 1127 ◽  
pp. 012041
Author(s):  
N J Trilaksono ◽  
M Taqiyya ◽  
N Dewani ◽  
I D G A Junnaedhi ◽  
E Riawan ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Filter Technique ◽  
Surface Data

Intercomparison of an Ensemble Kalman Filter with Three- and Four-Dimensional Variational Data Assimilation Methods in a Limited-Area Model over the Month of June 2003

2011 ◽  
Vol 139 (2) ◽  
pp. 566-572 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang ◽  
Xiang-Yu Huang ◽  
Xin Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Forecast Error ◽  
Wrf Model ◽  
Warm Season ◽  
Variational Data Assimilation ◽  
Lead Times ◽  
Limited Area ◽  
Forecast Errors

Abstract This study compares the performance of an ensemble Kalman filter (EnKF) with both the three-dimensional and four-dimensional variational data assimilation (3DVar and 4DVar) methods of the Weather Research and Forecasting (WRF) model over the contiguous United States in a warm-season month (June) of 2003. The data assimilated every 6 h include conventional sounding and surface observations as well as data from wind profilers, ships and aircraft, and the cloud-tracked winds from satellites. The performances of these methods are evaluated through verifying the 12- to 72-h forecasts initialized twice daily from the analysis of each method against the standard sounding observations. It is found that 4DVar has consistently smaller error than that of 3DVar for winds and temperature at all forecast lead times except at 60 and 72 h when their forecast errors become comparable in amplitude, while the two schemes have similar performance in moisture at all lead times. The forecast error of the EnKF is comparable to that of the 4DVar at 12–36-h lead times, both of which are substantially smaller than that of the 3DVar, despite the fact that 3DVar fits the sounding observations much more closely at the analysis time. The advantage of the EnKF becomes even more evident at 48–72-h lead times; the 72-h forecast error of the EnKF is comparable in magnitude to the 48-h error of 3DVar/4DVar.

scholarly journals Assimilation of Stratospheric Temperature and Ozone with an Ensemble Kalman Filter in a Chemistry–Climate Model

2011 ◽  
Vol 139 (11) ◽  
pp. 3389-3404 ◽  
Author(s):  
Thomas Milewski ◽  
Michel S. Bourqui
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Covariance Matrix ◽  
Ensemble Kalman Filter ◽  
Climate Model ◽  
Observation Error ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Error Covariance ◽  
Analysis Error

Abstract A new stratospheric chemical–dynamical data assimilation system was developed, based upon an ensemble Kalman filter coupled with a Chemistry–Climate Model [i.e., the intermediate-complexity general circulation model Fast Stratospheric Ozone Chemistry (IGCM-FASTOC)], with the aim to explore the potential of chemical–dynamical coupling in stratospheric data assimilation. The system is introduced here in a context of a perfect-model, Observing System Simulation Experiment. The system is found to be sensitive to localization parameters, and in the case of temperature (ozone), assimilation yields its best performance with horizontal and vertical decorrelation lengths of 14 000 km (5600 km) and 70 km (14 km). With these localization parameters, the observation space background-error covariance matrix is underinflated by only 5.9% (overinflated by 2.1%) and the observation-error covariance matrix by only 1.6% (0.5%), which makes artificial inflation unnecessary. Using optimal localization parameters, the skills of the system in constraining the ensemble-average analysis error with respect to the true state is tested when assimilating synthetic Michelson Interferometer for Passive Atmospheric Sounding (MIPAS) retrievals of temperature alone and ozone alone. It is found that in most cases background-error covariances produced from ensemble statistics are able to usefully propagate information from the observed variable to other ones. Chemical–dynamical covariances, and in particular ozone–wind covariances, are essential in constraining the dynamical fields when assimilating ozone only, as the radiation in the stratosphere is too slow to transfer ozone analysis increments to the temperature field over the 24-h forecast window. Conversely, when assimilating temperature, the chemical–dynamical covariances are also found to help constrain the ozone field, though to a much lower extent. The uncertainty in forecast/analysis, as defined by the variability in the ensemble, is large compared to the analysis error, which likely indicates some amount of noise in the covariance terms, while also reducing the risk of filter divergence.

Sign in / Sign up

Export Citation Format

Share Document