A Multicase Comparative Assessment of the Ensemble Kalman Filter for Assimilation of Radar Observations. Part II: Short-Range Ensemble Forecasts

2010 ◽  
Vol 138 (4) ◽  
pp. 1273-1292 ◽  
Author(s):  
Altuğ Aksoy ◽  
David C. Dowell ◽  
Chris Snyder
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Cloud Model ◽  
Wrf Model ◽  
Radar Data ◽  
Negative Effects ◽  
Ensemble Forecasts ◽  
Radar Observations

Abstract The quality of convective-scale ensemble forecasts, initialized from analysis ensembles obtained through the assimilation of radar observations using an ensemble Kalman filter (EnKF), is investigated for cases whose behaviors span supercellular, linear, and multicellular organization. This work is the companion to Part I, which focused on the quality of analyses during the 60-min analysis period. Here, the focus is on 30-min ensemble forecasts initialized at the end of that period. As in Part I, the Weather Research and Forecasting (WRF) model is employed as a simplified cloud model at 2-km horizontal grid spacing. Various observation-space and state-space verification metrics, computed both for ensemble means and individual ensemble members, are employed to assess the quality of ensemble forecasts comparatively across cases. While the cases exhibit noticeable differences in predictability, the forecast skill in each case, as measured by various metrics, decays on a time scale of tens of minutes. The ensemble spread also increases rapidly but significant outlier members or clustering among members are not encountered. Forecast quality is seen to be influenced to varying degrees by the respective initial soundings. While radar data assimilation is able to partially mitigate some of the negative effects in some situations, the supercell case, in particular, remains difficult to predict even after 60 min of data assimilation.

A Multicase Comparative Assessment of the Ensemble Kalman Filter for Assimilation of Radar Observations. Part I: Storm-Scale Analyses

2009 ◽  
Vol 137 (6) ◽  
pp. 1805-1824 ◽  
Author(s):  
Altuğ Aksoy ◽  
David C. Dowell ◽  
Chris Snyder
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Cloud Model ◽  
Wrf Model ◽  
Horizontal Wind ◽  
Observation Error ◽  
Ensemble Spread ◽  
Radar Observations ◽  
Filter Performance

Abstract The effectiveness of the ensemble Kalman filter (EnKF) for assimilating radar observations at convective scales is investigated for cases whose behaviors span supercellular, linear, and multicellular organization. The parallel EnKF algorithm of the Data Assimilation Research Testbed (DART) is used for data assimilation, while the Weather Research and Forecasting (WRF) Model is employed as a simplified cloud model at 2-km horizontal grid spacing. In each case, reflectivity and radial velocity measurements are utilized from a single Weather Surveillance Radar-1988 Doppler (WSR-88D) within the U.S. operational network. Observations are assimilated every 2 min for a duration of 60 min and correction of folded radial velocities occurs within the EnKF. Initial ensemble uncertainty includes random perturbations to the horizontal wind components of the initial environmental sounding. The EnKF performs effectively and with robust results across all the cases. Over the first 18–30 min of assimilation, the rms and domain-averaged prior fits to observations in each case improve significantly from their initial levels, reaching comparable values of 3–6 m s−1 and 7–10 dBZ. Representation of mesoscale uncertainty, albeit in the simplest form of initial sounding perturbations, is a critical part of the assimilation system, as it increases ensemble spread and improves filter performance. In addition, assimilation of “no precipitation” observations (i.e., reflectivity observations with values small enough to indicate the absence of precipitation) serves to suppress spurious convection in ensemble members. At the same time, it is clear that the assimilation is far from optimal, as the ensemble spread is consistently smaller than what would be expected from the innovation statistics and the assumed observation-error variance.

scholarly journals Radar Data Assimilation in the Canadian High-Resolution Ensemble Kalman Filter System: Performance and Verification with Real Summer Cases

2014 ◽  
Vol 142 (6) ◽  
pp. 2118-2138 ◽  
Author(s):  
Weiguang Chang ◽  
Kao-Shen Chung ◽  
Luc Fillion ◽  
Seung-Jong Baek
Keyword(s):  
Kalman Filter ◽  
High Resolution ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Radar Data ◽  
Radial Velocities ◽  
Short Term ◽  
Radar Observations ◽  
Filter Convergence ◽  
Radar Data Assimilation

Abstract An 80-member high-resolution ensemble Kalman filter (HREnKF) is implemented for assimilating radar observations with the Canadian Meteorological Center’s (CMC’s) Global Environmental Multiscale Limited-Area Model (GEM-LAM). This system covers the Montréal, Canada, region and assimilates radar data from the McGill Radar Observatory with 4-km data thinning. The GEM-LAM operates in fully nonhydrostatic mode with 58 hybrid vertical levels and 1-km horizontal grid spacing. As a first step toward full radar data assimilation, only radial velocities are directly assimilated in this study. The HREnKF is applied on three 2011 summer cases having different precipitation structures: squall-line structure, isolated small-scale structures, and widespread stratiform precipitation. The short-term (<2 h) accuracy of the HREnKF analyses and forecasts is examined. In HREnKF, the ensemble spread is sufficient to cover the estimated error from innovations and lead to filter convergence. It results in part from a realistic initiation of HREnKF data assimilation cycle by using a Canadian regional EnKF system (itself coupled to a global EnKF) working at meso- and synoptic scales. The filter convergence is confirmed by the HREnKF background fields gradually approaching to radar observations as the assimilation cycling proceeds. At each analysis step, it is clearly shown that unobserved variables are significantly modified through HREnKF cross correlation of errors from the ensemble. Radar reflectivity observations are used to verify the improvements in analyses and short-term forecasts achievable by assimilating only radial velocities. Further developments of the analysis system are discussed.

Ensemble Probabilistic Forecasts of a Tornadic Mesoscale Convective System from Ensemble Kalman Filter Analyses Using WSR-88D and CASA Radar Data

2012 ◽  
Vol 140 (7) ◽  
pp. 2126-2146 ◽  
Author(s):  
Nathan Snook ◽  
Ming Xue ◽  
Youngsun Jung
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Mesoscale Convective System ◽  
Radar Data ◽  
Radar Reflectivity ◽  
Convective System ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Mesoscale Convective

Abstract This study examines the ability of a storm-scale numerical weather prediction (NWP) model to predict precipitation and mesovortices within a tornadic mesoscale convective system that occurred over Oklahoma on 8–9 May 2007, when the model is initialized from ensemble Kalman filter (EnKF) analyses including data from four Engineering Research Center for Collaborative Adaptive Sensing of the Atmosphere (CASA) X-band and five Weather Surveillance Radar-1988 Doppler (WSR-88D) S-band radars. Ensemble forecasts are performed and probabilistic forecast products generated, focusing on prediction of radar reflectivity (a proxy of quantitative precipitation) and mesovortices (an indication of tornado potential). Assimilating data from both the CASA and WSR-88D radars for the ensemble and using a mixed-microphysics ensemble during data assimilation produces the best probabilistic mesovortex forecast. The use of multiple microphysics schemes within the ensemble aims to address at least partially the model physics uncertainty and effectively plays a role of flow-dependent inflation (in precipitation regions) during EnKF data assimilation. The ensemble predicts with high probability (approximately 0.65) the near-surface mesovortex associated with the first of three reported tornadoes. Though a bias toward stronger precipitation is noted in the ensemble forecasts, all experiments produce skillful probabilistic forecasts of radar reflectivity on a 0–3-h time scale as evaluated by multiple probabilistic verification metrics. These results suggest that both the inclusion of CASA radar data and use of a mixed-microphysics ensemble during EnKF data assimilation positively impact the skill of 2–3-h ensemble forecasts of mesovortices, despite having little impact on the quality of precipitation forecasts (analyzed in terms of predicted radar reflectivity), and are important steps toward an operational EnKF-based ensemble analysis and probabilistic forecast system to support convective-scale warn-on-forecast operations.

E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model

2012 ◽  
Vol 140 (2) ◽  
pp. 587-600 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Prediction Model ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Coupled System ◽  
Limited Area ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Hybrid Data Assimilation

A hybrid data assimilation approach that couples the ensemble Kalman filter (EnKF) and four-dimensional variational (4DVar) methods is implemented for the first time in a limited-area weather prediction model. In this coupled system, denoted E4DVar, the EnKF and 4DVar systems run in parallel while feeding into each other. The multivariate, flow-dependent background error covariance estimated from the EnKF ensemble is used in the 4DVar minimization and the ensemble mean in the EnKF analysis is replaced by the 4DVar analysis, while updating the analysis perturbations for the next cycle of ensemble forecasts with the EnKF. Therefore, the E4DVar can obtain flow-dependent information from both the explicit covariance matrix derived from ensemble forecasts, as well as implicitly from the 4DVar trajectory. The performance of an E4DVar system is compared with the uncoupled 4DVar and EnKF for a limited-area model by assimilating various conventional observations over the contiguous United States for June 2003. After verifying the forecasts from each analysis against standard sounding observations, it is found that the E4DVar substantially outperforms both the EnKF and 4DVar during this active summer month, which featured several episodes of severe convective weather. On average, the forecasts produced from E4DVar analyses have considerably smaller errors than both of the stand-alone EnKF and 4DVar systems for forecast lead times up to 60 h.

Intercomparison of an Ensemble Kalman Filter with Three- and Four-Dimensional Variational Data Assimilation Methods in a Limited-Area Model over the Month of June 2003

2011 ◽  
Vol 139 (2) ◽  
pp. 566-572 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang ◽  
Xiang-Yu Huang ◽  
Xin Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Forecast Error ◽  
Wrf Model ◽  
Warm Season ◽  
Variational Data Assimilation ◽  
Lead Times ◽  
Limited Area ◽  
Forecast Errors

Abstract This study compares the performance of an ensemble Kalman filter (EnKF) with both the three-dimensional and four-dimensional variational data assimilation (3DVar and 4DVar) methods of the Weather Research and Forecasting (WRF) model over the contiguous United States in a warm-season month (June) of 2003. The data assimilated every 6 h include conventional sounding and surface observations as well as data from wind profilers, ships and aircraft, and the cloud-tracked winds from satellites. The performances of these methods are evaluated through verifying the 12- to 72-h forecasts initialized twice daily from the analysis of each method against the standard sounding observations. It is found that 4DVar has consistently smaller error than that of 3DVar for winds and temperature at all forecast lead times except at 60 and 72 h when their forecast errors become comparable in amplitude, while the two schemes have similar performance in moisture at all lead times. The forecast error of the EnKF is comparable to that of the 4DVar at 12–36-h lead times, both of which are substantially smaller than that of the 3DVar, despite the fact that 3DVar fits the sounding observations much more closely at the analysis time. The advantage of the EnKF becomes even more evident at 48–72-h lead times; the 72-h forecast error of the EnKF is comparable in magnitude to the 48-h error of 3DVar/4DVar.

Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation

2016 ◽  
Vol 144 (12) ◽  
pp. 4489-4532 ◽  
Author(s):  
P. L. Houtekamer ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Hybrid Systems ◽  
Ensemble Kalman Filter ◽  
Satellite Observations ◽  
General Description ◽  
System Error ◽  
Radar Observations ◽  
Atmospheric Data ◽  
Filter Divergence

Abstract This paper reviews the development of the ensemble Kalman filter (EnKF) for atmospheric data assimilation. Particular attention is devoted to recent advances and current challenges. The distinguishing properties of three well-established variations of the EnKF algorithm are first discussed. Given the limited size of the ensemble and the unavoidable existence of errors whose origin is unknown (i.e., system error), various approaches to localizing the impact of observations and to accounting for these errors have been proposed. However, challenges remain; for example, with regard to localization of multiscale phenomena (both in time and space). For the EnKF in general, but higher-resolution applications in particular, it is desirable to use a short assimilation window. This motivates a focus on approaches for maintaining balance during the EnKF update. Also discussed are limited-area EnKF systems, in particular with regard to the assimilation of radar data and applications to tracking severe storms and tropical cyclones. It seems that relatively less attention has been paid to optimizing EnKF assimilation of satellite radiance observations, the growing volume of which has been instrumental in improving global weather predictions. There is also a tendency at various centers to investigate and implement hybrid systems that take advantage of both the ensemble and the variational data assimilation approaches; this poses additional challenges and it is not clear how it will evolve. It is concluded that, despite more than 10 years of operational experience, there are still many unresolved issues that could benefit from further research. Contents Introduction...4490 Popular flavors of the EnKF algorithm...4491 General description...4491 Stochastic and deterministic filters...4492 The stochastic filter...4492 The deterministic filter...4492 Sequential or local filters...4493 Sequential ensemble Kalman filters...4493 The local ensemble transform Kalman filter...4494 Extended state vector...4494 Issues for the development of algorithms...4495 Use of small ensembles...4495 Monte Carlo methods...4495 Validation of reliability...4497 Use of group filters with no inbreeding...4498 Sampling error due to limited ensemble size: The rank problem...4498 Covariance localization...4499 Localization in the sequential filter...4499 Localization in the LETKF...4499 Issues with localization...4500 Summary...4501 Methods to increase ensemble spread...4501 Covariance inflation...4501 Additive inflation...4501 Multiplicative inflation...4502 Relaxation to prior ensemble information...4502 Issues with inflation...4503 Diffusion and truncation...4503 Error in physical parameterizations...4504 Physical tendency perturbations...4504 Multimodel, multiphysics, and multiparameter approaches...4505 Future directions...4505 Realism of error sources...4506 Balance and length of the assimilation window...4506 The need for balancing methods...4506 Time-filtering methods...4506 Toward shorter assimilation windows...4507 Reduction of sources of imbalance...4507 Regional data assimilation...4508 Boundary conditions and consistency across multiple domains...4509 Initialization of the starting ensemble...4510 Preprocessing steps for radar observations...4510 Use of radar observations for convective-scale analyses...4511 Use of radar observations for tropical cyclone analyses...4511 Other issues with respect to LAM data assimilation...4511 The assimilation of satellite observations...4512 Covariance localization...4512 Data density...4513 Bias-correction procedures...4513 Impact of covariance cycling...4514 Assumptions regarding observational error...4514 Recommendations regarding satellite observations...4515 Computational aspects...4515 Parameters with an impact on quality...4515 Overview of current parallel algorithms...4516 Evolution of computer architecture...4516 Practical issues...4517 Approaching the gray zone...4518 Summary...4518 Hybrids with variational and EnKF components...4519 Hybrid background error covariances...4519 E4DVar with the α control variable...4519 Not using linearized models with 4DEnVar...4520 The hybrid gain algorithm...4521 Open issues and recommendations...4521 Summary and discussion...4521 Stochastic or deterministic filters...4522 The nature of system error...4522 Going beyond the synoptic scales...4522 Satellite observations...4523 Hybrid systems...4523 Future of the EnKF...4523 APPENDIX A...4524 Types of Filter Divergence...4524 Classical filter divergence...4524 Catastrophic filter divergence...4524 APPENDIX B...4524 Systems Available for Download...4524 References...4525

scholarly journals Ensemble Kalman Filter Assimilation of Doppler Radar Data with a Compressible Nonhydrostatic Model: OSS Experiments

2005 ◽  
Vol 133 (7) ◽  
pp. 1789-1807 ◽  
Author(s):  
Mingjing Tong ◽  
Ming Xue
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Radial Velocity ◽  
Ensemble Kalman Filter ◽  
Doppler Radar ◽  
Radar Data ◽  
Relative Role ◽  
Doppler Radar Data ◽  
Ice Microphysics ◽  
Reflectivity Data

Abstract A Doppler radar data assimilation system is developed based on an ensemble Kalman filter (EnKF) method and tested with simulated radar data from a supercell storm. As a first implementation, it is assumed that the forward models are perfect and that the radar data are sampled at the analysis grid points. A general purpose nonhydrostatic compressible model is used with the inclusion of complex multiclass ice microphysics. New aspects of this study compared to previous work include the demonstration of the ability of the EnKF method to retrieve multiple microphysical species associated with a multiclass ice microphysics scheme, and to accurately retrieve the wind and thermodynamic variables. Also new are the inclusion of reflectivity observations and the determination of the relative role of the radial velocity and reflectivity data as well as their spatial coverage in recovering the full-flow and cloud fields. In general, the system is able to reestablish the model storm extremely well after a number of assimilation cycles, and best results are obtained when both radial velocity and reflectivity data, including reflectivity information outside of the precipitation regions, are used. Significant positive impact of the reflectivity assimilation is found even though the observation operator involved is nonlinear. The results also show that a compressible model that contains acoustic modes, hence the associated error growth, performs at least as well as an anelastic model used in previous EnKF studies at the cloud scale. Flow-dependent and dynamically consistent background error covariances estimated from the forecast ensemble play a critical role in successful assimilation and retrieval. When the assimilation cycles start from random initial perturbations, better results are obtained when the updating of the fields that are not directly related to radar reflectivity is withheld during the first few cycles. In fact, during the first few cycles, the updating of the variables indirectly related to reflectivity hurts the analysis. This is so because the estimated background covariances are unreliable at this stage of the data assimilation process, which is related to the way the forecast ensemble is initialized. Forecasts of supercell storms starting from the best-assimilated initial conditions are shown to remain very good for at least 2 h.

scholarly journals A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation

2005 ◽  
Vol 133 (11) ◽  
pp. 3081-3094 ◽  
Author(s):  
A. Caya ◽  
J. Sun ◽  
C. Snyder
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Forecast Model ◽  
Radar Data ◽  
Forecast Errors ◽  
Error Covariance ◽  
Convective Scale ◽  
Cloud Resolving Model ◽  
Comparable Accuracy

Abstract A four-dimensional variational data assimilation (4DVAR) algorithm is compared to an ensemble Kalman filter (EnKF) for the assimilation of radar data at the convective scale. Using a cloud-resolving model, simulated, imperfect radar observations of a supercell storm are assimilated under the assumption of a perfect forecast model. Overall, both assimilation schemes perform well and are able to recover the supercell with comparable accuracy, given radial-velocity and reflectivity observations where rain was present. 4DVAR produces generally better analyses than the EnKF given observations limited to a period of 10 min (or three volume scans), particularly for the wind components. In contrast, the EnKF typically produces better analyses than 4DVAR after several assimilation cycles, especially for model variables not functionally related to the observations. The advantages of the EnKF in later cycles arise at least in part from the fact that the 4DVAR scheme implemented here does not use a forecast from a previous cycle as background or evolve its error covariance. Possible reasons for the initial advantage of 4DVAR are deficiencies in the initial ensemble used by the EnKF, the temporal smoothness constraint used in 4DVAR, and nonlinearities in the evolution of forecast errors over the assimilation window.

Sign in / Sign up

Export Citation Format

Share Document