scholarly journals Global Ensemble Predictions of 2009’s Tropical Cyclones Initialized with an Ensemble Kalman Filter

2011 ◽  
Vol 139 (2) ◽  
pp. 668-688 ◽  
Author(s):  
Thomas M. Hamill ◽  
Jeffrey S. Whitaker ◽  
Michael Fiorino ◽  
Stanley G. Benjamin
Keyword(s):  
Kalman Filter ◽  
Tropical Cyclones ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Ensemble Forecast ◽  
Central Pressure ◽  
Ensemble Prediction ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Track Error

Abstract Verification was performed on ensemble forecasts of 2009 Northern Hemisphere summer tropical cyclones (TCs) from two experimental global numerical weather prediction ensemble prediction systems (EPSs). The first model was a high-resolution version (T382L64) of the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS). The second model was a 30-km version of the experimental NOAA/Earth System Research Laboratory’s Flow-following finite-volume Icosahedral Model (FIM). Both models were initialized with the first 20 members of a 60-member ensemble Kalman filter (EnKF) using the T382L64 GFS. The GFS–EnKF assimilated the full observational data stream that was normally assimilated into the NCEP operational Global Statistical Interpolation (GSI) data assimilation, plus human-synthesized “observations” of tropical cyclone central pressure and position produced at the National Hurricane Center and the Joint Typhoon Warning Center. The forecasts from the two experimental ensembles were compared against four operational EPSs from the European Centre for Medium-Range Weather Forecasts (ECMWF), NCEP, the Canadian Meteorological Centre (CMC), and the Met Office (UKMO). The errors of GFS–EnKF ensemble track forecasts were competitive with those from the ECMWF ensemble system, and the overall spread of the ensemble tracks was consistent in magnitude with the track error. Both experimental EPSs had much lower errors than the operational NCEP, UKMO, and CMC EPSs, but the FIM–EnKF tracks were somewhat less accurate than the GFS–EnKF. The ensemble forecasts were often stretched in particular directions, and not necessarily along or across track. The better-performing EPSs provided useful information on potential track error anisotropy. While the GFS–EnKF initialized relatively deep vortices by assimilating the TC central pressure estimate, the model storms filled during the subsequent 24 h. Other forecast models also systematically underestimated TC intensity (e.g., maximum forecast surface wind speed). The higher-resolution models generally had less bias. Analyses were conducted to try to understand whether the additional central pressure observation, the EnKF, or the extra resolution was most responsible for the decrease in track error of the experimental Global Ensemble Forecast System (GEFS)–EnKF over the operational NCEP. The assimilation of the additional TC observations produced only a small change in deterministic track forecasts initialized with the GSI. The T382L64 GFS–EnKF ensemble was used to initialize a T126L28 ensemble forecast to facilitate a comparison with the operational NCEP system. The T126L28 GFS–EnKF EPS track forecasts were dramatically better than the NCEP operational, suggesting the positive impact of the EnKF, perhaps through improved steering flow.

E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model

2012 ◽  
Vol 140 (2) ◽  
pp. 587-600 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Prediction Model ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Coupled System ◽  
Limited Area ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Hybrid Data Assimilation

A hybrid data assimilation approach that couples the ensemble Kalman filter (EnKF) and four-dimensional variational (4DVar) methods is implemented for the first time in a limited-area weather prediction model. In this coupled system, denoted E4DVar, the EnKF and 4DVar systems run in parallel while feeding into each other. The multivariate, flow-dependent background error covariance estimated from the EnKF ensemble is used in the 4DVar minimization and the ensemble mean in the EnKF analysis is replaced by the 4DVar analysis, while updating the analysis perturbations for the next cycle of ensemble forecasts with the EnKF. Therefore, the E4DVar can obtain flow-dependent information from both the explicit covariance matrix derived from ensemble forecasts, as well as implicitly from the 4DVar trajectory. The performance of an E4DVar system is compared with the uncoupled 4DVar and EnKF for a limited-area model by assimilating various conventional observations over the contiguous United States for June 2003. After verifying the forecasts from each analysis against standard sounding observations, it is found that the E4DVar substantially outperforms both the EnKF and 4DVar during this active summer month, which featured several episodes of severe convective weather. On average, the forecasts produced from E4DVar analyses have considerably smaller errors than both of the stand-alone EnKF and 4DVar systems for forecast lead times up to 60 h.

scholarly journals Performance Characteristics of a Pseudo-Operational Ensemble Kalman Filter

2008 ◽  
Vol 136 (10) ◽  
pp. 3947-3963 ◽  
Author(s):  
Ryan D. Torn ◽  
Gregory J. Hakim
Keyword(s):  
Kalman Filter ◽  
Ensemble Kalman Filter ◽  
Prediction Models ◽  
North Pacific Ocean ◽  
Weather Prediction ◽  
Limited Area ◽  
Observation Data ◽  
Error Statistics ◽  
Ensemble Forecasts ◽  
Ensemble Mean

The 2-yr performance of a pseudo-operational (real time) limited-area ensemble Kalman filter (EnKF) based on the Weather Research and Forecasting Model is described. This system assimilates conventional observations from surface stations, rawinsondes, the Aircraft Communications Addressing and Reporting System (ACARS), and cloud motion vectors every 6 h on a domain that includes the eastern North Pacific Ocean and western North America. Ensemble forecasts from this system and deterministic output from operational numerical weather prediction models during this same period are verified against rawinsonde and surface observation data. Relative to operational forecasts, the forecast from the ensemble-mean analysis has slightly larger errors in wind and temperature but smaller errors in moisture, even though satellite radiances are not assimilated by the EnKF. Time-averaged correlations indicate that assimilating ACARS and cloud wind data with flow-dependent error statistics provides corrections to the moisture field in the absence of direct observations of that field. Comparison with a control experiment in which a deterministic forecast is cycled without observation assimilation indicates that the skill in the EnKF’s forecasts results from assimilating observations and not from lateral boundary conditions or the model formulation. Furthermore, the ensemble variance is generally in good agreement with the ensemble-mean error and the spread increases monotonically with forecast hour.

scholarly journals A Comparison of Perturbations from an Ensemble Transform and an Ensemble Kalman Filter for the NCEP Global Ensemble Forecast System

2016 ◽  
Vol 31 (6) ◽  
pp. 2057-2074 ◽  
Author(s):  
Xiaqiong Zhou ◽  
Yuejian Zhu ◽  
Dingchen Hou ◽  
Daryl Kleist
Keyword(s):  
Kalman Filter ◽  
Ensemble Kalman Filter ◽  
Forecast Model ◽  
Skill Score ◽  
Ensemble Forecast ◽  
Boreal Summer ◽  
Lead Times ◽  
Operational Environment ◽  
Forecast System ◽  
Ensemble Mean

Abstract Two perturbation generation schemes, the ensemble transformation with rescaling (ETR) and the ensemble Kalman filter (EnKF), are compared for the NCEP operational environment for the Global Ensemble Forecast System (GEFS). Experiments that utilize each of the two schemes are carried out and evaluated for two boreal summer seasons. It is found that these two schemes generally have comparable performance. Experiments utilizing both perturbation methods fail to generate sufficient spread at medium-range lead times beyond day 8. In general, the EnKF-based experiment outperforms the ETR in terms of the continuous ranked probability skill score (CRPSS) in the Northern Hemisphere (NH) for the first week. In the SH, the ensemble mean forecast is more skillful from the ETR perturbations. Additional experiments are performed with the stochastic total tendency perturbation (STTP) scheme, in which the total tendencies of all model variables are perturbed to represent the uncertainty in the forecast model. An improved spread–error relationship is found for the ETR-based experiments, but the STTP increases the ensemble spread for the EnKF-based experiment that is already overdispersive at early lead times, especially in the SH. With STTP employed, an increase in the EnKF-based CRPSS in the NH is reduced with a larger degradation in both the probability and ensemble-mean forecast skills in the SH. The results indicate that a rescaling of the EnKF initial perturbations and/or tuning of the STTP scheme is required when STTP is applied using the EnKF-based perturbations. This study provided guidance for the replacement of ETR with EnKF perturbations as part of the 2015 GEFS implementation.

scholarly journals A Real-Time Convection-Allowing Ensemble Prediction System Initialized by Mesoscale Ensemble Kalman Filter Analyses

2015 ◽  
Vol 30 (5) ◽  
pp. 1158-1181 ◽  
Author(s):  
Craig S. Schwartz ◽  
Glen S. Romine ◽  
Morris L. Weisman ◽  
Ryan A. Sobash ◽  
Kathryn R. Fossell ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Ensemble Kalman Filter ◽  
Wrf Model ◽  
Severe Weather ◽  
Ensemble Prediction ◽  
Limited Area ◽  
Ensemble Forecasts ◽  
Ensemble Prediction System ◽  
Weather Events

Abstract In May and June 2013, the National Center for Atmospheric Research produced real-time 48-h convection-allowing ensemble forecasts at 3-km horizontal grid spacing using the Weather Research and Forecasting (WRF) Model in support of the Mesoscale Predictability Experiment field program. The ensemble forecasts were initialized twice daily at 0000 and 1200 UTC from analysis members of a continuously cycling, limited-area, mesoscale (15 km) ensemble Kalman filter (EnKF) data assimilation system and evaluated with a focus on precipitation and severe weather guidance. Deterministic WRF Model forecasts initialized from GFS analyses were also examined. Subjectively, the ensemble forecasts often produced areas of intense convection over regions where severe weather was observed. Objective statistics confirmed these subjective impressions and indicated that the ensemble was skillful at predicting precipitation and severe weather events. Forecasts initialized at 1200 UTC were more skillful regarding precipitation and severe weather placement than forecasts initialized 12 h earlier at 0000 UTC, and the ensemble forecasts were typically more skillful than GFS-initialized forecasts. At times, 0000 UTC GFS-initialized forecasts had temporal distributions of domain-average rainfall closer to observations than EnKF-initialized forecasts. However, particularly when GFS analyses initialized WRF Model forecasts, 1200 UTC forecasts produced more rainfall during the first diurnal maximum than 0000 UTC forecasts. This behavior was mostly attributed to WRF Model initialization of clouds and moist physical processes. The success of these real-time ensemble forecasts demonstrates the feasibility of using limited-area continuously cycling EnKFs as a method to initialize convection-allowing ensemble forecasts, and future real-time high-resolution ensemble development leveraging EnKFs seems justified.

scholarly journals An Ensemble Kalman Filter for Numerical Weather Prediction Based on Variational Data Assimilation: VarEnKF

2017 ◽  
Vol 145 (2) ◽  
pp. 617-635 ◽  
Author(s):  
Mark Buehner ◽  
Ron McTaggart-Cowan ◽  
Sylvain Heilliette
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Variational Approach ◽  
Variational Data Assimilation ◽  
Ensemble Prediction ◽  
Deterministic System ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Ensemble Mean

Several NWP centers currently employ a variational data assimilation approach for initializing deterministic forecasts and a separate ensemble Kalman filter (EnKF) system both for initializing ensemble forecasts and for providing ensemble background error covariances for the deterministic system. This study describes a new approach for performing the data assimilation step within a perturbed-observation EnKF. In this approach, called VarEnKF, the analysis increment is computed with a variational data assimilation approach both for the ensemble mean and for all of the ensemble perturbations. To obtain a computationally efficient algorithm, a much simpler configuration is used for the ensemble perturbations, whereas the configuration used for the ensemble mean is similar to that used for the deterministic system. Numerous practical benefits may be realized by using a variational approach for both deterministic and ensemble prediction, including improved efficiency for the development and maintenance of the computer code. Also, the use of essentially the same data assimilation algorithm would likely reduce the amount of numerical experimentation required when making system changes, since their impacts in the two systems would be very similar. The variational approach enables the use of hybrid background error covariances and may also allow the assimilation of a larger volume of observations. Preliminary tests with the Canadian global 256-member system produced significantly improved ensemble forecasts with VarEnKF as compared with the current EnKF and at a comparable computational cost. These improvements resulted entirely from changes to the ensemble mean analysis increment calculation. Moreover, because each ensemble perturbation is updated independently, VarEnKF scales perfectly up to a very large number of processors.

scholarly journals Initial perturbations based on Ensemble Transfrom Kalman Filter with rescaling method for ensemble forecast

2021 ◽  
Author(s):  
Jingzhuo Wang ◽  
Jing Chen ◽  
Hanbin Zhang ◽  
Hua Tian ◽  
Yining Shi
Keyword(s):  
Growth Rate ◽  
Kalman Filter ◽  
Weather Forecasting ◽  
Initial Perturbation ◽  
Ensemble Forecast ◽  
Ensemble Prediction ◽  
Forecast Errors ◽  
Model Uncertainties ◽  
Ensemble Prediction System ◽  
Probabilistic Forecasts

AbstractEnsemble forecast is a method to faithfully describe initial and model uncertainties in a weather forecasting system. Initial uncertainties are much more important than model uncertainties in the short-range numerical prediction. Currently, initial uncertainties are described by Ensemble Transform Kalman Filter (ETKF) initial perturbation method in Global and Regional Assimilation and Prediction Enhanced System-Regional Ensemble Prediction System (GRAPES-REPS). However, an initial perturbation distribution similar to the analysis error cannot be yielded in the ETKF method of the GRAPES-REPS. To improve the method, we introduce a regional rescaling factor into the ETKF method (we call it ETKF_R). We also compare the results between the ETKF and ETKF_R methods and further demonstrate how rescaling can affect the initial perturbation characteristics as well as the ensemble forecast skills. The characteristics of the initial ensemble perturbation improve after applying the ETKF_R method. For example, the initial perturbation structures become more reasonable, the perturbations are better able to explain the forecast errors at short lead times, and the lower kinetic energy spectrum as well as perturbation energy at the initial forecast times can lead to a higher growth rate of themselves. Additionally, the ensemble forecast verification results suggest that the ETKF_R method has a better spread-skill relationship, a faster ensemble spread growth rate and a more reasonable rank histogram distribution than ETKF. Furthermore, the rescaling has only a minor impact on the assessment of the sharpness of probabilistic forecasts. The above results all suggest that ETKF_R can be effectively applied to the operational GRAPES-REPS.

scholarly journals A Transformed Lagged Ensemble Forecasting Technique for Increasing Ensemble Size

2007 ◽  
Vol 135 (4) ◽  
pp. 1424-1438 ◽  
Author(s):  
Andrew R. Lawrence ◽  
James A. Hansen
Keyword(s):  
Prediction Models ◽  
Weather Prediction ◽  
Ensemble Forecast ◽  
Ensemble Forecasting ◽  
Limited Area ◽  
Ensemble Size ◽  
Probabilistic Forecasting ◽  
Ensemble Forecasts ◽  
Chaotic Model ◽  
The Impact

Abstract An ensemble-based data assimilation approach is used to transform old ensemble forecast perturbations with more recent observations for the purpose of inexpensively increasing ensemble size. The impact of the transformations are propagated forward in time over the ensemble’s forecast period without rerunning any models, and these transformed ensemble forecast perturbations can be combined with the most recent ensemble forecast to sensibly increase forecast ensemble sizes. Because the transform takes place in perturbation space, the transformed perturbations must be centered on the ensemble mean from the most recent forecasts. Thus, the benefit of the approach is in terms of improved ensemble statistics rather than improvements in the mean. Larger ensemble forecasts can be used for numerous purposes, including probabilistic forecasting, targeted observations, and to provide boundary conditions to limited-area models. This transformed lagged ensemble forecasting approach is explored and is shown to give positive results in the context of a simple chaotic model. By incorporating a suitable perturbation inflation factor, the technique was found to generate forecast ensembles whose skill were statistically comparable to those produced by adding nonlinear model integrations. Implications for ensemble forecasts generated by numerical weather prediction models are briefly discussed, including multimodel ensemble forecasting.

scholarly journals PostProcessing and Visualization Techniques for Convection-Allowing Ensembles

2019 ◽  
Vol 100 (7) ◽  
pp. 1245-1258 ◽  
Author(s):  
Brett Roberts ◽  
Israel L. Jirak ◽  
Adam J. Clark ◽  
Steven J. Weiss ◽  
John S. Kain
Keyword(s):  
Real Time ◽  
Data Extraction ◽  
Deep Convection ◽  
Weather Prediction ◽  
Ensemble Forecast ◽  
Ensemble Prediction ◽  
Data Volume ◽  
Explicit Simulation ◽  
Prediction Systems ◽  
Visualization Techniques

AbstractSince the early 2000s, growing computing resources for numerical weather prediction (NWP) and scientific advances enabled development and testing of experimental, real-time deterministic convection-allowing models (CAMs). By the late 2000s, continued advancements spurred development of CAM ensemble forecast systems, through which a broad range of successful forecasting applications have been demonstrated. This work has prepared the National Weather Service (NWS) for practical usage of the High Resolution Ensemble Forecast (HREF) system, which was implemented operationally in November 2017. Historically, methods for postprocessing and visualizing products from regional and global ensemble prediction systems (e.g., ensemble means and spaghetti plots) have been applied to fields that provide information on mesoscale to synoptic-scale processes. However, much of the value from CAMs is derived from the explicit simulation of deep convection and associated storm-attribute fields like updraft helicity and simulated reflectivity. Thus, fully exploiting CAM ensembles for forecasting applications has required the development of fundamentally new data extraction, postprocessing, and visualization strategies. In the process, challenges imposed by the immense data volume inherent to these systems required new approaches when considering diverse factors like forecaster interpretation and computational expense. In this article, we review the current state of postprocessing and visualization for CAM ensembles, with a particular focus on forecast applications for severe convective hazards that have been evaluated within NOAA’s Hazardous Weather Testbed. The HREF web viewer implemented at the NWS Storm Prediction Center (SPC) is presented as a prototype for deploying these techniques in real time on a flexible and widely accessible platform.

scholarly journals Medium-Range Convection-Allowing Ensemble Forecasts with a Variable-Resolution Global Model

2019 ◽  
Vol 147 (8) ◽  
pp. 2997-3023 ◽  
Author(s):  
Craig S. Schwartz
Keyword(s):  
High Resolution ◽  
Ensemble Forecast ◽  
The Other ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Variable Resolution ◽  
Cell Spacing ◽  
Medium Range ◽  
Potential Benefits ◽  
Convective Mode

Abstract Two sets of global, 132-h (5.5-day), 10-member ensemble forecasts were produced with the Model for Prediction Across Scales (MPAS) for 35 cases in April and May 2017. One MPAS ensemble had a quasi-uniform 15-km mesh while the other employed a variable-resolution mesh with 3-km cell spacing over the conterminous United States (CONUS) that smoothly relaxed to 15 km over the rest of the globe. Precipitation forecasts from both MPAS ensembles were objectively verified over the central and eastern CONUS to assess the potential benefits of configuring MPAS with a 3-km mesh refinement region for medium-range forecasts. In addition, forecasts from NCEP’s operational Global Ensemble Forecast System were evaluated and served as a baseline against which to compare the experimental MPAS ensembles. The 3-km MPAS ensemble most faithfully reproduced the observed diurnal cycle of precipitation throughout the 132-h forecasts and had superior precipitation skill and reliability over the first 48 h. However, after 48 h, the three ensembles had more similar spread, reliability, and skill, and differences between probabilistic precipitation forecasts derived from the 3- and 15-km MPAS ensembles were typically statistically insignificant. Nonetheless, despite fewer benefits of increased resolution for spatial placement after 48 h, 3-km ensemble members explicitly provided potentially valuable guidance regarding convective mode throughout the 132-h forecasts while the other ensembles did not. Collectively, these results suggest both strengths and limitations of medium-range high-resolution ensemble forecasts and reveal pathways for future investigations to improve understanding of high-resolution global ensembles with variable-resolution meshes.

scholarly journals Scale-Dependent Representation of the Information Content of Observations in the Global Ensemble Kalman Filter Data Assimilation

2016 ◽  
Vol 144 (8) ◽  
pp. 2927-2945
Author(s):  
Nedjeljka Žagar ◽  
Jeffrey Anderson ◽  
Nancy Collins ◽  
Timothy Hoar ◽  
Kevin Raeder ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Information Content ◽  
Ensemble Kalman Filter ◽  
Large Scale ◽  
Variance Reduction ◽  
Weather Prediction ◽  
Current Data ◽  
Model Framework ◽  
The Tropics

Abstract Global data assimilation systems for numerical weather prediction (NWP) are characterized by significant uncertainties in tropical analysis fields. Furthermore, the largest spread of global ensemble forecasts in the short range on all scales is in the tropics. The presented results suggest that these properties hold even in the perfect-model framework and the ensemble Kalman filter data assimilation with a globally homogeneous network of wind and temperature profiles. The reasons for this are discussed by using the modal analysis, which provides information about the scale dependency of analysis and forecast uncertainties and information about the efficiency of data assimilation to reduce the prior uncertainties in the balanced and inertio-gravity dynamics. The scale-dependent representation of variance reduction of the prior ensemble by the data assimilation shows that the peak efficiency of data assimilation is on the synoptic scales in the midlatitudes that are associated with quasigeostrophic dynamics. In contrast, the variance associated with the inertia–gravity modes is less successfully reduced on all scales. A smaller information content of observations on planetary scales with respect to the synoptic scales is discussed in relation to the large-scale tropical uncertainties that current data assimilation methodologies do not address successfully. In addition, it is shown that a smaller reduction of the large-scale uncertainties in the prior state for NWP in the tropics than in the midlatitudes is influenced by the applied radius for the covariance localization.

Sign in / Sign up

Export Citation Format

Share Document