Comparing partial and continuously cycling ensemble Kalman filter data assimilation systems for convection-allowing ensemble forecast initialization

2021 ◽  
Author(s):  
Craig S. Schwartz ◽  
Jonathan Poterjoy ◽  
Jacob R. Carley ◽  
David C. Dowell ◽  
Glen S. Romine ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Limited Area ◽  
Computational Domain ◽  
Grid Spacing ◽  
Pass Filter ◽  
Continuous Cycling ◽  
Horizontal Grid ◽  
Better Than

AbstractSeveral limited-area 80-member ensemble Kalman filter (EnKF) data assimilation systems with 15-km horizontal grid spacing were run over a computational domain spanning the conterminous United States (CONUS) for a 4-week period. One EnKF employed continuous cycling, where the prior ensemble was always the 1-h forecast initialized from the previous cycle’s analysis. In contrast, the other EnKFs used a partial cycling procedure, where limited-area states were discarded after 12 or 18 h of self-contained hourly cycles and re-initialized the next day from global model fields. “Blended” states were also constructed by combining large scales from global ensemble initial conditions (ICs) with small scales from limited-area continuously cycling EnKF analyses using a low-pass filter. Both the blended states and EnKF analysis ensembles initialized 36-h, 10-member ensemble forecasts with 3-km horizontal grid spacing. Continuously cycling EnKF analyses initialized ~1–18-h precipitation forecasts that were comparable to or somewhat better than those with partial cycling EnKF ICs. Conversely, ~18–36-h forecasts with partial cycling EnKF ICs were comparable to or better than those with unblended continuously cycling EnKF ICs. However, blended ICs yielded ~18–36-h forecasts that were statistically indistinguishable from those with partial cycling ICs. ICs that more closely resembled global analysis spectral characteristics at wavelengths > 200 km, like partial cycling and blended ICs, were associated with relatively good ~18–36-h forecasts. Ultimately, findings suggest that EnKFs employing a combination of continuous cycling and blending can potentially replace the partial cycling assimilation systems that currently initialize operational limited-area models over the CONUS without sacrificing forecast quality.

Initial Conditions for Convection-Allowing Ensembles over the Conterminous United States

2020 ◽  
Vol 148 (7) ◽  
pp. 2645-2669
Author(s):  
Craig S. Schwartz ◽  
May Wong ◽  
Glen S. Romine ◽  
Ryan A. Sobash ◽  
Kathryn R. Fossell
Keyword(s):  
United States ◽  
Ensemble Kalman Filter ◽  
Initial Conditions ◽  
Limited Area ◽  
Grid Spacing ◽  
Forecast System ◽  
Skill Scores ◽  
Ensemble Mean ◽  
Horizontal Grid ◽  
Better Than

Abstract Five sets of 48-h, 10-member, convection-allowing ensemble (CAE) forecasts with 3-km horizontal grid spacing were systematically evaluated over the conterminous United States with a focus on precipitation across 31 cases. The various CAEs solely differed by their initial condition perturbations (ICPs) and central initial states. CAEs initially centered about deterministic Global Forecast System (GFS) analyses were unequivocally better than those initially centered about ensemble mean analyses produced by a limited-area single-physics, single-dynamics 15-km continuously cycling ensemble Kalman filter (EnKF), strongly suggesting relative superiority of the GFS analyses. Additionally, CAEs with flow-dependent ICPs derived from either the EnKF or multimodel 3-h forecasts from the Short-Range Ensemble Forecast (SREF) system had higher fractions skill scores than CAEs with randomly generated mesoscale ICPs. Conversely, due to insufficient spread, CAEs with EnKF ICPs had worse reliability, discrimination, and dispersion than those with random and SREF ICPs. However, members in the CAE with SREF ICPs undesirably clustered by dynamic core represented in the ICPs, and CAEs with random ICPs had poor spinup characteristics. Collectively, these results indicate that continuously cycled EnKF mean analyses were suboptimal for CAE initialization purposes and suggest that further work to improve limited-area continuously cycling EnKFs over large regional domains is warranted. Additionally, the deleterious aspects of using both multimodel and random ICPs suggest efforts toward improving spread in CAEs with single-physics, single-dynamics, flow-dependent ICPs should continue.

Toward unifying short-term and next-day convection-allowing ensemble forecast systems with a continuously-cycling 3-km ensemble Kalman filter over the entire conterminous United States

2020 ◽  
pp. 1-83
Author(s):  
Craig S. Schwartz ◽  
Glen S. Romine ◽  
David C. Dowell
Keyword(s):  
United States ◽  
Kalman Filter ◽  
High Resolution ◽  
Ensemble Kalman Filter ◽  
Ensemble Forecast ◽  
Grid Spacing ◽  
Short Term ◽  
Pass Filter ◽  
Low Pass Filter ◽  
Horizontal Grid

Abstract Using the Weather Research and Forecasting model, 80-member ensemble Kalman filter (EnKF) analyses with 3-km horizontal grid spacing were produced over the entire conterminous United States (CONUS) for 4 weeks using 1-h continuous cycling. For comparison, similarly configured EnKF analyses with 15-km horizontal grid spacing were also produced. At 0000 UTC, 15- and 3-km EnKF analyses initialized 36-h, 3-km, 10-member ensemble forecasts that were verified with a focus on precipitation. Additionally, forecasts were initialized from operational Global Ensemble Forecast System (GEFS) initial conditions (ICs) and experimental “blended” ICs produced by combining large scales from GEFS ICs with small scales from EnKF analyses using a low-pass filter. The EnKFs had stable climates with generally small biases, and precipitation forecasts initialized from 3-km EnKF analyses were more skillful and reliable than those initialized from downscaled GEFS and 15-km EnKF ICs through 12–18 and 6–12 h, respectively. Conversely, after 18 h, GEFS-initialized precipitation forecasts were better than EnKF-initialized precipitation forecasts. Blended 3-km ICs reflected the respective strengths of both GEFS and high-resolution EnKF ICs and yielded the best performance considering all times: blended 3-km ICs led to short-term forecasts with similar or better skill and reliability than those initialized from unblended 3-km EnKF analyses and ~18–36-h forecasts possessing comparable quality as GEFS-initialized forecasts. This work likely represents the first time a convection-allowing EnKF has been continuously cycled over a region as large as the entire CONUS, and results suggest blending high-resolution EnKF analyses with low-resolution global fields can potentially unify short-term and next-day convection-allowing ensemble forecast systems under a common framework.

scholarly journals Convection-Permitting Forecasts Initialized with Continuously Cycling Limited-Area 3DVAR, Ensemble Kalman Filter, and “Hybrid” Variational–Ensemble Data Assimilation Systems

2014 ◽  
Vol 142 (2) ◽  
pp. 716-738 ◽  
Author(s):  
Craig S. Schwartz ◽  
Zhiquan Liu
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Three Dimensional ◽  
Skill Score ◽  
Limited Area ◽  
Computational Domain ◽  
Ensemble Data Assimilation ◽  
Ensemble Data ◽  
Precipitation Characteristics ◽  
High Precipitation

Abstract Analyses with 20-km horizontal grid spacing were produced from parallel continuously cycling three-dimensional variational (3DVAR), ensemble square root Kalman filter (EnSRF), and “hybrid” variational–ensemble data assimilation (DA) systems between 0000 UTC 6 May and 0000 UTC 21 June 2011 over a domain spanning the contiguous United States. Beginning 9 May, the 0000 UTC analyses initialized 36-h Weather Research and Forecasting Model (WRF) forecasts containing a large convection-permitting 4-km nest. These 4-km 3DVAR-, EnSRF-, and hybrid-initialized forecasts were compared to benchmark WRF forecasts initialized by interpolating 0000 UTC Global Forecast System (GFS) analyses onto the computational domain. While important differences regarding mean state characteristics of the 20-km DA systems were noted, verification efforts focused on the 4-km precipitation forecasts. The 3DVAR-, hybrid-, and EnSRF-initialized 4-km precipitation forecasts performed similarly regarding general precipitation characteristics, such as timing of the diurnal cycle, and all three forecast sets had high precipitation biases at heavier rainfall rates. However, meaningful differences emerged regarding precipitation placement as quantified by the fractions skill score. For most forecast hours, the hybrid-initialized 4-km precipitation forecasts were better than the EnSRF-, 3DVAR-, and GFS-initialized forecasts, and the improvement was often statistically significant at the 95th percentile. These results demonstrate the potential of limited-area continuously cycling hybrid DA configurations and suggest additional hybrid development is warranted.

Evaluation of Surface Analyses and Forecasts with a Multiscale Ensemble Kalman Filter in Regions of Complex Terrain

2011 ◽  
Vol 139 (6) ◽  
pp. 2008-2024 ◽  
Author(s):  
Brian C. Ancell ◽  
Clifford F. Mass ◽  
Gregory J. Hakim
Keyword(s):  
Kalman Filter ◽  
High Resolution ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Complex Terrain ◽  
Error Variance ◽  
Small Scale ◽  
Observation Error ◽  
Grid Spacing ◽  
Background Error

Abstract Previous research suggests that an ensemble Kalman filter (EnKF) data assimilation and modeling system can produce accurate atmospheric analyses and forecasts at 30–50-km grid spacing. This study examines the ability of a mesoscale EnKF system using multiscale (36/12 km) Weather Research and Forecasting (WRF) model simulations to produce high-resolution, accurate, regional surface analyses, and 6-h forecasts. This study takes place over the complex terrain of the Pacific Northwest, where the small-scale features of the near-surface flow field make the region particularly attractive for testing an EnKF and its flow-dependent background error covariances. A variety of EnKF experiments are performed over a 5-week period to test the impact of decreasing the grid spacing from 36 to 12 km and to evaluate new approaches for dealing with representativeness error, lack of surface background variance, and low-level bias. All verification in this study is performed with independent, unassimilated observations. Significant surface analysis and 6-h forecast improvements are found when EnKF grid spacing is reduced from 36 to 12 km. Forecast improvements appear to be a consequence of increased resolution during model integration, whereas analysis improvements also benefit from high-resolution ensemble covariances during data assimilation. On the 12-km domain, additional analysis improvements are found by reducing observation error variance in order to address representativeness error. Removing model surface biases prior to assimilation significantly enhances the analysis. Inflating surface wind and temperature background error variance has large impacts on analyses, but only produces small improvements in analysis RMS errors. Both surface and upper-air 6-h forecasts are nearly unchanged in the 12-km experiments. Last, 12-km WRF EnKF surface analyses and 6-h forecasts are shown to generally outperform those of the Global Forecast System (GFS), North American Model (NAM), and the Rapid Update Cycle (RUC) by about 10%–30%, although these improvements do not extend above the surface. Based on these results, future improvements in multiscale EnKF are suggested.

E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model

2012 ◽  
Vol 140 (2) ◽  
pp. 587-600 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Prediction Model ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Coupled System ◽  
Limited Area ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Hybrid Data Assimilation

A hybrid data assimilation approach that couples the ensemble Kalman filter (EnKF) and four-dimensional variational (4DVar) methods is implemented for the first time in a limited-area weather prediction model. In this coupled system, denoted E4DVar, the EnKF and 4DVar systems run in parallel while feeding into each other. The multivariate, flow-dependent background error covariance estimated from the EnKF ensemble is used in the 4DVar minimization and the ensemble mean in the EnKF analysis is replaced by the 4DVar analysis, while updating the analysis perturbations for the next cycle of ensemble forecasts with the EnKF. Therefore, the E4DVar can obtain flow-dependent information from both the explicit covariance matrix derived from ensemble forecasts, as well as implicitly from the 4DVar trajectory. The performance of an E4DVar system is compared with the uncoupled 4DVar and EnKF for a limited-area model by assimilating various conventional observations over the contiguous United States for June 2003. After verifying the forecasts from each analysis against standard sounding observations, it is found that the E4DVar substantially outperforms both the EnKF and 4DVar during this active summer month, which featured several episodes of severe convective weather. On average, the forecasts produced from E4DVar analyses have considerably smaller errors than both of the stand-alone EnKF and 4DVar systems for forecast lead times up to 60 h.

Intercomparison of an Ensemble Kalman Filter with Three- and Four-Dimensional Variational Data Assimilation Methods in a Limited-Area Model over the Month of June 2003

2011 ◽  
Vol 139 (2) ◽  
pp. 566-572 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang ◽  
Xiang-Yu Huang ◽  
Xin Zhang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Forecast Error ◽  
Wrf Model ◽  
Warm Season ◽  
Variational Data Assimilation ◽  
Lead Times ◽  
Limited Area ◽  
Forecast Errors

Abstract This study compares the performance of an ensemble Kalman filter (EnKF) with both the three-dimensional and four-dimensional variational data assimilation (3DVar and 4DVar) methods of the Weather Research and Forecasting (WRF) model over the contiguous United States in a warm-season month (June) of 2003. The data assimilated every 6 h include conventional sounding and surface observations as well as data from wind profilers, ships and aircraft, and the cloud-tracked winds from satellites. The performances of these methods are evaluated through verifying the 12- to 72-h forecasts initialized twice daily from the analysis of each method against the standard sounding observations. It is found that 4DVar has consistently smaller error than that of 3DVar for winds and temperature at all forecast lead times except at 60 and 72 h when their forecast errors become comparable in amplitude, while the two schemes have similar performance in moisture at all lead times. The forecast error of the EnKF is comparable to that of the 4DVar at 12–36-h lead times, both of which are substantially smaller than that of the 3DVar, despite the fact that 3DVar fits the sounding observations much more closely at the analysis time. The advantage of the EnKF becomes even more evident at 48–72-h lead times; the 72-h forecast error of the EnKF is comparable in magnitude to the 48-h error of 3DVar/4DVar.

scholarly journals E3DVar: Coupling an Ensemble Kalman Filter with Three-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model and Comparison to E4DVar

2013 ◽  
Vol 141 (3) ◽  
pp. 900-917 ◽  
Author(s):  
Fuqing Zhang ◽  
Meng Zhang ◽  
Jonathan Poterjoy
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Weather Prediction ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Lead Times ◽  
Limited Area ◽  
Model Errors ◽  
Mean Square Errors

Abstract This study examines the performance of a hybrid ensemble-variational data assimilation system (E3DVar) that couples an ensemble Kalman filter (EnKF) with the three-dimensional variational data assimilation (3DVar) system for the Weather Research and Forecasting (WRF) Model. The performance of E3DVar and the component EnKF and 3DVar systems are compared over the eastern United States for June 2003. Conventional sounding and surface observations as well as data from wind profilers, aircraft and ships, and cloud-tracked winds from satellites, are assimilated every 6 h during the experiments, and forecasts are verified using standard sounding observations. Forecasts with 12- to 72-h lead times are found to have noticeably smaller root-mean-square errors when initialized with the E3DVar system, as opposed to the EnKF, especially for the 12-h wind and moisture fields. The E3DVar system demonstrates similar performance as an EnKF, while using less than half the number of ensemble members, and is less sensitive to the use of a multiphysics ensemble to account for model errors. The E3DVar system is also compared with a similar hybrid method that replaces the 3DVar component with the WRF four-dimensional variational data assimilation (4DVar) method (denoted E4DVar). The E4DVar method demonstrated considerable improvements over E3DVar for nearly all model levels and variables at the shorter forecast lead times (12–48 h), but the forecast accuracies of all three ensemble-based methods (EnKF, E3DVar, and E4DVar) converge to similar results at longer lead times (60–72 h). Nevertheless, all methods that used ensemble information produced considerably better forecasts than the two methods that relied solely on static background error covariance (i.e., 3DVar and 4DVar).

scholarly journals A Regional GSI-Based Ensemble Kalman Filter Data Assimilation System for the Rapid Refresh Configuration: Testing at Reduced Resolution

2013 ◽  
Vol 141 (11) ◽  
pp. 4118-4139 ◽  
Author(s):  
Kefeng Zhu ◽  
Yujie Pan ◽  
Ming Xue ◽  
Xuguang Wang ◽  
Jeffrey S. Whitaker ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Ensemble Kalman Filter ◽  
Forecast Errors ◽  
Grid Spacing ◽  
Computational Costs ◽  
Skill Scores ◽  
Operational Application ◽  
Data Assimilation System ◽  
Statistical Interpolation ◽  
Better Than

Abstract A regional ensemble Kalman filter (EnKF) system is established for potential Rapid Refresh (RAP) operational application. The system borrows data processing and observation operators from the gridpoint statistical interpolation (GSI), and precalculates observation priors using the GSI. The ensemble square root Kalman filter (EnSRF) algorithm is used, which updates both the state vector and observation priors. All conventional observations that are used in the operational RAP GSI are assimilated. To minimize computational costs, the EnKF is run at ⅓ of the operational RAP resolution or about 40-km grid spacing, and its performance is compared to the GSI using the same datasets and resolution. Short-range (up to 18 h, the RAP forecast length) forecasts are verified against soundings, surface observations, and precipitation data. Experiments are run with 3-hourly assimilation cycles over a 9-day convectively active retrospective period from spring 2010. The EnKF performance was improved by extensive tuning, including the use of height-dependent covariance localization scales and adaptive covariance inflation. When multiple physics parameterization schemes are employed by the EnKF, forecast errors are further reduced, especially for relative humidity and temperature at the upper levels and for surface variables. The best EnKF configuration produces lower forecast errors than the parallel GSI run. Gilbert skill scores of precipitation forecasts on the 13-km RAP grid initialized from the 3-hourly EnKF analyses are consistently better than those from GSI analyses.

scholarly journals Assimilation of High-Resolution Tropical Cyclone Observations with an Ensemble Kalman Filter Using NOAA/AOML/HRD’s HEDAS: Evaluation of the 2008–11 Vortex-Scale Analyses

2013 ◽  
Vol 141 (6) ◽  
pp. 1842-1865 ◽  
Author(s):  
Altuğ Aksoy ◽  
Sim D. Aberson ◽  
Tomislava Vukicevic ◽  
Kathryn J. Sellwood ◽  
Sylvie Lorsolo ◽  
...  
Keyword(s):  
Kalman Filter ◽  
High Resolution ◽  
Tropical Cyclone ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Inner Core ◽  
Weather Research And Forecasting ◽  
Planetary Boundary Layer Parameterization ◽  
Data Assimilation Technique ◽  
Horizontal Grid

Abstract The Hurricane Weather Research and Forecasting (HWRF) Ensemble Data Assimilation System (HEDAS) is developed to assimilate tropical cyclone inner-core observations for high-resolution vortex initialization. It is based on a serial implementation of the square root ensemble Kalman filter (EnKF). In this study, HWRF is used in an experimental configuration with horizontal grid spacing of 9 (3) km on the outer (inner) domain. HEDAS is applied to 83 cases from years 2008 to 2011. With the exception of two Hurricane Hilary (2011) cases in the eastern North Pacific basin, all cases are observed in the Atlantic basin. Observed storm intensity for these cases ranges from tropical depression to category-4 hurricane. Overall, it is found that high-resolution tropical cyclone observations, when assimilated with an advanced data assimilation technique such as the EnKF, result in analyses of the primary circulation that are realistic in terms of intensity, wavenumber-0 radial structure, as well as wavenumber-1 azimuthal structure. Representing the secondary circulation in the analyses is found to be more challenging with systematic errors in the magnitude and depth of the low-level radial inflow. This is believed to result from a model bias in the experimental HWRF caused by the overdiffusive nature of the planetary boundary layer parameterization utilized. Thermodynamic deviations from the observed structure are believed to be caused by both an imbalance between the number of the kinematic and thermodynamic observations in general and the suboptimal ensemble covariances between kinematic and thermodynamic fields. Future plans are discussed to address these challenges.

scholarly journals Evaluating Forecast Impact of Assimilating Microwave Humidity Sounder (MHS) Radiances with a Regional Ensemble Kalman Filter Data Assimilation System

2015 ◽  
Vol 30 (4) ◽  
pp. 964-983 ◽  
Author(s):  
Kathryn M. Newman ◽  
Craig S. Schwartz ◽  
Zhiquan Liu ◽  
Hui Shao ◽  
Xiang-Yu Huang
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Ensemble Kalman Filter ◽  
Specific Humidity ◽  
Lead Times ◽  
Limited Area ◽  
Microwave Humidity Sounder ◽  
The Impact ◽  
Data Assimilation System ◽  
Assimilation System

Abstract This study examines the impact of assimilating Microwave Humidity Sounder (MHS) radiances in a limited-area ensemble Kalman filter (EnKF) data assimilation system. Two experiments spanning 11 August–13 September 2008 were run over a domain featuring the Atlantic basin using a 6-h full cycling analysis and forecast system. Deterministic 72-h forecasts were initialized at 0000 and 1200 UTC for a comparison of forecast impact. The two experiments were configured identically with the exception of the inclusion of the MHS radiances (AMHS) in the second to isolate the impacts of the MHS radiance data. The results were verified against several sources, and statistical significance tests indicate the most notable differences are in the midlevel moisture fields. Both configurations were characterized by high moisture biases when compared to the European Centre for Medium-Range Weather Forecasts interim reanalysis (ERA-Interim, also known as ERA-I) specific humidity fields, as well as precipitable water vapor from an observationally based product. However, the AMHS experiment has midlevel moisture fields closer to the ERA-I and observation datasets. When reducing the verification domain to focus on the subtropical and easterly wave regions of the North Atlantic Ocean, larger improvements in midlevel moisture at nearly all lead times is seen in the AMHS simulation. Finally, when considering tropical cyclone forecasts, the AMHS configuration shows improvement in intensity forecasts at several lead times as well as improvements at early to intermediate lead times for minimum sea level pressure forecasts.

Sign in / Sign up

Export Citation Format

Share Document