Improving Background Error Covariances in a 3D Ensemble–Variational Data Assimilation System for Regional NWP

2019 ◽  
Vol 147 (1) ◽  
pp. 135-151 ◽  
Author(s):  
Jean-François Caron ◽  
Yann Michel ◽  
Thibaut Montmerle ◽  
Étienne Arbogast
Keyword(s):  
Data Assimilation ◽  
Spatial Scales ◽  
Three Dimensional ◽  
Winter Period ◽  
Ensemble Size ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Error Covariance ◽  
Time Lagged ◽  
Recent Formulation

Following the recent development of a three-dimensional ensemble–variational (3DEnVar) data assimilation algorithm for the AROME-France NWP system, this paper examines different approaches to reduce the sampling noise in the ensemble-derived background error covariances in this new scheme without modifying the background ensemble generation strategy. We first examine two variants of scale-dependent localization: one method consists of applying different amounts of localization to different ranges of background error covariance spatial scales, while simultaneously assimilating all of the available observations. Another separate approach uses time-lagged forecasts in order to increase the effective ensemble size, up to a factor of 3 here. This approach of time-lagged forecasts is considered both on its own and together with scale-dependent localization. When the background error covariances are derived from the most recent 25-member ensemble forecasts, the results from data assimilation cycles over a 33-day winter period show that avoiding cross covariances between scales in the scale-dependent localization formulation first proposed by Buehner performs better than the more recent formulation of Buehner and Shlyaeva. However, when increasing the effective ensemble size to 75 members with time-lagged forecasts, the two scale-dependent formulations provide similar forecast improvements overall. It is also found that the lagged-members approach outperforms scale-dependent localization on its own. The largest forecast improvements are obtained when combining the two approaches.

Scale-Dependent Background Error Covariance Localization: Evaluation in a Global Deterministic Weather Forecasting System

2018 ◽  
Vol 146 (5) ◽  
pp. 1367-1381 ◽  
Author(s):  
Jean-François Caron ◽  
Mark Buehner
Keyword(s):  
Data Assimilation ◽  
Weather Forecasting ◽  
Spatial Scales ◽  
Winter Period ◽  
Wind Fields ◽  
Horizontal Scale ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Forecasting System

Abstract Scale-dependent localization (SDL) consists of applying the appropriate (i.e., different) amount of localization to different ranges of background error covariance spatial scales while simultaneously assimilating all of the available observations. The SDL method proposed by Buehner and Shlyaeva for ensemble–variational (EnVar) data assimilation was tested in a 3D-EnVar version of the Canadian operational global data assimilation system. It is shown that a horizontal-scale-dependent horizontal localization leads to implicit vertical-level-dependent, variable-dependent, and location-dependent horizontal localization. The results from data assimilation cycles show that horizontal-scale-dependent horizontal covariance localization is able to improve the forecasts up to day 5 in the Northern Hemisphere extratropical summer period and up to day 7 in the Southern Hemisphere extratropical winter period. In the tropics, use of SDL results in improvements similar to what can be obtained by increasing the uniform amount of spatial localization. An investigation of the dynamical balance in the resulting analysis increments demonstrates that SDL does not further harm the balance between the mass and the rotational wind fields, as compared to the traditional localization approach. Potential future applications for the SDL method are also discussed.

scholarly journals An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part III: Antarctic Applications with Advanced Research WRF Using Real Data

2013 ◽  
Vol 141 (8) ◽  
pp. 2721-2739 ◽  
Author(s):  
Chengsi Liu ◽  
Qingnong Xiao
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Real Data ◽  
Variational Data Assimilation ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Short Period ◽  
Inflation Factor

Abstract A four-dimensional ensemble-based variational data assimilation (4DEnVar) algorithm proposed in Part I of the 4DEnVar series (denoted En4DVar in Part I, but here we refer to it as 4DEnVar according to WMO conference recommendation to differentiate it from En4DVar algorithm using adjoint model) uses a flow-dependent background error covariance calculated from ensemble forecasts and performs 4DVar optimization based on an incremental approach and a preconditioning algorithm. In Part II, the authors evaluated 4DEnVar with observing system simulation experiments (OSSEs) using the Advanced Research Weather Research and Forecasting Model (ARW-WRF, hereafter WRF). The current study extends the 4DEnVar to assimilate real observations for a cyclone in the Antarctic and the Southern Ocean in October 2007. The authors performed an intercomparison of four different WRF variational approaches for the case, including three-dimensional variational data assimilation (3DVar), first guess at the appropriate time (FGAT), and ensemble-based three-dimensional (En3DVar) and four-dimensional (4DEnVar) variational data assimilations. It is found that all data assimilation approaches produce positive impacts in this case. Applying the flow-dependent background error covariance in En3DVar and 4DEnVar yields forecast skills superior to those with the homogeneous and isotropic background error covariance in 3DVar and FGAT. In addition, the authors carried out FGAT and 4DEnVar 3-day cycling and 72-h forecasts. The results show that 4DEnVar produces a better performance in the cyclone prediction. The inflation factor on 4DEnVar can effectively improve the 4DEnVar analysis. The authors also conducted a short period (10-day lifetime of the cyclone in the domain) of analysis/forecast intercomparison experiments using 4DEnVar, FGAT, and 3DVar. The 4DEnVar scheme demonstrates overall superior and robust performance.

scholarly journals A Comparison of Multiscale GSI-Based EnKF and 3DVar Data Assimilation Using Radar and Conventional Observations for Midlatitude Convective-Scale Precipitation Forecasts

2015 ◽  
Vol 143 (8) ◽  
pp. 3087-3108 ◽  
Author(s):  
Aaron Johnson ◽  
Xuguang Wang ◽  
Jacob R. Carley ◽  
Louis J. Wicker ◽  
Christopher Karstens
Keyword(s):  
Data Assimilation ◽  
Multiscale Analysis ◽  
Multiple Scales ◽  
Three Dimensional ◽  
Forecast Period ◽  
Background Error ◽  
Cold Pools ◽  
Error Covariance ◽  
Convective Scale

Abstract A GSI-based data assimilation (DA) system, including three-dimensional variational assimilation (3DVar) and ensemble Kalman filter (EnKF), is extended to the multiscale assimilation of both meso- and synoptic-scale observation networks and convective-scale radar reflectivity and velocity observations. EnKF and 3DVar are systematically compared in this multiscale context to better understand the impacts of differences between the DA techniques on the analyses at multiple scales and the subsequent convective-scale precipitation forecasts. Averaged over 10 diverse cases, 8-h precipitation forecasts initialized using GSI-based EnKF are more skillful than those using GSI-based 3DVar, both with and without storm-scale radar DA. The advantage from radar DA persists for ~5 h using EnKF, but only ~1 h using 3DVar. A case study of an upscale growing MCS is also examined. The better EnKF-initialized forecast is attributed to more accurate analyses of both the mesoscale environment and the storm-scale features. The mesoscale location and structure of a warm front is more accurately analyzed using EnKF than 3DVar. Furthermore, storms in the EnKF multiscale analysis are maintained during the subsequent forecast period. However, storms in the 3DVar multiscale analysis are not maintained and generate excessive cold pools. Therefore, while the EnKF forecast with radar DA remains better than the forecast without radar DA throughout the forecast period, the 3DVar forecast quality is degraded by radar DA after the first hour. Diagnostics revealed that the inferior analysis at mesoscales and storm scales for the 3DVar is primarily attributed to the lack of flow dependence and cross-variable correlation, respectively, in the 3DVar static background error covariance.

scholarly journals Forecast Sensitivity Observation Impact in the 4DVAR and Hybrid-4DVAR Data Assimilation Systems

2019 ◽  
Vol 36 (8) ◽  
pp. 1563-1575 ◽  
Author(s):  
Sung-Min Kim ◽  
Hyun Mee Kim
Keyword(s):  
Data Assimilation ◽  
East Asia ◽  
Forecast Error ◽  
Integration Time ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Error Covariance ◽  
Atmospheric Motion ◽  
Observation Impact ◽  
Atmospheric Motion Vectors

AbstractIn this study, the observation impacts on 24-h forecast error reduction (FER), based on the adjoint method in the four-dimensional variational (4DVAR) data assimilation (DA) and hybrid-4DVAR DA systems coupled with the Unified Model, were evaluated from 0000 UTC 5 August to 1800 UTC 26 August 2014. The nonlinear FER in hybrid-4DVAR was 12.2% greater than that in 4DVAR due to the use of flow-dependent background error covariance (BEC), which was a weighted combination of the static BEC and the ensemble BEC based on ensemble forecasts. In hybrid-4DVAR, the observation impacts (i.e., the approximated nonlinear FER) for most observation types increase compared to those in 4DVAR. The increased observation impact from using hybrid-4DVAR instead of 4DVAR changes depending on the analysis time and regions. To calculate the ensemble BEC in hybrid-4DVAR, analyses at 0600 and 1800 UTC (0000 and 1200 UTC) used 3-h (9-h) ensemble forecasts. Greater observation impact was obtained when 3-h ensemble forecasts were used for the ensemble BEC at 0600 and 1800 UTC, than with 9-h ensemble forecasts at 0000 and 1200 UTC. Different from other observations, the atmospheric motion vectors (AMVs) deduced from geostationary satellite are more frequently observed in the same area. When the ensemble forecasts with longer integration times were used for the ensemble BEC in hybrid-4DVAR, the observation impact of the AMVs decreased the most in East Asia. This implies that the observation impact of AMVs in East Asia shows the highest sensitivity to the integration time of the ensemble members used for deducing the flow-dependent BEC in hybrid-4DVAR.

scholarly journals The impacts of uncertainties in emissions on aerosol data assimilation and short-term PM<sub>2.5</sub> predictions in CMAQ v5.2.1 over East Asia

2020 ◽  
Author(s):  
Sojin Lee ◽  
Chul Han Song ◽  
Kyung Man Han ◽  
Daven K. Henze ◽  
Kyunghwa Lee ◽  
...  
Keyword(s):  
Air Quality ◽  
Data Assimilation ◽  
East Asia ◽  
Conventional Method ◽  
Meteorological Data ◽  
Three Dimensional ◽  
Short Term ◽  
Background Error ◽  
Multi Scale ◽  
Error Covariance

Abstract. For the purpose of improving PM prediction skills in East Asia, we estimated a new background error covariance matrix (BEC) for aerosol data assimilation using surface PM2.5 observations that accounts for the uncertainties in anthropogenic emissions. In contrast to the conventional method to estimate the BEC that uses perturbations in meteorological data, this method additionally considered the perturbations using two different emission inventories. The impacts of the new BEC were then tested for the prediction of surface PM2.5 over East Asia using Community Multi-scale Air Quality (CMAQ) initialized by three-dimensional variational method (3D-VAR). The surface PM2.5 data measured at 154 sites in South Korea and 1,535 sites in China were assimilated every six hours during the Korea-United States Air Quality Study (KORUS-AQ) campaign period (1 May–14 June 2016). Data assimilation with our new BEC showed better agreement with the surface PM2.5 observations than that with the conventional method. Our method also showed closer agreement with the observations in 24-hour PM2.5 predictions with ~ 44 % fewer negative biases than the conventional method. We conclude that increased standard deviations, together with horizontal and vertical length scales in the new BEC, tend to improve the data assimilation and short-term predictions for the surface PM2.5. This paper also suggests further research efforts devoted to estimating the BEC to improve PM2.5 predictions.

An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test

2008 ◽  
Vol 136 (9) ◽  
pp. 3363-3373 ◽  
Author(s):  
Chengsi Liu ◽  
Qingnong Xiao ◽  
Bin Wang
Keyword(s):  
Data Assimilation ◽  
Preliminary Test ◽  
Background Field ◽  
Variational Data Assimilation ◽  
Water Model ◽  
Observation Error ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance

Abstract Applying a flow-dependent background error covariance (𝗕 matrix) in variational data assimilation has been a topic of interest among researchers in recent years. In this paper, an ensemble-based four-dimensional variational (En4DVAR) algorithm, designed by the authors, is presented that uses a flow-dependent background error covariance matrix constructed by ensemble forecasts and performs 4DVAR optimization to produce a balanced analysis. A great advantage of this En4DVAR design over standard 4DVAR methods is that the tangent linear and adjoint models can be avoided in its formulation and implementation. In addition, it can be easily incorporated into variational data assimilation systems that are already in use at operational centers and among the research community. A one-dimensional shallow water model was used for preliminary tests of the En4DVAR scheme. Compared with standard 4DVAR, the En4DVAR converges well and can produce results that are as good as those with 4DVAR but with far less computation cost in its minimization. In addition, a comparison of the results from En4DVAR with those from other data assimilation schemes [e.g., 3DVAR and ensemble Kalman filter (EnKF)] is made. The results show that the En4DVAR yields an analysis that is comparable to the widely used variational or ensemble data assimilation schemes and can be a promising approach for real-time applications. In addition, experiments were carried out to test the sensitivities of EnKF and En4DVAR, whose background error covariance is estimated from the same ensemble forecasts. The experiments indicated that En4DVAR obtained reasonably sound analysis even with larger observation error, higher observation frequency, and more unbalanced background field.

scholarly journals A New Data Assimilation Scheme: The Space-Expanded Ensemble Localization Kalman Filter

2013 ◽  
Vol 2013 ◽  
pp. 1-6 ◽  
Author(s):  
Hongze Leng ◽  
Junqiang Song ◽  
Fengshun Lu ◽  
Xiaoqun Cao
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Forecast Error ◽  
Three Dimensional ◽  
Full Rank ◽  
Observation Error ◽  
Model Framework ◽  
Background Error ◽  
Error Covariance ◽  
Expanded Ensemble

This study considers a new hybrid three-dimensional variational (3D-Var) and ensemble Kalman filter (EnKF) data assimilation (DA) method in a non-perfect-model framework, named space-expanded ensemble localization Kalman filter (SELKF). In this method, the localization operation is directly applied to the ensemble anomalies with a Schur Product, rather than to the full error covariance of the state in the EnKF. Meanwhile, the correction space of analysis increment is expanded to a space with larger dimension, and the rank of the forecast error covariance is significantly increased. This scheme can reduce the spurious correlations in the covariance and approximate the full-rank background error covariance well. Furthermore, a deterministic scheme is used to generate the analysis anomalies. The results show that the SELKF outperforms the perturbed EnKF given a relatively small ensemble size, especially when the length scale is relatively long or the observation error covariance is relatively small.

scholarly journals A Multiscale Variational Data Assimilation Scheme: Formulation and Illustration

2015 ◽  
Vol 143 (9) ◽  
pp. 3804-3822 ◽  
Author(s):  
Zhijin Li ◽  
James C. McWilliams ◽  
Kayo Ide ◽  
John D. Farrara
Keyword(s):  
High Resolution ◽  
Data Assimilation ◽  
Cost Function ◽  
Spatial Scales ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Cost ◽  
Fine Resolution

Abstract A multiscale data assimilation (MS-DA) scheme is formulated for fine-resolution models. A decomposition of the cost function is derived for a set of distinct spatial scales. The decomposed cost function allows for the background error covariance to be estimated separately for the distinct spatial scales, and multi-decorrelation scales to be explicitly incorporated in the background error covariance. MS-DA minimizes the partitioned cost functions sequentially from large to small scales. The multi-decorrelation length scale background error covariance enhances the spreading of sparse observations and prevents fine structures in high-resolution observations from being overly smoothed. The decomposition of the cost function also provides an avenue for mitigating the effects of scale aliasing and representativeness errors that inherently exist in a multiscale system, thus further improving the effectiveness of the assimilation of high-resolution observations. A set of one-dimensional experiments is performed to examine the properties of the MS-DA scheme. Emphasis is placed on the assimilation of patchy high-resolution observations representing radar and satellite measurements, alongside sparse observations representing those from conventional in situ platforms. The results illustrate how MS-DA improves the effectiveness of the assimilation of both these types of observations simultaneously.

scholarly journals Multivariate localization functions for strongly coupled data assimilation in the bivariate Lorenz ’96 system

2021 ◽  
Author(s):  
Zofia Stanley ◽  
Ian Grooms ◽  
William Kleiber
Keyword(s):  
Data Assimilation ◽  
Spatial Scales ◽  
Background Error ◽  
Strongly Coupled ◽  
Localization Function ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Coupled Data Assimilation ◽  
Lorenz 96 ◽  
The Impact

Abstract. Localization is widely used in data assimilation schemes to mitigate the impact of sampling errors on ensemble-derived background error covariance matrices. Strongly coupled data assimilation allows observations in one component of a coupled model to directly impact another component through inclusion of cross-domain terms in the background error covariance matrix. When different components have disparate dominant spatial scales, localization between model domains must properly account for the multiple length scales at play. In this work we develop two new multivariate localization functions, one of which is a multivariate extension of the fifth-order piecewise rational Gaspari-Cohn localization function; the within-component localization functions are standard Gaspari-Cohn with different localization radii while the cross-localization function is newly constructed. The functions produce non-negative definite localization matrices, which are suitable for use in variational data assimilation schemes. We compare the performance of our two new multivariate localization functions to two other multivariate localization functions and to the univariate analogs of all four functions in a simple experiment with the bivariate Lorenz '96 system. In our experiment the multivariate Gaspari-Cohn function leads to better performance than any of the other localization functions.

scholarly journals THE INFLUENCE OF BACKGROUND ERROR COVARIANCE OF GSI THREE-DIMENSIONAL VARIATIONAL DATA ASSIMILATION ON METEOROLOGY AND AEROSOL PREDICTION

2018 ◽  
Vol XLII-3/W5 ◽  
pp. 17-23
Author(s):  
Y. Hu ◽  
M. Zhang ◽  
Y. Liang ◽  
L. Ye ◽  
D. Zhao ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Three Dimensional ◽  
Variational Data Assimilation ◽  
Small Scale ◽  
Length Scale ◽  
Background Error ◽  
Background Error Covariance ◽  
Error Covariance ◽  
Horizontal Length ◽  
Mean Square Errors

<p><strong>Abstract.</strong> Background error covariance (BEC) plays a key role in a variational data assimilation system. It determines variable analysis increments by spreading information from observation points. In order to test the influence of BEC on the GSI data assimilation and prediction of aerosol in Beijing-Tianjin-Hebei, a regional BEC is calculated using one month series of numerical forecast fields of November 2017 based on the National Meteorological Center (NMC) method, and compared with the global BEC.The results show that the standard deviation of stream function of the regional BEC is larger than that of the global BEC. And the horizontal length-scale of the regional BEC is smaller than that of the global BEC, white the vertical length-scale of the regional BEC is similar with that of the global BEC. The increments of the assimilation experiment with the regional BEC present more small scale information than that with the global BEC. The forecast skill of the experiment with the regional BEC is higher than that with the global BEC in the stations of Beijing, Tianjin, Chengde and Taiyuan, and the average root-mean-square errors (RMSE) reduces by over 13.4%.</p>

Sign in / Sign up

Export Citation Format

Share Document