A Simulation Study Using a Local Ensemble Transform Kalman Filter for Data Assimilation in New York Harbor

2008 ◽  
Vol 25 (9) ◽  
pp. 1638-1656 ◽  
Author(s):  
Ross N. Hoffman ◽  
Rui M. Ponte ◽  
Eric J. Kostelich ◽  
Alan Blumberg ◽  
Istvan Szunyogh ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Standard Deviation ◽  
Data Assimilation ◽  
External Forcing ◽  
Ensemble Spread ◽  
Initial Ensemble ◽  
Error Standard Deviation ◽  
Grid Points ◽  
Ensemble Transform Kalman Filter ◽  
Ensemble Transform

Abstract Data assimilation approaches that use ensembles to approximate a Kalman filter have many potential advantages for oceanographic applications. To explore the extent to which this holds, the Estuarine and Coastal Ocean Model (ECOM) is coupled with a modern data assimilation method based on the local ensemble transform Kalman filter (LETKF), and a series of simulation experiments is conducted. In these experiments, a long ECOM “nature” run is taken to be the “truth.” Observations are generated at analysis times by perturbing the nature run at randomly chosen model grid points with errors of known statistics. A diverse collection of model states is used for the initial ensemble. All experiments use the same lateral boundary conditions and external forcing fields as in the nature run. In the data assimilation, the analysis step combines the observations and the ECOM forecasts using the Kalman filter equations. As a control, a free-running forecast (FRF) is made from the initial ensemble mean to check the relative importance of external forcing versus data assimilation on the analysis skill. Results of the assimilation cycle and the FRF are compared to truth to quantify the skill of each. The LETKF performs well for the cases studied here. After just a few assimilation cycles, the analysis errors are smaller than the observation errors and are much smaller than the errors in the FRF. The assimilation quickly eliminates the domain-averaged bias of the initial ensemble. The filter accurately tracks the truth at all data densities examined, from observations at 50% of the model grid points down to 2% of the model grid points. As the data density increases, the ensemble spread, bias, and error standard deviation decrease. As the ensemble size increases, the ensemble spread increases and the error standard deviation decreases. Increases in the size of the observation error lead to a larger ensemble spread but have a small impact on the analysis accuracy.

scholarly journals Gain Form of the Ensemble Transform Kalman Filter and Its Relevance to Satellite Data Assimilation with Model Space Ensemble Covariance Localization

2017 ◽  
Vol 145 (11) ◽  
pp. 4575-4592 ◽  
Author(s):  
Craig H. Bishop ◽  
Jeffrey S. Whitaker ◽  
Lili Lei
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Satellite Data ◽  
Localization Length ◽  
Model Space ◽  
Ensemble Size ◽  
Length Scales ◽  
Ensemble Transform Kalman Filter ◽  
Ensemble Transform ◽  
Expanded Ensemble

To ameliorate suboptimality in ensemble data assimilation, methods have been introduced that involve expanding the ensemble size. Such expansions can incorporate model space covariance localization and/or estimates of climatological or model error covariances. Model space covariance localization in the vertical overcomes problematic aspects of ensemble-based satellite data assimilation. In the case of the ensemble transform Kalman filter (ETKF), the expanded ensemble size associated with vertical covariance localization would also enable the simultaneous update of entire vertical columns of model variables from hyperspectral and multispectral satellite sounders. However, if the original formulation of the ETKF were applied to an expanded ensemble, it would produce an analysis ensemble that was the same size as the expanded forecast ensemble. This article describes a variation on the ETKF called the gain ETKF (GETKF) that takes advantage of covariances from the expanded ensemble, while producing an analysis ensemble that has the required size of the unexpanded forecast ensemble. The approach also yields an inflation factor that depends on the localization length scale that causes the GETKF to perform differently to an ensemble square root filter (EnSRF) using the same expanded ensemble. Experimentation described herein shows that the GETKF outperforms a range of alternative ETKF-based solutions to the aforementioned problems. In cycling data assimilation experiments with a newly developed storm-track version of the Lorenz-96 model, the GETKF analysis root-mean-square error (RMSE) matches the EnSRF RMSE at shorter than optimal localization length scales but is superior in that it yields smaller RMSEs for longer localization length scales.

scholarly journals Estimating Surface Carbon Fluxes Based on a Local Ensemble Transform Kalman Filter with a Short Assimilation Window and a Long Observation Window

2017 ◽  
Author(s):  
Yun Liu ◽  
Eugenia Kalnay ◽  
Ning Zeng ◽  
Ghassem Asrar ◽  
Zhaohui Chen ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Grid Point ◽  
Carbon Fluxes ◽  
Transfer Model ◽  
Observation Window ◽  
Surface Carbon ◽  
Ensemble Transform Kalman Filter ◽  
Ensemble Transform ◽  
Assimilation System

Abstract. We developed a Carbon data assimilation system to estimate the surface carbon fluxes using the Local Ensemble Transform Kalman Filter and atmospheric transfer model of GEOS-Chem driven by the MERRA-1 reanalysis of the meteorological fields based on the Goddard Earth Observing System Model, Version 5 (GEOS-5). This assimilation system is inspired by the method of Kang et al. [2011, 2012], who estimated the surface carbon fluxes in an Observing System Simulation Experiment (OSSE) mode, as evolving parameters in the assimilation of the atmospheric CO2, using a short assimilation window of 6 hours. They included the assimilation of the standard meteorological variables, so that the ensemble provided a measure of the uncertainty in the CO2 transport. After introducing new techniques such as variable localization, and increased observation weights near the surface, they obtained accurate carbon fluxes at grid point resolution. We developed a new version of the LETKF related to the Running-in-Place (RIP) method used to accelerate the spin-up of EnKF data assimilation [Kalnay and Yang, 2010; Wang et al., 2013, Yang et al., 2014]. Like RIP, the new assimilation system uses the no-cost smoothing algorithm for the LETKF [Kalnay et al., 2007b], which allows shifting at no cost the Kalman Filter solution forward or backward within an assimilation window. In the new scheme a long observation window (e.g., 7-days or longer) is used to create an LETKF ensemble at 7-days. Then, the RIP smoother is used to obtain an accurate final analysis at 1-day. This analysis has the advantage of being based on a short assimilation window, which makes it more accurate, and of having been exposed to the future 7-days observations, which accelerates the spin up. The assimilation and observation windows are then shifted forward by one day, and the process is repeated. This reduces significantly the analysis error, suggesting that this method could be used in other data assimilation problems.

scholarly journals Application of ensemble transform data assimilation methods for parameter estimation in reservoir modeling

2018 ◽  
Vol 25 (4) ◽  
pp. 731-746 ◽  
Author(s):  
Sangeetika Ruchi ◽  
Svetlana Dubinkina
Keyword(s):  
Parameter Estimation ◽  
Kalman Filter ◽  
Data Assimilation ◽  
Particle Filter ◽  
Reservoir Modeling ◽  
Model Parameters ◽  
Uncertain Parameters ◽  
Initial Ensemble ◽  
Leading Mode ◽  
Ensemble Transform

Abstract. Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable Markov chain Monte Carlo (MCMC) methods are computationally expensive. Sequential ensemble methods such as ensemble Kalman filters and particle filters provide a favorable alternative. However, ensemble Kalman filter has an assumption of Gaussianity. Ensemble transform particle filter does not have this assumption and has proven to be highly beneficial for an initial condition estimation and a small number of parameter estimations in chaotic dynamical systems with non-Gaussian distributions. In this paper we employ ensemble transform particle filter (ETPF) and ensemble transform Kalman filter (ETKF) for parameter estimation in nonlinear problems with 1, 5, and 2500 uncertain parameters and compare them to importance sampling (IS). The large number of uncertain parameters is of particular interest for subsurface reservoir modeling as it allows us to parameterize permeability on the grid. We prove that the updated parameters obtained by ETPF lie within the range of an initial ensemble, which is not the case for ETKF. We examine the performance of ETPF and ETKF in a twin experiment setup, where observations of pressure are synthetically created based on the known values of parameters. For a small number of uncertain parameters (one and five) ETPF performs comparably to ETKF in terms of the mean estimation. For a large number of uncertain parameters (2500) ETKF is robust with respect to the initial ensemble, while ETPF is sensitive due to sampling error. Moreover, for the high-dimensional test problem ETPF gives an increase in the root mean square error after data assimilation is performed. This is resolved by applying distance-based localization, which however deteriorates a posterior estimation of the leading mode by largely increasing the variance due to a combination of less varying localized weights, not keeping the imposed bounds on the modes via the Karhunen–Loeve expansion, and the main variability explained by the leading mode. A possible remedy is instead of applying localization to use only leading modes that are well estimated by ETPF, which demands knowledge of which mode to truncate.

scholarly journals Volcanic ash forecast using ensemble-based data assimilation: the Ensemble Transform Kalman Filter coupled with FALL3D-7.2 model (ETKF-FALL3D, version 1.0)

2019 ◽  
Author(s):  
Soledad Osores ◽  
Juan Ruiz ◽  
Arnau Folch ◽  
Estela Collini
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Volcanic Ash ◽  
Source Parameters ◽  
Joint Estimation ◽  
Volcanic Ash Cloud ◽  
Ensemble Transform Kalman Filter ◽  
Ensemble Transform ◽  
Ash Cloud ◽  
Ash Dispersal

Abstract. Quantitative volcanic ash cloud forecasts are prone to uncertainties coming from the source term quantification (e.g. eruption strength or vertical distribution of the emitted particles), with consequent implications on operational ash impact assessment. We present an ensemble-based data assimilation and forecast system for volcanic ash dispersal and deposition aimed at reducing uncertainties related to eruption source parameters. The FALL3D atmospheric dispersal model is coupled with the Ensemble Transform Kalman Filter (ETKF) data assimilation technique by combining ash mass loading observations with ash dispersal simulations in order to obtain a better joint estimation of 3D ash concentration and source parameters. The ETKF-FALL3D data assimilation system is evaluated performing Observation System Simulation Experiments (OSSE) in which synthetic observations of fine ash mass loadings are assimilated. The evaluation of the ETKF-FALL3D system considering reference states of steady and time-varying eruption source parameters shows that the assimilation process gives both better estimations of ash concentration and time-dependent optimized values of eruption source parameters. The joint estimation of concentrations and source parameters leads to a better analysis and forecast of the 3D ash concentrations. Results show the potential of the methodology to improve volcanic ash cloud forecasts in operational contexts.

scholarly journals Evaluation of a Strategy for the Assimilation of Satellite Radiance Observations with the Local Ensemble Transform Kalman Filter

2011 ◽  
Vol 139 (6) ◽  
pp. 1932-1951 ◽  
Author(s):  
José A. Aravéquia ◽  
Istvan Szunyogh ◽  
Elana J. Fertig ◽  
Eugenia Kalnay ◽  
David Kuhl ◽  
...  
Keyword(s):  
Kalman Filter ◽  
Data Assimilation ◽  
Grid Point ◽  
Earth Observing System ◽  
Wind Analysis ◽  
Correction Technique ◽  
Ensemble Transform Kalman Filter ◽  
Environmental Prediction ◽  
Observation Bias ◽  
Ensemble Transform

Abstract This paper evaluates a strategy for the assimilation of satellite radiance observations with the local ensemble transform Kalman filter (LETKF) data assimilation scheme. The assimilation strategy includes a mechanism to select the radiance observations that are assimilated at a given grid point and an ensemble-based observation bias-correction technique. Numerical experiments are carried out with a reduced (T62L28) resolution version of the model component of the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS). The observations used for the evaluation of the assimilation strategy are AMSU-A level 1B brightness temperature data from the Earth Observing System (EOS) Aqua spacecraft. The assimilation of these observations, in addition to all operationally assimilated nonradiance observations, leads to a statistically significant improvement of both the temperature and wind analysis in the Southern Hemisphere. This result suggests that the LETKF, combined with the proposed data assimilation strategy for the assimilation of satellite radiance observations, can efficiently extract information from radiance observations.

Sign in / Sign up

Export Citation Format

Share Document