An Iterative Ensemble Kalman Filter for Multiphase Fluid Flow Data Assimilation

SPE Journal ◽  
2007 ◽  
Vol 12 (04) ◽  
pp. 438-446 ◽  
Author(s):  
Yaqing Gu ◽  
Dean S. Oliver

Summary The dynamical equations for multiphase flow in porous media are highly nonlinear and the number of variables required to characterize the medium is usually large, often two or more variables per simulator gridblock. Neither the extended Kalman filter nor the ensemble Kalman filter is suitable for assimilating data or for characterizing uncertainty for this type of problem. Although the ensemble Kalman filter handles the nonlinear dynamics correctly during the forecast step, it sometimes fails badly in the analysis (or updating) of saturations. This paper focuses on the use of an iterative ensemble Kalman filter for data assimilation in nonlinear problems, especially of the type related to multiphase ow in porous media. Two issues are key:iteration to enforce constraints andensuring that the resulting ensemble is representative of the conditional pdf (i.e., that the uncertainty quantification is correct). The new algorithm is compared to the ensemble Kalman filter on several highly nonlinear example problems, and shown to be superior in the prediction of uncertainty. Introduction For linear problems, the Kalman filter is optimal for assimilating measurements to continuously update the estimate of state variables. Kalman filters have occasionally been applied to the problem of estimating values of petroleum reservoir variables (Eisenmann et al. 1994; Corser et al. 2000), but they are most appropriate when the problems are characterized by a small number of variables and when the variables to be estimated are linearly related to the observations. Most data assimilation problems in petroleum reservoir engineering are highly nonlinear and are characterized by many variables, often two or more variables per simulator gridblock. The problem of weather forecasting is in many respects similar to the problem of predicting future petroleum reservoir performance. The economic impact of inaccurate predictions is substantial in both cases, as is the difficulty of assimilating very large data sets and updating very large numerical models. One method that has been recently developed for assimilating data in weather forecasting is ensemble Kalman filtering (Evensen 1994; Houtekamer and Mitchell 1998; Anderson and Anderson 1999; Hamill et al. 2000; Houtekamer and Mitchell 2001; Evensen 2003). It has been demonstrated to be useful for weather prediction over the North Atlantic. The method is now beginning to be applied for data assimilation in groundwater hydrology (Reichle et al. 2002; Chen and Zhang 2006) and in petroleum engineering (Nævdal et al. 2002, 2005; Gu and Oliver 2005; Liu and Oliver 2005a; Wen and Chen 2006, 2007; Zafari and Reynolds 2007; Gao et al. 2006; Lorentzen et al. 2005; Skjervheim et al. 2007; Dong et al. 2006), but the applications to state variables whose density functions are bimodal has proved problematic (Gu and Oliver 2006). For applications to nonlinear assimilation problems, it is useful to think of the ensemble Kalman filter as a least squares method that obtains an averaged gradient for minimization not from a variational approach but from an empirical correlation between model variables (Anderson 2003; Zafari et al. 2006). In addition to providing a mean estimate of the variables, a Monte Carlo estimate of uncertainty can be obtained directly from the variability in the ensemble.

2014 ◽  
Vol 71 (2) ◽  
pp. 469-482 ◽  
Author(s):  
Hailiang Du ◽  
Leonard A. Smith

Abstract State estimation lies at the heart of many meteorological tasks. Pseudo-orbit-based data assimilation provides an attractive alternative approach to data assimilation in nonlinear systems such as weather forecasting models. In the perfect model scenario, noisy observations prevent a precise estimate of the current state. In this setting, ensemble Kalman filter approaches are hampered by their foundational assumptions of dynamical linearity, while variational approaches may fail in practice owing to local minima in their cost function. The pseudo-orbit data assimilation approach improves state estimation by enhancing the balance between the information derived from the dynamic equations and that derived from the observations. The potential use of this approach for numerical weather prediction is explored in the perfect model scenario within two deterministic chaotic systems: the two-dimensional Ikeda map and 18-dimensional Lorenz96 flow. Empirical results demonstrate improved performance over that of the two most common traditional approaches of data assimilation (ensemble Kalman filter and four-dimensional variational assimilation).


SPE Journal ◽  
2010 ◽  
Vol 16 (02) ◽  
pp. 331-342 ◽  
Author(s):  
Hemant A. Phale ◽  
Dean S. Oliver

Summary When the ensemble Kalman filter (EnKF) is used for history matching, the resulting updates to reservoir properties sometimes exceed physical bounds, especially when the problem is highly nonlinear. Problems of this type are often encountered during history matching compositional models using the EnKF. In this paper, we illustrate the problem using an example in which the updated molar density of CO2 in some regions is observed to take negative values while molar densities of the remaining components are increased. Standard truncation schemes avoid negative values of molar densities but do not address the problem of increased molar densities of other components. The results can include a spurious increase in reservoir pressure with a subsequent inability to maintain injection. In this paper, we present a method for constrained EnKF (CEnKF), which takes into account the physical constraints on the plausible values of state variables during data assimilation. In the proposed method, inequality constraints are converted to a small number of equality constraints, which are used as virtual observations for calibrating the model parameters within plausible ranges. The CEnKF method is tested on a 2D compositional model and on a highly heterogeneous three-phase-flow reservoir model. The effect of the constraints on mass conservation is illustrated using a 1D Buckley-Leverett flow example. Results show that the CEnKF technique is able to enforce the nonnegativity constraints on molar densities and the bound constraints on saturations (all phase saturations must be between 0 and 1) and achieve a better estimation of reservoir properties than is obtained using only truncation with the EnKF.


Water ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 1520
Author(s):  
Zheng Jiang ◽  
Quanzhong Huang ◽  
Gendong Li ◽  
Guangyong Li

The parameters of water movement and solute transport models are essential for the accurate simulation of soil moisture and salinity, particularly for layered soils in field conditions. Parameter estimation can be achieved using the inverse modeling method. However, this type of method cannot fully consider the uncertainties of measurements, boundary conditions, and parameters, resulting in inaccurate estimations of parameters and predictions of state variables. The ensemble Kalman filter (EnKF) is well-suited to data assimilation and parameter prediction in Situations with large numbers of variables and uncertainties. Thus, in this study, the EnKF was used to estimate the parameters of water movement and solute transport in layered, variably saturated soils. Our results indicate that when used in conjunction with the HYDRUS-1D software (University of California Riverside, California, CA, USA) the EnKF effectively estimates parameters and predicts state variables for layered, variably saturated soils. The assimilation of factors such as the initial perturbation and ensemble size significantly affected in the simulated results. A proposed ensemble size range of 50–100 was used when applying the EnKF to the highly nonlinear hydrological models of the present study. Although the simulation results for moisture did not exhibit substantial improvement with the assimilation, the simulation of the salinity was significantly improved through the assimilation of the salinity and relative solutetransport parameters. Reducing the uncertainties in measured data can improve the goodness-of-fit in the application of the EnKF method. Sparse field condition observation data also benefited from the accurate measurement of state variables in the case of EnKF assimilation. However, the application of the EnKF algorithm for layered, variably saturated soils with hydrological models requires further study, because it is a challenging and highly nonlinear problem.


2016 ◽  
Vol 144 (8) ◽  
pp. 2927-2945
Author(s):  
Nedjeljka Žagar ◽  
Jeffrey Anderson ◽  
Nancy Collins ◽  
Timothy Hoar ◽  
Kevin Raeder ◽  
...  

Abstract Global data assimilation systems for numerical weather prediction (NWP) are characterized by significant uncertainties in tropical analysis fields. Furthermore, the largest spread of global ensemble forecasts in the short range on all scales is in the tropics. The presented results suggest that these properties hold even in the perfect-model framework and the ensemble Kalman filter data assimilation with a globally homogeneous network of wind and temperature profiles. The reasons for this are discussed by using the modal analysis, which provides information about the scale dependency of analysis and forecast uncertainties and information about the efficiency of data assimilation to reduce the prior uncertainties in the balanced and inertio-gravity dynamics. The scale-dependent representation of variance reduction of the prior ensemble by the data assimilation shows that the peak efficiency of data assimilation is on the synoptic scales in the midlatitudes that are associated with quasigeostrophic dynamics. In contrast, the variance associated with the inertia–gravity modes is less successfully reduced on all scales. A smaller information content of observations on planetary scales with respect to the synoptic scales is discussed in relation to the large-scale tropical uncertainties that current data assimilation methodologies do not address successfully. In addition, it is shown that a smaller reduction of the large-scale uncertainties in the prior state for NWP in the tropics than in the midlatitudes is influenced by the applied radius for the covariance localization.


2019 ◽  
Vol 1127 ◽  
pp. 012041
Author(s):  
N J Trilaksono ◽  
M Taqiyya ◽  
N Dewani ◽  
I D G A Junnaedhi ◽  
E Riawan ◽  
...  

2012 ◽  
Vol 140 (2) ◽  
pp. 587-600 ◽  
Author(s):  
Meng Zhang ◽  
Fuqing Zhang

A hybrid data assimilation approach that couples the ensemble Kalman filter (EnKF) and four-dimensional variational (4DVar) methods is implemented for the first time in a limited-area weather prediction model. In this coupled system, denoted E4DVar, the EnKF and 4DVar systems run in parallel while feeding into each other. The multivariate, flow-dependent background error covariance estimated from the EnKF ensemble is used in the 4DVar minimization and the ensemble mean in the EnKF analysis is replaced by the 4DVar analysis, while updating the analysis perturbations for the next cycle of ensemble forecasts with the EnKF. Therefore, the E4DVar can obtain flow-dependent information from both the explicit covariance matrix derived from ensemble forecasts, as well as implicitly from the 4DVar trajectory. The performance of an E4DVar system is compared with the uncoupled 4DVar and EnKF for a limited-area model by assimilating various conventional observations over the contiguous United States for June 2003. After verifying the forecasts from each analysis against standard sounding observations, it is found that the E4DVar substantially outperforms both the EnKF and 4DVar during this active summer month, which featured several episodes of severe convective weather. On average, the forecasts produced from E4DVar analyses have considerably smaller errors than both of the stand-alone EnKF and 4DVar systems for forecast lead times up to 60 h.


2017 ◽  
Vol 145 (5) ◽  
pp. 1897-1918 ◽  
Author(s):  
Jonathan Poterjoy ◽  
Ryan A. Sobash ◽  
Jeffrey L. Anderson

Abstract Particle filters (PFs) are Monte Carlo data assimilation techniques that operate with no parametric assumptions for prior and posterior errors. A data assimilation method introduced recently, called the local PF, approximates the PF solution within neighborhoods of observations, thus allowing for its use in high-dimensional systems. The current study explores the potential of the local PF for atmospheric data assimilation through cloud-permitting numerical experiments performed for an idealized squall line. Using only 100 ensemble members, experiments using the local PF to assimilate simulated radar measurements demonstrate that the method provides accurate analyses at a cost comparable to ensemble filters currently used in weather models. Comparisons between the local PF and an ensemble Kalman filter demonstrate benefits of the local PF for producing probabilistic analyses of non-Gaussian variables, such as hydrometeor mixing ratios. The local PF also provides more accurate forecasts than the ensemble Kalman filter, despite yielding higher posterior root-mean-square errors. A major advantage of the local PF comes from its ability to produce more physically consistent posterior members than the ensemble Kalman filter, which leads to fewer spurious model adjustments during forecasts. This manuscript presents the first successful application of the local PF in a weather prediction model and discusses implications for real applications where nonlinear measurement operators and nonlinear model processes limit the effectiveness of current Gaussian data assimilation techniques.


2016 ◽  
Vol 38 ◽  
pp. 190
Author(s):  
Regis Sperotto de Quadros ◽  
Fabrício Pereira Harter ◽  
Daniela Buske ◽  
Larri Silveira Pereira

Data Assimilation is a procedure to get the initial condition as accurately as possible, through the statistical combination of collected observations and a background field, usually a short-range forecast. In this research a complete assimilation system for the Lorenz equations based on Ensemble Kalman Filter is presented and examined. The Lorenz model is chosen for its simplicity in structure and the dynamic similarities with primitive equations models, such as modern numerical weather forecasting. Based on results, was concluded that, in this implementation, 10 members is the best setting, because there is an overfitting for ensembles with 50 and 100 members. It was also examined if the EnKF is effective to track the control for 20% and 40% of error in the initial conditions. The results show a disagreement between the “truth” and the estimation, especially in the end of integration period, due the chaotic nature of the system.  It was also concluded that EnKF have to be performed sufficiently frequently in order to produce desirable results.


2010 ◽  
Vol 138 (11) ◽  
pp. 4186-4198 ◽  
Author(s):  
Jeffrey L. Anderson

Abstract A deterministic square root ensemble Kalman filter and a stochastic perturbed observation ensemble Kalman filter are used for data assimilation in both linear and nonlinear single variable dynamical systems. For the linear system, the deterministic filter is simply a method for computing the Kalman filter and is optimal while the stochastic filter has suboptimal performance due to sampling error. For the nonlinear system, the deterministic filter has increasing error as ensemble size increases because all ensemble members but one become tightly clustered. In this case, the stochastic filter performs better for sufficiently large ensembles. A new method for computing ensemble increments in observation space is proposed that does not suffer from the pathological behavior of the deterministic filter while avoiding much of the sampling error of the stochastic filter. This filter uses the order statistics of the prior observation space ensemble to create an approximate continuous prior probability distribution in a fashion analogous to the use of rank histograms for ensemble forecast evaluation. This rank histogram filter can represent non-Gaussian observation space priors and posteriors and is shown to be competitive with existing filters for problems as large as global numerical weather prediction. The ability to represent non-Gaussian distributions is useful for a variety of applications such as convective-scale assimilation and assimilation of bounded quantities such as relative humidity.


2020 ◽  
Author(s):  
Yohei Sawada

Abstract. It is expected that hyperresolution land modeling substantially innovates the simulation of terrestrial water, energy, and carbon cycles. The major advantage of hyperresolution land models against conventional one-dimensional land surface models is that hyperresolution land models can explicitly simulate lateral water flows. Despite many efforts on data assimilation of hydrological observations into those hyperresolution land models, how surface water flows driven by local topography matter for data assimilation of soil moisture observations has not been fully clarified. Here I perform two minimalist synthetic experiments where soil moisture observations are assimilated into an integrated surface-groundwater land model by an ensemble Kalman filter. I discuss how differently the ensemble Kalman filter works when surface lateral flows are switched on and off. A horizontal background error covariance provided by overland flows is important to adjust the unobserved state variables (pressure head and soil moisture) and parameters (saturated hydraulic conductivity). However, the non-Gaussianity of the background error provided by the nonlinearity of a topography-driven surface flow harms the performance of data assimilation. It is difficult to efficiently constrain model states at the edge of the area where the topography-driven surface flow reaches by linear-Gaussian filters. It brings the new challenge in land data assimilation for hyperresolution land models. This study highlights the importance of surface lateral flows in hydrological data assimilation.


Sign in / Sign up

Export Citation Format

Share Document