scholarly journals Fast sensitivity analysis methods for computationally expensive models with multi-dimensional output

2018 ◽  
Vol 11 (8) ◽  
pp. 3131-3146 ◽  
Author(s):  
Edmund Ryan ◽  
Oliver Wild ◽  
Apostolos Voulgarakis ◽  
Lindsay Lee

Abstract. Global sensitivity analysis (GSA) is a powerful approach in identifying which inputs or parameters most affect a model's output. This determines which inputs to include when performing model calibration or uncertainty analysis. GSA allows quantification of the sensitivity index (SI) of a particular input – the percentage of the total variability in the output attributed to the changes in that input – by averaging over the other inputs rather than fixing them at specific values. Traditional methods of computing the SIs using the Sobol and extended Fourier Amplitude Sensitivity Test (eFAST) methods involve running a model thousands of times, but this may not be feasible for computationally expensive Earth system models. GSA methods that use a statistical emulator in place of the expensive model are popular, as they require far fewer model runs. We performed an eight-input GSA, using the Sobol and eFAST methods, on two computationally expensive atmospheric chemical transport models using emulators that were trained with 80 runs of the models. We considered two methods to further reduce the computational cost of GSA: (1) a dimension reduction approach and (2) an emulator-free approach. When the output of a model is multi-dimensional, it is common practice to build a separate emulator for each dimension of the output space. Here, we used principal component analysis (PCA) to reduce the output dimension, built an emulator for each of the transformed outputs, and then computed SIs of the reconstructed output using the Sobol method. We considered the global distribution of the annual column mean lifetime of atmospheric methane, which requires ∼ 2000 emulators without PCA but only 5–40 emulators with PCA. We also applied an emulator-free method using a generalised additive model (GAM) to estimate the SIs using only the training runs. Compared to the emulator-only methods, the emulator–PCA and GAM methods accurately estimated the SIs of the ∼ 2000 methane lifetime outputs but were on average 24 and 37 times faster, respectively.

2017 ◽  
Author(s):  
Edmund Ryan ◽  
Oliver Wild ◽  
Fiona O'Connor ◽  
Apostolos Voulgarakis ◽  
Lindsay Lee

Abstract. Global sensitivity analysis (GSA) is a critical approach in identifying which inputs or parameters of a model most affect model output. This determines which inputs to include when performing model calibration or uncertainty analysis. GSA allows quantification of the sensitivity index (SI) of a particular input – the percentage of the total variability in the output attributed to the changes in that input – by averaging over the other inputs rather than fixing them at specific values. Traditional methods of computing the SIs (e.g. Sobol) involve running a model thousands of times, but this may not be feasible for computationally expensive earth system models. GSA methods that use a statistical emulator in place of the expensive model are popular as they require far fewer model runs. Here, we perform an eight-input GSA on two computationally expensive atmospheric chemistry transport models using emulators that were trained with 80 runs of the models. We consider two methods to further reduce the computational cost of GSA: (1) a dimension reduction approach and (2) an emulator-free approach. When the output of a model is multi-dimensional, it is common practice to build a separate emulator for each dimension of the output space. Here, we use principal component analysis (PCA) to reduce the output dimension and build an emulator for each of the transformed outputs. We consider the global distribution of the annual column mean lifetime of atmospheric methane, which requires ~ 2000 emulators without PCA, but only 5–40 emulators with PCA. As an alternative, we apply an emulator-free method using a generalised additive model (GAM) to estimate the SIs using only the training runs. Compared to the emulator-only method, the hybrid PCA-emulator and GAM methods are 6 and 30 times quicker, respectively, at computing the SIs for the ~ 2000 methane lifetime outputs. The SIs computed using the two computationally faster methods are almost identical to those computed using the standard emulator-only method.


Author(s):  
Hyunkyoo Cho ◽  
Ujjwal Shrestha ◽  
Young-Do Choi ◽  
Jungwan Park

Abstract Global sensitivity analysis (GSA) estimates influence of design variables in the entire design domain on performance measures. Hence, using GSA, important design variables could be found for an engineering application with high dimension which require computationally expensive analyses. Then, similar engineering applications could use selected variables to carry out design process with smaller dimension and affordable computational cost. In this study, GSA has been carried out for the performance measures in design of stay vane and casing of reaction hydraulic turbines. Global sensitivity index method is used for GSA because it can fully capture the effect of interaction between the design variables. For efficiency, genetic aggregation surrogate models are constructed using the responses of computational fluid dynamic (CFD) analysis. Global sensitivity indices for the performance measures of stay vane and casing have been evaluated using the surrogate models. It is found that less than three design variables among 12 are effective in the design process of stay vane and casing in reaction hydraulic turbines.


Author(s):  
Rasool Koosha ◽  
Fatemeh Shahsavari

Abstract In the building energy performance simulation, the uncertainty analysis (UA) couples to the sensitivity analysis (SA) to handle ever-existing uncertainties; induced by the sources of uncertainty including random occupants behavior and degradation of building materials over time. As a building simulation tool reaches to a high level of complexity, it becomes more challenging for the sensitivity analysis to deliver reliable outputs; thus the accuracy of the SA results substantially depends upon the number of sample sets or the type of analysis performed. This paper describes a variance-based SA tool integrated into a building Resistance-Capacitance (RC) thermal model. Then, for a hypothetical residential building test case, three distinct first-order sensitivity index simulators and three total sensitivity index simulators are implemented and compared in terms of the dependency of results on the sample size, i.e., the demand for the computational cost.


2017 ◽  
Vol 2017 ◽  
pp. 1-16 ◽  
Author(s):  
Xiaojing Wu ◽  
Weiwei Zhang ◽  
Shufang Song

Airfoil geometric uncertainty can generate aerodynamic characteristics fluctuations. Uncertainty quantification is applied to compute its impact on the aerodynamic characteristics. In addition, the contribution of each uncertainty variable to aerodynamic characteristics should be computed by the uncertainty sensitivity analysis. In the paper, Sobol’s analysis is used for uncertainty sensitivity analysis and a nonintrusive polynomial chaos method is used for uncertainty quantification and Sobol’s analysis. It is difficult to describe geometric uncertainty because it needs a lot of input parameters. In order to alleviate the contradiction between the variable dimension and computational cost, a principal component analysis is introduced to describe geometric uncertainty of airfoil. Through this technique, the number of input uncertainty variables can be reduced and typical global deformation modes can be obtained. By uncertainty quantification, we can learn that the flow characteristics of shock wave and boundary layer separation are sensitive to the geometric uncertainty in transonic region, which is the main reason that transonic drag is sensitive to the geometric uncertainty. The sensitivity analysis shows that the model can be simplified by eliminating unimportant geometric modes. Moreover, which are the most important geometric modes to transonic aerodynamics can be learnt. This is very helpful for airfoil design.


2019 ◽  
Vol 2019 ◽  
pp. 1-19 ◽  
Author(s):  
Xiao Wei ◽  
Haichao Chang ◽  
Baiwei Feng ◽  
Zuyuan Liu

In order to truly reflect the ship performance under the influence of uncertainties, uncertainty-based design optimization (UDO) for ships that fully considers various uncertainties in the early stage of design has gradually received more and more attention. Meanwhile, it also brings high dimensionality problems, which may result in inefficient and impractical optimization. Sensitivity analysis (SA) is a feasible way to alleviate this problem, which can qualitatively or quantitatively evaluate the influence of the model input uncertainty on the model output, so that uninfluential uncertain variables can be determined for the descending dimension to achieve dimension reduction. In this paper, polynomial chaos expansions (PCE) with less computational cost are chosen to directly obtain Sobol' global sensitivity indices by its polynomial coefficients; that is, once the polynomial of the output variable is established, the analysis of the sensitivity index is only the postprocessing of polynomial coefficients. Besides, in order to further reduce the computational cost, for solving the polynomial coefficients of PCE, according to the properties of orthogonal polynomials, an improved probabilistic collocation method (IPCM) based on the linear independence principle is proposed to reduce sample points. Finally, the proposed method is applied to UDO of a bulk carrier preliminary design to ensure the robustness and reliability of the ship.


Author(s):  
Wenxuan Wang ◽  
Xiaoyi Wang

Sensitivity analysis plays an important role in quantifying the impact of input uncertainty on model response uncertainty. Through sensitivity analysis, we can grasp the crucial parameters and gain a deeper understanding of the model behavior. In this paper, an effective analytical solution for solving the variance-based global sensitivity index is proposed. Firstly, the original performance function is approximated as the sum of a series of univariate functions using the conventional dimensional reduction method (C-DRM). Then, the Taylor series expansion is used to expand the univariate function as unary linear function and unary quadratic functions. Finally, the analytical solutions of the variance-based global sensitivity index based on unary linear function and unary quadratic functions are derived respectively. The computational cost of the proposed method is completely concentrated on the calculation of the partial derivative information of the performance function with respect to each variable. As long as the partial derivative information is obtained, the variance-based global sensitivity index can be obtained directly by the proposed method without any additional computational cost. For simple explicit performance functions, the derivative information can be directly derived analytically. For complex explicit or implicit performance functions, the derivative information can be estimated by some simple numerical difference methods. Five examples are studied to investigate the accuracy and efficiency of the proposed method.


2021 ◽  
pp. 1471082X2110229
Author(s):  
D. Stasinopoulos Mikis ◽  
A. Rigby Robert ◽  
Georgikopoulos Nikolaos ◽  
De Bastiani Fernanda

A solution to the problem of having to deal with a large number of interrelated explanatory variables within a generalized additive model for location, scale and shape (GAMLSS) is given here using as an example the Greek–German government bond yield spreads from 25 April 2005 to 31 March 2010. Those were turbulent financial years, and in order to capture the spreads behaviour, a model has to be able to deal with the complex nature of the financial indicators used to predict the spreads. Fitting a model, using principal components regression of both main and first order interaction terms, for all the parameters of the assumed distribution of the response variable seems to produce promising results.


2021 ◽  
Vol 13 (2) ◽  
pp. 188
Author(s):  
Tingting Li ◽  
Irena Hajnsek ◽  
Kun-Shan Chen

Soil moisture is one of the vital environmental variables in the land–atmosphere cycle. A study of the sensitivity analysis of bistatic scattering coefficients from bare soil at the Ku-band is presented, with the aim of deepening our understanding of the bistatic scattering features and exploring its potential in soil moisture retrieval. First, a well-established advanced integral method was adopted for simulating the bistatic scattering response of bare soil. Secondly, a sensitivity index and a normalized weight quality index were proposed to evaluate the effect of soil moisture on the bistatic scattering coefficient in terms of polarization and angular diversity, and the combinations thereof. The results of single-polarized VV data show that the regions with the maximum sensitivity and high quality index, simultaneously, to soil moisture are in the forward off-specular direction. However, due to the effect of surface roughness and surface autocorrelation function (ACF), the single-polarized data have some limitations for soil moisture inversion. By contrast, the results of two different polarization combinations, as well as a dual-angular simulation of one transmitter and two receivers, show significant estimation benefits. It can be seen that they all provide better ACF suppression capabilities, larger high-sensitivity area, and higher quality indices compared to single-polarized estimation. In addition, dual polarization or dual angular combined measurement provides the possibility of retrieving soil moisture in backward regions. These results are expected to contribute to the design of future bistatic observation systems.


Author(s):  
Benjamin D. Youngman ◽  
David B. Stephenson

We develop a statistical framework for simulating natural hazard events that combines extreme value theory and geostatistics. Robust generalized additive model forms represent generalized Pareto marginal distribution parameters while a Student’s t -process captures spatial dependence and gives a continuous-space framework for natural hazard event simulations. Efficiency of the simulation method allows many years of data (typically over 10 000) to be obtained at relatively little computational cost. This makes the model viable for forming the hazard module of a catastrophe model. We illustrate the framework by simulating maximum wind gusts for European windstorms, which are found to have realistic marginal and spatial properties, and validate well against wind gust measurements.


Sign in / Sign up

Export Citation Format

Share Document