scholarly journals Task-driven assessment of experimental designs in diffusion MRI: A computational framework

PLoS ONE ◽  
2021 ◽  
Vol 16 (10) ◽  
pp. e0258442
Author(s):  
Sean C. Epstein ◽  
Timothy J. P. Bray ◽  
Margaret A. Hall-Craggs ◽  
Hui Zhang

This paper proposes a task-driven computational framework for assessing diffusion MRI experimental designs which, rather than relying on parameter-estimation metrics, directly measures quantitative task performance. Traditional computational experimental design (CED) methods may be ill-suited to experimental tasks, such as clinical classification, where outcome does not depend on parameter-estimation accuracy or precision alone. Current assessment metrics evaluate experiments’ ability to faithfully recover microstructural parameters rather than their task performance. The method we propose addresses this shortcoming. For a given MRI experimental design (protocol, parameter-estimation method, model, etc.), experiments are simulated start-to-finish and task performance is computed from receiver operating characteristic (ROC) curves and associated summary metrics (e.g. area under the curve (AUC)). Two experiments were performed: first, a validation of the pipeline’s task performance predictions against clinical results, comparing in-silico predictions to real-world ROC/AUC; and second, a demonstration of the pipeline’s advantages over traditional CED approaches, using two simulated clinical classification tasks. Comparison with clinical datasets validates our method’s predictions of (a) the qualitative form of ROC curves, (b) the relative task performance of different experimental designs, and (c) the absolute performance (AUC) of each experimental design. Furthermore, we show that our method outperforms traditional task-agnostic assessment methods, enabling improved, more useful experimental design. Our pipeline produces accurate, quantitative predictions of real-world task performance. Compared to current approaches, such task-driven assessment is more likely to identify experimental designs that perform well in practice. Our method is not limited to diffusion MRI; the pipeline generalises to any task-based quantitative MRI application, and provides the foundation for developing future task-driven end-to end CED frameworks.

2021 ◽  
Vol 16 (2) ◽  
pp. 1-30
Author(s):  
Juan I. G. Hidalgo ◽  
Silas G. T. C. Santos ◽  
Roberto S. M. Barros

A data stream can be defined as a system that continually generates a lot of data over time. Today, processing data streams requires new demands and challenging tasks in the data mining and machine learning areas. Concept Drift is a problem commonly characterized as changes in the distribution of the data within a data stream. The implementation of new methods for dealing with data streams where concept drifts occur requires algorithms that can adapt to several scenarios to improve its performance in the different experimental situations where they are tested. This research proposes a strategy for dynamic parameter adjustment in the presence of concept drifts. Parameter Estimation Procedure (PEP) is a general method proposed for dynamically adjusting parameters which is applied to the diversity parameter (λ) of several classification ensembles commonly used in the area. To this end, the proposed estimation method (PEP) was used to create Boosting-like Online Learning Ensemble with Parameter Estimation (BOLE-PE), Online AdaBoost-based M1 with Parameter Estimation (OABM1-PE), and Oza and Russell’s Online Bagging with Parameter Estimation (OzaBag-PE), based on the existing ensembles BOLE, OABM1, and OzaBag, respectively. To validate them, experiments were performed with artificial and real-world datasets using Hoeffding Tree (HT) as base classifier. The accuracy results were statistically evaluated using a variation of the Friedman test and the Nemenyi post-hoc test. The experimental results showed that the application of the dynamic estimation in the diversity parameter (λ) produced good results in most scenarios, i.e., the modified methods have improved accuracy in the experiments with both artificial and real-world datasets.


SAGE Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 215824402110269
Author(s):  
Lang Liang

The Bass model is the most popular model for forecasting the diffusion process of a new product. However, the controlling parameters in it are unknown in practice and need to be determined in advance. Currently, the estimation of the controlling parameters has been approached by various techniques. In this case, a novel optimization-based parameter estimation (OPE) method for the Bass model is proposed in the theoretical framework of system dynamics ( SD). To do this, the SD model of the Bass differential equation is first established and then the corresponding optimization mathematical model is formulated by introducing the controlling parameters as design variable and the discrepancy of the adopter function to the reference value as objective function. Using the VENSIM software, the present SD optimization model is solved, and its effectiveness and accuracy are demonstrated by two examples: one involves the exact solution and another is related to the actual user diffusion problem from Chinese Mobile. The results show that the present OPE method can produce higher predicting accuracy of the controlling parameters than the nonlinear weighted least squares method and the genetic algorithms. Moreover, the reliability interval of the estimated parameters and the goodness of fitting of the optimal results are given as well to further demonstrate the accuracy of the present OPE method.


2021 ◽  
Vol 13 (7) ◽  
pp. 168781402110277
Author(s):  
Yankai Hou ◽  
Zhaosheng Zhang ◽  
Peng Liu ◽  
Chunbao Song ◽  
Zhenpo Wang

Accurate estimation of the degree of battery aging is essential to ensure safe operation of electric vehicles. In this paper, using real-world vehicles and their operational data, a battery aging estimation method is proposed based on a dual-polarization equivalent circuit (DPEC) model and multiple data-driven models. The DPEC model and the forgetting factor recursive least-squares method are used to determine the battery system’s ohmic internal resistance, with outliers being filtered using boxplots. Furthermore, eight common data-driven models are used to describe the relationship between battery degradation and the factors influencing this degradation, and these models are analyzed and compared in terms of both estimation accuracy and computational requirements. The results show that the gradient descent tree regression, XGBoost regression, and light GBM regression models are more accurate than the other methods, with root mean square errors of less than 6.9 mΩ. The AdaBoost and random forest regression models are regarded as alternative groups because of their relative instability. The linear regression, support vector machine regression, and k-nearest neighbor regression models are not recommended because of poor accuracy or excessively high computational requirements. This work can serve as a reference for subsequent battery degradation studies based on real-time operational data.


Water ◽  
2021 ◽  
Vol 13 (15) ◽  
pp. 2092
Author(s):  
Songbai Song ◽  
Yan Kang ◽  
Xiaoyan Song ◽  
Vijay P. Singh

The choice of a probability distribution function and confidence interval of estimated design values have long been of interest in flood frequency analysis. Although the four-parameter exponential gamma (FPEG) distribution has been developed for application in hydrology, its maximum likelihood estimation (MLE)-based parameter estimation method and asymptotic variance of its quantiles have not been well documented. In this study, the MLE method was used to estimate the parameters and confidence intervals of quantiles of the FPEG distribution. This method entails parameter estimation and asymptotic variances of quantile estimators. The parameter estimation consisted of a set of four equations which, after algebraic simplification, were solved using a three dimensional Levenberg-Marquardt algorithm. Based on sample information matrix and Fisher’s expected information matrix, derivatives of the design quantile with respect to the parameters were derived. The method of estimation was applied to annual precipitation data from the Weihe watershed, China and confidence intervals for quantiles were determined. Results showed that the FPEG was a good candidate to model annual precipitation data and can provide guidance for estimating design values


2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Jian-wei Yang ◽  
Man-feng Dou ◽  
Zhi-yong Dai

Taking advantage of the high reliability, multiphase permanent magnet synchronous motors (PMSMs), such as five-phase PMSM and six-phase PMSM, are widely used in fault-tolerant control applications. And one of the important fault-tolerant control problems is fault diagnosis. In most existing literatures, the fault diagnosis problem focuses on the three-phase PMSM. In this paper, compared to the most existing fault diagnosis approaches, a fault diagnosis method for Interturn short circuit (ITSC) fault of five-phase PMSM based on the trust region algorithm is presented. This paper has two contributions. (1) Analyzing the physical parameters of the motor, such as resistances and inductances, a novel mathematic model for ITSC fault of five-phase PMSM is established. (2) Introducing an object function related to the Interturn short circuit ratio, the fault parameters identification problem is reformulated as the extreme seeking problem. A trust region algorithm based parameter estimation method is proposed for tracking the actual Interturn short circuit ratio. The simulation and experimental results have validated the effectiveness of the proposed parameter estimation method.


2010 ◽  
Vol 118-120 ◽  
pp. 601-605
Author(s):  
Han Ming

Evaluation method of reliability parameter estimation needs to be improved effectively with the advance of science and technology. This paper develops a new method of parameter estimation, which is named E-Bayesian estimation method. In the case one hyper-parameter, the definition of E-Bayesian estimation of the failure probability is provided, moreover, the formulas of E-Bayesian estimation and hierarchical Bayesian estimation, and the property of E-Bayesian estimation of the failure probability are also provided. Finally, calculation on practical problems shows that the provided method is feasible and easy to perform.


Sign in / Sign up

Export Citation Format

Share Document