The Prediction of Diatom Abundance by Comparison of Various Machine Learning Methods

This study adopts two approaches to analyze the occurrence of algae at Haman Weir for Nakdong River; one is the traditional statistical method, such as logistic regression, while the other is machine learning technique, such as kNN, ANN, RF, Bagging, Boosting, and SVM. In order to compare the performance of the models, this study measured the accuracy, specificity, sensitivity, and AUC, which are representative model evaluation tools. The ROC curve is created by plotting association of sensitivity and (1-specificity). The AUC that is area of ROC curve represents sensitivity and specificity. This measure has two competitive advantages compared to other evaluation tools. One is that it is scale-invariant. It means that purpose of AUC is how well the model predicts. The other is that the AUC is classification-threshold-invariant. It shows that the AUC is independent of threshold because it is plotted association of sensitivity and (1-specificity) obtained by threshold. We chose AUC as a final model evaluation tool with two advantages. Also, variable selection was conducted using the Boruta algorithm. In addition, we tried to distinguish the better model by comparing the model with the variable selection method and the model without the variable selection method. As a result of the analysis, Boruta algorithm as a variable selection method suggested PO4-P, DO, BOD, NH3-N, Susp, pH, TOC, Temp, TN, and TP as significant explanatory variables. A comparison was made between the model with and without these selected variables. Among the models without variable selection method, the accuracy of RF analysis was highest, and ANN analysis showed the highest AUC. In conclusion, ANN analysis using the variable selection method showed the best performance among the models with and without variable selection method.

Download Full-text

Variable Selection Method Based on Partial Mutual Information and Its Application to NOx Emission Prediction

2020 39th Chinese Control Conference (CCC) ◽

10.23919/ccc50068.2020.9189070 ◽

2020 ◽

Author(s):

QIN Tianmu ◽

ZHANG Jinzhe ◽

YOU Mo ◽

YANG Tingting

Keyword(s):

Mutual Information ◽

Variable Selection ◽

Selection Method ◽

Nox Emission ◽

Variable Selection Method

Download Full-text

Predictive and Descriptive CoMFA Models: The Effect of Variable Selection

Combinatorial Chemistry & High Throughput Screening ◽

10.2174/1386207321666180212162028 ◽

2018 ◽

Vol 21 (2) ◽

pp. 117-124 ◽

Cited By ~ 4

Author(s):

Bakhtyar Sepehri ◽

Nematollah Omidikia ◽

Mohsen Kompany-Zareh ◽

Raouf Ghavami

Keyword(s):

Variable Selection ◽

Predictive Power ◽

Selection Method ◽

Data Sets ◽

Data Set ◽

Comfa Model ◽

Variable Selection Method

Aims & Scope: In this research, 8 variable selection approaches were used to investigate the effect of variable selection on the predictive power and stability of CoMFA models. Materials & Methods: Three data sets including 36 EPAC antagonists, 79 CD38 inhibitors and 57 ATAD2 bromodomain inhibitors were modelled by CoMFA. First of all, for all three data sets, CoMFA models with all CoMFA descriptors were created then by applying each variable selection method a new CoMFA model was developed so for each data set, 9 CoMFA models were built. Obtained results show noisy and uninformative variables affect CoMFA results. Based on created models, applying 5 variable selection approaches including FFD, SRD-FFD, IVE-PLS, SRD-UVEPLS and SPA-jackknife increases the predictive power and stability of CoMFA models significantly. Result & Conclusion: Among them, SPA-jackknife removes most of the variables while FFD retains most of them. FFD and IVE-PLS are time consuming process while SRD-FFD and SRD-UVE-PLS run need to few seconds. Also applying FFD, SRD-FFD, IVE-PLS, SRD-UVE-PLS protect CoMFA countor maps information for both fields.

Download Full-text

Performance of smoothly clipped absolute deviation as a variable selection method in the artificial neural network‐based QSAR studies

Journal of Chemometrics ◽

10.1002/cem.3338 ◽

2021 ◽

Author(s):

Zeinab Mozafari ◽

Mansour Arab Chamjangali ◽

Mohammad Arashi ◽

Nasser Goudarzi

Keyword(s):

Neural Network ◽

Artificial Neural Network ◽

Variable Selection ◽

Selection Method ◽

Absolute Deviation ◽

Qsar Studies ◽

Variable Selection Method ◽

Smoothly Clipped Absolute Deviation ◽

Artificial Neural

Download Full-text

Variable Selection in the Regularized Simultaneous Component Analysis Method for Multi-Source Data Integration

Scientific Reports ◽

10.1038/s41598-019-54673-2 ◽

2019 ◽

Vol 9 (1) ◽

Cited By ~ 1

Author(s):

Zhengguo Gu ◽

Niek C. de Schipper ◽

Katrijn Van Deun

Keyword(s):

Variable Selection ◽

Data Integration ◽

Component Analysis ◽

Selection Method ◽

Gps Data ◽

Positioning Systems ◽

Variable Selection Method ◽

Diary Data ◽

Simultaneous Component Analysis ◽

Travel Diary

AbstractInterdisciplinary research often involves analyzing data obtained from different data sources with respect to the same subjects, objects, or experimental units. For example, global positioning systems (GPS) data have been coupled with travel diary data, resulting in a better understanding of traveling behavior. The GPS data and the travel diary data are very different in nature, and, to analyze the two types of data jointly, one often uses data integration techniques, such as the regularized simultaneous component analysis (regularized SCA) method. Regularized SCA is an extension of the (sparse) principle component analysis model to the cases where at least two data blocks are jointly analyzed, which - in order to reveal the joint and unique sources of variation - heavily relies on proper selection of the set of variables (i.e., component loadings) in the components. Regularized SCA requires a proper variable selection method to either identify the optimal values for tuning parameters or stably select variables. By means of two simulation studies with various noise and sparseness levels in simulated data, we compare six variable selection methods, which are cross-validation (CV) with the “one-standard-error” rule, repeated double CV (rdCV), BIC, Bolasso with CV, stability selection, and index of sparseness (IS) - a lesser known (compared to the first five methods) but computationally efficient method. Results show that IS is the best-performing variable selection method.

Download Full-text