scholarly journals A Novel Embedded Feature Selection and Dimensionality Reduction Method for an SVM Type Classifier to Predict Periventricular Leukomalacia (PVL) in Neonates

2021 ◽  
Vol 11 (23) ◽  
pp. 11156
Author(s):  
Dieter Bender ◽  
Daniel J. Licht ◽  
C. Nataraj

This paper is concerned with the prediction of the occurrence of periventricular leukomalacia (PVL) in neonates after heart surgery. Our prior work shows that the Support Vector Machine (SVM) classifier can be a powerful tool in predicting clinical outcomes of such complicated and uncommon diseases, even when the number of data samples is low. In the presented work, we first illustrate and discuss the shortcomings of the traditional automatic machine learning (aML) approach. Consequently, we describe our methodology for addressing these shortcomings, while utilizing the designed interactive ML (iML) algorithm. Finally, we conclude with a discussion of the developed method and the results obtained. In sum, by adding an additional (Genetic Algorithm) optimization step in the SVM learning framework, we were able to (a) reduce the dimensionality of an SVM model from 248 to 53 features, (b) increase generalization that was confirmed by a 100% accuracy assessed on an unseen testing set, and (c) improve the overall SVM model’s performance from 65% to 100% testing accuracy, utilizing the proposed iML method.

2013 ◽  
Vol 37 (3) ◽  
pp. 467-476 ◽  
Author(s):  
Ing-Jr Ding ◽  
Chih-Ta Yen ◽  
Zih-Jheng Lin

In this paper, a fuzzy logic-based intelligent control (FLIC) scheme for support vector machine (SVM) speaker verification, called FLICSVM, is developed. The proposed FLICSVM method enhances SVM training by considering the property of training utterances for establishing the SVM model and therefore could further ensure the robustness of the SVM classifier on speaker verification. In FLICSVM, when establishing the SVM model in the training procedure, the popular fuzzy control methodology is employed to tune certain specific SVM parameter according to the prior information of SVM training utterances that is derived from Gaussian mixture model (GMM) calculations. Experimental results demonstrated that proposed FLICSVM is apparently superior to conventional SVM in the recognition accuracy.


2019 ◽  
Vol 11 (2) ◽  
pp. 512 ◽  
Author(s):  
Chao Fu ◽  
Guo-Quan Li ◽  
Kuo-Ping Lin ◽  
Hui-Juan Zhang

Renewable energy technologies are essential contributors to sustainable energy including renewable energy sources. Wind energy is one of the important renewable energy resources. Therefore, efficient and consistent utilization of wind energy has been an important issue. The wind speed has the characteristics of intermittence and instability. If the wind power is directly connected to the grid, it will impact the voltage and frequency of the power system. Short-term wind power prediction can reduce the impact of wind power on the power grid and the stability of power system operation is guaranteed. In this study, the improved chicken swarm algorithm optimization support vector machine (ICSO-SVM) model is proposed to predict the wind power. The traditional chicken swarm optimization algorithm (CSO) easily falls into a local optimum when solving high-dimensional problems due to its own characteristics. So the CSO algorithm is improved and the ICSO algorithm is developed. In order to verify the validity of the ICSO-SVM model, the following work has been done. (1) The particle swarm optimization (PSO), ICSO, CSO and differential evolution algorithm (DE) are tested respectively by four standard testing functions, and the results are compared. (2) The ICSO-SVM and CSO-SVM models are tested respectively by two sets of wind power data. This study draws the following conclusions: (1) the PSO, CSO, DE and ICSO algorithms are tested by the four standard test functions and the test data are analyzed. By comparing it with the other three optimization algorithms, the ICSO algorithm has the best convergence effect. (2) The number of training samples has an obvious impact on the prediction results. The average relative error percentage and root mean square error (RMSE) values of the ICSO model are smaller than those of CSO-SVM model. Therefore, the ICSO-SVM model can efficiently provide credible short-term predictions for wind power forecasting.


2013 ◽  
Vol 333-335 ◽  
pp. 1344-1348
Author(s):  
Yu Kai Yao ◽  
Yang Liu ◽  
Zhao Li ◽  
Xiao Yun Chen

Support Vector Machine (SVM) is one of the most popular and effective data mining algorithms which can be used to resolve classification or regression problems, and has attracted much attention these years. SVM could find the optimal separating hyperplane between classes, which afford outstanding generalization ability with it. Usually all the labeled records are used as training set. However, the optimal separating hyperplane only depends on a few crucial samples (Support Vectors, SVs), we neednt train SVM model on the whole training set. In this paper a novel SVM model based on K-means clustering is presented, in which only a small subset of the original training set is selected to constitute the final training set, and the SVM classifier is built through training on these selected samples. This greatly decrease the scale of the training set, and effectively saves the training and predicting cost of SVM, meanwhile guarantees its generalization performance.


Author(s):  
Dieter Bender ◽  
Ali Jalali ◽  
Daniel J. Licht ◽  
C. Nataraj

Prior work has documented that Support Vector Machine (SVM) classifiers can be powerful tools in predicting clinical outcomes of complex diseases such as Periventricular Leukomalacia (PVL). Our previous study showed that SVM performance can be improved significantly by optimizing the supervised training set used during the learning stage of the overall SVM algorithm. This study fully develops the initial idea using the reliable Leave-One-Out Cross-validation (LOOCV) technique. The work presented in this paper confirms previous results and improves the performance of the SVM even further. In addition, using the LOOCV technique, the computational time is decreased and the structure of the algorithm simplified, making this framework more feasible. Furthermore, we evaluate the performance of the resulting optimized SVM classifier on an unseen set of data. This demonstrates that the developed SVM algorithm outperforms normal SVM type classifiers without any loss of generalization.


2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Wenzheng Ma ◽  
Yi Cao ◽  
Wenzheng Bao ◽  
Bin Yang ◽  
Yuehui Chen

The interactions between proteins play important roles in several organisms, and such issue can be involved in almost all activities in the cell. The research of protein-protein interactions (PPIs) can make a huge contribution to the prevention and treatment of diseases. Currently, many prediction methods based on machine learning have been proposed to predict PPIs. In this article, we propose a novel method ACT-SVM that can effectively predict PPIs. The ACT-SVM model maps protein sequences to digital features, performs feature extraction twice on the protein sequence to obtain vector A and descriptor CT, and combines them into a vector. Then, the feature vectors of the protein pair are merged as the input of the support vector machine (SVM) classifier. We utilize nonredundant H. pylori and human dataset to verify the prediction performance of our method. Finally, the proposed method has a prediction accuracy of 0.727897 for H. pylori data and a prediction accuracy of 0.838799 for human dataset. The results demonstrate that this method can be called a stable and reliable prediction model of PPIs.


2021 ◽  
Vol 19 (2) ◽  
pp. 1720-1744
Author(s):  
Xiao Jian Tan ◽  
◽  
Nazahah Mustafa ◽  
Mohd Yusoff Mashor ◽  
Khairul Shakir Ab Rahman ◽  
...  

<abstract> <p>Based on the Nottingham Histopathology Grading (NHG) system, mitosis cells detection is one of the important criteria to determine the grade of breast carcinoma. Mitosis cells detection is a challenging task due to the heterogeneous microenvironment of breast histopathology images. Recognition of complex and inconsistent objects in the medical images could be achieved by incorporating domain knowledge in the field of interest. In this study, the strategies of the histopathologist and domain knowledge approach were used to guide the development of the image processing framework for automated mitosis cells detection in breast histopathology images. The detection framework starts with color normalization and hyperchromatic nucleus segmentation. Then, a knowledge-assisted false positive reduction method is proposed to eliminate the false positive (i.e., non-mitosis cells). This stage aims to minimize the percentage of false positive and thus increase the F1-score. Next, features extraction was performed. The mitosis candidates were classified using a Support Vector Machine (SVM) classifier. For evaluation purposes, the knowledge-assisted detection framework was tested using two datasets: a custom dataset and a publicly available dataset (i.e., MITOS dataset). The proposed knowledge-assisted false positive reduction method was found promising by eliminating at least 87.1% of false positive in both the dataset producing promising results in the F1-score. Experimental results demonstrate that the knowledge-assisted detection framework can achieve promising results in F1-score (custom dataset: 89.1%; MITOS dataset: 88.9%) and outperforms the recent works.</p> </abstract>


2020 ◽  
Author(s):  
Hao Li ◽  
Liqian Cui ◽  
Liping Cao ◽  
Yizhi Zhang ◽  
Yueheng Liu ◽  
...  

Abstract Background: Bipolar disorder (BPD) is a common mood disorder that is often goes misdiagnosed or undiagnosed. Recently, machine learning techniques have been combined with neuroimaging methods to aid in the diagnosis of BPD. However, most studies have focused on the construction of classifiers based on single-modality MRI. Hence, in this study, we aimed to construct a support vector machine (SVM) model using a combination of structural and functional MRI, which could be used to accurately identify patients with BPD.Methods: In total, 44 patients with BPD and 36 healthy controls were enrolled in the study. Clinical evaluation and MRI scans were performed for each subject. Next, image pre-processing, VBM and ReHo analyses were performed. The ReHo values of each subject in the clusters showing significant differences were extracted. Further, LASSO approach was recruited to screen features. Based on selected features, the SVM model was established, and discriminant analysis was performed.Results: After using the two-sample t-test with multiple comparisons, a total of 8 clusters were extracted from the data (VBM = 6; ReHo = 2). Next, we used both VBM and ReHo data to construct the new SVM classifier, which could effectively identify patients with BPD at an accuracy of 87.5% (95%CI: 72.5-95.3%), sensitivity of 86.4% (95%CI: 64.0-96.4%), and specificity of 88.9% (95%CI: 63.9-98.0%) in the test data (p=0.0022). Conclusions: A combination of structural and functional MRI can be of added value in the construction of SVM classifiers to aid in the accurate identification of BPD in the clinic.


2020 ◽  
Author(s):  
Hao Li ◽  
Liqian Cui ◽  
Liping Cao ◽  
Yizhi Zhang ◽  
Yueheng Liu ◽  
...  

Abstract Background: Bipolar disorder (BPD) is a common mood disorder that is often goes misdiagnosed or undiagnosed. Recently, machine learning techniques have been combined with neuroimaging methods to aid in the diagnosis of BPD. However, most studies have focused on the construction of classifiers based on single-modality MRI. Hence, in this study, we aimed to construct a support vector machine (SVM) model using a combination of structural and functional MRI, which could be used to accurately identify patients with BPD.Methods: In total, 44 patients with BPD and 36 healthy controls were enrolled in the study. Clinical evaluation and MRI scans were performed for each subject. Next, image pre-processing, VBM and ReHo analyses were performed. The ReHo values of each subject in the clusters showing significant differences were extracted. Further, LASSO approach was recruited to screen features. Based on selected features, the SVM model was established, and discriminant analysis was performed.Results: After using the two-sample t-test with multiple comparisons, a total of 8 clusters were extracted from the data (VBM = 6; ReHo = 2). Next, we used both VBM and ReHo data to construct the new SVM classifier, which could effectively identify patients with BPD at an accuracy of 87.5% (95%CI: 72.5-95.3%), sensitivity of 86.4% (95%CI: 64.0-96.4%), and specificity of 88.9% (95%CI: 63.9-98.0%) in the test data (p=0.0022). Limitations: The sample size was small, and we were unable to eliminate the potential effects of medications. Conclusions: A combination of structural and functional MRI can be of added value in the construction of SVM classifiers to aid in the accurate identification of BPD in the clinic.


Sign in / Sign up

Export Citation Format

Share Document