Robust multiobjective evolutionary feature subset selection algorithm for binary classification using machine learning techniques

2017 ◽  
Vol 241 ◽  
pp. 128-146 ◽  
Author(s):  
Ayça Deniz ◽  
Hakan Ezgi Kiziloz ◽  
Tansel Dokeroglu ◽  
Ahmet Cosar
Keyword(s):  
Machine Learning ◽  
Binary Classification ◽  
Subset Selection ◽  
Feature Subset Selection ◽  
Machine Learning Techniques ◽  
Feature Subset ◽  
Selection Algorithm ◽  
Learning Techniques

Machine Learning Techniques to Predict Software Defect

2014 ◽  
pp. 1422-1434 ◽  
Author(s):  
Ramakanta Mohanty ◽  
Vadlamani Ravi
Keyword(s):  
Machine Learning ◽  
Feature Subset Selection ◽  
Machine Learning Techniques ◽  
Group Method ◽  
Software Project ◽  
Feature Subset ◽  
Software Defects ◽  
Software Defect ◽  
Learning Techniques ◽  
Sensitivity Specificity

The past 10 years have seen the prediction of software defects proposed by many researchers using various metrics based on measurable aspects of source code entities (e.g. methods, classes, files or modules) and the social structure of software project in an effort to predict the software defects. However, these metrics could not predict very high accuracies in terms of sensitivity, specificity and accuracy. In this chapter, we propose the use of machine learning techniques to predict software defects. The effectiveness of all these techniques is demonstrated on ten datasets taken from literature. Based on an experiment, it is observed that PNN outperformed all other techniques in terms of accuracy and sensitivity in all the software defects datasets followed by CART and Group Method of data handling. We also performed feature selection by t-statistics based approach for selecting feature subsets across different folds for a given technique and followed by the feature subset selection. By taking the most important variables, we invoked the classifiers again and observed that PNN outperformed other classifiers in terms of sensitivity and accuracy. Moreover, the set of ‘if- then rules yielded by J48 and CART can be used as an expert system for prediction of software defects.

scholarly journals SVM and KNN Based SGO Feature Selection Algorithm for Breast Cancer Diagnosis

2020 ◽  
Vol 8 (2S7) ◽  
pp. 2237-2240
Keyword(s):  
Breast Cancer ◽  
Machine Learning ◽  
Feature Selection ◽  
Learning Algorithms ◽  
Subset Selection ◽  
Machine Learning Algorithms ◽  
Feature Subset Selection ◽  
Feature Subset ◽  
Selection Algorithm ◽  
Feature Selection Algorithm

In diagnosis and prediction systems, algorithms working on datasets with a high number of dimensions tend to take more time than those with fewer dimensions. Feature subset selection algorithms enhance the efficiency of Machine Learning algorithms in prediction problems by selecting a subset of the total features and thus pruning redundancy and noise. In this article, such a feature subset selection method is proposed and implemented to diagnose breast cancer using Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) algorithms. This feature selection algorithm is based on Social Group Optimization (SGO) an evolutionary algorithm. Higher accuracy in diagnosing breast cancer is achieved using our proposed model when compared to other feature selection-based Machine Learning algorithms

A conservative feature subset selection algorithm with missing data

2010 ◽  
Vol 73 (4-6) ◽  
pp. 585-590 ◽  
Author(s):  
Alex Aussem ◽  
Sergio Rodrigues de Morais
Keyword(s):  
Missing Data ◽  
Subset Selection ◽  
Feature Subset Selection ◽  
Feature Subset ◽  
Selection Algorithm

Improved Intrusion Detection Algorithm based on TLBO and GA Algorithms

2021 ◽  
Vol 18 (2) ◽  
Keyword(s):  
Machine Learning ◽  
Intrusion Detection ◽  
Optimization Algorithm ◽  
Feature Subset Selection ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Feature Subset ◽  
Teaching Learning Based Optimization ◽  
Teaching Learning

Optimization algorithms are widely used for the identification of intrusion. This is attributable to the increasing number of audit data features and the decreasing performance of human-based smart Intrusion Detection Systems (IDS) regarding classification accuracy and training time. In this paper, an improved method for intrusion detection for binary classification was presented and discussed in detail. The proposed method combined the New Teaching-Learning-Based Optimization Algorithm (NTLBO), Support Vector Machine (SVM), Extreme Learning Machine (ELM), and Logistic Regression (LR) (feature selection and weighting) NTLBO algorithm with supervised machine learning techniques for Feature Subset Selection (FSS). The process of selecting the least number of features without any effect on the result accuracy in FSS was considered a multi-objective optimization problem. The NTLBO was proposed in this paper as an FSS mechanism; its algorithm-specific, parameter-less concept (which requires no parameter tuning during an optimization) was explored. The experiments were performed on the prominent intrusion machine-learning datasets (KDDCUP’99 and CICIDS 2017), where significant enhancements were observed with the suggested NTLBO algorithm as compared to the classical Teaching-Learning-Based Optimization algorithm (TLBO), NTLBO presented better results than TLBO and many existing works. The results showed that NTLBO reached 100% accuracy for KDDCUP’99 dataset and 97% for CICIDS dataset

A novel Markov boundary based feature subset selection algorithm

2010 ◽  
Vol 73 (4-6) ◽  
pp. 578-584 ◽  
Author(s):  
Sérgio Rodrigues de Morais ◽  
Alex Aussem
Keyword(s):  
Subset Selection ◽  
Feature Subset Selection ◽  
Feature Subset ◽  
Selection Algorithm

The feature subset selection algorithm

2003 ◽  
Vol 20 (1) ◽  
pp. 57-61
Author(s):  
Yongguo Liu ◽  
Xueming Li ◽  
Zhongfu Wu
Keyword(s):  
Subset Selection ◽  
Feature Subset Selection ◽  
Feature Subset ◽  
Selection Algorithm

scholarly journals Predicting Takeover Success Using Machine Learning Techniques

2012 ◽  
Vol 10 (10) ◽  
pp. 547
Author(s):  
Mei Zhang ◽  
Gregory Johnson ◽  
Jia Wang
Keyword(s):  
Machine Learning ◽  
Learning Community ◽  
Binary Classification ◽  
Classification Problem ◽  
Machine Learning Techniques ◽  
Success Prediction ◽  
Support Vector ◽  
Font Size ◽  
Network Support ◽  
Learning Techniques

<span style="font-family: Times New Roman; font-size: small;"> </span><p style="margin: 0in 0.5in 0pt; text-align: justify; mso-pagination: none; mso-layout-grid-align: none;" class="MsoNormal"><span style="color: black; font-size: 10pt; mso-themecolor: text1;"><span style="font-family: Times New Roman;">A takeover success prediction model aims at predicting the probability that a takeover attempt will succeed by using publicly available information at the time of the announcement.<span style="mso-spacerun: yes;"> </span>We perform a thorough study using machine learning techniques to predict takeover success.<span style="mso-spacerun: yes;"> </span>Specifically, we model takeover success prediction as a binary classification problem, which has been widely studied in the machine learning community.<span style="mso-spacerun: yes;"> </span>Motivated by the recent advance in machine learning, we empirically evaluate and analyze many state-of-the-art classifiers, including logistic regression, artificial neural network, support vector machines with different kernels, decision trees, random forest, and Adaboost.<span style="mso-spacerun: yes;"> </span>The experiments validate the effectiveness of applying machine learning in takeover success prediction, and we found that the support vector machine with linear kernel and the Adaboost with stump weak classifiers perform the best for the task.<span style="mso-spacerun: yes;"> </span>The result is consistent with the general observations of these two approaches.</span></span></p><span style="font-family: Times New Roman; font-size: small;"> </span>

Sign in / Sign up

Export Citation Format

Share Document