RJMIM: A New Feature Selection Method Based On Joint Mutual Information

2016 ◽  
Vol 31 (4) ◽  
Keyword(s):  
Feature Selection ◽  
Mutual Information ◽  
Feature Selection Method ◽  
Selection Method ◽  
New Feature

scholarly journals A redundancy-removing feature selection algorithm for nominal data

2015 ◽  
Vol 1 ◽  
pp. e24 ◽  
Author(s):  
Zhihua Li ◽  
Wenqu Gu
Keyword(s):  
Feature Selection ◽  
Mutual Information ◽  
Feature Selection Method ◽  
Selection Method ◽  
Selection Algorithm ◽  
Nominal Data ◽  
New Information ◽  
New Feature ◽  
High Dimensional Datasets ◽  
Experimental Comparisons

No order correlation or similarity metric exists in nominal data, and there will always be more redundancy in a nominal dataset, which means that an efficient mutual information-based nominal-data feature selection method is relatively difficult to find. In this paper, a nominal-data feature selection method based on mutual information without data transformation, called the redundancy-removing more relevance less redundancy algorithm, is proposed. By forming several new information-related definitions and the corresponding computational methods, the proposed method can compute the information-related amount of nominal data directly. Furthermore, by creating a new evaluation function that considers both the relevance and the redundancy globally, the new feature selection method can evaluate the importance of each nominal-data feature. Although the presented feature selection method takes commonly used MIFS-like forms, it is capable of handling high-dimensional datasets without expensive computations. We perform extensive experimental comparisons of the proposed algorithm and other methods using three benchmarking nominal datasets with two different classifiers. The experimental results demonstrate the average advantage of the presented algorithm over the well-known NMIFS algorithm in terms of the feature selection and classification accuracy, which indicates that the proposed method has a promising performance.

scholarly journals A redundancy-removing feature selection algorithm for nominal data

2015 ◽  
Author(s):  
Zhihua Li
Keyword(s):  
Feature Selection ◽  
Mutual Information ◽  
Feature Selection Method ◽  
Selection Method ◽  
Selection Algorithm ◽  
Nominal Data ◽  
New Information ◽  
New Feature ◽  
High Dimensional Datasets ◽  
Experimental Comparisons

No order correlation or similarity metric exists in nominal data, and there will always be more redundancy in a nominal dataset, which means that an efficient mutual information-based nominal-data feature selection method is relatively difficult to find. In this paper, a nominal-data feature selection method based on mutual information without data transformation, called the redundancy-removing more relevance less redundancy algorithm, is proposed. By forming several new information-related definitions and the corresponding computational methods, the proposed method can compute the information-related amount of nominal data directly. Furthermore, by creating a new evaluation function that considers both the relevance and the redundancy globally, the new feature selection method can evaluate the importance of each nominal-data feature. Although the presented feature selection method takes commonly used MIFS-like forms, it is capable of handling high-dimensional datasets without expensive computations. We perform extensive experimental comparisons of the proposed algorithm and other methods using three benchmarking nominal datasets with two different classifiers. The experimental results demonstrate the average advantage of the presented algorithm over the well-known NMIFS algorithm in terms of the feature selection and classification accuracy, which indicates that the proposed method has a promising performance.

scholarly journals A redundancy-removing feature selection algorithm for nominal data

2015 ◽  
Author(s):  
Zhihua Li
Keyword(s):  
Feature Selection ◽  
Mutual Information ◽  
Feature Selection Method ◽  
Selection Method ◽  
Selection Algorithm ◽  
Nominal Data ◽  
New Information ◽  
New Feature ◽  
High Dimensional Datasets ◽  
Experimental Comparisons

No order correlation or similarity metric exists in nominal data, and there will always be more redundancy in a nominal dataset, which means that an efficient mutual information-based nominal-data feature selection method is relatively difficult to find. In this paper, a nominal-data feature selection method based on mutual information without data transformation, called the redundancy-removing more relevance less redundancy algorithm, is proposed. By forming several new information-related definitions and the corresponding computational methods, the proposed method can compute the information-related amount of nominal data directly. Furthermore, by creating a new evaluation function that considers both the relevance and the redundancy globally, the new feature selection method can evaluate the importance of each nominal-data feature. Although the presented feature selection method takes commonly used MIFS-like forms, it is capable of handling high-dimensional datasets without expensive computations. We perform extensive experimental comparisons of the proposed algorithm and other methods using three benchmarking nominal datasets with two different classifiers. The experimental results demonstrate the average advantage of the presented algorithm over the well-known NMIFS algorithm in terms of the feature selection and classification accuracy, which indicates that the proposed method has a promising performance.

A lazy feature selection method for multi-label classification

2021 ◽  
Vol 25 (1) ◽  
pp. 21-34
Author(s):  
Rafael B. Pereira ◽  
Alexandre Plastino ◽  
Bianca Zadrozny ◽  
Luiz H.C. Merschmann
Keyword(s):  
Feature Selection ◽  
Text Categorization ◽  
Feature Selection Method ◽  
Selection Method ◽  
Video Classification ◽  
Classification Problems ◽  
Class Label ◽  
New Feature ◽  
Feature Selection Techniques ◽  
Biomolecular Analysis

In many important application domains, such as text categorization, biomolecular analysis, scene or video classification and medical diagnosis, instances are naturally associated with more than one class label, giving rise to multi-label classification problems. This has led, in recent years, to a substantial amount of research in multi-label classification. More specifically, feature selection methods have been developed to allow the identification of relevant and informative features for multi-label classification. This work presents a new feature selection method based on the lazy feature selection paradigm and specific for the multi-label context. Experimental results show that the proposed technique is competitive when compared to multi-label feature selection techniques currently used in the literature, and is clearly more scalable, in a scenario where there is an increasing amount of data.

A New Feature Selection Method for Enhancing Cancer Diagnosis Based on DNA Microarray

2020 ◽  
Author(s):  
Mostafa Atlam ◽  
Hanaa Torkey ◽  
Hanaa Salem ◽  
Nawal El-Fishawy
Keyword(s):  
Feature Selection ◽  
Dna Microarray ◽  
Cancer Diagnosis ◽  
Feature Selection Method ◽  
Selection Method ◽  
New Feature

Feature Selection Method Based on Mutual Information and Support Vector Machine

2021 ◽  
pp. 2150021
Author(s):  
Gang Liu ◽  
Chunlei Yang ◽  
Sen Liu ◽  
Chunbao Xiao ◽  
Bin Song
Keyword(s):  
Support Vector Machine ◽  
Feature Selection ◽  
Mutual Information ◽  
Classification Accuracy ◽  
Feature Selection Method ◽  
Selection Method ◽  
Support Vector ◽  
Svm Classifier ◽  
Standard Data ◽  
Feature Dimension

A feature selection method based on mutual information and support vector machine (SVM) is proposed in order to eliminate redundant feature and improve classification accuracy. First, local correlation between features and overall correlation is calculated by mutual information. The correlation reflects the information inclusion relationship between features, so the features are evaluated and redundant features are eliminated with analyzing the correlation. Subsequently, the concept of mean impact value (MIV) is defined and the influence degree of input variables on output variables for SVM network based on MIV is calculated. The importance weights of the features described with MIV are sorted by descending order. Finally, the SVM classifier is used to implement feature selection according to the classification accuracy of feature combination which takes MIV order of feature as a reference. The simulation experiments are carried out with three standard data sets of UCI, and the results show that this method can not only effectively reduce the feature dimension and high classification accuracy, but also ensure good robustness.

scholarly journals A New Feature Selection Method for Nominal Classifier based on Formal Concept Analysis

2017 ◽  
Vol 112 ◽  
pp. 186-194 ◽  
Author(s):  
Marwa Trabelsi ◽  
Nida Meddouri ◽  
Mondher Maddouri
Keyword(s):  
Feature Selection ◽  
Formal Concept Analysis ◽  
Feature Selection Method ◽  
Concept Analysis ◽  
Selection Method ◽  
Formal Concept ◽  
New Feature

A new feature selection method for the detection of architectural distortion in mammographic images

2016 ◽  
Author(s):  
Xiaoming Liu ◽  
Leilei Zhai ◽  
Ting Zhu ◽  
Kai Zhang
Keyword(s):  
Feature Selection ◽  
Feature Selection Method ◽  
Selection Method ◽  
Architectural Distortion ◽  
Mammographic Images ◽  
New Feature
Sign in / Sign up

Export Citation Format

Share Document