scholarly journals The impact of feature extraction and selection for the classification of gait patterns between ACL deficient and intact knees based on different classification models

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Wei Zeng ◽  
Shiek Abdullah Ismail ◽  
Evangelos Pappas
Keyword(s):  
Feature Extraction ◽  
Superior Performance ◽  
Support Vector ◽  
Svm Classifier ◽  
Classification Models ◽  
Acl Deficiency ◽  
Feature Extraction And Selection ◽  
Dynamical Features ◽  
The Impact ◽  
Acl Deficient

AbstractThe anterior cruciate ligament (ACL) plays an important role in stabilizing translation and rotation of the tibia relative to the femur. Individuals with ACL deficiency usually demonstrate alterations in gait characteristics. Evidence indicates that walking speed, alterations in kinetics and kinematics on the ACL deficient limb, and inter-limb asymmetries between deficient and intact knees may contribute to poor long-term outcomes following ACL deficiency. They corrode function of the knee joint and put it at higher risk of degeneration. For the purpose of developing an automatic and highly accurate system for detection of ACL deficiency, this study investigated the classification capability of different dynamical features extracted from gait kinematic and kinetic signals when evaluating their impact on different classification models. A general feature extraction framework was proposed and various dynamical features, such as recurrence rate, determinism and entropy from the recurrence quantification analysis, fuzzy entropy, Teager-Kaiser energy feature and statistical analysis, were included. Different classification models, including support vector machine (SVM), K-nearest neighbor (KNN), naive Bayes (NB) classifier, decision tree (DT) classifier and ensemble learning based Adaboost (ELA) classifier, derived for discriminant analysis of multiple dynamical gait features were evaluated for a comparative study. The effectiveness of this strategy was verified using a dataset of knee, hip and ankle kinematic and kinetic waveforms from 43 patients with unilateral ACL deficiency. When evaluated with 2-fold, 10-fold and leave-one-out cross-validation styles, the highest classification accuracy for discriminating between groups of ACL deficient and contralateral ACL intact knees was reported to be 91.22 $$\%$$ % , 95.12$$\%$$ % and 96.34$$\%$$ % , respectively,by using the SVM classifier and the optimal feature set. For other four classifiers, KNN achieved the accuracy of 78.05$$\%$$ % , 85.37$$\%$$ % and 87.80$$\%$$ % , respectively. NB achieved the accuracy of 57.56$$\%$$ % , 60.98$$\%$$ % and 61.22$$\%$$ % , respectively. DT achieved the accuracy of 77.56$$\%$$ % , 80.49$$\%$$ % and 83.66$$\%$$ % , respectively. ELA achieved the accuracy of 73.66$$\%$$ % , 78.05$$\%$$ % and 79.27$$\%$$ % , respectively. Compared with other state-of-the-art methods, the results demonstrate superior performance and support the validity of the proposed method.

scholarly journals Cursor Movement Detection in Brain-Computer-Interface Systems Using the Hybrid K-Means Clustering Method and LSVM

2020 ◽  
Author(s):  
Leila Mohammadi ◽  
zahra einalou ◽  
Hamidreza Hosseinzadeh ◽  
Mehrdad Dadgostar
Keyword(s):  
Feature Extraction ◽  
Clustering Algorithm ◽  
Feature Vector ◽  
Support Vector ◽  
Svm Classifier ◽  
Clustering Method ◽  
Feature Extraction And Selection ◽  
New Feature ◽  
Linear Svm ◽  
The Right

Abstract In this study, we present the detection of the up- and downward as well as the right- and leftward motion of cursor based on feature extraction. Feature Extraction and selection for finding the proper classifier among the data mining methods are of great importance. In the proposed method, the hybrid K-means clustering algorithm and the linear support vector machine (LSVM) classifier have been used for extracting the important features and detecting the cursor motion. In this algorithm, the K-means clustering method is used to recognize the available hidden patterns in each of the four modes (up, down, left, and right). The identification of these patterns can raise the accuracy of classification. The membership degree of each feature vector in the proposed new patterns is considered as a new feature vector corresponding to the previous feature vector and then, the cursor motion is detected using the linear SVM classifier. The database of the Karadeniz Technical University of Turkey has been used in the present article. Applying the proposed method for data based on the hold-up cross validation causes the accuracy of the classifier in the up- and downward and left- and rightward movements in each person to increase by 2–10%.

Protein Structural Class Prediction Based on Distance-related Statistical Features from Graphical Representation of Predicted Secondary Structure

2019 ◽  
Vol 16 (4) ◽  
pp. 317-324
Author(s):  
Liang Kong ◽  
Lichao Zhang ◽  
Xiaodong Han ◽  
Jinfeng Lv
Keyword(s):  
Feature Extraction ◽  
Secondary Structure ◽  
Protein Sequence ◽  
Function Analysis ◽  
Superior Performance ◽  
Support Vector ◽  
Chaos Game Representation ◽  
Class Prediction ◽  
Structural Class ◽  
Protein Structural Class

Protein structural class prediction is beneficial to protein structure and function analysis. Exploring good feature representation is a key step for this prediction task. Prior works have demonstrated the effectiveness of the secondary structure based feature extraction methods especially for lowsimilarity protein sequences. However, the prediction accuracies still remain limited. To explore the potential of secondary structure information, a novel feature extraction method based on a generalized chaos game representation of predicted secondary structure is proposed. Each protein sequence is converted into a 20-dimensional distance-related statistical feature vector to characterize the distribution of secondary structure elements and segments. The feature vectors are then fed into a support vector machine classifier to predict the protein structural class. Our experiments on three widely used lowsimilarity benchmark datasets (25PDB, 1189 and 640) show that the proposed method achieves superior performance to the state-of-the-art methods. It is anticipated that our method could be extended to other graphical representations of protein sequence and be helpful in future protein research.

A Structural Analysis Based Feature Extraction Method for OCR System For Myanmar Printed Document Images

2012 ◽  
Vol 2 (1) ◽  
pp. 16-41 ◽  
Author(s):  
Htwe Pa Pa Win ◽  
Phyo Thu Thu Khine ◽  
Khin Nwe Ni Tun
Keyword(s):  
Feature Extraction ◽  
Structural Analysis ◽  
Character Recognition ◽  
Optical Character Recognition ◽  
Extraction Method ◽  
Recognition Performance ◽  
Extraction Methods ◽  
Support Vector ◽  
Svm Classifier ◽  
Feature Extraction Method

This paper proposes a new feature extraction method for off-line recognition of Myanmar printed documents. One of the most important factors to achieve high recognition performance in Optical Character Recognition (OCR) system is the selection of the feature extraction methods. Different types of existing OCR systems used various feature extraction methods because of the diversity of the scripts’ natures. One major contribution of the work in this paper is the design of logically rigorous coding based features. To show the effectiveness of the proposed method, this paper assumed the documents are successfully segmented into characters and extracted features from these isolated Myanmar characters. These features are extracted using structural analysis of the Myanmar scripts. The experimental results have been carried out using the Support Vector Machine (SVM) classifier and compare the pervious proposed feature extraction method.

scholarly journals Aircraft Type Recognition in Remote Sensing Images Based on Feature Learning with Conditional Generative Adversarial Networks

2018 ◽  
Vol 10 (7) ◽  
pp. 1123 ◽  
Author(s):  
Yuhang Zhang ◽  
Hao Sun ◽  
Jiawei Zuo ◽  
Hongqi Wang ◽  
Guangluan Xu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Extraction ◽  
Loss Function ◽  
Extraction Method ◽  
Generative Adversarial Networks ◽  
Support Vector ◽  
Svm Classifier ◽  
Feature Extraction Method ◽  
Adversarial Networks ◽  
Aircraft Type

Aircraft type recognition plays an important role in remote sensing image interpretation. Traditional methods suffer from bad generalization performance, while deep learning methods require large amounts of data with type labels, which are quite expensive and time-consuming to obtain. To overcome the aforementioned problems, in this paper, we propose an aircraft type recognition framework based on conditional generative adversarial networks (GANs). First, we design a new method to precisely detect aircrafts’ keypoints, which are used to generate aircraft masks and locate the positions of the aircrafts. Second, a conditional GAN with a region of interest (ROI)-weighted loss function is trained on unlabeled aircraft images and their corresponding masks. Third, an ROI feature extraction method is carefully designed to extract multi-scale features from the GAN in the regions of aircrafts. After that, a linear support vector machine (SVM) classifier is adopted to classify each sample using their features. Benefiting from the GAN, we can learn features which are strong enough to represent aircrafts based on a large unlabeled dataset. Additionally, the ROI-weighted loss function and the ROI feature extraction method make the features more related to the aircrafts rather than the background, which improves the quality of features and increases the recognition accuracy significantly. Thorough experiments were conducted on a challenging dataset, and the results prove the effectiveness of the proposed aircraft type recognition framework.

scholarly journals Deep Learning Assisted Neonatal Cry Classification via Support Vector Machine Models

2021 ◽  
Vol 9 ◽  
Author(s):  
Ashwini K ◽  
P. M. Durai Raj Vincent ◽  
Kathiravan Srinivasan ◽  
Chuan-Yu Chang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Support Vector ◽  
Svm Classifier ◽  
Infant Cry ◽  
Learning Techniques

Neonatal infants communicate with us through cries. The infant cry signals have distinct patterns depending on the purpose of the cries. Preprocessing, feature extraction, and feature selection need expert attention and take much effort in audio signals in recent days. In deep learning techniques, it automatically extracts and selects the most important features. For this, it requires an enormous amount of data for effective classification. This work mainly discriminates the neonatal cries into pain, hunger, and sleepiness. The neonatal cry auditory signals are transformed into a spectrogram image by utilizing the short-time Fourier transform (STFT) technique. The deep convolutional neural network (DCNN) technique takes the spectrogram images for input. The features are obtained from the convolutional neural network and are passed to the support vector machine (SVM) classifier. Machine learning technique classifies neonatal cries. This work combines the advantages of machine learning and deep learning techniques to get the best results even with a moderate number of data samples. The experimental result shows that CNN-based feature extraction and SVM classifier provides promising results. While comparing the SVM-based kernel techniques, namely radial basis function (RBF), linear and polynomial, it is found that SVM-RBF provides the highest accuracy of kernel-based infant cry classification system provides 88.89% accuracy.

scholarly journals Persian Handwritten Digit Recognition Using Combination of Convolutional Neural Network and Support Vector Machine Methods

2020 ◽  
Vol 17 (4) ◽  
pp. 572-578
Author(s):  
Mohammad Parseh ◽  
Mohammad Rahmanimanesh ◽  
Parviz Keshavarzi
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Feature Extraction ◽  
Convolutional Neural Network ◽  
Recognition Rate ◽  
Support Vector ◽  
Svm Classifier ◽  
Handwritten Digit Recognition ◽  
Digit Recognition ◽  
Handwritten Digit

Persian handwritten digit recognition is one of the important topics of image processing which significantly considered by researchers due to its many applications. The most important challenges in Persian handwritten digit recognition is the existence of various patterns in Persian digit writing that makes the feature extraction step to be more complicated.Since the handcraft feature extraction methods are complicated processes and their performance level are not stable, most of the recent studies have concentrated on proposing a suitable method for automatic feature extraction. In this paper, an automatic method based on machine learning is proposed for high-level feature extraction from Persian digit images by using Convolutional Neural Network (CNN). After that, a non-linear multi-class Support Vector Machine (SVM) classifier is used for data classification instead of fully connected layer in final layer of CNN. The proposed method has been applied to HODA dataset and obtained 99.56% of recognition rate. Experimental results are comparable with previous state-of-the-art methods

scholarly journals Color–Texture Pattern Classification Using Global–Local Feature Extraction, an SVM Classifier, with Bagging Ensemble Post-Processing

2019 ◽  
Vol 9 (15) ◽  
pp. 3130 ◽  
Author(s):  
Navarro ◽  
Perez
Keyword(s):  
Feature Extraction ◽  
Pattern Classification ◽  
Texture Classification ◽  
Support Vector ◽  
Svm Classifier ◽  
Post Processing ◽  
Image Partition ◽  
Global And Local ◽  
Bagging Ensemble ◽  
Color Texture

Many applications in image analysis require the accurate classification of complex patterns including both color and texture, e.g., in content image retrieval, biometrics, and the inspection of fabrics, wood, steel, ceramics, and fruits, among others. A new method for pattern classification using both color and texture information is proposed in this paper. The proposed method includes the following steps: division of each image into global and local samples, texture and color feature extraction from samples using a Haralick statistics and binary quaternion-moment-preserving method, a classification stage using support vector machine, and a final stage of post-processing employing a bagging ensemble. One of the main contributions of this method is the image partition, allowing image representation into global and local features. This partition captures most of the information present in the image for colored texture classification allowing improved results. The proposed method was tested on four databases extensively used in color–texture classification: the Brodatz, VisTex, Outex, and KTH-TIPS2b databases, yielding correct classification rates of 97.63%, 97.13%, 90.78%, and 92.90%, respectively. The use of the post-processing stage improved those results to 99.88%, 100%, 98.97%, and 95.75%, respectively. We compared our results to the best previously published results on the same databases finding significant improvements in all cases.

Kernel Optimized-Support Vector Machine and MapReduce Framework for Sentiment Classification of Train Reviews

2019 ◽  
Vol 27 (06) ◽  
pp. 1025-1050
Author(s):  
Rashmi K. Thakur ◽  
Manojkumar V. Deshpande
Keyword(s):  
Support Vector Machine ◽  
Feature Extraction ◽  
Public Transportation ◽  
Extraction Process ◽  
Sentiment Classification ◽  
Support Vector ◽  
Svm Classifier ◽  
Mapreduce Framework ◽  
Mapreduce Model

Sentiment analysis is one of the popular techniques gaining attention in recent times. Nowadays, people gain information on reviews of users regarding public transportation, movies, hotel reservation, etc., by utilizing the resources available, as they meet their needs. Hence, sentiment classification is an essential process employed to determine the positive and negative responses. This paper presents an approach for sentiment classification of train reviews using MapReduce model with the proposed Kernel Optimized-Support Vector Machine (KO-SVM) classifier. The MapReduce framework handles big data using a mapper, which performs feature extraction and reducer that classifies the review based on KO-SVM classification. The feature extraction process utilizes features that are classification-specific and SentiWordNet-based. KO-SVM adopts SVM for the classification, where the exponential kernel is replaced by an optimized kernel, finding the weights using a novel optimizer, Self-adaptive Lion Algorithm (SLA). In a comparative analysis, the performance of KO-SVM classifier is compared with SentiWordNet, NB, NN, and LSVM, using the evaluation metrics, specificity, sensitivity, and accuracy, with train review and movie review database. The proposed KO-SVM classifier could attain maximum sensitivity of 93.46% and 91.249% specificity of 74.485% and 70.018%; and accuracy of 84.341% and 79.611% respectively, for train review and movie review databases.

Automated brain tumor segmentation from multimodal MRI data based on Tamura texture feature and an ensemble SVM classifier

2019 ◽  
Vol 12 (4) ◽  
pp. 466-480
Author(s):  
Li Na ◽  
Xiong Zhiyong ◽  
Deng Tianqi ◽  
Ren Kai
Keyword(s):  
Brain Tumor ◽  
Brain Tumors ◽  
Superior Performance ◽  
Support Vector ◽  
Svm Classifier ◽  
Data Set ◽  
Original Solution ◽  
Content Type ◽  
Tumor Region ◽  
The Brain

Purpose The precise segmentation of brain tumors is the most important and crucial step in their diagnosis and treatment. Due to the presence of noise, uneven gray levels, blurred boundaries and edema around the brain tumor region, the brain tumor image has indistinct features in the tumor region, which pose a problem for diagnostics. The paper aims to discuss these issues. Design/methodology/approach In this paper, the authors propose an original solution for segmentation using Tamura Texture and ensemble Support Vector Machine (SVM) structure. In the proposed technique, 124 features of each voxel are extracted, including Tamura texture features and grayscale features. Then, these features are ranked using the SVM-Recursive Feature Elimination method, which is also adopted to optimize the parameters of the Radial Basis Function kernel of SVMs. Finally, the bagging random sampling method is utilized to construct the ensemble SVM classifier based on a weighted voting mechanism to classify the types of voxel. Findings The experiments are conducted over a sample data set to be called BraTS2015. The experiments demonstrate that Tamura texture is very useful in the segmentation of brain tumors, especially the feature of line-likeness. The superior performance of the proposed ensemble SVM classifier is demonstrated by comparison with single SVM classifiers as well as other methods. Originality/value The authors propose an original solution for segmentation using Tamura Texture and ensemble SVM structure.

scholarly journals A Comparative Study of Indian Food Image Classification Using K-Nearest-Neighbour and Support-Vector-Machines

2018 ◽  
Vol 7 (3.12) ◽  
pp. 521 ◽  
Author(s):  
Pathanjali C ◽  
Vimuktha E Salis ◽  
Jalaja G ◽  
Latha A
Keyword(s):  
Comparative Study ◽  
Detection System ◽  
Experimental Result ◽  
Support Vector ◽  
Svm Classifier ◽  
Nearest Neighbour ◽  
Classification Models ◽  
Food Detection ◽  
Knn Classifier ◽  
Indian Food

Food being the vital part of everyone’s lives, food detection and recognition becomes an interesting and challenging problem in computer vision and image processing. In this paper we mainly propose an automatic food detection system that detects and recognises varieties of Indian food. This paper uses a combined colour and shape features. The K-Nearest-Neighbour (KNN) and Support-Vector -Machine (SVM) classification models are used to classify the features. A comparative study on the performance of both the classification models is performed. The experimental result shows the higher efficiency of SVM classifier over KNN classifier. 

Sign in / Sign up

Export Citation Format

Share Document