scholarly journals Sound Classification Based on Multihead Attention and Support Vector Machine

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Lei Yang ◽  
Hongdong Zhao
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Classification Systems ◽  
Support Vector ◽  
Small Scale ◽  
Sound Classification ◽  
Comparable Performance ◽  
Public Datasets ◽  
Recurrent Architecture ◽  
The Impact

Sound classification is a broad area of research that has gained much attention in recent years. The sound classification systems based on recurrent neural networks (RNNs) and convolutional neural networks (CNNs) have undergone significant enhancements in the recognition capability of models. However, their computational complexity and inadequate exploration of global dependencies for long sequences restrict improvements in their classification results. In this paper, we show that there are still opportunities to improve the performance of sound classification by substituting the recurrent architecture with the parallel processing structure in the feature extraction. In light of the small-scale and high-dimension sound datasets, we propose the use of the multihead attention and support vector machine (SVM) for sound taxonomy. The multihead attention is taken as the feature extractor to obtain salient features, and SVM is taken as the classifier to recognize all categories. Extensive experiments are conducted across three acoustically characterized public datasets, UrbanSound8K, GTZAN, and IEMOCAP, by using two commonly used audio spectrograms as inputs, respectively, and we fully evaluate the impact of parameters and feature types on classification accuracy. Our results suggest that the proposed model can reach comparable performance with existing methods and reveal its strong generalization ability of sound taxonomy.

scholarly journals Authorship Identification of a Russian-Language Text Using Support Vector Machine and Deep Neural Networks

2020 ◽  
Vol 13 (1) ◽  
pp. 3
Author(s):  
Aleksandr Romanov ◽  
Anna Kurtukova ◽  
Alexander Shelupanov ◽  
Anastasia Fedotova ◽  
Valery Goncharov
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Deep Neural Networks ◽  
Educational Process ◽  
Russian Language ◽  
Support Vector ◽  
Plagiarism Detection ◽  
Authorship Identification ◽  
The Impact ◽  
Language Text

The article explores approaches to determining the author of a natural language text and the advantages and disadvantages of these approaches. The importance of the considered problem is due to the active digitalization of society and reassignment of most parts of the life activities online. Text authorship methods are particularly useful for information security and forensics. For example, such methods can be used to identify authors of suicide notes, and other texts are subjected to forensic examinations. Another area of application is plagiarism detection. Plagiarism detection is a relevant issue both for the field of intellectual property protection in the digital space and for the educational process. The article describes identifying the author of the Russian-language text using support vector machine (SVM) and deep neural network architectures (long short-term memory (LSTM), convolutional neural networks (CNN) with attention, Transformer). The results show that all the considered algorithms are suitable for solving the authorship identification problem, but SVM shows the best accuracy. The average accuracy of SVM reaches 96%. This is due to thoroughly chosen parameters and feature space, which includes statistical and semantic features (including those extracted as a result of an aspect analysis). Deep neural networks are inferior to SVM in accuracy and reach only 93%. The study also includes an evaluation of the impact of attacks on the method on models’ accuracy. Experiments show that the SVM-based methods are unstable to deliberate text anonymization. In comparison, the loss in accuracy of deep neural networks does not exceed 20%. Transformer architecture is the most effective for anonymized texts and allows 81% accuracy to be achieved.

scholarly journals Intuitionistic Fuzzy Laplacian Twin Support Vector Machine for Semi-supervised Classification

2021 ◽  
Author(s):  
Jia-Bin Zhou ◽  
Yan-Qin Bai ◽  
Yan-Ru Guo ◽  
Hai-Xiang Lin
Keyword(s):  
Support Vector Machine ◽  
Negative Impact ◽  
Twin Support Vector Machine ◽  
Fuzzy Membership ◽  
Support Vector ◽  
Membership Functions ◽  
Fuzzy Membership Functions ◽  
Intuitionistic Fuzzy ◽  
Benchmark Datasets ◽  
The Impact

AbstractIn general, data contain noises which come from faulty instruments, flawed measurements or faulty communication. Learning with data in the context of classification or regression is inevitably affected by noises in the data. In order to remove or greatly reduce the impact of noises, we introduce the ideas of fuzzy membership functions and the Laplacian twin support vector machine (Lap-TSVM). A formulation of the linear intuitionistic fuzzy Laplacian twin support vector machine (IFLap-TSVM) is presented. Moreover, we extend the linear IFLap-TSVM to the nonlinear case by kernel function. The proposed IFLap-TSVM resolves the negative impact of noises and outliers by using fuzzy membership functions and is a more accurate reasonable classifier by using the geometric distribution information of labeled data and unlabeled data based on manifold regularization. Experiments with constructed artificial datasets, several UCI benchmark datasets and MNIST dataset show that the IFLap-TSVM has better classification accuracy than other state-of-the-art twin support vector machine (TSVM), intuitionistic fuzzy twin support vector machine (IFTSVM) and Lap-TSVM.

Sensor Dynamic Modeling Based on LS-SVM and NGA

2008 ◽  
Vol 381-382 ◽  
pp. 439-442
Author(s):  
Qi Wang ◽  
Zhi Gang Feng ◽  
K. Shida
Keyword(s):  
Genetic Algorithm ◽  
Neural Networks ◽  
Support Vector Machine ◽  
Least Squares ◽  
Dynamic Model ◽  
Dynamic Modeling ◽  
Support Vector ◽  
Local Minima ◽  
Highly Nonlinear ◽  
Sharing Function

Least squares support vector machine (LS-SVM) combined with niche genetic algorithm (NGA) are proposed for nonlinear sensor dynamic modeling. Compared with neural networks, the LS-SVM can overcome the shortcomings of local minima and over fitting, and has higher generalization performance. The sharing function based niche genetic algorithm is used to select the LS-SVM parameters automatically. The effectiveness and reliability of this method are demonstrated in two examples. The results show that this approach can escape from the blindness of man-made choice of LS-SVM parameters. It is still effective even if the sensor dynamic model is highly nonlinear.

IMPROVEMENT OF DOSE ESTIMATION PROCESS USING ARTIFICIAL NEURAL NETWORKS

2018 ◽  
Vol 184 (1) ◽  
pp. 36-43 ◽  
Author(s):  
Gal Amit ◽  
Hanan Datz
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
Physical Parameters ◽  
Machine Method ◽  
Algorithm Performance ◽  
Artificial Neural ◽  
First Time ◽  
Automatic Algorithm

Abstract We present here for the first time a fast and reliable automatic algorithm based on artificial neural networks for the anomaly detection of a thermoluminescence dosemeter (TLD) glow curves (GCs), and compare its performance with formerly developed support vector machine method. The GC shape of TLD depends on numerous physical parameters, which may significantly affect it. When integrated into a dosimetry laboratory, this automatic algorithm can classify ‘anomalous’ (having any kind of anomaly) GCs for manual review, and ‘regular’ (acceptable) GCs for automatic analysis. The new algorithm performance is then compared with two kinds of formerly developed support vector machine classifiers—regular and weighted ones—using three different metrics. Results show an impressive accuracy rate of 97% for TLD GCs that are correctly classified to either of the classes.

scholarly journals Adaptive control scheme based on the least squares support vector machine network

2011 ◽  
Vol 21 (4) ◽  
pp. 685-696 ◽  
Author(s):  
Tarek Mahmoud
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Adaptive Control ◽  
Least Squares ◽  
Nonlinear System Identification ◽  
Support Vector ◽  
Reference Trajectory ◽  
Control Scheme ◽  
Support Vector Machine Network ◽  
Adaptive Control Scheme

Adaptive control scheme based on the least squares support vector machine networkRecently, a new type of neural networks called Least Squares Support Vector Machines (LS-SVMs) has been receiving increasing attention in nonlinear system identification and control due to its generalization performance. This paper develops a stable adaptive control scheme using the LS-SVM network. The developed control scheme includes two parts: the identification part that uses a modified structure of LS-SVM neural networks called the multi-resolution wavelet least squares support vector machine network (MRWLS-SVM) as a predictor model, and the controller part that is developed to track a reference trajectory. By means of the Lyapunov stability criterion, stability analysis for the tracking errors is performed. Finally, simulation studies are performed to demonstrate the capability of the developed approach in controlling a pH process.

Sign in / Sign up

Export Citation Format

Share Document