Research of a New SVM Kernel Function

2014 ◽  
Vol 543-547 ◽  
pp. 1659-1662
Author(s):  
Juan Du ◽  
Wen Long Zhang ◽  
Meng Meng Xie

The kernel was the key technology of SVM; the kernel affected the learning ability and generalization ability of support vector machine. Aiming at the specific application of harmful text information recognition, combining traditional kernel function the paper structured a new combination kernel, modeling for the independent harmful vocabulary and co-occur vocabularies, and then evaluation the linear kernel, homogeneous polynomial kernel, non homogeneous polynomial kernel and combination kernel function in the sample experiment. The experimental results of combination kernel function showed that the effect has increased greatly than other kernel functions for the application of harmful text information filtering. Especially the Rcall value achieved satisfactory results.

Author(s):  
B. Yekkehkhany ◽  
A. Safari ◽  
S. Homayouni ◽  
M. Hasanlou

In this paper, a framework is developed based on Support Vector Machines (SVM) for crop classification using polarimetric features extracted from multi-temporal Synthetic Aperture Radar (SAR) imageries. The multi-temporal integration of data not only improves the overall retrieval accuracy but also provides more reliable estimates with respect to single-date data. Several kernel functions are employed and compared in this study for mapping the input space to higher Hilbert dimension space. These kernel functions include linear, polynomials and Radial Based Function (RBF). <br><br> The method is applied to several UAVSAR L-band SAR images acquired over an agricultural area near Winnipeg, Manitoba, Canada. In this research, the temporal alpha features of H/A/α decomposition method are used in classification. The experimental tests show an SVM classifier with RBF kernel for three dates of data increases the Overall Accuracy (OA) to up to 3% in comparison to using linear kernel function, and up to 1% in comparison to a 3rd degree polynomial kernel function.


2016 ◽  
Vol 16 (5) ◽  
pp. 5-14 ◽  
Author(s):  
Hao Huanrui

Abstract The pattern analysis technology based on kernel methods is a new technology, which combines good performance and strict theory. With support vector machine, pattern analysis is easy and fast. But the existing kernel function fits the requirement. In the paper, we explore the new mixed kernel functions which are mixed with Gaussian and Wavelet function, Gaussian and Polynomial kernel function. With the new mixed kernel functions, we check different parameters. The results shows that the new mixed kernel functions have good time efficiency and accuracy. In image recognition we used SVM with two mixed kernel functions, the mixed kernel function of Gaussian and Wavelet function are suitable for more states.


2020 ◽  
Vol 1 (1) ◽  
pp. 37-41
Author(s):  
Noramalina Mohd Hatta ◽  
Zuraini Ali Shah ◽  
Shahreen Kasim

Multiclass cancer classification is basically one of the challenging fields in machine learning which a fast growing technology that use human behaviour as examples. Supervised classification such Support Vector Machine (SVM) has been used to classify the dataset on classification by its own function and merely known as kernel function. Kernel function has stated to have a problem especially in selecting their best kernels based on a specific datasets and tasks. Besides, there is an issue stated that the kernels function have a high impossibility to distribute the data in straight line. Here, three basic kernel functions was used and tested with selected dataset and they are linear kernel, polynomial kernel and Radial Basis Function (RBF) kernel function. The three kernels were tested by different dataset to gain the accuracy. For a comparison, this study conducting a test by with and without feature selection in SVM classification kernel function since both tests will give different result and thus give a big meaning to the study.


2013 ◽  
Vol 2013 ◽  
pp. 1-7 ◽  
Author(s):  
Rakesh Patra ◽  
Sujan Kumar Saha

Support vector machine (SVM) is one of the popular machine learning techniques used in various text processing tasks including named entity recognition (NER). The performance of the SVM classifier largely depends on the appropriateness of the kernel function. In the last few years a number of task-specific kernel functions have been proposed and used in various text processing tasks, for example, string kernel, graph kernel, tree kernel and so on. So far very few efforts have been devoted to the development of NER task specific kernel. In the literature we found that the tree kernel has been used in NER task only for entity boundary detection or reannotation. The conventional tree kernel is unable to execute the complete NER task on its own. In this paper we have proposed a kernel function, motivated by the tree kernel, which is able to perform the complete NER task. To examine the effectiveness of the proposed kernel, we have applied the kernel function on the openly available JNLPBA 2004 data. Our kernel executes the complete NER task and achieves reasonable accuracy.


2018 ◽  
Vol 8 (12) ◽  
pp. 2574 ◽  
Author(s):  
Qinghua Mao ◽  
Hongwei Ma ◽  
Xuhui Zhang ◽  
Guangming Zhang

Skewness Decision Tree Support Vector Machine (SDTSVM) algorithm is widely known as a supervised learning model for multi-class classification problems. However, the classification accuracy of the SDTSVM algorithm depends on the perfect selection of its parameters and the classification order. Therefore, an improved SDTSVM (ISDTSVM) algorithm is proposed in order to improve the classification accuracy of steel cord conveyor belt defects. In the proposed model, the classification order is determined by the sum of the Euclidean distances between multi-class sample centers and the parameters are optimized by the inertia weight Particle Swarm Optimization (PSO) algorithm. In order to verify the effectiveness of the ISDTSVM algorithm with different feature space, experiments were conducted on multiple UCI (University of California Irvine) data sets and steel cord conveyor belt defects using the proposed ISDTSVM algorithm and the conventional SDTSVM algorithm respectively. The average classification accuracies of five-fold cross-validation were obtained, based on two kinds of kernel functions respectively. For the Vowel, Zoo, and Wine data sets of the UCI data sets, as well as the steel cord conveyor belt defects, the ISDTSVM algorithm improved the classification accuracy by 3%, 3%, 1% and 4% respectively, compared to the SDTSVM algorithm. The classification accuracy of the radial basis function kernel were higher than the polynomial kernel. The results indicated that the proposed ISDTSVM algorithm improved the classification accuracy significantly, compared to the conventional SDTSVM algorithm.


Symmetry ◽  
2020 ◽  
Vol 12 (4) ◽  
pp. 667
Author(s):  
Wismaji Sadewo ◽  
Zuherman Rustam ◽  
Hamidah Hamidah ◽  
Alifah Roudhoh Chusmarsyah

Early detection of pancreatic cancer is difficult, and thus many cases of pancreatic cancer are diagnosed late. When pancreatic cancer is detected, the cancer is usually well developed. Machine learning is an approach that is part of artificial intelligence and can detect pancreatic cancer early. This paper proposes a machine learning approach with the twin support vector machine (TWSVM) method as a new approach to detecting pancreatic cancer early. TWSVM aims to find two symmetry planes such that each plane has a distance close to one data class and as far as possible from another data class. TWSVM is fast in building a model and has good generalizations. However, TWSVM requires kernel functions to operate in the feature space. The kernel functions commonly used are the linear kernel, polynomial kernel, and radial basis function (RBF) kernel. This paper uses the TWSVM method with these kernels and compares the best kernel for use by TWSVM to detect pancreatic cancer early. In this paper, the TWSVM model with each kernel is evaluated using a 10-fold cross validation. The results obtained are that TWSVM based on the kernel is able to detect pancreatic cancer with good performance. However, the best kernel obtained is the RBF kernel, which produces an accuracy of 98%, a sensitivity of 97%, a specificity of 100%, and a running time of around 1.3408 s.


Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1362 ◽  
Author(s):  
Marco Bassoli ◽  
Valentina Bianchi ◽  
Ilaria De Munari

Recent research in wearable sensors have led to the development of an advanced platform capable of embedding complex algorithms such as machine learning algorithms, which are known to usually be resource-demanding. To address the need for high computational power, one solution is to design custom hardware platforms dedicated to the specific application by exploiting, for example, Field Programmable Gate Array (FPGA). Recently, model-based techniques and automatic code generation have been introduced in FPGA design. In this paper, a new model-based floating-point accumulation circuit is presented. The architecture is based on the state-of-the-art delayed buffering algorithm. This circuit was conceived to be exploited in order to compute the kernel function of a support vector machine. The implementation of the proposed model was carried out in Simulink, and simulation results showed that it had better performance in terms of speed and occupied area when compared to other solutions. To better evaluate its figure, a practical case of a polynomial kernel function was considered. Simulink and VHDL post-implementation timing simulations and measurements on FPGA confirmed the good results of the stand-alone accumulator.


Author(s):  
YUN LING ◽  
QIUYAN CAO ◽  
HUA ZHANG

Consumer credit scoring is considered as a crucial issue in the credit industry. SVM has been successfully utilized for classification in many areas including credit scoring. Kernel function is vital when applying SVM to classification problem for enhancing the prediction performance. Currently, most of kernel functions used in SVM are single kernel functions such as the radial basis function (RBF) which has been widely used. On the basis of the existing kernel functions, this paper proposes a multi-kernel function to improve the learning and generalization ability of SVM by integrating several single kernel functions. Chaos particle swarm optimization (CPSO) which is a kind of improved PSO algorithm is utilized to optimize parameters and to select features simultaneously. Two UCI credit data sets are used as the experimental data to evaluate the classification performance of the proposed method.


2011 ◽  
Vol 48-49 ◽  
pp. 241-245
Author(s):  
Hong Bing Gao ◽  
Liao Yang ◽  
Xian Zhang ◽  
Chen Cheng

A brief introduction of the basic concepts of the classification interval, the optimal classification surface and support vector; explained derivation of SVM based on Lagrange optimization method; Sigmoid kernel function and so on. It describes three methods of C-SVM、V-SVM and least squares SVM based on Sigmoid kernel function. To a bearing failure as a example to compare three results of SVM training of the kernel linear function, polynomial kernel function, Sigmoid kernel function, The results show that satisfactory fault analysis demand the appropriate kernel function selection. Fault in the gear box, the bearing failure is 19%, In addition, the rate is as high as 30% in other rotating machinery system failure [1,2].Thus, rolling bearing condition monitoring and fault diagnosis are very important to production safety, and many scholars have done numerous studies [3,4]. Support vector machine method is a learning methods based on statistical learning theory Vapnik-Chervonenkis dimension theory and structural risk minimization [5,6].


2021 ◽  
pp. 33-42
Author(s):  
Zehai Xu ◽  
Haiyan Song ◽  
Zhiming Wu ◽  
Zefu Xu ◽  
Shifang Wang

The blurring of crop images acquired by agricultural Unmanned Aerial Vehicle (UAV) due to sudden inputs by operators, atmospheric disturbance, and many other factors will eventually affect the subsequent crop identification, information extraction, and yield estimation. Aiming at the above problems, the new proposed combined deblurring algorithm based on the re-weighted graph total variation (RGTV) and L0-regularized prior, and the other two representative deblurring algorithms were applied to restore blurry crop images acquired during UAV flight, respectively. The restoration performance was measured by subjective vision, and objective evaluation indexes. The crop shape-related and texture-related feature parameters were then extracted, the Support Vector Machine (SVM) classifier with four common kernel functions was implemented for crop classification to realize the purpose of crop information extraction. The deblurring results showed that the proposed algorithm performed better in suppressing the ringing effect and preserving the image fine details, and retained higher objective evaluation indexes than the other two deblurring algorithms. The comparative analysis of different classification kernel functions showed that the Polynomial kernel function with an average recognition rate of 94.83% was most suitable for crop classification and recognition. The research will help in further popularization of crop monitoring based on UAV low-altitude remote sensing.


Sign in / Sign up

Export Citation Format

Share Document