scholarly journals Robust Proximal Support Vector Regression Based on Maximum Correntropy Criterion

2019 ◽  
Vol 2019 ◽  
pp. 1-11
Author(s):  
Kuaini Wang ◽  
Huimin Pei ◽  
Xiaoshuai Ding ◽  
Ping Zhong

The robustness problem of the classical proximal support vector machine for regression estimation (PSVR) when confronting with samples in the presence of outliers is addressed in this paper. Correntropy is a local similarity measure between two arbitrary variables and has been proven the insensitivity to noises and outliers. Based on the maximum correntropy criterion (MCC), a correntropy-based robust PSVR framework is proposed, named as RPSVR-MCC. The half-quadratic optimization method is employed to solve the resultant optimization, and an iterative algorithm is developed to solve RPSVR-MCC. In each iteration, the complex optimization can be converted to a linear system of equations which can be easily solved by the widely popular optimization techniques. The experimental results on synthetic datasets and real-world benchmark datasets demonstrate that the effectiveness of the proposed method. Moreover, the superiority of the proposed algorithm is more evident in noisy environment, especially in the presence of outliers.

2019 ◽  
Vol 11 (1) ◽  
pp. 78-89 ◽  
Author(s):  
Ping Zhong ◽  
Mengdi Li ◽  
Kai Mu ◽  
Juan Wen ◽  
Yiming Xue

This article presents the linear Proximal Support Vector Machine (PSVM) to the image steganalysis, and further generates a very efficient method called PSVM-LSMR through implementing PSVM by the state-of-the-art optimization method Least Square Minimum-Residual (LSMR). Also, motivated by extreme learning machine (ELM), a nonlinear algorithm PSVM-ELM is proposed for the image steganalysis. It is shown by the experiments with the wide stego schemes and rich steganalysis feature sets in both the spatial and JPEG domains that the PSVM can achieve comparable performance with Fisher Linear Discriminant (FLD) and ridge regression, and its computational time is far more less than that of them on large feature sets. The PSVM-LSMR is comparable to Ridge Regression implemented by LSMR (RR-LSMR), and both of them require the least computational time among all the competitions when dealing with medium or large feature sets. The nonlinear PSVM-ELM performs comparably or even better than FLD and ridge regression for the spatial domain steganographic schemes, and its computational time is apparently less than that of them on large feature sets.


2020 ◽  
pp. 1181-1198
Author(s):  
Sushruta Mishra ◽  
Brojo Kishore Mishra ◽  
Soumya Sahoo ◽  
Bijayalaxmi Panda

Diabetes has affected over 246 million people worldwide and by 2025 it is expected to rise to over 380 million. With the rise of information technology and its continued advent into the medical and healthcare sector, different symptoms of diabetes are being documented. The techniques inspired from the distributed collective behavior of social colonies have shown worth and excellence in dealing with complex optimization problems and are becoming more popular nowadays. It can be used as an effective problem solving tool for identifying diabetes disease risks. This paper aims at finding solutions to diagnose the disease by analyzing the patterns found in data through various swarm optimization techniques by employing Support Vector Machines and Naïve Bayes algorithms. It proposes a quicker and more efficient technique of diagnosing the disease, leading to timely treatment of the patients.


Author(s):  
Sushruta Mishra ◽  
Brojo Kishore Mishra ◽  
Soumya Sahoo ◽  
Bijayalaxmi Panda

Diabetes has affected over 246 million people worldwide and by 2025 it is expected to rise to over 380 million. With the rise of information technology and its continued advent into the medical and healthcare sector, different symptoms of diabetes are being documented. The techniques inspired from the distributed collective behavior of social colonies have shown worth and excellence in dealing with complex optimization problems and are becoming more popular nowadays. It can be used as an effective problem solving tool for identifying diabetes disease risks. This paper aims at finding solutions to diagnose the disease by analyzing the patterns found in data through various swarm optimization techniques by employing Support Vector Machines and Naïve Bayes algorithms. It proposes a quicker and more efficient technique of diagnosing the disease, leading to timely treatment of the patients.


Author(s):  
Hongbo Zhao ◽  
Zhongliang Ru ◽  
Changxing Zhu

Traditionally, the design of tunnels is based on determinate parameter values. In practice, both the performance and safety of tunnels are affected by numerous uncertainties: for example,it is difficult for engineers to predict uncertainties in geological conditions and rock mass properties. The purpose of reliability-based optimization (RBO) is to find a balanced design that is not only economical but also reliable in the presence of uncertainty. In the past few decades, numerous reliability optimization techniques have been proposed for taking uncertainty into account in the design of engineering structures. In the present study, the first-order reliability method (FORM) was used to compute the reliability index using Excel Solver. The least squares support vector machine (LSSVM) approach was adopted to build a relationship between reliability index and design variables,and the artificial bee colony (ABC) algorithm was employed for the reliability-based optimization. A proposed LSSVM/ABC-based reliability optimization method was applied to the case of a tunnel with rockbolt reinforcement. The mechanical parameters of the rock mass, in-situ stress and internal pressure were considered as the random variables. The reliability index of tunnel was analysed. The length, distance out of plane and the number of rockbolts were determined and optimized considering the uncertainty based on RBO. The proposed method improved the efficiency of RBO while maintaining high accuracy. The results showed that the proposed method not only meets the design accuracy, but also improves the efficiency of reliability-based optimization.


Symmetry ◽  
2021 ◽  
Vol 13 (5) ◽  
pp. 833
Author(s):  
Yuanyuan Chen ◽  
Zhixia Yang

Functional data analysis has become a research hotspot in the field of data mining. Traditional data mining methods regard functional data as a discrete and limited observation sequence, ignoring the continuity. In this paper, the functional data classification is addressed, proposing a functional generalized eigenvalue proximal support vector machine (FGEPSVM). Specifically, we find two nonparallel hyperplanes in function space, a positive functional hyperplane, and a functional negative hyperplane. The former is closest to the positive functional data and furthest from the negative functional data, while the latter has the opposite properties. By introducing the orthonormal basis, the problem in function space is transformed into the ones in vector space. It should be pointed out that the higher-order derivative information is applied from two aspects. We apply the derivatives alone or the weighted linear combination of the original function and the derivatives. It can be expected that to improve the classification accuracy by using more data information. Experiments on artificial datasets and benchmark datasets show the effectiveness of our FGEPSVM for functional data classification.


2019 ◽  
Vol 13 ◽  
Author(s):  
Yan Zhang ◽  
Ren Sheng

Background: In order to improve the efficiency of fault treatment of mining motor, the method of model construction is used to construct the type of kernel function based on the principle of vector machine classification and the optimization method of parameters. Methodology: One-to-many algorithm is used to establish two kinds of support vector machine models for fault diagnosis of motor rotor of crusher. One of them is to obtain the optimal parameters C and g based on the input samples of the instantaneous power fault characteristic data of some motor rotors which have not been processed by rough sets. Patents on machine learning have also shows their practical usefulness in the selction of the feature for fault detection. Results: The results show that the instantaneous power fault feature extracted from the rotor of the crusher motor is obtained by the cross validation method of grid search k-weights (where k is 3) and the final data of the applied Gauss radial basis penalty parameter C and the nuclear parameter g are obtained. Conclusion: The model established by the optimal parameters is used to classify and diagnose the sample of instantaneous power fault characteristic measurement of motor rotor. Therefore, the classification accuracy of the sample data processed by rough set is higher.


Open Physics ◽  
2018 ◽  
Vol 16 (1) ◽  
pp. 1033-1045
Author(s):  
Guodong Zhou ◽  
Huailiang Zhang ◽  
Raquel Martínez Lucas

Abstract Aiming at the excellent descriptive ability of SURF operator for local features of images, except for the shortcoming of global feature description ability, a compressed sensing image restoration algorithm based on improved SURF operator is proposed. The SURF feature vector set of the image is extracted, and the vector set data is reduced into a single high-dimensional feature vector by using a histogram algorithm, and then the image HSV color histogram is extracted.MSA image decomposition algorithm is used to obtain sparse representation of image feature vectors. Total variation curvature diffusion method and Bayesian weighting method perform image restoration for data smoothing feature and local similarity feature of texture part respectively. A compressed sensing image restoration model is obtained by using Schatten-p norm, and image color supplement is performed on the model. The compressed sensing image is iteratively solved by alternating optimization method, and the compressed sensing image is restored. The experimental results show that the proposed algorithm has good restoration performance, and the restored image has finer edge and texture structure and better visual effect.


Author(s):  
Jia-Bin Zhou ◽  
Yan-Qin Bai ◽  
Yan-Ru Guo ◽  
Hai-Xiang Lin

AbstractIn general, data contain noises which come from faulty instruments, flawed measurements or faulty communication. Learning with data in the context of classification or regression is inevitably affected by noises in the data. In order to remove or greatly reduce the impact of noises, we introduce the ideas of fuzzy membership functions and the Laplacian twin support vector machine (Lap-TSVM). A formulation of the linear intuitionistic fuzzy Laplacian twin support vector machine (IFLap-TSVM) is presented. Moreover, we extend the linear IFLap-TSVM to the nonlinear case by kernel function. The proposed IFLap-TSVM resolves the negative impact of noises and outliers by using fuzzy membership functions and is a more accurate reasonable classifier by using the geometric distribution information of labeled data and unlabeled data based on manifold regularization. Experiments with constructed artificial datasets, several UCI benchmark datasets and MNIST dataset show that the IFLap-TSVM has better classification accuracy than other state-of-the-art twin support vector machine (TSVM), intuitionistic fuzzy twin support vector machine (IFTSVM) and Lap-TSVM.


Sensor Review ◽  
2014 ◽  
Vol 34 (3) ◽  
pp. 304-311 ◽  
Author(s):  
Pengfei Jia ◽  
Fengchun Tian ◽  
Shu Fan ◽  
Qinghua He ◽  
Jingwei Feng ◽  
...  

Purpose – The purpose of the paper is to propose a new optimization algorithm to realize a synchronous optimization of sensor array and classifier, to improve the performance of E-nose in the detection of wound infection. When an electronic nose (E-nose) is used to detect the wound infection, sensor array’s optimization and parameters’ setting of classifier have a strong impact on the classification accuracy. Design/methodology/approach – An enhanced quantum-behaved particle swarm optimization based on genetic algorithm, genetic quantum-behaved particle swarm optimization (G-QPSO), is proposed to realize a synchronous optimization of sensor array and classifier. The importance-factor (I-F) method is used to weight the sensors of E-nose by its degree of importance in classification. Both radical basis function network and support vector machine are used for classification. Findings – The classification accuracy of E-nose is the highest when the weighting coefficients of the I-F method and classifier’s parameters are optimized by G-QPSO. All results make it clear that the proposed method is an ideal optimization method of E-nose in the detection of wound infection. Research limitations/implications – To make the proposed optimization method more effective, the key point of further research is to enhance the classifier of E-nose. Practical implications – In this paper, E-nose is used to distinguish the class of wound infection; meanwhile, G-QPSO is used to realize a synchronous optimization of sensor array and classifier of E-nose. These are all important for E-nose to realize its clinical application in wound monitoring. Originality/value – The innovative concept improves the performance of E-nose in wound monitoring and paves the way for the clinical detection of E-nose.


Sign in / Sign up

Export Citation Format

Share Document