Image Steganalysis in High-Dimensional Feature Spaces with Proximal Support Vector Machine

2019 ◽  
Vol 11 (1) ◽  
pp. 78-89 ◽  
Author(s):  
Ping Zhong ◽  
Mengdi Li ◽  
Kai Mu ◽  
Juan Wen ◽  
Yiming Xue
Keyword(s):  
Support Vector Machine ◽  
Ridge Regression ◽  
Optimization Method ◽  
Least Square ◽  
Computational Time ◽  
Support Vector ◽  
Image Steganalysis ◽  
Linear Discriminant ◽  
Feature Sets ◽  
Proximal Support Vector Machine

This article presents the linear Proximal Support Vector Machine (PSVM) to the image steganalysis, and further generates a very efficient method called PSVM-LSMR through implementing PSVM by the state-of-the-art optimization method Least Square Minimum-Residual (LSMR). Also, motivated by extreme learning machine (ELM), a nonlinear algorithm PSVM-ELM is proposed for the image steganalysis. It is shown by the experiments with the wide stego schemes and rich steganalysis feature sets in both the spatial and JPEG domains that the PSVM can achieve comparable performance with Fisher Linear Discriminant (FLD) and ridge regression, and its computational time is far more less than that of them on large feature sets. The PSVM-LSMR is comparable to Ridge Regression implemented by LSMR (RR-LSMR), and both of them require the least computational time among all the competitions when dealing with medium or large feature sets. The nonlinear PSVM-ELM performs comparably or even better than FLD and ridge regression for the spatial domain steganographic schemes, and its computational time is apparently less than that of them on large feature sets.

Prediction of Periventricular Leukomalacia Occurrence in Neonates Using a Novel Support Vector Machine Classifier Optimization Method

2015 ◽  
Author(s):  
Dieter Bender ◽  
Ali Jalali ◽  
Daniel J. Licht ◽  
C. Nataraj
Keyword(s):  
Support Vector Machine ◽  
Periventricular Leukomalacia ◽  
Optimization Method ◽  
Computational Time ◽  
Support Vector ◽  
Svm Classifier ◽  
Learning Stage ◽  
Svm Algorithm ◽  
Initial Idea ◽  
Leave One Out

Prior work has documented that Support Vector Machine (SVM) classifiers can be powerful tools in predicting clinical outcomes of complex diseases such as Periventricular Leukomalacia (PVL). Our previous study showed that SVM performance can be improved significantly by optimizing the supervised training set used during the learning stage of the overall SVM algorithm. This study fully develops the initial idea using the reliable Leave-One-Out Cross-validation (LOOCV) technique. The work presented in this paper confirms previous results and improves the performance of the SVM even further. In addition, using the LOOCV technique, the computational time is decreased and the structure of the algorithm simplified, making this framework more feasible. Furthermore, we evaluate the performance of the resulting optimized SVM classifier on an unseen set of data. This demonstrates that the developed SVM algorithm outperforms normal SVM type classifiers without any loss of generalization.

scholarly journals Edible Gelatin Diagnosis Using Laser-Induced Breakdown Spectroscopy and Partial Least Square Assisted Support Vector Machine

Sensors ◽  
2019 ◽  
Vol 19 (19) ◽  
pp. 4225 ◽  
Author(s):  
Hao Zhang ◽  
Shun Wang ◽  
Dongxian Li ◽  
Yanyan Zhang ◽  
Jiandong Hu ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Partial Least Square ◽  
Least Square ◽  
Computational Time ◽  
Laser Induced Breakdown Spectroscopy ◽  
Accurate Estimation ◽  
Support Vector ◽  
Breakdown Spectroscopy ◽  
Svm Model ◽  
Laser Induced Breakdown

Edible gelatin has been widely used as a food additive in the food industry, and illegal adulteration with industrial gelatin will cause serious harm to human health. The present work used laser-induced breakdown spectroscopy (LIBS) coupled with the partial least square–support vector machine (PLS-SVM) method for the fast and accurate estimation of edible gelatin adulteration. Gelatin samples with 11 different adulteration ratios were prepared by mixing pure edible gelatin with industrial gelatin, and the LIBS spectra were recorded to analyze their elemental composition differences. The PLS, SVM, and PLS-SVM models were separately built for the prediction of gelatin adulteration ratios, and the hybrid PLS-SVM model yielded a better performance than only the PLS and SVM models. Besides, four different variable selection methods, including competitive adaptive reweighted sampling (CARS), Monte Carlo uninformative variable elimination (MC-UVE), random frog (RF), and principal component analysis (PCA), were adopted to combine with the SVM model for comparative study; the results further demonstrated that the PLS-SVM model was superior to the other SVM models. This study reveals that the hybrid PLS-SVM model, with the advantages of low computational time and high prediction accuracy, can be employed as a preferred method for the accurate estimation of edible gelatin adulteration.

scholarly journals Characteristic Selection and Prediction of Octane Number Loss in Gasoline Refinement Process

2021 ◽  
Vol 245 ◽  
pp. 01040
Author(s):  
Wei Li ◽  
Jiali Yang ◽  
Peihao Yang ◽  
Sheng Li
Keyword(s):  
Support Vector Machine ◽  
Ridge Regression ◽  
Octane Number ◽  
Production Management ◽  
Least Square ◽  
Support Vector ◽  
High Dimensions ◽  
Maximum Information ◽  
Loss Prediction ◽  
Refinement Process

In the refining process of gasoline, accurate prediction of the octane number loss is conducive to production management to ensure the octane content in gasoline. Therefore, the relevant research has important theoretical significance and application value. Aiming at the characteristics of octane number loss with few samples, high dimensions and non-linear of the octane number loss, this paper uses maximum information coefficient, recursive characteristic elimination and random forest regression algorithm to select the main characteristics, and establishes the octane number loss prediction model based on least squares support vector machine respectively. Compared with the three algorithms of support vector machine, BP neural network and ridge regression, the experimental results show that the two models of ridge regression and least square support vector machine have higher prediction accuracy, but the least square support vector machine has the best effect.

scholarly journals Pengenalan Wajah Menggunakan Implementasi T-shape Mask pada Two Dimentional Linear Discriminant Analysis dan Support Vector Machine

2016 ◽  
Vol 7 (1) ◽  
Author(s):  
Ahmad Reza Musthafa ◽  
Alif Akbar Fitrawan ◽  
Supria Supria
Keyword(s):  
Support Vector Machine ◽  
Face Recognition ◽  
Discriminant Analysis ◽  
Linear Discriminant Analysis ◽  
Computing Time ◽  
Computational Time ◽  
Significant Feature ◽  
Support Vector ◽  
Two Dimensional ◽  
Linear Discriminant

Abstract. Face recognition is the identification process to recognize a person's face. Many studies have been developing face recognition methods, one of which is the Two Dimensional Linear Discriminant Analysis (TDLDA) which has pretty good accuracy results with the method of classification Support Vector Machine (SVM). With more training data can add computational time. TDLDA using all the piksel image as input to be processed for feature extraction. Though not all the objects in the area of the face is a significant feature in face recognition. In this study, the proposed use of the T-shape with only use a significant part is the eyes, nose, and mouth are integrated with TDLDA and SVM. The result could reduce computing time on face recognition 21.56% faster than TDLDA method. The accuracy of the results in this study was 91% -96% which is close to the level of accuracy without using a mask on the face.Keyword: face recognition, T-shape, TDLDA, Support vector machine. Abstrak. Pengenalan wajah merupakan proses identifikasi untuk mengenali wajah seseorang. Telah Banyak penelitian yang mengembangkan metode pengenalan wajah, salah satunya adalah Two Dimensional Linear Discriminant Analysis (TDLDA) yang memiliki hasil akurasi yang cukup baik dengan metode klasifikasi Support Vector Machine (SVM). Dengan semakin banyak data training dapat menambah waktu komputasinya. TDLDA menggunakan semua piksel citra sebagai masukan yang akan diproses untuk ekstrasi fitur. Padahal tidak semua objek pada area wajah merupakan fitur yang signifikan dalam pengenalan wajah. Dalam penelitian ini diusulkan penggunaan T-shape dengan hanya menyimpan bagian yang signifikan yaitu mata, hidung, dan mulut yang diintegrasikan dengan TDLDA dan SVM. Hasilnya dapat mengurangi waktu komputasi pada pengenalan wajah 21,56% lebih cepat daripada metode TDLDA. Hasil akurasi pada penelitian ini adalah 91%-96% yang mendekati tingkat akurasi tanpa menggunakan mask pada wajah.Kata Kunci: pengenalan wajah, T-shape, TDLDA, Support vector machine.

Fault Diagnosis Method of Mine Motor Based on Support Vector Machine

2019 ◽  
Vol 13 ◽  
Author(s):  
Yan Zhang ◽  
Ren Sheng
Keyword(s):  
Support Vector Machine ◽  
Fault Diagnosis ◽  
Optimization Method ◽  
Support Vector ◽  
Optimal Parameters ◽  
Instantaneous Power ◽  
Practical Usefulness ◽  
Sample Data ◽  
Diagnosis Method ◽  
Fault Characteristic

Background: In order to improve the efficiency of fault treatment of mining motor, the method of model construction is used to construct the type of kernel function based on the principle of vector machine classification and the optimization method of parameters. Methodology: One-to-many algorithm is used to establish two kinds of support vector machine models for fault diagnosis of motor rotor of crusher. One of them is to obtain the optimal parameters C and g based on the input samples of the instantaneous power fault characteristic data of some motor rotors which have not been processed by rough sets. Patents on machine learning have also shows their practical usefulness in the selction of the feature for fault detection. Results: The results show that the instantaneous power fault feature extracted from the rotor of the crusher motor is obtained by the cross validation method of grid search k-weights (where k is 3) and the final data of the applied Gauss radial basis penalty parameter C and the nuclear parameter g are obtained. Conclusion: The model established by the optimal parameters is used to classify and diagnose the sample of instantaneous power fault characteristic measurement of motor rotor. Therefore, the classification accuracy of the sample data processed by rough set is higher.

scholarly journals Mie scattering and microparticle-based characterization of heavy metal ions and classification by statistical inference methods

2019 ◽  
Vol 6 (5) ◽  
pp. 190001 ◽  
Author(s):  
Katherine E. Klug ◽  
Christian M. Jennings ◽  
Nicholas Lytal ◽  
Lingling An ◽  
Jeong-Yeol Yoon
Keyword(s):  
Heavy Metal ◽  
Support Vector Machine ◽  
Metal Ions ◽  
Heavy Metal Ions ◽  
Mie Scattering ◽  
Training Data ◽  
Scattering Data ◽  
Support Vector ◽  
Linear Discriminant ◽  
Machine Analysis

A straightforward method for classifying heavy metal ions in water is proposed using statistical classification and clustering techniques from non-specific microparticle scattering data. A set of carboxylated polystyrene microparticles of sizes 0.91, 0.75 and 0.40 µm was mixed with the solutions of nine heavy metal ions and two control cations, and scattering measurements were collected at two angles optimized for scattering from non-aggregated and aggregated particles. Classification of these observations was conducted and compared among several machine learning techniques, including linear discriminant analysis, support vector machine analysis, K-means clustering and K-medians clustering. This study found the highest classification accuracy using the linear discriminant and support vector machine analysis, each reporting high classification rates for heavy metal ions with respect to the model. This may be attributed to moderate correlation between detection angle and particle size. These classification models provide reasonable discrimination between most ion species, with the highest distinction seen for Pb(II), Cd(II), Ni(II) and Co(II), followed by Fe(II) and Fe(III), potentially due to its known sorption with carboxyl groups. The support vector machine analysis was also applied to three different mixture solutions representing leaching from pipes and mine tailings, and showed good correlation with single-species data, specifically with Pb(II) and Ni(II). With more expansive training data and further processing, this method shows promise for low-cost and portable heavy metal identification and sensing.

Sign in / Sign up

Export Citation Format

Share Document