Prototype Classification: Insights from Machine Learning

2009 ◽  
Vol 21 (1) ◽  
pp. 272-300 ◽  
Author(s):  
Arnulf B. A. Graf ◽  
Olivier Bousquet ◽  
Gunnar Rätsch ◽  
Bernhard Schölkopf
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Relevance Vector Machine ◽  
Support Vector ◽  
Classification Algorithms ◽  
Normal Vector ◽  
Machine Learning Classification ◽  
Formal Framework ◽  
Soft Margin ◽  
Prototype Classification

We shed light on the discrimination between patterns belonging to two different classes by casting this decoding problem into a generalized prototype framework. The discrimination process is then separated into two stages: a projection stage that reduces the dimensionality of the data by projecting it on a line and a threshold stage where the distributions of the projected patterns of both classes are separated. For this, we extend the popular mean-of-class prototype classification using algorithms from machine learning that satisfy a set of invariance properties. We report a simple yet general approach to express different types of linear classification algorithms in an identical and easy-to-visualize formal framework using generalized prototypes where these prototypes are used to express the normal vector and offset of the hyperplane. We investigate non-margin classifiers such as the classical prototype classifier, the Fisher classifier, and the relevance vector machine. We then study hard and soft margin classifiers such as the support vector machine and a boosted version of the prototype classifier. Subsequently, we relate mean-of-class prototype classification to other classification algorithms by showing that the prototype classifier is a limit of any soft margin classifier and that boosting a prototype classifier yields the support vector machine. While giving novel insights into classification per se by presenting a common and unified formalism, our generalized prototype framework also provides an efficient visualization and a principled comparison of machine learning classification.

scholarly journals Diabetes Prediction Using Machine Learning Techniques

2021 ◽  
pp. 150-152
Author(s):  
Seyma Kiziltas Koc ◽  
Mustafa Yeniad
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
High Performance ◽  
Nearest Neighbor ◽  
Classification Performance ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Classification Algorithms ◽  
K Nearest Neighbor ◽  
Machine Learning Classification

Technologies which are used in the healthcare industry are changing rapidly because the technology is evolving to improve people's lifestyles constantly. For instance, different technological devices are used for the diagnosis and treatment of diseases. It has been revealed that diagnosis of disease can be made by computer systems with developing technology.Machine learning algorithms are frequently used tools because of their high performance in the field of health as well as many field. The aim of this study is to investigate different machine learning classification algorithms that can be used in the diagnosis of diabetes and to make comparative analyzes according to the metrics in the literature. In the study, seven classification algorithms were used in the literature. These algorithms are Logistic Regression, K-Nearest Neighbor, Multilayer Perceptron, Random Forest, Decision Trees, Support Vector Machine and Naive Bayes. Firstly, classification performance of algorithms are compared. These comparisons are based on accuracy, sensitivity, precision, and F1-score. The results obtained showed that support vector machine algorithm had the highest accuracy with 78.65%.

scholarly journals An Ontology Driven System to Predict Diabetes with Machine Learning Techniques

2019 ◽  
Vol 9 (2) ◽  
pp. 4005-4011
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Decision Tree ◽  
Early Stage ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Classification Algorithms ◽  
Machine Learning Classification ◽  
Diagnostic Center ◽  
Mental Trauma

Diabetes Mellitus is considered one of the chronic diseases of humankind which causes an increase in blood sugar. Many complications are reported if DM remains untreated and unidentified. Identification of this disease requires a lot of physical and mental trauma and effort which involves visiting a doctor, blood and urine test at the diagnostic center which consumes more time. Difficulties can be over crossed using the trending technology of Machine learning. The idea of the model is to prognosticate the occurrence of a diabetic with high accuracy. Therefore, two machine learning classification algorithms namely Fine Decision Tree and Support Vector Machine are used in this experiment to detect diabetes at an early stage. Therefore two machine learning classification algorithms namely Fine Decision Tree and Support Vector Machine are used in this experiment to detect diabetes at an early stage.

scholarly journals Using Machine Learning to Perform Proximity Detection - Classifying Bluetooth Beacon RSSI V alues

2020 ◽  
Author(s):  
Karen Song
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Smart Phones ◽  
Support Vector ◽  
Classification Algorithms ◽  
Decision Tree Classifier ◽  
Machine Learning Classification ◽  
Proximity Detection ◽  
Tree Classifier ◽  
Testing Accuracy

This project focuses on using machine learning classification algorithms to determine whether two people are 6 feet apart or not. Two Raspberry Pis were used simulate smart phones. RSSI values of the Bluetooth beacons transmitted between the Raspberry Pis were collected and recorded to train the classifier. The Gaussian Support Vector Machine Classifer yielded the highest testing accuracy of 79.670 and the Decision Tree Classifier yielded the highest AUC of 0.80.

scholarly journals Using Machine Learning to Perform Proximity Detection - Classifying Bluetooth Beacon RSSI Values

2020 ◽  
Author(s):  
Karen Song
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Smart Phones ◽  
Support Vector ◽  
Classification Algorithms ◽  
Decision Tree Classifier ◽  
Machine Learning Classification ◽  
Proximity Detection ◽  
Tree Classifier ◽  
Testing Accuracy

This project focuses on using machine learning classification algorithms to determine whether two people are 6 feet apart or not. Two Raspberry Pis were used simulate smart phones. RSSI values of the Bluetooth beacons transmitted between the Raspberry Pis were collected and recorded to train the classifier. The Gaussian Support Vector Machine Classifer yielded the highest testing accuracy of 79.670 and the Decision Tree Classifier yielded the highest AUC of 0.80.

scholarly journals Diabetes Prediction Using Machine Learning Techniques

2021 ◽  
pp. 150-152
Author(s):  
Seyma Kiziltas Koc ◽  
Mustafa Yeniad
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
High Performance ◽  
Nearest Neighbor ◽  
Classification Performance ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Classification Algorithms ◽  
K Nearest Neighbor ◽  
Machine Learning Classification

Technologies which are used in the healthcare industry are changing rapidly because the technology is evolving to improve people's lifestyles constantly. For instance, different technological devices are used for the diagnosis and treatment of diseases. It has been revealed that diagnosis of disease can be made by computer systems with developing technology.Machine learning algorithms are frequently used tools because of their high performance in the field of health as well as many field. The aim of this study is to investigate different machine learning classification algorithms that can be used in the diagnosis of diabetes and to make comparative analyzes according to the metrics in the literature. In the study, seven classification algorithms were used in the literature. These algorithms are Logistic Regression, K-Nearest Neighbor, Multilayer Perceptron, Random Forest, Decision Trees, Support Vector Machine and Naive Bayes. Firstly, classification performance of algorithms are compared. These comparisons are based on accuracy, sensitivity, precision, and F1-score. The results obtained showed that support vector machine algorithm had the highest accuracy with 78.65%.

Machine Learning Classification Algorithms to Predict aGvHD following Allo-HSCT: A Systematic Review

2019 ◽  
Vol 58 (06) ◽  
pp. 205-212
Author(s):  
Cirruse Salehnasab ◽  
Abbas Hajifathali ◽  
Farkhondeh Asadi ◽  
Elham Roshandel ◽  
Alireza Kazemi ◽  
...  
Keyword(s):  
Machine Learning ◽  
Systemic Review ◽  
Predictor Variables ◽  
Support Vector ◽  
Classification Algorithms ◽  
K Nearest Neighbors ◽  
Hematopoietic Stem ◽  
Machine Learning Classification ◽  
Graft Versus Host ◽  
Meta Analyses

Abstract Background The acute graft-versus-host disease (aGvHD) is the most important cause of mortality in patients receiving allogeneic hematopoietic stem cell transplantation. Given that it occurs at the stage of severe tissue damage, its diagnosis is late. With the advancement of machine learning (ML), promising real-time models to predict aGvHD have emerged. Objective This article aims to synthesize the literature on ML classification algorithms for predicting aGvHD, highlighting algorithms and important predictor variables used. Methods A systemic review of ML classification algorithms used to predict aGvHD was performed using a search of the PubMed, Embase, Web of Science, Scopus, Springer, and IEEE Xplore databases undertaken up to April 2019 based on Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statements. The studies with a focus on using the ML classification algorithms in the process of predicting of aGvHD were considered. Results After applying the inclusion and exclusion criteria, 14 studies were selected for evaluation. The results of the current analysis showed that the algorithms used were Artificial Neural Network (79%), Support Vector Machine (50%), Naive Bayes (43%), k-Nearest Neighbors (29%), Regression (29%), and Decision Trees (14%), respectively. Also, many predictor variables have been used in these studies so that we have divided them into more abstract categories, including biomarkers, demographics, infections, clinical, genes, transplants, drugs, and other variables. Conclusion Each of these ML algorithms has a particular characteristic and different proposed predictors. Therefore, it seems these ML algorithms have a high potential for predicting aGvHD if the process of modeling is performed correctly.

scholarly journals Analisis Perbandingan Algoritma SVM, KNN, dan CNN untuk Klasifikasi Citra Cuaca

2021 ◽  
Vol 8 (2) ◽  
pp. 311
Author(s):  
Mohammad Farid Naufal
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Computer Vision ◽  
Support Vector Machine ◽  
Convolutional Neural Network ◽  
Cross Validation ◽  
Nearest Neighbors ◽  
Support Vector ◽  
Classification Algorithms ◽  
K Nearest Neighbors

<p class="Abstrak">Cuaca merupakan faktor penting yang dipertimbangkan untuk berbagai pengambilan keputusan. Klasifikasi cuaca manual oleh manusia membutuhkan waktu yang lama dan inkonsistensi. <em>Computer vision</em> adalah cabang ilmu yang digunakan komputer untuk mengenali atau melakukan klasifikasi citra. Hal ini dapat membantu pengembangan <em>self autonomous machine</em> agar tidak bergantung pada koneksi internet dan dapat melakukan kalkulasi sendiri secara <em>real time</em>. Terdapat beberapa algoritma klasifikasi citra populer yaitu K-Nearest Neighbors (KNN), Support Vector Machine (SVM), dan Convolutional Neural Network (CNN). KNN dan SVM merupakan algoritma klasifikasi dari <em>Machine Learning</em> sedangkan CNN merupakan algoritma klasifikasi dari Deep Neural Network. Penelitian ini bertujuan untuk membandingkan performa dari tiga algoritma tersebut sehingga diketahui berapa gap performa diantara ketiganya. Arsitektur uji coba yang dilakukan adalah menggunakan 5 cross validation. Beberapa parameter digunakan untuk mengkonfigurasikan algoritma KNN, SVM, dan CNN. Dari hasil uji coba yang dilakukan CNN memiliki performa terbaik dengan akurasi 0.942, precision 0.943, recall 0.942, dan F1 Score 0.942.</p><p class="Abstrak"> </p><p class="Abstrak"><em><strong>Abstract</strong></em></p><p class="Abstract"><em>Weather is an important factor that is considered for various decision making. Manual weather classification by humans is time consuming and inconsistent. Computer vision is a branch of science that computers use to recognize or classify images. This can help develop self-autonomous machines so that they are not dependent on an internet connection and can perform their own calculations in real time. There are several popular image classification algorithms, namely K-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Convolutional Neural Network (CNN). KNN and SVM are Machine Learning classification algorithms, while CNN is a Deep Neural Networks classification algorithm. This study aims to compare the performance of that three algorithms so that the performance gap between the three is known. The test architecture is using 5 cross validation. Several parameters are used to configure the KNN, SVM, and CNN algorithms. From the test results conducted by CNN, it has the best performance with 0.942 accuracy, 0.943 precision, 0.942 recall, and F1 Score 0.942.</em></p><p class="Abstrak"><em><strong><br /></strong></em></p>

scholarly journals Application of Machine Learning Classification to Detect Fraudulent E‑wallet Deposit Notification SMSes

2020 ◽  
pp. 1-13
Author(s):  
Fillemon S. Enkono ◽  
Nalina Suresh
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Mobile Applications ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Support Vector ◽  
Svm Classifier ◽  
Machine Learning Classification

Fraudulent e-wallet deposit notification SMSes designed to steal money and goods from m-banking users have become pervasive in Namibia. Motivated by an observed lack of mobile applications to protect users from such deceptions, this study evaluated the ability of machine learning to detect the fraudulent e-wallet deposit notification SMSes. The naïve Bayes (NB) and support vector machine (SVM) classifiers were trained to classify both ham (desired) SMSes and scam (fraudulent) e-wallet deposit notification SMSes. The performances of the two classifier models were then evaluated. The results revealed that the SVM classifier model could detect the fraudulent SMSes more efficiently than the NB classifier.

Prediction of Breast Cancer Using Machine Learning

2020 ◽  
Vol 13 (5) ◽  
pp. 901-908
Author(s):  
Somil Jain ◽  
Puneet Kumar
Keyword(s):  
Breast Cancer ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Random Forest ◽  
Prediction Accuracy ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Support Vector ◽  
Classification Algorithms ◽  
Breast Cancer Dataset

Background:: Breast cancer is one of the diseases which cause number of deaths ever year across the globe, early detection and diagnosis of such type of disease is a challenging task in order to reduce the number of deaths. Now a days various techniques of machine learning and data mining are used for medical diagnosis which has proven there metal by which prediction can be done for the chronic diseases like cancer which can save the life’s of the patients suffering from such type of disease. The major concern of this study is to find the prediction accuracy of the classification algorithms like Support Vector Machine, J48, Naïve Bayes and Random Forest and to suggest the best algorithm. Objective:: The objective of this study is to assess the prediction accuracy of the classification algorithms in terms of efficiency and effectiveness. Methods: This paper provides a detailed analysis of the classification algorithms like Support Vector Machine, J48, Naïve Bayes and Random Forest in terms of their prediction accuracy by applying 10 fold cross validation technique on the Wisconsin Diagnostic Breast Cancer dataset using WEKA open source tool. Results:: The result of this study states that Support Vector Machine has achieved the highest prediction accuracy of 97.89 % with low error rate of 0.14%. Conclusion:: This paper provides a clear view over the performance of the classification algorithms in terms of their predicting ability which provides a helping hand to the medical practitioners to diagnose the chronic disease like breast cancer effectively.

scholarly journals Benthic Habitat Mapping Model and Cross Validation Using Machine-Learning Classification Algorithms

2019 ◽  
Vol 11 (11) ◽  
pp. 1279 ◽  
Author(s):  
Pramaditya Wicaksono ◽  
Prama Ardha Aryaguna ◽  
Wahyu Lazuardi
Keyword(s):  
Machine Learning ◽  
Classification Scheme ◽  
Learning Algorithm ◽  
Classification Tree ◽  
Habitat Mapping ◽  
Support Vector ◽  
Benthic Habitat ◽  
Classification Algorithms ◽  
Machine Learning Classification ◽  
Mapping Model

This research was aimed at developing the mapping model of benthic habitat mapping using machine-learning classification algorithms and tested the applicability of the model in different areas. We integrated in situ benthic habitat data and image processing of WorldView-2 (WV2) image to parameterise the machine-learning algorithm, namely: Random Forest (RF), Classification Tree Analysis (CTA), and Support Vector Machine (SVM). The classification inputs are sunglint-free bands, water column corrected bands, Principle Component (PC) bands, bathymetry, and the slope of underwater topography. Kemujan Island was used in developing the model, while Karimunjawa, Menjangan Besar, and Menjangan Kecil Islands served as test areas. The results obtained indicated that RF was more accurate than any other classification algorithm based on the statistics and benthic habitats spatial distribution. The maximum accuracy of RF was 94.17% (4 classes) and 88.54% (14 classes). The accuracies from RF, CTA, and SVM were consistent across different input bands for each classification scheme. The application of RF model in the classification of benthic habitat in other areas revealed that it is recommended to make use of the more general classification scheme in order to avoid several issues regarding benthic habitat variations. The result also established the possibility of mapping a benthic habitat without the use of training areas.

Sign in / Sign up

Export Citation Format

Share Document