scholarly journals k-Nearest Neighbour Classifiers - A Tutorial

2021 ◽  
Vol 54 (6) ◽  
pp. 1-25
Author(s):  
Pádraig Cunningham ◽  
Sarah Jane Delany
Keyword(s):  
Machine Learning ◽  
Similarity Measures ◽  
Machine Learning Techniques ◽  
Nearest Neighbour ◽  
Computational Power ◽  
Learning Techniques ◽  
Nearest Neighbours ◽  
Technical Report ◽  
Nearest Neighbour Classifier ◽  
Similarity Distance

Perhaps the most straightforward classifier in the arsenal or Machine Learning techniques is the Nearest Neighbour Classifier—classification is achieved by identifying the nearest neighbours to a query example and using those neighbours to determine the class of the query. This approach to classification is of particular importance, because issues of poor runtime performance is not such a problem these days with the computational power that is available. This article presents an overview of techniques for Nearest Neighbour classification focusing on: mechanisms for assessing similarity (distance), computational issues in identifying nearest neighbours, and mechanisms for reducing the dimension of the data. This article is the second edition of a paper previously published as a technical report [16]. Sections on similarity measures for time-series, retrieval speedup, and intrinsic dimensionality have been added. An Appendix is included, providing access to Python code for the key methods.

scholarly journals Ecological Interactions and the Netflix Problem

2016 ◽  
Author(s):  
Philippe Desjardins-Proulx ◽  
Idaline Laigle ◽  
Timothée Poisot ◽  
Dominique Gravel
Keyword(s):  
Machine Learning ◽  
Supervised Learning ◽  
Random Forests ◽  
Species Interactions ◽  
Similarity Measures ◽  
Theoretical Models ◽  
Machine Learning Techniques ◽  
Nearest Neighbour ◽  
Ecological Interactions ◽  
Learning Techniques

0AbstractSpecies interactions are a key component of ecosystems but we generally have an incomplete picture of who-eats-who in a given community. Different techniques have been devised to predict species interactions using theoretical models or abundances. Here, we explore the K nearest neighbour approach, with a special emphasis on recommendation, along with other machine learning techniques. Recommenders are algorithms developed for companies like Netflix to predict if a customer would like a product given the preferences of similar customers. These machine learning techniques are well-suited to study binary ecological interactions since they focus on positive-only data. We also explore how the K nearest neighbour approach can be used with both positive and negative information, in which case the goal of the algorithm is to fill missing entries from a matrix (imputation). By removing a prey from a predator, we find that recommenders can guess the missing prey around 50% of the times on the first try, with up to 881 possibilities. Traits do not improve significantly the results for the K nearest neighbour, although a simple test with a supervised learning approach (random forests) show we can predict interactions with high accuracy using only three traits per species. This result shows that binary interactions can be predicted without regard to the ecological community given only three variables: body mass and two variables for the species’ phylogeny. These techniques are complementary, as recommenders can predict interactions in the absence of traits, using only information about other species’ interactions, while supervised learning algorithms such as random forests base their predictions on traits only but do not exploit other species’ interactions. Further work should focus on developing custom similarity measures specialized to ecology to improve the KNN algorithms and using richer data to capture indirect relationships between species.

scholarly journals Comparison of Machine Learning algorithm for COVID-19 Death Risk Prediction

2021 ◽  
Author(s):  
Praveeen Anandhanathan ◽  
Priyanka Gopalan
Keyword(s):  
Machine Learning ◽  
Learning Algorithm ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Nearest Neighbour ◽  
Decision Tree Algorithm ◽  
The Past ◽  
Random Forest Method ◽  
Learning Techniques ◽  
The World

Abstract Coronavirus disease (COVID-19) is spreading across the world. Since at first it has appeared in Wuhan, China in December 2019, it has become a serious issue across the globe. There are no accurate resources to predict and find the disease. So, by knowing the past patients’ records, it could guide the clinicians to fight against the pandemic. Therefore, for the prediction of healthiness from symptoms Machine learning techniques can be implemented. From this we are going to analyse only the symptoms which occurs in every patient. These predictions can help clinicians in the easier manner to cure the patients. Already for prediction of many of the diseases, techniques like SVM (Support vector Machine), Fuzzy k-Means Clustering, Decision Tree algorithm, Random Forest Method, ANN (Artificial Neural Network), KNN (k-Nearest Neighbour), Naïve Bayes, Linear Regression model are used. As we haven’t faced this disease before, we can’t say which technique will give the maximum accuracy. So, we are going to provide an efficient result by comparing all the such algorithms in RStudio.

scholarly journals Heart Disease Prediction using Machine Learning

2020 ◽  
Vol 9 (1) ◽  
pp. 700-704
Keyword(s):  
Machine Learning ◽  
Heart Disease ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Disease Prediction ◽  
Nearest Neighbour ◽  
Decision Tree Classifier ◽  
Support Vector Classifier ◽  
Learning Techniques ◽  
Tree Classifier

Deriving the methodologies to detect heart issues at an earlier stage and intimating the patient to improve their health. To resolve this problem, we will use Machine Learning techniques to predict the incidence at an earlier stage. We have a tendency to use sure parameters like age, sex, height, weight, case history, smoking and alcohol consumption and test like pressure ,cholesterol, diabetes, ECG, ECHO for prediction. In machine learning there are many algorithms which will be used to solve this issue. The algorithms include K-Nearest Neighbour, Support vector classifier, decision tree classifier, logistic regression and Random Forest classifier. Using these parameters and algorithms we need to predict whether or not the patient has heart disease or not and recommend the patient to improve his/her health.

Supervised Machine Learning for Plants Identification Based on Images of Their Leaves

2020 ◽  
pp. 1314-1330 ◽  
Author(s):  
Mohamed Elhadi Rahmani ◽  
Abdelmalek Amine ◽  
Reda Mohamed Hamou
Keyword(s):  
Machine Learning ◽  
Learning Algorithm ◽  
Texture Feature ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Nearest Neighbour ◽  
Curve Shape ◽  
Distance Curve ◽  
Shape Signature ◽  
Learning Techniques

Botanists study in general the characteristics of leaves to give to each plant a scientific name; such as shape, margin...etc. This paper proposes a comparison of supervised plant identification using different approaches. The identification is done according to three different features extracted from images of leaves: a fine-scale margin feature histogram, a Centroid Contour Distance Curve shape signature and an interior texture feature histogram. First represent each leaf by one feature at a time in, then represent leaves by two features, and each leaf was represented by the three features. After that, the authors classified the obtained vectors using different supervised machine learning techniques; the used techniques are Decision tree, Naïve Bayes, K-nearest neighbour, and neural network. Finally, they evaluated the classification using cross validation. The main goal of this work is studying the influence of representation of leaves' images on the identification of plants, and also studying the use of supervised machine learning algorithm for plant leaves classification.

scholarly journals Machine Classification of Transient Images

2014 ◽  
Vol 10 (S306) ◽  
pp. 288-291
Author(s):  
Lise du Buisson ◽  
Navin Sivanandam ◽  
Bruce A. Bassett ◽  
Mathew Smith
Keyword(s):  
Machine Learning ◽  
Naive Bayes ◽  
Machine Learning Techniques ◽  
Imaging Data ◽  
Transient Detection ◽  
Minimum Error ◽  
Learning Techniques ◽  
Nearest Neighbours ◽  
Transient Imaging

AbstractUsing transient imaging data from the 2nd and 3rd years of the SDSS supernova survey, we apply various machine learning techniques to the problem of classifying transients (e.g. SNe) from artefacts, one of the first steps in any transient detection pipeline, and one that is often still carried out by human scanners. Using features mostly obtained from PCA, we show that we can match human levels of classification success, and find that a K-nearest neighbours algorithm and SkyNet perform best, while the Naive Bayes, SVM and minimum error classifier have performances varying from slightly to significantly worse.

scholarly journals Soil Classification and Harvest Proposal Implemented using Machine Learning Techniques

2020 ◽  
Vol 9 (12) ◽  
pp. 19-22
Keyword(s):  
Machine Learning ◽  
Soil Type ◽  
Soil Classification ◽  
Machine Learning Algorithms ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Nearest Neighbour ◽  
The People ◽  
Learning Techniques ◽  
Crop Type

The major source of living for the people of India is agriculture. It is considered as important economy for the country. India is one of the country that suffer from natural calamities like drought and flood that may destroy the crops which may lead to heavy loss for the people doing agriculture. Predicting the crop type can help them to cultivate the suitable crop that can be cultivated in that particular soil type. Soil is one major factor or agriculture. There are several types of soil available in our county. In order to classify the soil type we need to understand the characteristics of the soil. Data mining and machine learning is one of the emerging technology in the field of agriculture and horticulture. In order to classify the soil type and Provide suggestion of fertilizers that can improve the growth of the crop cultivated in that particular soil type plays major role in agriculture. For that here exploring Several machine learning algorithms such as Support vector machine(SVM),k-Nearest Neighbour(k-NN) and logistic regression are used to classify the soil type.

scholarly journals Ecological interactions and the Netflix problem

PeerJ ◽  
2017 ◽  
Vol 5 ◽  
pp. e3644 ◽  
Author(s):  
Philippe Desjardins-Proulx ◽  
Idaline Laigle ◽  
Timothée Poisot ◽  
Dominique Gravel
Keyword(s):  
Machine Learning ◽  
Supervised Learning ◽  
Random Forests ◽  
Species Interactions ◽  
Similarity Measures ◽  
Theoretical Models ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Nearest Neighbour ◽  
Ecological Interactions

Species interactions are a key component of ecosystems but we generally have an incomplete picture of who-eats-who in a given community. Different techniques have been devised to predict species interactions using theoretical models or abundances. Here, we explore the K nearest neighbour approach, with a special emphasis on recommendation, along with a supervised machine learning technique. Recommenders are algorithms developed for companies like Netflix to predict whether a customer will like a product given the preferences of similar customers. These machine learning techniques are well-suited to study binary ecological interactions since they focus on positive-only data. By removing a prey from a predator, we find that recommenders can guess the missing prey around 50% of the times on the first try, with up to 881 possibilities. Traits do not improve significantly the results for the K nearest neighbour, although a simple test with a supervised learning approach (random forests) show we can predict interactions with high accuracy using only three traits per species. This result shows that binary interactions can be predicted without regard to the ecological community given only three variables: body mass and two variables for the species’ phylogeny. These techniques are complementary, as recommenders can predict interactions in the absence of traits, using only information about other species’ interactions, while supervised learning algorithms such as random forests base their predictions on traits only but do not exploit other species’ interactions. Further work should focus on developing custom similarity measures specialized for ecology to improve the KNN algorithms and using richer data to capture indirect relationships between species.

Oceanographic data reconstruction using machine learning techniques

2021 ◽  
Author(s):  
Hrvoje Kalinić ◽  
Zvonimir Bilokapić ◽  
Frano Matić
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Linear Regression ◽  
Spatial Resolution ◽  
Adriatic Sea ◽  
Machine Learning Techniques ◽  
Wind Data ◽  
Average Amplitude ◽  
Learning Techniques ◽  
Nearest Neighbours

<p>In certain measurement endeavours spatial resolution of the data is restricted, while in others data have poor temporal resolution. Typical example of these scenarios come from geoscience where measurement stations are fixed and scattered sparsely in space which results in poor spatial resolution of acquired data. Thus, we ask if it is possible to use a portion of data as a proxy to estimate the rest of the data using different machine learning techniques. In this study, four supervised machine learning methods are trained on the wind data from the Adriatic Sea and used to reconstruct the missing data. The vector wind data components at 10m height are taken from ERA5 reanalysis model in range from 1981 to 2017 and sampled every 6 hours. Data taken from the northern part of the Adriatic Sea was used to estimate the wind at the southern part of Adriatic. The machine learning models utilized for this task were linear regression, K-nearest neighbours, decision trees and a neural network. As a measure of quality of reconstruction the difference between the true and estimated values of wind data in the southern part of Adriatic was used. The result shows that all four models reconstruct the data few hundred kilometres away with average amplitude error below 1m/s. Linear regression, K-nearest neighbours, decision trees and a neural network show average amplitude reconstruction error of 0.52, 0.91, 0.76 and 0.73, and standard deviation of 1.00, 1.42, 1.23 and 1.17, respectively. This work has been supported by Croatian Science Foundation under the project UIP-2019-04-1737.</p>

scholarly journals A shell dataset, for shell features extraction and recognition

2019 ◽  
Vol 6 (1) ◽  
Author(s):  
Qi Zhang ◽  
Jianhang Zhou ◽  
Jing He ◽  
Xiaodong Cun ◽  
Shaoning Zeng ◽  
...  
Keyword(s):  
Machine Learning ◽  
Recognition Performance ◽  
Academic Research ◽  
Features Extraction ◽  
Machine Learning Techniques ◽  
New Methods ◽  
Learning Techniques ◽  
Nearest Neighbours ◽  
The World ◽  
New Machine

Abstract Shells are very common objects in the world, often used for decorations, collections, academic research, etc. With tens of thousands of species, shells are not easy to identify manually. Until now, no one has proposed the recognition of shells using machine learning techniques. We initially present a shell dataset, containing 7894 shell species with 29622 samples, where totally 59244 shell images for shell features extraction and recognition are used. Three features of shells, namely colour, shape and texture were generated from 134 shell species with 10 samples, which were then validated by two different classifiers: k-nearest neighbours (k-NN) and random forest. Since the development of conchology is mature, we believe this dataset can represent a valuable resource for automatic shell recognition. The extracted features of shells are also useful in developing and optimizing new machine learning techniques. Furthermore, we hope more researchers can present new methods to extract shell features and develop new classifiers based on this dataset, in order to improve the recognition performance of shell species.

Sign in / Sign up

Export Citation Format

Share Document