Predicting Bug Priority Using Topic Modelling in Imbalanced Learning Environments

2021 ◽  
Vol 11 (1) ◽  
pp. 31-42
Author(s):  
Jayalath Bandara Ekanayake
Keyword(s):  
Logistic Regression ◽  
Decision Tree ◽  
Prediction Models ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Potential Candidate ◽  
Priority Level ◽  
Bug Reports ◽  
Manual Classification

Manual classification of bug reports is time-consuming as the reports are received in large quantities. Alternatively, this project proposed automatic bug prediction models to classify the bug reports. The topics or the candidate keywords are mined from the developer description in bug reports using RAKE algorithm and converted into attributes. These attributes together with the target attribute—priority level—construct the training datasets. Naïve Bayes, logistic regression, and decision tree learner algorithms are trained, and the prediction quality was measured using area under recursive operative characteristics curves (AUC) as AUC does not consider the biasness in datasets. The logistics regression model outperforms the other two models providing the accuracy of 0.86 AUC whereas the naïve Bayes and the decision tree learner recorded 0.79 AUC and 0.81 AUC, respectively. The bugs can be classified without developer involvement and logistic regression is also a potential candidate as naïve Bayes for bug classification.

scholarly journals Bug Severity Prediction using Keywords in Imbalanced Learning Environment

2021 ◽  
Vol 13 (3) ◽  
pp. 53-60
Author(s):  
Jayalath Ekanayake ◽  
Keyword(s):  
Logistic Regression ◽  
Regression Model ◽  
Prediction Models ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Classification Models ◽  
Prediction Quality ◽  
Bug Reports ◽  
Severity Prediction ◽  
Severity Levels

Reported bugs of software systems are classified into different severity levels before fixing them. The number of bug reports may not be equally distributed according to the severity levels of bugs. However, most of the severity prediction models developed in the literature assumed that the underlying data distribution is evenly distributed, which may not correct at all instances and hence, the aim of this study is to develop bug classification models from unevenly distributed datasets and tested them accordingly. To that end first, the topics or keywords of developer descriptions of bug reports are extracted using Rapid Keyword Extraction (RAKE) algorithm and then transferred them into numerical attributes, which combined with severity levels constructs datasets. These datasets are used to build classification models; Naïve Bayes, Logistic Regression, and Decision Tree Learner algorithms. The models’ prediction quality is measured using Area Under Recursive Operative Characteristics Curves (AUC) as the models learnt from more skewed environments. According to the results, the prediction quality of the Logistics Regression model is 0.65 AUC whereas the other two models recorded maximum 0.60 AUC. Though the datasets contain comparatively less number of instances from the high severity classes; Blocking and High, the Logistic Regression models predict the two classes with a decent AUC value of 0.65 AUC. Hence, this projects shows that the models can be trained from highly skewed datasets so that the models prediction quality is equally well over all the classes regardless of number of instances representing the class. Further, this project emphasizes that the models should be evaluated using the appropriate metrics when the models are trained from imbalance learning environments. Also, this work uncovers that the Logistic Regression model is also capable of classifying documents as Naïve Bayes, which is well known for this task.

scholarly journals Classifying the Level of Energy-Environmental Efficiency Rating of Brazilian Ethanol

Energies ◽  
2020 ◽  
Vol 13 (8) ◽  
pp. 2067
Author(s):  
Nilsa Duarte da Silva Lima ◽  
Irenilza de Alencar Nääs ◽  
João Gilberto Mendes dos Reis ◽  
Raquel Baracat Tosi Rodrigues da Silva
Keyword(s):  
Decision Tree ◽  
High Efficiency ◽  
Rating Scale ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Environmental Efficiency ◽  
Classification Model ◽  
Bayes Algorithm ◽  
J48 Decision Tree

The present study aimed to assess and classify energy-environmental efficiency levels to reduce greenhouse gas emissions in the production, commercialization, and use of biofuels certified by the Brazilian National Biofuel Policy (RenovaBio). The parameters of the level of energy-environmental efficiency were standardized and categorized according to the Energy-Environmental Efficiency Rating (E-EER). The rating scale varied between lower efficiency (D) and high efficiency + (highest efficiency A+). The classification method with the J48 decision tree and naive Bayes algorithms was used to predict the models. The classification of the E-EER scores using a decision tree using the J48 algorithm and Bayesian classifiers using the naive Bayes algorithm produced decision tree models efficient at estimating the efficiency level of Brazilian ethanol producers and importers certified by the RenovaBio. The rules generated by the models can assess the level classes (efficiency scores) according to the scale discretized into high efficiency (Classification A), average efficiency (Classification B), and standard efficiency (Classification C). These results might generate an ethanol energy-environmental efficiency label for the end consumers and resellers of the product, to assist in making a purchase decision concerning its performance. The best classification model was naive Bayes, compared to the J48 decision tree. The classification of the Energy Efficiency Note levels using the naive Bayes algorithm produced a model capable of estimating the efficiency level of Brazilian ethanol to create labels.

scholarly journals Komparasi Tujuh Algoritma Identifikasi Fraud ATM Pada PT. Bank Central Asia Tbk

2020 ◽  
Vol 7 (3) ◽  
pp. 441-450
Author(s):  
Haliem Sunata
Keyword(s):  
Logistic Regression ◽  
Random Forest ◽  
Decision Tree ◽  
Central Asia ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Random Tree

Tingginya penggunaan mesin ATM, sehingga menimbulkan celah fraud yang dapat dilakukan oleh pihak ketiga dalam membantu PT. Bank Central Asia Tbk untuk menjaga mesin ATM agar selalu siap digunakan oleh nasabah. Lambat dan sulitnya mengidentifikasi fraud mesin ATM menjadi salah satu kendala yang dihadapi PT. Bank Central Asia Tbk. Dengan adanya permasalahan tersebut maka peneliti mengumpulkan 5 dataset dan melakukan pre-processing dataset sehingga dapat digunakan untuk pemodelan dan pengujian algoritma, guna menjawab permasalahan yang terjadi. Dilakukan 7 perbandingan algoritma diantaranya decision tree, gradient boosted trees, logistic regression, naive bayes ( kernel ), naive bayes, random forest dan random tree. Setelah dilakukan pemodelan dan pengujian didapatkan hasil bahwa algoritma gradient boosted trees merupakan algoritma terbaik dengan hasil akurasi sebesar 99.85% dan nilai AUC sebesar 1, tingginya hasil algoritma ini disebabkan karena kecocokan setiap attribut yang diuji dengan karakter gradient boosted trees dimana algoritma ini menyimpan dan mengevaluasi hasil yang ada. Maka algoritma gradient boosted trees merupakan penyelesaian dari permasalahan yang dihadapi oleh PT. Bank Central Asia Tbk.

scholarly journals IProCAD: Intelligent Prognosis of Coronary Artery Disease Excluding Angiogram in Patient with Stable Angina

2020 ◽  
Vol 9 (5) ◽  
pp. 2032-2040
Keyword(s):  
Machine Learning ◽  
Logistic Regression ◽  
Heart Disease ◽  
Random Forest ◽  
Decision Tree ◽  
Stable Angina ◽  
Naive Bayes ◽  
Feature Vector ◽  
Naïve Bayes ◽  
The Other

Cardiovascular diseases are one of the main causes of mortality in the world. A proper prediction mechanism system with reasonable cost can significantly reduce this death toll in the low-income countries like Bangladesh. For those countries we propose machine learning backed embedded system that can predict possible cardiac attack effectively by excluding the high cost angiogram and incorporating only twelve (12) low cost features which are age, sex, chest pain, blood pressure, cholesterol, blood sugar, ECG results, heart rate, exercise induced angina, old peak, slope, and history of heart disease. Here, two heart disease datasets of own built NICVD (National Institute of Cardiovascular Disease, Bangladesh) patients’, and UCI (University of California Irvin) are used. The overall process comprises into four phases: Comprehensive literature review, collection of stable angina patients’ data through survey questionnaires from NICVD, feature vector dimensionality is reduced manually (from 14 to 12 dimensions), and the reduced feature vector is fed to machine learning based classifiers to obtain a prediction model for the heart disease. From the experiments, it is observed that the proposed investigation using NICVD patient’s data with 12 features without incorporating angiographic disease status to Artificial Neural Network (ANN) shows better classification accuracy of 92.80% compared to the other classifiers Decision Tree (82.50%), Naïve Bayes (85%), Support Vector Machine (SVM) (75%), Logistic Regression (77.50%), and Random Forest (75%) using the 10-fold cross validation. To accommodate small scale training and test data in our experimental environment we have observed the accuracy of ANN, Decision Tree, Naïve Bayes, SVM, Logistic Regression and Random Forest using Jackknife method, which are 84.80%, 71%, 75.10%, 75%, 75.33% and 71.42% respectively. On the other hand, the classification accuracies of the corresponding classifiers are 91.7%, 76.90%, 86.50%, 76.3%, 67.0% and 67.3%, respectively for the UCI dataset with 12 attributes. Whereas the same dataset with 14 attributes including angiographic status shows the accuracies 93.5%, 76.7%, 86.50%, 76.8%, 67.7% and 69.6% for the respective classifiers

scholarly journals Tackling pandemics in smart cities using machine learning architecture

2021 ◽  
Vol 18 (6) ◽  
pp. 8444-8461
Author(s):  
Desire Ngabo ◽  
◽  
Wang Dong ◽  
Ebuka Ibeke ◽  
Celestine Iwendi ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Logistic Regression ◽  
Decision Tree ◽  
Naive Bayes ◽  
Smart Cities ◽  
Naïve Bayes ◽  
Healthcare Data ◽  
Runny Nose ◽  
Rate Analysis ◽  
Nearest Neighbours

<abstract><p>With the recent advancement in analytic techniques and the increasing generation of healthcare data, artificial intelligence (AI) is reinventing the healthcare system for tackling pandemics securely in smart cities. AI tools continue register numerous successes in major disease areas such as cancer, neurology and now in new coronavirus SARS-CoV-2 (COVID-19) detection. COVID-19 patients often experience several symptoms which include breathlessness, fever, cough, nausea, sore throat, blocked nose, runny nose, headache, muscle aches, and joint pains. This paper proposes an artificial intelligence (AI) algorithm that predicts the rate of likely survivals of COVID-19 suspected patients based on good immune system, exercises and age quantiles securely. Four algorithms (Naïve Bayes, Logistic Regression, Decision Tree and k-Nearest Neighbours (kNN)) were compared. We performed True Positive (TP) rate and False Positive (FP) rate analysis on both positive and negative covid patients data. The experimental results show that kNN, and Decision Tree both obtained a score of 99.30% while Naïve Bayes and Logistic Regression obtained 91.70% and 99.20%, respectively on TP rate for negative patients. For positive covid patients, Naïve Bayes outperformed other models with a score of 10.90%. On the other hand, Naïve Bayes obtained a score of 89.10% for FP rate for negative patients while Logistic Regression, kNN, and Decision Tree obtained scores of 93.90%, 93.90%, and 94.50%, respectively.</p></abstract>

Identification of Most Relevant Features for Classification of Francisella tularensis using Machine Learning

2020 ◽  
Vol 15 ◽  
Author(s):  
Fareed Ahmad ◽  
Amjad Farooq ◽  
Muhammad Usman Ghani Khan ◽  
Muhammad Zubair Shabbir ◽  
Masood Rabbani ◽  
...  
Keyword(s):  
Machine Learning ◽  
Random Forest ◽  
Francisella Tularensis ◽  
Naive Bayes ◽  
Naïve Bayes ◽  
Feature Ranking ◽  
Potential Candidate ◽  
Ranking Methods ◽  
Statistical Measures

Background: Francisella tularensis is a stealth pathogen fatal for animals and humans. Ease of its propagation, coupled with high capacity for ailment and death makes it a potential candidate for biological weapon. Objective: Work related to the pathogen’s classification and factors affecting its prolonged existence in soil is limited to statistical measures. Machine learning other than conventional analysis methods may be applied to better predict epidemiological modeling for this soil-borne pathogen. Method: Feature-ranking algorithms namely; relief, correlation and oneR are used for soil attribute ranking. Moreover, classification algorithms; SVM, random forest, naive bayes, logistic regression and MLP are used for classification of the soil attribute dataset for Francisella tularensis positive and negative soils. Results: Feature-ranking methods conclude; clay, nitrogen, organic matter, soluble salts, zinc, silt and nickel are the most significant attributes while potassium, phosphorous, iron, calcium, copper, chromium and sand are least contributing risk factors for the persistence of the pathogen. However, clay is the most significant and potassium is the least contributing attribute. Data analysis suggests that feature-ranking using relief produced classification accuracy of 84.35% for multilayer perceptron; 82.99% for linear regression; 80.27% for SVM and random forest; and 78.23% for naive bayes, which is better than other ranking methods. MLP outperforms other classifiers by generating an accuracy of 84.35%,82.99% and 81.63% for feature-ranking using relief, correlation and oneR algorithms, respectively. Conclusion: These models can significantly improve accuracy and can minimize the risk of incorrect classification. They further help in controlling epidemics and thereby minimizing the socio-economic impact on the society.

Sign in / Sign up

Export Citation Format

Share Document