Performance Analysis of Machine Learning Techniques on Big Data Using Apache Spark

2018 ◽  
pp. 17-26 ◽  
Author(s):  
Garima Mogha ◽  
Khyati Ahlawat ◽  
Amit Prakash Singh
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Performance Analysis ◽  
Apache Spark ◽  
Machine Learning Techniques ◽  
Learning Techniques

Performance analysis of machine learning techniques for the prediction of breast cancer in big data environment

2020 ◽  
Author(s):  
Premalatha Jayapaul ◽  
Aswini Balasundaram ◽  
Kavi Priya Dharshini Seturamalingam ◽  
Kavithra Sekar
Keyword(s):  
Breast Cancer ◽  
Machine Learning ◽  
Big Data ◽  
Performance Analysis ◽  
Machine Learning Techniques ◽  
Learning Techniques ◽  
Data Environment

scholarly journals Comparative Analysis of Machine Learning Techniques to Identify Churn for Telecom Data

2018 ◽  
Vol 7 (3.34) ◽  
pp. 291
Author(s):  
M Malleswari ◽  
R.J Manira ◽  
Praveen Kumar ◽  
Murugan .
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Random Forest ◽  
Decision Tree ◽  
Apache Spark ◽  
Machine Learning Techniques ◽  
Churn Prediction ◽  
Learning Techniques ◽  
Boosted Tree ◽  
Customer Attrition

 Big data analytics has been the focus for large scale data processing. Machine learning and Big data has great future in prediction. Churn prediction is one of the sub domain of big data. Preventing customer attrition especially in telecom is the advantage of churn prediction.  Churn prediction is a day-to-day affair involving millions. So a solution to prevent customer attrition can save a lot. This paper propose to do comparison of three machine learning techniques Decision tree algorithm, Random Forest algorithm and Gradient Boosted tree algorithm using Apache Spark. Apache Spark is a data processing engine used in big data which provides in-memory processing so that the processing speed is higher. The analysis is made by extracting the features of the data set and training the model. Scala is a programming language that combines both object oriented and functional programming and so a powerful programming language. The analysis is implemented using Apache Spark and modelling is done using scala ML. The accuracy of Decision tree model came out as 86%, Random Forest model is 87% and Gradient Boosted tree is 85%. 

scholarly journals Estimating the CAP greening effect by machine learning techniques: A big data ex post analysis

2021 ◽  
Vol 119 ◽  
pp. 44-53
Author(s):  
Danilo Bertoni ◽  
Giacomo Aletti ◽  
Daniele Cavicchioli ◽  
Alessandra Micheletti ◽  
Roberto Pretolani
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Machine Learning Techniques ◽  
Ex Post ◽  
Learning Techniques ◽  
Ex Post Analysis

scholarly journals Leveraging Artificial Intelligence and Big Data to Optimize COVID-19 Clinical Public Health and Vaccination Roll-Out Strategies in Africa

2021 ◽  
Vol 18 (15) ◽  
pp. 7890
Author(s):  
Bruce Mellado ◽  
Jianhong Wu ◽  
Jude Dzevela Kong ◽  
Nicola Luigi Bragazzi ◽  
Ali Asgary ◽  
...  
Keyword(s):  
Public Health ◽  
Artificial Intelligence ◽  
Machine Learning ◽  
Big Data ◽  
Developed Countries ◽  
Machine Learning Techniques ◽  
Multiple Data ◽  
Learning Techniques ◽  
Unequal Access ◽  
Roll Out

COVID-19 is imposing massive health, social and economic costs. While many developed countries have started vaccinating, most African nations are waiting for vaccine stocks to be allocated and are using clinical public health (CPH) strategies to control the pandemic. The emergence of variants of concern (VOC), unequal access to the vaccine supply and locally specific logistical and vaccine delivery parameters, add complexity to national CPH strategies and amplify the urgent need for effective CPH policies. Big data and artificial intelligence machine learning techniques and collaborations can be instrumental in an accurate, timely, locally nuanced analysis of multiple data sources to inform CPH decision-making, vaccination strategies and their staged roll-out. The Africa-Canada Artificial Intelligence and Data Innovation Consortium (ACADIC) has been established to develop and employ machine learning techniques to design CPH strategies in Africa, which requires ongoing collaboration, testing and development to maximize the equity and effectiveness of COVID-19-related CPH interventions.

scholarly journals Predictors of outpatients’ no-show: big data analytics using apache spark

2020 ◽  
Vol 7 (1) ◽  
Author(s):  
Tahani Daghistani ◽  
Huda AlGhamdi ◽  
Riyad Alshammari ◽  
Raed H. AlHazme
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Negative Impact ◽  
Big Data Analytics ◽  
Quality Of Healthcare ◽  
Machine Learning Techniques ◽  
Gradient Boosting ◽  
Healthcare Organizations ◽  
Data Framework ◽  
Learning Techniques

AbstractOutpatients who fail to attend their appointments have a negative impact on the healthcare outcome. Thus, healthcare organizations facing new opportunities, one of them is to improve the quality of healthcare. The main challenges is predictive analysis using techniques capable of handle the huge data generated. We propose a big data framework for identifying subject outpatients’ no-show via feature engineering and machine learning (MLlib) in the Spark platform. This study evaluates the performance of five machine learning techniques, using the (2,011,813‬) outpatients’ visits data. Conducting several experiments and using different validation methods, the Gradient Boosting (GB) performed best, resulting in an increase of accuracy and ROC to 79% and 81%, respectively. In addition, we showed that exploring and evaluating the performance of the machine learning models using various evaluation methods is critical as the accuracy of prediction can significantly differ. The aim of this paper is exploring factors that affect no-show rate and can be used to formulate predictions using big data machine learning techniques.

Sign in / Sign up

Export Citation Format

Share Document