Machine Learning for Big Data

2021 ◽  
pp. 56-76
Author(s):  
Supriya M. S. ◽  
Keerthana Sasidaran
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Learning Algorithms ◽  
Full Scale ◽  
Machine Learning Algorithms ◽  
Learning Approaches ◽  
Data Process ◽  
Machine Learning Model ◽  
To Come ◽  
Insight Into

Big data and machine learning currently play an important role in various applications and in research. These approaches are explored in depth in this chapter. The chapter starts with a summary of big data and its implementation in a number of fields, and then deals with the problems that big data presents and the need for other technology to resolve these issues/challenges. Big data can best be used with the aid of the machine learning model, even though they are not directly related. Thus, the paradigms of machine learning that support big data can be combined with big data technology, thus providing insight into a range of big data machine learning approaches and techniques. Although big data cannot rely solely on the few paradigms of machine learning, the underlying problems are addressed. New machine learning algorithms are needed that can explore the full scale of the big data process and enable software engineering firms to come up with better solutions.

scholarly journals An Optimizing Method for Performance and ResourceUtilization in Quantum Machine Learning Circuits

2022 ◽  
Author(s):  
Tahereh Salehi ◽  
Mariam Zomorodi ◽  
Paweł Pławiak ◽  
Mina Abbaszade ◽  
Vahid Salari
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Quantum Algorithms ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Learning Approaches ◽  
Special Cases ◽  
Daunting Task ◽  
Quantum Machine Learning ◽  
Learning Circuits

Abstract Quantum computing is a new and advanced topic that refers to calculations based on the principles of quantum mechanics. Itmakes certain kinds of problems be solved easier compared to classical computers. This advantage of quantum computingcan be used to implement many existing problems in different fields incredibly effectively. One important field that quantumcomputing has shown great results in machine learning. Until now, many different quantum algorithms have been presented toperform different machine learning approaches. In some special cases, the execution time of these quantum algorithms will bereduced exponentially compared to the classical ones. But at the same time, with increasing data volume and computationtime, taking care of systems to prevent unwanted interactions with the environment can be a daunting task and since thesealgorithms work on machine learning problems, which usually includes big data, their implementation is very costly in terms ofquantum resources. Here, in this paper, we have proposed an approach to reduce the cost of quantum circuits and to optimizequantum machine learning circuits in particular. To reduce the number of resources used, in this paper an approach includingdifferent optimization algorithms is considered. Our approach is used to optimize quantum machine learning algorithms forbig data. In this case, the optimized circuits run quantum machine learning algorithms in less time than the original onesand by preserving the original functionality. Our approach improves the number of quantum gates by 10.7% and 14.9% indifferent circuits and the number of time steps is reduced by three and 15 units, respectively. This is the amount of reduction forone iteration of a given sub-circuit U in the main circuit. For cases where this sub-circuit is repeated more times in the maincircuit, the optimization rate is increased. Therefore, by applying the proposed method to circuits with big data, both cost andperformance are improved.

scholarly journals Searching for improvements in predicting human eye colour from DNA

2021 ◽  
Author(s):  
Magdalena Kukla-Bartoszek ◽  
Paweł Teisseyre ◽  
Ewelina Pośpiech ◽  
Joanna Karłowska-Pik ◽  
Piotr Zieliński ◽  
...  
Keyword(s):  
Machine Learning ◽  
Regression Models ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Sequencing Analysis ◽  
Learning Approaches ◽  
Human Eye ◽  
Software Analysis ◽  
Whole Exome ◽  
Eye Colour

AbstractIncreasing understanding of human genome variability allows for better use of the predictive potential of DNA. An obvious direct application is the prediction of the physical phenotypes. Significant success has been achieved, especially in predicting pigmentation characteristics, but the inference of some phenotypes is still challenging. In search of further improvements in predicting human eye colour, we conducted whole-exome (enriched in regulome) sequencing of 150 Polish samples to discover new markers. For this, we adopted quantitative characterization of eye colour phenotypes using high-resolution photographic images of the iris in combination with DIAT software analysis. An independent set of 849 samples was used for subsequent predictive modelling. Newly identified candidates and 114 additional literature-based selected SNPs, previously associated with pigmentation, and advanced machine learning algorithms were used. Whole-exome sequencing analysis found 27 previously unreported candidate SNP markers for eye colour. The highest overall prediction accuracies were achieved with LASSO-regularized and BIC-based selected regression models. A new candidate variant, rs2253104, located in the ARFIP2 gene and identified with the HyperLasso method, revealed predictive potential and was included in the best-performing regression models. Advanced machine learning approaches showed a significant increase in sensitivity of intermediate eye colour prediction (up to 39%) compared to 0% obtained for the original IrisPlex model. We identified a new potential predictor of eye colour and evaluated several widely used advanced machine learning algorithms in predictive analysis of this trait. Our results provide useful hints for developing future predictive models for eye colour in forensic and anthropological studies.

Efficient and Rapid Machine Learning Algorithms for Big Data and Dynamic Varying Systems

2017 ◽  
Vol 47 (10) ◽  
pp. 2625-2626 ◽  
Author(s):  
Fuchun Sun ◽  
Guang-Bin Huang ◽  
Q. M. Jonathan Wu ◽  
Shiji Song ◽  
Donald C. Wunsch II
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Learning Algorithms ◽  
Machine Learning Algorithms

scholarly journals A Survey on Machine Learning Algorithms for Vision State Classification and Prediction Through Electroencephalogram (EEG) Signal

2020 ◽  
pp. 426-429
Author(s):  
Devipriya A ◽  
Brindha D ◽  
Kousalya A
Keyword(s):  
Machine Learning ◽  
Learning Algorithms ◽  
Problem Area ◽  
Machine Learning Algorithms ◽  
Eeg Signal ◽  
Ensemble Machine Learning ◽  
State Classification ◽  
Machine Learning Model ◽  
Knn Classification ◽  
Electroencephalogram Eeg

Eye state ID is a sort of basic time-arrangement grouping issue in which it is additionally a problem area in the late exploration. Electroencephalography (EEG) is broadly utilized in a vision state in order to recognize people perception form. Past examination was approved possibility of AI & measurable methodologies of EEG vision state arrangement. This research means to propose novel methodology for EEG vision state distinguishing proof utilizing Gradual Characteristic Learning (GCL) in light of neural organizations. GCL is a novel AI methodology which bit by bit imports and prepares includes individually. Past examinations have confirmed that such a methodology is appropriate for settling various example acknowledgment issues. Nonetheless, in these past works, little examination on GCL zeroed in its application to temporal-arrangement issues. Thusly, it is as yet unclear if GCL will be utilized for adapting the temporal-arrangement issues like EEG vision state characterization. Trial brings about this examination shows that, with appropriate element extraction and highlight requesting, GCL cannot just productively adapt to time-arrangement order issues, yet additionally display better grouping execution as far as characterization mistake rates in correlation with ordinary and some different methodologies. Vision state classification is performed and discussed with KNN classification and accuracy is enriched finally discussed the vision state classification with ensemble machine learning model.

Detection and defense of cyberattacks on the machine learning control of robotic systems

2021 ◽  
pp. 154851292110438
Author(s):  
George W Clark ◽  
Todd R Andel ◽  
J Todd McDonald ◽  
Tom Johnsten ◽  
Tom Thomas
Keyword(s):  
Machine Learning ◽  
Autonomous Vehicles ◽  
Defense Mechanisms ◽  
Autonomous Vehicle ◽  
Learning Algorithms ◽  
Learning Model ◽  
Machine Learning Algorithms ◽  
Robotic Systems ◽  
Machine Learning Model ◽  
Attack Surface

Robotic systems are no longer simply built and designed to perform sequential repetitive tasks primarily in a static manufacturing environment. Systems such as autonomous vehicles make use of intricate machine learning algorithms to adapt their behavior to dynamic conditions in their operating environment. These machine learning algorithms provide an additional attack surface for an adversary to exploit in order to perform a cyberattack. Since an attack on robotic systems such as autonomous vehicles have the potential to cause great damage and harm to humans, it is essential that detection and defenses of these attacks be explored. This paper discusses the plausibility of direct and indirect cyberattacks on a machine learning model through the use of a virtual autonomous vehicle operating in a simulation environment using a machine learning model for control. Using this vehicle, this paper proposes various methods of detection of cyberattacks on its machine learning model and discusses possible defense mechanisms to prevent such attacks.

Machine Learning Algorithms for Big Data

2019 ◽  
pp. 195-215
Author(s):  
C.S.R. Prabhu ◽  
Aneesh Sreevallabh Chivukula ◽  
Aditya Mogadala ◽  
Rohit Ghosh ◽  
L.M. Jenila Livingston
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Learning Algorithms ◽  
Machine Learning Algorithms

Essentiality of Machine Learning Algorithms for Big Data Computation

2016 ◽  
pp. 156-167
Author(s):  
Manjunath Thimmasandra Narayanapppa ◽  
T. P. Puneeth Kumar ◽  
Ravindra S. Hegadi
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Large Scale ◽  
Learning Algorithms ◽  
Big Data Analytics ◽  
Machine Learning Algorithms ◽  
Real Time Analysis ◽  
Large Scale Data ◽  
Computational Environment ◽  
Large Scale Data Processing

Recent technological advancements have led to generation of huge volume of data from distinctive domains (scientific sensors, health care, user-generated data, finical companies and internet and supply chain systems) over the past decade. To capture the meaning of this emerging trend the term big data was coined. In addition to its huge volume, big data also exhibits several unique characteristics as compared with traditional data. For instance, big data is generally unstructured and require more real-time analysis. This development calls for new system platforms for data acquisition, storage, transmission and large-scale data processing mechanisms. In recent years analytics industries interest expanding towards the big data analytics to uncover potentials concealed in big data, such as hidden patterns or unknown correlations. The main goal of this chapter is to explore the importance of machine learning algorithms and computational environment including hardware and software that is required to perform analytics on big data.

Sign in / Sign up

Export Citation Format

Share Document