scholarly journals Hadoop solution for large data protection

2021 ◽  
pp. 23-27
Author(s):  
Nataliya Maslova ◽  
Olha Polovynka
Keyword(s):  
Data Analysis ◽  
Data Protection ◽  
Large Data ◽  
Unstructured Data ◽  
Management Systems ◽  
Intelligent Data Analysis ◽  
Apache Hadoop ◽  
Parallel Version ◽  
Cryptographic Algorithms ◽  
Using Data

Investigated one of large data problems of - providing protection in the process of accumulation and processing. The case of application of Hadoop technology and its latest modification Apache Hadoop 3.3.0 is considered. A solution is proposed with strengthening the protection of processed data, connecting the Apache Knox Gateway, Apache Ranger and Apache Atlas tools. The possibil-ity of using data obtained as a result of the work of local databases, electronic archives, database management systems and individual users is provided. The solution also features the use of a pri-vate cloud and cryptographic algorithms. An example of the implementation of a secure solution to the problem of Intelligent Data Analysis is given on the example of a parallel version of the problem of finding association rules when working with unstructured data of large volumes.

Intelligent Data Analysis

2011 ◽  
pp. 308-314 ◽  
Author(s):  
Xiaohui Liu
Keyword(s):  
Data Analysis ◽  
High Performance ◽  
Large Data ◽  
Large Data Sets ◽  
Data Sets ◽  
Intelligent Data Analysis ◽  
Statistical Knowledge ◽  
Interdisciplinary Study ◽  
Performance Computing ◽  
Effective Analysis

Intelligent Data Analysis (IDA) is an interdisciplinary study concerned with the effective analysis of data. IDA draws the techniques from diverse fields, including artificial intelligence, databases, high-performance computing, pattern recognition, and statistics. These fields often complement each other (e.g., many statistical methods, particularly those for large data sets, rely on computation, but brute computing power is no substitute for statistical knowledge) (Berthold & Hand 2003; Liu, 1999).

scholarly journals Unstructured Data Processing using Spark for Topics Modelling

2020 ◽  
Vol 9 (5) ◽  
pp. 1060-1063
Keyword(s):  
Data Analysis ◽  
Latent Dirichlet Allocation ◽  
Unstructured Data ◽  
Retrieval Algorithm ◽  
Multiple Sources ◽  
Data Set ◽  
Using Data ◽  
Clear Idea ◽  
Day By Day ◽  
Technology Domain

Information Technology domain is facing changes day by day. Furthermore, the size of data increases, as well as the demand to process them. There are two types of data: structured and unstructured data. The multiple sources and the variety of data today involve the use of “Big data” instead of data. It is related that 80% of enteUprise’s data is unstructured [1]. However, the procedures to handle unstructured data are more complex than those for structured data. Thus, it becomes necessary to have a clear idea about this type of data and to know how to extract useful information from this data set. In this paper we will study how to retrieve useful information from unstructured data in E-commerce area using data analysis tools: Spark. To solve this issue, first an overview on structured and unstructured data and data analysis is provided, then information retrieval algorithm will be implemented using Spark MLlib tool in order to determine for a set of reviews, negative or positive, which subjects are more discussed by the customers. This study is needed in order to improve business based on customer satisfaction reviews. In that case, Unsupervised Machine Learning Latent Dirichlet Allocation (LDA) algorithm constitutes our model. Finally, the evaluation of the model will be given based on some parameters.

Intelligent Data Analysis

2011 ◽  
pp. 634-638 ◽  
Author(s):  
Xiaohui Liu
Keyword(s):  
Data Analysis ◽  
High Performance ◽  
Large Data ◽  
Large Data Sets ◽  
Data Sets ◽  
Intelligent Data Analysis ◽  
Statistical Knowledge ◽  
Interdisciplinary Study ◽  
Performance Computing ◽  
Effective Analysis

Intelligent Data Analysis (IDA) is an interdisciplinary study concerned with the effective analysis of data. IDA draws the techniques from diverse fields, including artificial intelligence, databases, high-performance computing, pattern recognition, and statistics. These fields often complement each other (e.g., many statistical methods, particularly those for large data sets, rely on computation, but brute computing power is no substitute for statistical knowledge) (Berthold & Hand 2003; Liu, 1999).

AKTUALISASI PEDIDIKAN KARAKTER DALAM PENGEMBANGAN REVOLUSI MENTAL BERBASIS ADIWIYATA DAN MULTIKULTURAL

2018 ◽  
Vol 2 (2) ◽  
Author(s):  
Suhardi Suhardi
Keyword(s):  
Data Analysis ◽  
Character Education ◽  
Achievement Motivation ◽  
Case Study Research ◽  
Individual Development ◽  
Human Beings ◽  
Soft Skill ◽  
Design Data ◽  
Strategic Role ◽  
Using Data

Mental revolution of education requires efforts to print educated human beings by having the motivation to meet the standards of achievement excellence, such as ethos of progress, ethics, achievement motivation, discipline, optimistic, productive, innovative and active views. This can be implemented with character education. Character education is one of the soft skill tools that can be integrated in learning in each subject. Learning activities using an active learning approach have a strategic role in instilling national character values so that students are able to behave and act on values that have become their personality. The purpose of this study was to find and analyze about: 1) Implementation of Character Education to Build Adiwiyata-Based Mental Revolution and Multiculturalism; 2) Implementation of Character Education to Build Mental Revolution in Organizational Culture. This study uses a qualitative approach with phenomenological naturatistics (phenomenology approach), with a descriptive type of case study research design. Data were analyzed using data analysis techniques: data reduction, data analysis and conclusions. The results of the study are: The application of character education to develop a mental revolution can be started from the character of building the environment. Environmental character is very important for individual development. The implementation of character education in building a mental revolution can emphasize the internalization of multicultural values and Adiwiyata which in the end will form a loving environmental awareness and foster a spirit of tolerance.

Peranan Ketua Pengurus dan Manajer Dalam Penyusunan dan Penerapan Laporan Keuangan Berbasis SAK ETAP Pada Koperasi di Kota Palembang

2019 ◽  
Vol 14 (2) ◽  
pp. 119
Author(s):  
Riza Syahputera ◽  
Martha Rianty
Keyword(s):  
Data Analysis ◽  
Sampling Technique ◽  
Financial Statements ◽  
Significant Positive Effect ◽  
Analysis Technique ◽  
Regression Test ◽  
Using Data ◽  
The City ◽  
Positive Effect

AbstractThis study aims to determine the effect of the role of the Chairperson and Cooperative Manager in the preparation and application of Financial Statements based on SAK ETAP in cooperatives in the city of Palembang. This research is a quantitative study using data obtained from questionnaires and measured using a Likert scale. The sampling technique used is purposive sampling. The sample used in this study was the Chairperson of the cooperative and the manager of the cooperative in the city of Palembang. The cooperatives studied were 203 cooperatives. The data analysis technique used is multiple linear regression test. The results showed that the role of cooperative leaders and managers had a significant positive effect on the preparation and application of SAK ETAP-based financial statements.Keywords : chairman, manager, SAK ETAP, cooperative

K-MEANS CLUSTERING ALGORITHM FOR SERVICE DATA ANALYSIS BASED ON CUSTOMERS COMBINATION

2018 ◽  
Vol 3 (1) ◽  
pp. 001
Author(s):  
Zulhendra Zulhendra ◽  
Gunadi Widi Nurcahyo ◽  
Julius Santony
Keyword(s):  
Data Mining ◽  
Data Analysis ◽  
Clustering Algorithm ◽  
Customer Complaints ◽  
Using Data ◽  
Clustering Data ◽  
Service Data ◽  
Selection Of

In this study using Data Mining, namely K-Means Clustering. Data Mining can be used in searching for a large enough data analysis that aims to enable Indocomputer to know and classify service data based on customer complaints using Weka Software. In this study using the algorithm K-Means Clustering to predict or classify complaints about hardware damage on Payakumbuh Indocomputer. And can find out the data of Laptop brands most do service on Indocomputer Payakumbuh as one of the recommendations to consumers for the selection of Laptops.

Predicting Optimal Cricket Team using Data Analysis

2021 ◽  
Author(s):  
Ranjana Jadhav ◽  
Bhargav Pawar ◽  
Nishant Bhat ◽  
Shyam Kawale ◽  
Abhijit Gawai
Keyword(s):  
Data Analysis ◽  
Using Data

Intelligent data analysis for wellbeing monitoring

2005 ◽  
Author(s):  
B. Majeed ◽  
T. Martin ◽  
N. Clarke ◽  
Beum-Seuk Lee
Keyword(s):  
Data Analysis ◽  
Intelligent Data Analysis
Sign in / Sign up

Export Citation Format

Share Document