scholarly journals Research on Industry Data Analysis Model Based on Hadoop Big Data Platform

2017 ◽  
Author(s):  
Xu Hongsheng ◽  
Fan Ganglong ◽  
Li Ke
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Analysis Model ◽  
Industry Data ◽  
Model Based ◽  
Data Platform

Construction of a multi-source heterogeneous hybrid platform for big data

2021 ◽  
pp. 1-10
Author(s):  
Ying Wang ◽  
Yiding Liu ◽  
Minna Xia
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Forest Fire ◽  
Original Data ◽  
Big Data Analysis ◽  
Multiple Sources ◽  
Data Types ◽  
Fire Monitoring ◽  
Data Platform

Big data is featured by multiple sources and heterogeneity. Based on the big data platform of Hadoop and spark, a hybrid analysis on forest fire is built in this study. This platform combines the big data analysis and processing technology, and learns from the research results of different technical fields, such as forest fire monitoring. In this system, HDFS of Hadoop is used to store all kinds of data, spark module is used to provide various big data analysis methods, and visualization tools are used to realize the visualization of analysis results, such as Echarts, ArcGIS and unity3d. Finally, an experiment for forest fire point detection is designed so as to corroborate the feasibility and effectiveness, and provide some meaningful guidance for the follow-up research and the establishment of forest fire monitoring and visualized early warning big data platform. However, there are two shortcomings in this experiment: more data types should be selected. At the same time, if the original data can be converted to XML format, the compatibility is better. It is expected that the above problems can be solved in the follow-up research.

scholarly journals Design on Big data Platform-based in Higher Education Institute

2020 ◽  
Vol 10 (4) ◽  
pp. 36
Author(s):  
Sajeewan Pratsri ◽  
Prachyanun Nilsook
Keyword(s):  
Higher Education ◽  
Big Data ◽  
Data Analysis ◽  
Digital Media ◽  
Data Storage ◽  
Security And Privacy ◽  
Digital Learning ◽  
Learning Platform ◽  
Data Platform ◽  
Tools And Techniques

According to a continuously increasing amount of information in all aspects whether the sources are retrieved from an internal or external organization, a platform should be provided for the automation of whole processes in the collection, storage, and processing of Big Data. The tool for creating Big Data is a Big Data challenge. Furthermore, the security and privacy of Big Data and Big Data analysis in organizations, government agencies, and educational institutions also have an impact on the aspect of designing a Big Data platform for higher education institute (HEi). It is a digital learning platform that is an online instruction and the use of digital media for educational reform including a module provides information on functions of various modules between computers and humans. 1) Big Data architecture is a framework for an architecture of numerous data which consisting of Big Data Infrastructure (BDI), Data Storage (Cloud-based), processing of a computer system that uses all parts of computer resources for optimal efficiency (High-Performance Computing: HPC), a network system to detect the target device network. Thereafter, according to Hadoop’s tools and techniques, when Big Data was introduced with Hadoop's tools and techniques, the benefits of the Big Data platform would provide desired data analysis by retrieving existing information, to illustrate, student information and teaching information that is large amounts of information to adopt for accurate forecasting.

scholarly journals A Novel on Transmission Line Tower Big Data Analysis Model Using Altered K-means and ADQL

2019 ◽  
Vol 11 (13) ◽  
pp. 3499 ◽  
Author(s):  
Se-Hoon Jung ◽  
Jun-Ho Huh
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Transmission Line ◽  
Clustering Algorithm ◽  
Learning Algorithm ◽  
Principal Component ◽  
Big Data Analysis ◽  
Standard Normal Distribution ◽  
Analysis Model ◽  
Q Learning

This study sought to propose a big data analysis and prediction model for transmission line tower outliers to assess when something is wrong with transmission line tower big data based on deep reinforcement learning. The model enables choosing automatic cluster K values based on non-labeled sensor big data. It also allows measuring the distance of action between data inside a cluster with the Q-value representing network output in the altered transmission line tower big data clustering algorithm containing transmission line tower outliers and old Deep Q Network. Specifically, this study performed principal component analysis to categorize transmission line tower data and proposed an automatic initial central point approach through standard normal distribution. It also proposed the A-Deep Q-Learning algorithm altered from the deep Q-Learning algorithm to explore policies based on the experiences of clustered data learning. It can be used to perform transmission line tower outlier data learning based on the distance of data within a cluster. The performance evaluation results show that the proposed model recorded an approximately 2.29%~4.19% higher prediction rate and around 0.8% ~ 4.3% higher accuracy rate compared to the old transmission line tower big data analysis model.

scholarly journals Big Data Analysis Model for MRO Business Using Artificial Intelligence System Concept

2018 ◽  
Vol 7 (3.33) ◽  
pp. 134
Author(s):  
Inhwan JUNG ◽  
He SUN ◽  
Jangmook KANG ◽  
Choong Hyong Lee ◽  
Sangwon LEE
Keyword(s):  
Artificial Intelligence ◽  
Big Data ◽  
Data Analysis ◽  
Business Models ◽  
Analysis Model ◽  
Artificial Intelligence System ◽  
Shipbuilding Industry ◽  
Intelligence System ◽  
System Concept ◽  
Ship Maintenance

The rapidly changing environment of the shipbuilding industry has put Korea’s shipbuilding industry in a crisis. The purpose of this study was to develop a business model to maintain, maintain and operate Big Data-based MRO(Maintenance, Repair, and Operation) consumables, which is expected to be the new growth engine for the domestic shipbuilding industry. Although Korean shipbuilders have world-class technologies for ship dogma, the market for ship maintenance and repair is still in its infancy. For Korean shipbuilders, MRO business can be a growth engine that will provide food for the next 30 years, but to do so, we need to make sure that everything that happens in the entire process, from ship design to maintenance and maintenance. Therefore, by systematically establishing Big Data related to components and developing MRO business models based on data analysis capabilities using Artificial Intelligence system concept, we can develop new growth engines for related industries in Ship Industry.  

Sign in / Sign up

Export Citation Format

Share Document