Encroachment in Data Processing using Big Data Technology

Geological data with phyletic and various, huge and complex data format, the analysis of geological data processing is mainly divided into three parts: Mines forecast, mine evaluation and mine positioning. Traditional geological data analysis model is limited by limited storage space and computational efficiency, and cannot meet the needs of a large number of geological data fast operations. "Big data technology" provides the ideal solution to the vast amounts of geological data management, information extraction, and comprehensive analysis. For mass storage capacity and high-speed computing power that the "big data technology" need, we built an intelligence systems applied to the analysis of geological data based on MapReduce and GPU double parallel processing cloud computing model. For a large number of geological data, using hadoop cluster system to solve the problem of large amounts of data storage, and designing efficient parallel processing method based on GPU (Graphics Processing Units: calculation of Graphics Processing unit), the method was applied to MapReduce framework, finally completing MapReduce and GPU double parallel processing cloud computing model to improve the operation speed of the system. Through theoretical modeling and experimental verification, indicating that the system can meet the analysis of geological data operation precision, the operation data amount and the operation speed.

Download Full-text

Physical Exercise Rehabilitation System Based on Internet of Things and Big Data Technology

10.21203/rs.3.rs-849561/v1 ◽

2021 ◽

Author(s):

Nana Zhao ◽

Yinzhong Yan ◽

Xiao Han ◽

Gaofei Zhang ◽

Long Chen

Keyword(s):

Big Data ◽

Internet Of Things ◽

Physical Exercise ◽

Data Processing ◽

Human Vision ◽

The Internet ◽

Exercise Rehabilitation ◽

Rehabilitation System ◽

The Internet Of Things ◽

Big Data Technology

Abstract With the combination of big data technology and the Internet of Things and exercise rehabilitation, we are also facing the problem of processing massive amounts of data. Whether these data can be used well has become the key to obtaining good business benefits and improving user experience. This paper applies the Internet of Things and big data technology to the physical exercise rehabilitation system to improve the sports data processing and combine with the big data processing technology to explore the factors affecting the effect of exercise rehabilitation to improve the effect of physical exercise rehabilitation. Moreover, this paper proposes a posture recognition algorithm based on human vision, and defines the human posture described by the feature, which improves the classifier's ability to classify different posture data. Finally, this paper combines experimental analysis to verify the effect of the method in this paper. From the research results, it can be seen that the method constructed in this paper has a good rehabilitation effect of physical exercise.

Download Full-text

Design and Implementation of Air Quality Data Processing System Based on Big Data Technology

2018 IEEE 4th International Conference on Computer and Communications (ICCC) ◽

10.1109/compcomm.2018.8780724 ◽

2018 ◽

Author(s):

Xin Zhu ◽

Shuqin Geng ◽

Yupeng Hou ◽

Xiaohong Peng ◽

Ligang Hou ◽

...

Keyword(s):

Big Data ◽

Air Quality ◽

Data Processing ◽

Processing System ◽

Quality Data ◽

Data Processing System ◽

Design And Implementation ◽

Air Quality Data ◽

Big Data Technology

Download Full-text

Managing Government Digital Reputation through Big Data Processing

JKAP (Jurnal Kebijakan dan Administrasi Publik) ◽

10.22146/jkap.31810 ◽

2019 ◽

Vol 22 (2) ◽

pp. 72

Author(s):

Khoirun Nisa' ◽

Effy Rusfian ◽

Zaenab Zaenab

Keyword(s):

Big Data ◽

Public Relations ◽

Data Processing ◽

Reputation Management ◽

Quality Data ◽

Management Process ◽

Big Data Processing ◽

The Public ◽

Credible Information ◽

Big Data Technology

The objective of this paper is to assess government reputation management performance by lev-eraging Big Data technology, internet, and public relations capacity, in particular creating credible information for the public. The research used a case study methodology on Indonesi-aBaik.id management for the period between 13th September to 13th October, 2017. The focus of the research was on the degree to which big data processing influenced communication, pub-lic persuasion, and content. Research techniques used to collect data including in-depth inter-views, observation, and literature review through elated techniques. Research findings indicate that effective Big Data processing is underpinned by quality data analysis and creative content development skills. This research contributes to knowledge on the application of online reputa-tion management processes for public relations officials and general readers based on the four steps of management process by Cutlip as applied to reputation management analysis using Big Data technology effectiveness. Based on the result of the research the government reputation management practice should also followed by higher competence of the public relation officials especially on the skill of reputation management process and public persuasion skill, thus, the process of creating credible information can be done adequately.

Download Full-text

Aproximación al grado de conocimiento y aplicación de Big Data en las bibliotecas universitarias españolas

Anales de Documentación ◽

10.6018/analesdoc.390931 ◽

2020 ◽

Vol 23 (1) ◽

Author(s):

Ana Belén Ríos Hilario ◽

Alberto Fraile Sastre

Keyword(s):

Big Data ◽

Data Processing ◽

Massive Data ◽

University Libraries ◽

Internal Sources ◽

Massive Data Processing ◽

Correct Implementation ◽

Big Data Technology

Se analiza el grado de conocimiento e implantación de la tecnología Big Data y sus características principales en las bibliotecas universitarias españolas inscritas en REBIUN con el objetivo de observar si estas instituciones se encuentran capacitadas para la utilización y aprovechamiento de las ventajas del tratamiento masivo de datos. Los datos son obtenidos mediante un cuestionario cuya respuesta proviene de fuentes internas de las bibliotecas, a partir de los cuales se establecen una serie de conclusiones junto a unas propuestas de mejora y líneas de trabajo futuras que permitan la correcta implantación, uso y aprovechamiento del Big Data en la oferta de servicios y funciones de las bibliotecas universitarias españolas. It is analyzed the degree of knowledge and implementation of Big Data technology and its main characteristics in the Spanish university libraries registered in REBIUN, with the objective of observing if these institutions are qualified for the use of the advantages of the massive data processing. The data is obtained by means of a questionnaire, whose response comes from internal sources of the libraries, from which a series of conclusions are established together with proposals for improvement and future lines of work that allow the correct implementation, use and exploitation of the Big Data in the offer of services and functions of the Spanish university libraries.

Download Full-text

Study of CDR Real-Time Query Based on Big Data Technologies

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.462-463.845 ◽

2013 ◽

Vol 462-463 ◽

pp. 845-848

Author(s):

Zhi Heng Gao ◽

Kang Chen ◽

Ling Yan Bi

Keyword(s):

Big Data ◽

Data Processing ◽

Open Source ◽

Real Time ◽

Performance Test ◽

Real Dataset ◽

Big Data Technologies ◽

Hadoop Platform ◽

Query System ◽

Big Data Technology

This paper describes big data technology layers, analyses the CDR (Call Data Records) real-time query scenario of telecommunications and brings forward a fast indexing and query solution based on the open source Hadoop platform. A CDR real-time query system was built according to the solution. A performance test was conducted with the real dataset of a city with 3 million subscribers. Compared with the existing system, the big data solution can greatly improve data processing performance and support real-time query with lower hardware and software investment.

Download Full-text