Semantic Enriched Category Recommendation System for Large-Scale Emails Exploiting Big Data Processing Technologies

Big Data refers to large-scale information management and analysis technologies that exceed the capability of traditional data processing technologies. In order to analyse complex data and to identify patterns it is very important to securely store, manage, and share large amounts of complex data. In recent years an increasing of database size according to the various forms (text, images and videos), in huge volumes and with high velocity, the services issues that use internet and desires big data come to leading edge (data-intensive services), (HDFS) Apache’s Hadoop distributed file system is in progress as outstanding software component for cloud computing joint with integrated pieces such as MapReduce. GoogleMapReduce implemented an open source which is Hadoop, having a distributed file system, present to software programmers the perception of the map and reduce. The research shows the security approaches for Big Data Hadoop distributed file system and the best security solution, also this research will help business by big data visualization which will help in better data analysis. In today’s data-centric world, big-data processing and analytics have become critical to most enterprise and government applications.

Download Full-text

Spark-Based Large-Scale Matrix Inversion for Big Data Processing

IEEE Access ◽

10.1109/access.2016.2546544 ◽

2016 ◽

Vol 4 ◽

pp. 2166-2176 ◽

Cited By ~ 20

Author(s):

Jun Liu ◽

Yang Liang ◽

Nirwan Ansari

Keyword(s):

Big Data ◽

Data Processing ◽

Large Scale ◽

Matrix Inversion ◽

Big Data Processing ◽

Scale Matrix

Download Full-text

BIG DATA PROCESSING: BIG CHALLENGES AND OPPORTUNITIES

Journal of Interconnection Networks ◽

10.1142/s0219265912500090 ◽

2012 ◽

Vol 13 (03n04) ◽

pp. 1250009 ◽

Cited By ~ 14

Author(s):

CHANGQING JI ◽

YU LI ◽

WENMING QIU ◽

YINGWEI JIN ◽

YUJIE XU ◽

...

Keyword(s):

Big Data ◽

Data Processing ◽

Data Management ◽

Data Storage ◽

Large Scale ◽

Distributed Applications ◽

Big Data Processing ◽

Cloud Data ◽

Management Platform ◽

Challenges And Opportunities

With the rapid growth of emerging applications like social network, semantic web, sensor networks and LBS (Location Based Service) applications, a variety of data to be processed continues to witness a quick increase. Effective management and processing of large-scale data poses an interesting but critical challenge. Recently, big data has attracted a lot of attention from academia, industry as well as government. This paper introduces several big data processing techniques from system and application aspects. First, from the view of cloud data management and big data processing mechanisms, we present the key issues of big data processing, including definition of big data, big data management platform, big data service models, distributed file system, data storage, data virtualization platform and distributed applications. Following the MapReduce parallel processing framework, we introduce some MapReduce optimization strategies reported in the literature. Finally, we discuss the open issues and challenges, and deeply explore the research directions in the future on big data processing in cloud computing environments.

Download Full-text

APPLYING BIG DATA PROCESSING TECHNOLOGIES TO NUCLEAR PLANT EQUIPMENT MODEL

Information Technologies of CAD/CAM/CAE ◽

10.52190/2073-2597_2021_2_10 ◽

2021 ◽

pp. 10-14

Author(s):

A. E. Dolganov ◽

K. E. Gavrov ◽

S. V. Sumarokov ◽

F. O. Novoselsky

Keyword(s):

Big Data ◽

Data Processing ◽

Nuclear Plant ◽

Big Data Processing ◽

Processing Technologies ◽

Plant Equipment

Download Full-text

Analysis of big data processing technologies

IOP Conference Series Materials Science and Engineering ◽

10.1088/1757-899x/862/4/042006 ◽

2020 ◽

Vol 862 ◽

pp. 042006

Author(s):

T Q Urazmatov ◽

B B Nurmetova ◽

X Sh Kuzibayev

Keyword(s):

Big Data ◽

Data Processing ◽

Big Data Processing ◽

Processing Technologies

Download Full-text

Collaborative Filtering Algorithm for Recommendation System of Improvement Based on Big Data Environment

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.736.189 ◽

2015 ◽

Vol 736 ◽

pp. 189-195 ◽

Cited By ~ 1

Author(s):

Shi Jin Li ◽

Wa Te He ◽

Xi Bing Wang ◽

Ting Shi

Keyword(s):

Big Data ◽

Data Processing ◽

Recommendation System ◽

Rapid Development ◽

User Interaction ◽

Big Data Processing ◽

Information Platform ◽

Collaborative Filtering Algorithm ◽

Data Environment ◽

Search History

With the rapid development of Internet and information technology, the exponential growth of information has attracted a lot of concern thesedays. Big data processing is particularly important. Recommendation system appears a good solution inadequacies of search engines, it is in addition based on keywords entered by the user to obtain information, but also with the user's social circle, as well as search history records, for users personalized recommendations services, and to establish a long and constant user interaction relations, not only improve customer loyalty, but also for the producers to create a good and reliable information platform for big data processing to achieve a win-win.

Download Full-text