New Approach in Big Data Mining for Frequent Itemset Using Mapreduce in HDFS

Author(s):  
Pallavi V. Nikam ◽  
Deepa S. Deshpande
2019 ◽  
Vol 5 (1) ◽  
pp. e000565 ◽  
Author(s):  
Daniel Rojas-Valverde ◽  
Carlos D Gómez-Carmona ◽  
Randall Gutiérrez-Vargas ◽  
Jose Pino-Ortega

The inertial measurement units (IMU) are instruments used to quantify the external load of athletes; they are increasingly common in assessing team and individual sports. This type of instruments has several sensors, such as accelerometers, gyroscopes and magnetometers; this allows access to a large amount of information and analysis possibilities. Due to the complexity of synthesising this data, it is necessary to create a flow for collecting, analysing and presenting the collected data in a simple way and present it as quickly as possible to the technical staff. This report aims to present new methods of reduction of the data and propose a new approach method for the analysis of the IMU’s outcomes.


Author(s):  
Zakria Mahrousa ◽  
Dima Mufti Alchawafa ◽  
Hasan Kazzaz

The Finding of frequent itemset in big data is an important task in data mining and knowledgediscovery. The exponential daily growth of data, called “Big Data”, mining frequent patterns from the hugevolumes of data has many challenges due to memory requirement, multiple data dimensions, heterogeneityof data and so on. The complexities related to mining frequent item-sets from a Big Data can be minimizedby using Modified FP-growth algorithm and parallelizing the mining task with Map Reduce framework inHadoop. In this paper, a modified FP-growth based on directed graph with Hadoop framework will reducethe execution time for the massive database and works efficiently on number of nodes (computers). Thealgorithm was tested, our experimental results demonstrated that the proposed algorithm could scale welland efficiently process large datasets. In addition, it achieves improvement in memory consumption to storefrequent patterns and time complexity.


Author(s):  
Feng Ye ◽  
Zhi-Jian Wang ◽  
Fa-Chao Zhou ◽  
Ya-Pu Wang ◽  
Yuan-Chao Zhou
Keyword(s):  
Big Data ◽  

Sign in / Sign up

Export Citation Format

Share Document