Efficient Processing of Job by Enhancing Hadoop Map Reduce Framework Using Containers

Author(s):  
Shweta V. H. Chaudhari ◽  
R. M. Wahul

The Speedy development of Internet has led to huge quantities of digital data available online and vast capacity of digital data is increasing and successfully stored. In demand to the process, analyzed, and linked huge volume of stored data to achieve correct Information, some computation is required. Even efficient processing and implementation is needed for scientific data performance analysis. We will compare with already existing MapReduce Technique with Hadoop to afford high performance and efficiency for large volume of dataset. Hadoop distributed architecture with MapReduce programming is analysis here.


Author(s):  
Shalin Eliabeth S. ◽  
Sarju S.

Big data privacy preservation is one of the most disturbed issues in current industry. Sometimes the data privacy problems never identified when input data is published on cloud environment. Data privacy preservation in hadoop deals in hiding and publishing input dataset to the distributed environment. In this paper investigate the problem of big data anonymization for privacy preservation from the perspectives of scalability and time factor etc. At present, many cloud applications with big data anonymization faces the same kind of problems. For recovering this kind of problems, here introduced a data anonymization algorithm called Two Phase Top-Down Specialization (TPTDS) algorithm that is implemented in hadoop. For the data anonymization-45,222 records of adults information with 15 attribute values was taken as the input big data. With the help of multidimensional anonymization in map reduce framework, here implemented proposed Two-Phase Top-Down Specialization anonymization algorithm in hadoop and it will increases the efficiency on the big data processing system. By conducting experiment in both one dimensional and multidimensional map reduce framework with Two Phase Top-Down Specialization algorithm on hadoop, the better result shown in multidimensional anonymization on input adult dataset. Data sets is generalized in a top-down manner and the better result was shown in multidimensional map reduce framework by the better IGPL values generated by the algorithm. The anonymization was performed with specialization operation on taxonomy tree. The experiment shows that the solutions improves the IGPL values, anonymity parameter and decreases the execution time of big data privacy preservation by compared to the existing algorithm. This experimental result will leads to great application to the distributed environment.


2019 ◽  
Vol 13 (5) ◽  
pp. 796-802
Author(s):  
Jiping Zheng ◽  
Shunqing Jiang ◽  
Jialiang Chen ◽  
Wei Yu

2020 ◽  
Vol 117 (38) ◽  
pp. 23982-23990 ◽  
Author(s):  
Shengjun Li ◽  
Mu Li ◽  
Kan Liu ◽  
Huimin Zhang ◽  
Shuxin Zhang ◽  
...  

MAC5 is a component of the conserved MOS4-associated complex. It plays critical roles in development and immunity. Here we report that MAC5 is required for microRNA (miRNA) biogenesis. MAC5 interacts with Serrate (SE), which is a core component of the microprocessor that processes primary miRNA transcripts (pri-miRNAs) into miRNAs and binds the stem-loop region of pri-miRNAs. MAC5 is essential for both the efficient processing and the stability of pri-miRNAs. Interestingly, the reduction of pri-miRNA levels inmac5is partially caused by XRN2/XRN3, the nuclear-localized 5′-to-3′ exoribonucleases, and depends on SE. These results reveal that MAC5 plays a dual role in promoting pri-miRNA processing and stability through its interaction with SE and/or pri-miRNAs. This study also uncovers that pri-miRNAs need to be protected from nuclear RNA decay machinery, which is connected to the microprocessor.


Author(s):  
Maria Fazio ◽  
Alina Buzachis ◽  
Antonino Galletta ◽  
Antonio Celesti ◽  
Jiafu Wan ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document