Research and Design of Performance Monitoring Tool for Hadoop Clusters

Author(s):  
Chongyang Xue ◽  
Feng Liu ◽  
Honghui Li ◽  
Jun Xiao ◽  
Zhen Liu
2018 ◽  
Vol 7 (4.20) ◽  
pp. 4220
Author(s):  
Manishankar S. ◽  
S. Sathayanarayana

Data generated from real time information systems are always incremental in nature. Processing of such a huge incremental data in large scale requires a parallel processing system like Hadoop based cluster. Major challenge that arises in all cluster-based system is how efficiently the resources of the system can be used. The research carried out proposes a model architecture for Hadoop cluster with additional components integrated such as super node who manages the clusters computations and a mediation manager who does the performance monitoring and evaluation. Super node in the system is equipped with intelligent or adaptive scheduler that does the scheduling of the job with optimal resources. The scheduler is termed intelligent as it automatically decides which resource to be taken for which computation, with the help of a cross mapping of resource and job with a genetic algorithm which finds the best matching resource. The mediation node deploys ganglia a standard monitoring tool for Hadoop cluster to collect and record the performance parameters of the Hadoop cluster. The system over all does the scheduling of different jobs with optimal usage of resources thus achieving better efficiency compared to the native capacity scheduler in Hadoop. The system is deployed on top of OpenNebula Cloud environment for scalability.     


2021 ◽  
pp. 088740342110218
Author(s):  
Victoria A. Sytsma ◽  
Eric L. Piza ◽  
Vijay F. Chillar ◽  
Leigh S. Grossman

This study capitalizes on a successful researcher–practitioner partnership to conduct a systematic social observation (SSO) of police body-worn camera (BWC) footage in Newark, NJ. To demonstrate the utility of BWCs as performance monitoring tools, we measure officer adherence to procedural justice standards throughout use of force events as mandated in the Newark Police Division’s updated policies pursuant to an ongoing federal consent decree. Overall, a slim majority of use of force events are procedurally just. However, results indicate several instances of policy noncompliance. Results are discussed, and policy recommendations related to procedural justice policy violations and BWCs for performance monitoring are provided.


Sign in / Sign up

Export Citation Format

Share Document