Visualization of Large-Scale Distributed Data

Author(s):  
Jason Leigh ◽  
Andrew Johnson ◽  
Luc Renambot ◽  
Venkatram Vishwanath ◽  
Tom Peterka ◽  
...  

An effective visualization is best achieved through the creation of a proper representation of data and the interactive manipulation and querying of the visualization. Large-scale data visualization is particularly challenging because the size of the data is several orders of magnitude larger than what can be managed on an average desktop computer. Large-scale data visualization therefore requires the use of distributed computing. By leveraging the widespread expansion of the Internet and other national and international high-speed network infrastructure such as the National LambdaRail, Internet-2, and the Global Lambda Integrated Facility, data and service providers began to migrate toward a model of widespread distribution of resources. This chapter introduces different instantiations of the visualization pipeline and the historic motivation for their creation. The authors examine individual components of the pipeline in detail to understand the technical challenges that must be solved in order to ensure continued scalability. They discuss distributed data management issues that are specifically relevant to large-scale visualization. They also introduce key data rendering techniques and explain through case studies approaches for scaling them by leveraging distributed computing. Lastly they describe advanced display technologies that are now considered the “lenses” for examining large-scale data.

2014 ◽  
Vol 1049-1050 ◽  
pp. 187-189
Author(s):  
Han Lin Wang ◽  
Yan Li Luo ◽  
Wen Xiao Zong ◽  
Qing Bin Guo

Safe city system due to the particularity of data types, with the increase of access points, how to efficient organize and store the large multiple types of large-scale data is the hotspot and difficulty in research in recent years. Safe City system based on massive amount of data, a wide variety of features, designed to use distributed storage solution. On the basis of the Hadoop HBase distributed computing architecture, using the Blur services, design and implement safe city system based on Hadoop . Experiments show that the system has good expansibility, storage and query efficiency, can effectively solve the concurrent access to huge amounts of data.


2016 ◽  
Vol 29 (6) ◽  
pp. 1061-1075
Author(s):  
Eun-Kyung Lee ◽  
Nayoung Hwang ◽  
Yoondong Lee

Sign in / Sign up

Export Citation Format

Share Document