Research on Big Data Parallel Processing Platform Based on Postal Industry

Author(s):  
Pinglin Yang ◽  
Gaizhi Guo
Author(s):  
Thomas Benz ◽  
Luca Bertaccini ◽  
Florian Zaruba ◽  
Fabian Schuiki ◽  
Frank K. Gurkaynak ◽  
...  

Author(s):  
Jaume Ferrarons ◽  
Mulu Adhana ◽  
Carlos Colmenares ◽  
Sandra Pietrowska ◽  
Fadila Bentayeb ◽  
...  

2013 ◽  
Vol 475-476 ◽  
pp. 306-311 ◽  
Author(s):  
Miao Miao Song ◽  
Zhe Li ◽  
Bin Zhou ◽  
Chao Ling Li

Geological data with phyletic and various, huge and complex data format, the analysis of geological data processing is mainly divided into three parts: Mines forecast, mine evaluation and mine positioning. Traditional geological data analysis model is limited by limited storage space and computational efficiency, and cannot meet the needs of a large number of geological data fast operations. "Big data technology" provides the ideal solution to the vast amounts of geological data management, information extraction, and comprehensive analysis. For mass storage capacity and high-speed computing power that the "big data technology" need, we built an intelligence systems applied to the analysis of geological data based on MapReduce and GPU double parallel processing cloud computing model. For a large number of geological data, using hadoop cluster system to solve the problem of large amounts of data storage, and designing efficient parallel processing method based on GPU (Graphics Processing Units: calculation of Graphics Processing unit), the method was applied to MapReduce framework, finally completing MapReduce and GPU double parallel processing cloud computing model to improve the operation speed of the system. Through theoretical modeling and experimental verification, indicating that the system can meet the analysis of geological data operation precision, the operation data amount and the operation speed.


Author(s):  
Lauritz Thamsen ◽  
Jossekin Beilharz ◽  
Vinh Thuy Tran ◽  
Sasho Nedelkoski ◽  
Odej Kao

Author(s):  
Yu Wu ◽  
Qi Zhang ◽  
Zhiqiang Yu ◽  
Jianhui Li

XML is playing crucial roles in web services, databases, and document representing and processing. However, the processing of XML document has been regarded as the main performance bottleneck especially for the processing of very large XML data. On the other hand, multi-core processing gains increasingly popularity both on the desktop computers and server computing machines. To take full advantage of multi-cores, we present a novel hybrid parallel XML processing model, which combines data-parallel and pipeline processing. It first partitions the XML by chunks to perform data parallel processing for both XML parsing and schema validation, then organize and execute them as a two stage pipeline to exploit more parallelism. The hybrid parallel XML processing model has shown great overall performance advantage on multi-core platform as indicated by the experiment performance results.


Sign in / Sign up

Export Citation Format

Share Document