LCC-Graph: A high-performance graph-processing framework with low communication costs

Author(s):  
Yongli Cheng ◽  
Fang Wang ◽  
Hong Jiang ◽  
Yu Hua ◽  
Dan Feng ◽  
...  
Author(s):  
Ilya V. Afanasyev ◽  
Vladimir V. Voevodin ◽  
Kazuhiko Komatsu ◽  
Hiroaki Kobayashi

Author(s):  
И.В. Афанасьев

В данной статье описан подход к созданию прототипа графового фреймворка VGL (Vector Graph Library), нацеленного на эффективную реализацию графовых алгоритмов для современной векторной архитектуры NEC SX–Aurora TSUBASA. Современные векторные системы позволяют значительно ускорять приложения, интенсивно использующие подсистему памяти, подклассом которых являются графовые алгоритмы. Однако подходы к эффективной реализации графовых алгоритмов для векторных систем на сегодняшний день исследованы крайне слабо: вследствие сильно нерегулярной структуры графов реального мира, эффективно задействовать векторные особенности целевых платформ затруднительно. В работе показано, что разработанные на основе предложенного фреймворка VGL реализации графовых алгоритмов не уступают в производительности оптимизированным “вручную” аналогам за счет инкапсуляции большого числа оптимизаций графовых алгоритмов, характерных для векторных систем. Вместе с этим предложенный фреймворк позволяет значительно упростить процесс разработки графовых алгоритмов для векторных систем, на порядок сокращая объем кода реализуемых алгоритмов и скрывая от пользователя особенности программирования систем данного класса. This article describes a prototype of graph-processing framework VGL (Vector Graph Library), aimed at the efficient implementation of graph algorithms for the modern NEC SX–Aurora TSUBASA vector architecture. Present day vector systems can significantly speed up various memory-intensive applications, including graph algorithms. However, approaches to the efficient implementation of graph algorithms for vector systems have been studied extremely poorly as of today: due to the highly irregular structure of real-world graphs, it is difficult to effectively use vector features of target platforms. This paper shows that the implementations of graph algorithms developed on the basis of the proposed VGL framework show the performance comparable to their manually optimized versions due to the encapsulation of a large number of graph algorithm optimizations typical for vector systems. At the same time, the proposed framework makes it possible to significantly simplify the process of developing graph algorithms for vector systems, by an order of magnitude reducing the amount of code for implemented algorithms and hiding the programming features of systems of this class from the user.


Author(s):  
Dipanjan Sengupta ◽  
Narayanan Sundaram ◽  
Xia Zhu ◽  
Theodore L. Willke ◽  
Jeffrey Young ◽  
...  

2017 ◽  
Vol 9 ◽  
pp. 9-17 ◽  
Author(s):  
Sabeur Aridhi ◽  
Alberto Montresor ◽  
Yannis Velegrakis

2015 ◽  
Vol 50 (8) ◽  
pp. 265-266 ◽  
Author(s):  
Yangzihao Wang ◽  
Andrew Davidson ◽  
Yuechao Pan ◽  
Yuduo Wu ◽  
Andy Riffel ◽  
...  

Author(s):  
Harendra Kumar ◽  
Nutan Kumari Chauhan ◽  
Pradeep Kumar Yadav

Tasks allocation is an important step for obtaining high performance in distributed computing system (DCS). This article attempts to develop a mathematical model for allocating the tasks to the processors in order to achieve optimal cost and optimal reliability of the system. The proposed model has been divided into two stages. Stage-I, makes the ‘n' clusters of set of ‘m' tasks by using k-means clustering technique. To use the k-means clustering techniques, the inter-task communication costs have been modified in such a way that highly communicated tasks are clustered together to minimize the communication costs between tasks. Stage-II, allocates the ‘n' clusters of tasks onto ‘n' processors to minimize the system cost. To design the mathematical model, executions costs and inter tasks communication costs have been taken in the form of matrices. To test the performance of the proposed model, many examples are considered from different research papers and results of examples have compared with some existing models.


Sign in / Sign up

Export Citation Format

Share Document