A Graphical Approach to Load Balancing and Sparse Matrix Vector Multiplication on the Hypercube

1988 ◽  
pp. 37-61 ◽  
Author(s):  
Geoffrey C. Fox
Keyword(s):  
Load Balancing ◽  
Sparse Matrix ◽  
Graphical Approach ◽  
Matrix Vector Multiplication ◽  
Matrix Vector

scholarly journals HYBRID-PARALLEL SPARSE MATRIX-VECTOR MULTIPLICATION WITH EXPLICIT COMMUNICATION OVERLAP ON CURRENT MULTICORE-BASED SYSTEMS

2011 ◽  
Vol 21 (03) ◽  
pp. 339-358 ◽  
Author(s):  
GERALD SCHUBERT ◽  
HOLGER FEHSKE ◽  
GEORG HAGER ◽  
GERHARD WELLEIN
Keyword(s):  
Load Balancing ◽  
Sparse Matrix ◽  
Communication Overhead ◽  
Single Node ◽  
Hybrid Programming ◽  
Matrix Vector Multiplication ◽  
Multicore Chips ◽  
Performance Results ◽  
Matrix Vector ◽  
Explicit Communication

We evaluate optimized parallel sparse matrix-vector operations for several representative application areas on widespread multicore-based cluster configurations. First the single-socket baseline performance is analyzed and modeled with respect to basic architectural properties of standard multicore chips. Beyond the single node, the performance of parallel sparse matrix-vector operations is often limited by communication overhead. Starting from the observation that nonblocking MPI is not able to hide communication cost using standard MPI implementations, we demonstrate that explicit overlap of communication and computation can be achieved by using a dedicated communication thread, which may run on a virtual core. Moreover we identify performance benefits of hybrid MPI/OpenMP programming due to improved load balancing even without explicit communication overlap. We compare performance results for pure MPI, the widely used "vector-like" hybrid programming strategies, and explicit overlap on a modern multicore-based cluster and a Cray XE6 system.

scholarly journals Sparse Matrix-Vector Multiplication on GPGPUs

2017 ◽  
Vol 43 (4) ◽  
pp. 1-49 ◽  
Author(s):  
Salvatore Filippone ◽  
Valeria Cardellini ◽  
Davide Barbieri ◽  
Alessandro Fanfarillo
Keyword(s):  
Sparse Matrix ◽  
Matrix Vector Multiplication ◽  
Matrix Vector
Sign in / Sign up

Export Citation Format

Share Document