Parallel Programming Models in High‐Performance Cloud (ParaMo 2019)

Author(s):  
Sangyoon Oh

Author(s):  
Miaoqing Huang ◽  
Chenggang Lai ◽  
Xuan Shi ◽  
Zhijun Hao ◽  
Haihang You

Coprocessors based on the Intel Many Integrated Core (MIC) Architecture have been adopted in many high-performance computer clusters. Typical parallel programming models, such as MPI and OpenMP, are supported on MIC processors to achieve the parallelism. In this work, we conduct a detailed study on the performance and scalability of the MIC processors under different programming models using the Beacon computer cluster. Our findings are as follows. (1) The native MPI programming model on the MIC processors is typically better than the offload programming model, which offloads the workload to MIC cores using OpenMP. (2) On top of the native MPI programming model, multithreading inside each MPI process can further improve the performance for parallel applications on computer clusters with MIC coprocessors. (3) Given a fixed number of MPI processes, it is a good strategy to schedule these MPI processes to as few MIC processors as possible to reduce the cross-processor communication overhead. (4) The hybrid MPI programming model, in which data processing is distributed to both MIC cores and CPU cores, can outperform the native MPI programming model.



2016 ◽  
Vol 10 (3) ◽  
pp. 14
Author(s):  
VEERASAMY BALA DHANDAYUTHAPANI ◽  
NASIRA G.M ◽  
◽  


Author(s):  
Matt Martineau ◽  
Simon McIntosh Smith ◽  
James Price ◽  
Tom Deakin




2018 ◽  
Vol 84 ◽  
pp. 22-31 ◽  
Author(s):  
Adrián Castelló ◽  
Rafael Mayo ◽  
Kevin Sala ◽  
Vicenç Beltran ◽  
Pavan Balaji ◽  
...  




2020 ◽  
Vol 2 (4) ◽  
pp. 382-400
Author(s):  
Jianbin Fang ◽  
Chun Huang ◽  
Tao Tang ◽  
Zheng Wang


Sign in / Sign up

Export Citation Format

Share Document