Optimizing Resource Allocation for Data-parallel Jobs via GCN-based Prediction

IEEE Transactions on Parallel and Distributed Systems ◽

10.1109/tpds.2021.3055019 ◽

2021 ◽

pp. 1-1

Author(s):

Zhiyao Hu ◽

Dongsheng Li ◽

Dongxiang Zhang ◽

Yiming Zhang ◽

Baoyun Peng

Keyword(s):

Resource Allocation ◽

Data Parallel ◽

Download Full-text

ReLoca: Optimize Resource Allocation for Data-parallel Jobs using Deep Learning

IEEE INFOCOM 2020 - IEEE Conference on Computer Communications ◽

10.1109/infocom41043.2020.9155521 ◽

2020 ◽

Author(s):

Zhiyao Hu ◽

Dongsheng Li ◽

Dongxiang Zhang ◽

Yixin Chen

Keyword(s):

Resource Allocation ◽

Deep Learning ◽

Data Parallel ◽

Download Full-text

Cluster fair queueing: Speeding up data-parallel jobs with delay guarantees

IEEE INFOCOM 2017 - IEEE Conference on Computer Communications ◽

10.1109/infocom.2017.8056948 ◽

2017 ◽

Author(s):

Chen Chen ◽

Wei Wang ◽

Shengkai Zhang ◽

Bo Li

Keyword(s):

Fair Queueing ◽

Data Parallel ◽

Parallel Jobs ◽

Delay Guarantees

Download Full-text

Efficient semantic-aware coflow scheduling for data-parallel jobs

2016 IEEE International Conference on Cluster Computing (CLUSTER) ◽

10.1109/cluster.2016.82 ◽

2016 ◽

Author(s):

Ziyang Li ◽

Yiming Zhang ◽

Yunxiang Zhao ◽

Dongsheng Li

Keyword(s):

Data Parallel ◽

Download Full-text

Energy-Aware Scheduling of Embarrassingly Parallel Jobs and Resource Allocation in Cloud

IEEE Transactions on Parallel and Distributed Systems ◽

10.1109/tpds.2016.2625254 ◽

2017 ◽

Vol 28 (6) ◽

pp. 1607-1620 ◽

Author(s):

Li Shi ◽

Zhemin Zhang ◽

Thomas Robertazzi

Keyword(s):

Resource Allocation ◽

Energy Aware ◽

Parallel Jobs ◽

Energy Aware Scheduling

Download Full-text

Resource allocation for data-parallel computing in networks with data locality

2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton) ◽

10.1109/allerton.2016.7852334 ◽

2016 ◽

Author(s):

Weina Wang ◽

Lei Ying

Keyword(s):

Resource Allocation ◽

Parallel Computing ◽

Data Locality ◽

Data Parallel ◽

Data Parallel Computing

Download Full-text

Network-Aware Scheduling for Data-Parallel Jobs

ACM SIGCOMM Computer Communication Review ◽

10.1145/2829988.2787488 ◽

2015 ◽

Vol 45 (4) ◽

pp. 407-420 ◽

Author(s):

Virajith Jalaparti ◽

Peter Bodik ◽

Ishai Menache ◽

Sriram Rao ◽

Konstantin Makarychev ◽

...

Keyword(s):

Data Parallel ◽

Download Full-text

Characterizing and Synthesizing Task Dependencies of Data-Parallel Jobs in Alibaba Cloud

Proceedings of the ACM Symposium on Cloud Computing - SoCC '19 ◽

10.1145/3357223.3362710 ◽

2019 ◽

Author(s):

Huangshi Tian ◽

Yunchuan Zheng ◽

Wei Wang

Keyword(s):

Data Parallel ◽

Download Full-text

Seflow: Efficient Flow Scheduling for Data-Parallel Jobs

2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW) ◽

10.1109/icdcsw.2017.40 ◽

2017 ◽

Author(s):

Qiao Zhou ◽

Ziyang Li ◽

Ping Zhong ◽

Tian Tian ◽

Yuxing Peng

Keyword(s):

Data Parallel ◽

Download Full-text

On the fairness of network resource allocation for data-parallel applications

10.14711/thesis-991012636568803412 ◽

2018 ◽

Author(s):

Shiyao Ma

Keyword(s):

Resource Allocation ◽

Parallel Applications ◽

Network Resource ◽

Data Parallel ◽

Network Resource Allocation

Download Full-text

Security-Aware Resource Allocation for Real-Time Parallel Jobs on Homogeneous and Heterogeneous Clusters

IEEE Transactions on Parallel and Distributed Systems ◽

10.1109/tpds.2007.70776 ◽

2008 ◽

Vol 19 (5) ◽

pp. 682-697 ◽

Author(s):

Tao Xie ◽

Xiao Qin

Keyword(s):

Resource Allocation ◽

Real Time ◽

Heterogeneous Clusters ◽

Download Full-text