Parallel Deep Neural Network Training for Big Data on Blue Gene/Q

SC14: International Conference for High Performance Computing, Networking, Storage and Analysis ◽

10.1109/sc.2014.66 ◽

2014 ◽

Author(s):

I-Hsin Chung ◽

Tara N. Sainath ◽

Bhuvana Ramabhadran ◽

Michael Pichen ◽

John Gunnels ◽

...

Keyword(s):

Neural Network ◽

Big Data ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training ◽

Download Full-text

Parallel Deep Neural Network Training for Big Data on Blue Gene/Q

IEEE Transactions on Parallel and Distributed Systems ◽

10.1109/tpds.2016.2626289 ◽

2017 ◽

Vol 28 (6) ◽

pp. 1703-1714 ◽

Author(s):

I-Hsin Chung ◽

Tara N. Sainath ◽

Bhuvana Ramabhadran ◽

Michael Picheny ◽

John Gunnels ◽

...

Keyword(s):

Neural Network ◽

Big Data ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training ◽

Download Full-text

Parallel deep neural network training for LVCSR tasks using blue gene/Q

10.21437/interspeech.2014-272 ◽

2014 ◽

Author(s):

Tara N. Sainath ◽

I-hsin Chung ◽

Bhuvana Ramabhadran ◽

Michael Picheny ◽

John Gunnels ◽

...

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training ◽

Download Full-text

A Deep Neural Network Training Architecture with Inference-aware Heterogeneous Data-type

IEEE Transactions on Computers ◽

10.1109/tc.2021.3078316 ◽

2021 ◽

pp. 1-1

Author(s):

Seungkyu Choi ◽

Jaekang Shin ◽

Lee-Sup Kim

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Heterogeneous Data ◽

Data Type ◽

Neural Network Training ◽

Network Training

Download Full-text

An Energy-Efficient Deep Neural Network Training Processor with Bit-Slice-Level Reconfigurability and Sparsity Exploitation

2021 IEEE Symposium in Low-Power and High-Speed Chips (COOL CHIPS) ◽

10.1109/coolchips52128.2021.9410324 ◽

2021 ◽

Author(s):

Donghyeon Han ◽

Dongseok Im ◽

Gwangtae Park ◽

Youngwoo Kim ◽

Seokchan Song ◽

...

Keyword(s):

Neural Network ◽

Energy Efficient ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Deep Neural Network Training Accelerator Designs in ASIC and FPGA

2020 International SoC Design Conference (ISOCC) ◽

10.1109/isocc50952.2020.9333063 ◽

2020 ◽

Author(s):

Shreyas K. Venkataramanaiah ◽

Shihui Yin ◽

Yu Cao ◽

Jae-Sun Seo

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training

IEEE Transactions on Neural Networks and Learning Systems ◽

10.1109/tnnls.2021.3130991 ◽

2021 ◽

pp. 1-15

Author(s):

Dongyeob Shin ◽

Geonho Kim ◽

Joongho Jo ◽

Jongsun Park

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Low Complexity ◽

Neural Network Training ◽

Computation Techniques ◽

Network Training ◽

Gradient Computation

Download Full-text

A FeRAM based Volatile/Non-volatile Dual-mode Buffer Memory for Deep Neural Network Training

10.23919/date51398.2021.9474180 ◽

2021 ◽

Author(s):

Yandong Luo ◽

Yuan-Chun Luc ◽

Shimeng Yu

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Dual Mode ◽

Buffer Memory ◽

Network Training

Download Full-text

Exploring one pass learning for deep neural network training with averaged stochastic gradient descent

2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) ◽

10.1109/icassp.2014.6854928 ◽

2014 ◽

Author(s):

Zhao You ◽

Xiaorui Wang ◽

Bo Xu

Keyword(s):

Neural Network ◽

Gradient Descent ◽

Deep Neural Network ◽

Stochastic Gradient ◽

Stochastic Gradient Descent ◽

Neural Network Training ◽

Network Training

Download Full-text

A 141.4 mW Low-Power Online Deep Neural Network Training Processor for Real-time Object Tracking in Mobile Devices

2018 IEEE International Symposium on Circuits and Systems (ISCAS) ◽

10.1109/iscas.2018.8351398 ◽

2018 ◽

Author(s):

Donghyeon Han ◽

Jinsu Lee ◽

Jinmook Lee ◽

Sungpill Choi ◽

Hoi-Jun Yoo

Keyword(s):

Neural Network ◽

Low Power ◽

Object Tracking ◽

Real Time ◽

Mobile Devices ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

A Unified Coded Deep Neural Network Training Strategy based on Generalized PolyDot codes

2018 IEEE International Symposium on Information Theory (ISIT) ◽

10.1109/isit.2018.8437852 ◽

2018 ◽

Author(s):

Sanghamitra Dutta ◽

Ziqian Bai ◽

Haewon Jeong ◽

Tze Meng Low ◽

Pulkit Grover

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Training Strategy ◽

Network Training

Download Full-text