PACL: Piecewise Arc Cotangent Decay Learning Rate for Deep Neural Network Training

IEEE Access ◽

10.1109/access.2020.3002884 ◽

2020 ◽

Vol 8 ◽

pp. 112805-112813 ◽

Author(s):

Haixu Yang ◽

Jihong Liu ◽

Hongwei Sun ◽

Henggui Zhang

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Learning Rate ◽

Neural Network Training ◽

Network Training

Download Full-text

Exponential decay sine wave learning rate for fast deep neural network training

2017 IEEE Visual Communications and Image Processing (VCIP) ◽

10.1109/vcip.2017.8305126 ◽

2017 ◽

Author(s):

Wangpeng An ◽

Haoqian Wang ◽

Yulun Zhang ◽

Qionghai Dai

Keyword(s):

Neural Network ◽

Exponential Decay ◽

Deep Neural Network ◽

Sine Wave ◽

Learning Rate ◽

Neural Network Training ◽

Network Training

Download Full-text

Multilingual Deep Neural Network Training Using Cyclical Learning Rate

10.21437/interspeech.2018-1891 ◽

2018 ◽

Author(s):

Andreas Søeborg Kirkedal ◽

Yeon-Jun Kim

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Learning Rate ◽

Neural Network Training ◽

Network Training

Download Full-text

Dynamic learning rate neural network training and composite structural damage detection

AIAA Journal ◽

10.2514/3.13701 ◽

1997 ◽

Vol 35 ◽

pp. 1522-1527

Author(s):

H. Luo ◽

S. Hanagud

Keyword(s):

Neural Network ◽

Damage Detection ◽

Structural Damage ◽

Learning Rate ◽

Neural Network Training ◽

Structural Damage Detection ◽

Dynamic Learning ◽

Network Training

Download Full-text

A Deep Neural Network Training Architecture with Inference-aware Heterogeneous Data-type

IEEE Transactions on Computers ◽

10.1109/tc.2021.3078316 ◽

2021 ◽

pp. 1-1

Author(s):

Seungkyu Choi ◽

Jaekang Shin ◽

Lee-Sup Kim

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Heterogeneous Data ◽

Data Type ◽

Neural Network Training ◽

Network Training

Download Full-text

An Energy-Efficient Deep Neural Network Training Processor with Bit-Slice-Level Reconfigurability and Sparsity Exploitation

2021 IEEE Symposium in Low-Power and High-Speed Chips (COOL CHIPS) ◽

10.1109/coolchips52128.2021.9410324 ◽

2021 ◽

Author(s):

Donghyeon Han ◽

Dongseok Im ◽

Gwangtae Park ◽

Youngwoo Kim ◽

Seokchan Song ◽

...

Keyword(s):

Neural Network ◽

Energy Efficient ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Deep Neural Network Training Accelerator Designs in ASIC and FPGA

2020 International SoC Design Conference (ISOCC) ◽

10.1109/isocc50952.2020.9333063 ◽

2020 ◽

Author(s):

Shreyas K. Venkataramanaiah ◽

Shihui Yin ◽

Yu Cao ◽

Jae-Sun Seo

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training

IEEE Transactions on Neural Networks and Learning Systems ◽

10.1109/tnnls.2021.3130991 ◽

2021 ◽

pp. 1-15

Author(s):

Dongyeob Shin ◽

Geonho Kim ◽

Joongho Jo ◽

Jongsun Park

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Low Complexity ◽

Neural Network Training ◽

Computation Techniques ◽

Network Training ◽

Gradient Computation

Download Full-text

A FeRAM based Volatile/Non-volatile Dual-mode Buffer Memory for Deep Neural Network Training

10.23919/date51398.2021.9474180 ◽

2021 ◽

Author(s):

Yandong Luo ◽

Yuan-Chun Luc ◽

Shimeng Yu

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Dual Mode ◽

Buffer Memory ◽

Network Training

Download Full-text

Exploring one pass learning for deep neural network training with averaged stochastic gradient descent

2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) ◽

10.1109/icassp.2014.6854928 ◽

2014 ◽

Author(s):

Zhao You ◽

Xiaorui Wang ◽

Bo Xu

Keyword(s):

Neural Network ◽

Gradient Descent ◽

Deep Neural Network ◽

Stochastic Gradient ◽

Stochastic Gradient Descent ◽

Neural Network Training ◽

Network Training

Download Full-text

A 141.4 mW Low-Power Online Deep Neural Network Training Processor for Real-time Object Tracking in Mobile Devices

2018 IEEE International Symposium on Circuits and Systems (ISCAS) ◽

10.1109/iscas.2018.8351398 ◽

2018 ◽

Author(s):

Donghyeon Han ◽

Jinsu Lee ◽

Jinmook Lee ◽

Sungpill Choi ◽

Hoi-Jun Yoo

Keyword(s):

Neural Network ◽

Low Power ◽

Object Tracking ◽

Real Time ◽

Mobile Devices ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text