A Comparison of Deep Neural Network Training Methods for Large Vocabulary Speech Recognition

Text, Speech, and Dialogue - Lecture Notes in Computer Science ◽

10.1007/978-3-642-40585-3_6 ◽

2013 ◽

pp. 36-43 ◽

Author(s):

László Tóth ◽

Tamás Grósz

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Deep Neural Network ◽

Training Methods ◽

Neural Network Training ◽

Large Vocabulary ◽

Network Training ◽

Large Vocabulary Speech Recognition

Download Full-text

Beyond cross-entropy: towards better frame-level objective functions for deep neural network training in automatic speech recognition

10.21437/interspeech.2014-306 ◽

2014 ◽

Author(s):

Zhen Huang ◽

Jinyu Li ◽

Chao Weng ◽

Chin-Hui Lee

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Automatic Speech Recognition ◽

Deep Neural Network ◽

Cross Entropy ◽

Neural Network Training ◽

Objective Functions ◽

Network Training

Download Full-text

Size matters: an empirical study of neural network training for large vocabulary continuous speech recognition

1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258) ◽

10.1109/icassp.1999.759875 ◽

1999 ◽

Author(s):

D. Ellis ◽

N. Morgan

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Empirical Study ◽

Neural Network Training ◽

Continuous Speech ◽

Continuous Speech Recognition ◽

Large Vocabulary ◽

Network Training

Download Full-text

KL-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition

2013 IEEE International Conference on Acoustics, Speech and Signal Processing ◽

10.1109/icassp.2013.6639201 ◽

2013 ◽

Author(s):

Dong Yu ◽

Kaisheng Yao ◽

Hang Su ◽

Gang Li ◽

Frank Seide

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Deep Neural Network ◽

Large Vocabulary ◽

Network Adaptation ◽

Kl Divergence ◽

Large Vocabulary Speech Recognition

Download Full-text

Neuron sparseness versus connection sparseness in deep neural network for large vocabulary speech recognition

2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) ◽

10.1109/icassp.2015.7178913 ◽

2015 ◽

Author(s):

Jian Kang ◽

Cheng Lu ◽

Meng Cai ◽

Wei-Qiang Zhang ◽

Jia Liu

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Deep Neural Network ◽

Large Vocabulary ◽

Large Vocabulary Speech Recognition

Download Full-text

Learning feature mapping using deep neural network bottleneck features for distant large vocabulary speech recognition

2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) ◽

10.1109/icassp.2015.7178830 ◽

2015 ◽

Author(s):

Ivan Himawan ◽

Petr Motlicek ◽

David Imseng ◽

Blaise Potard ◽

Namhoon Kim ◽

...

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Deep Neural Network ◽

Feature Mapping ◽

Large Vocabulary ◽

Large Vocabulary Speech Recognition

Download Full-text

Deep neural network training for whispered speech recognition using small databases and generative model sampling

International Journal of Speech Technology ◽

10.1007/s10772-017-9461-x ◽

2017 ◽

Vol 20 (4) ◽

pp. 1063-1075 ◽

Author(s):

Shabnam Ghaffarzadegan ◽

Hynek Bořil ◽

John H. L. Hansen

Keyword(s):

Neural Network ◽

Speech Recognition ◽

Deep Neural Network ◽

Generative Model ◽

Neural Network Training ◽

Network Training ◽

Whispered Speech

Download Full-text

A Deep Neural Network Training Architecture with Inference-aware Heterogeneous Data-type

IEEE Transactions on Computers ◽

10.1109/tc.2021.3078316 ◽

2021 ◽

pp. 1-1

Author(s):

Seungkyu Choi ◽

Jaekang Shin ◽

Lee-Sup Kim

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Heterogeneous Data ◽

Data Type ◽

Neural Network Training ◽

Network Training

Download Full-text

An Energy-Efficient Deep Neural Network Training Processor with Bit-Slice-Level Reconfigurability and Sparsity Exploitation

2021 IEEE Symposium in Low-Power and High-Speed Chips (COOL CHIPS) ◽

10.1109/coolchips52128.2021.9410324 ◽

2021 ◽

Author(s):

Donghyeon Han ◽

Dongseok Im ◽

Gwangtae Park ◽

Youngwoo Kim ◽

Seokchan Song ◽

...

Keyword(s):

Neural Network ◽

Energy Efficient ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Deep Neural Network Training Accelerator Designs in ASIC and FPGA

2020 International SoC Design Conference (ISOCC) ◽

10.1109/isocc50952.2020.9333063 ◽

2020 ◽

Author(s):

Shreyas K. Venkataramanaiah ◽

Shihui Yin ◽

Yu Cao ◽

Jae-Sun Seo

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Neural Network Training ◽

Network Training

Download Full-text

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training

IEEE Transactions on Neural Networks and Learning Systems ◽

10.1109/tnnls.2021.3130991 ◽

2021 ◽

pp. 1-15

Author(s):

Dongyeob Shin ◽

Geonho Kim ◽

Joongho Jo ◽

Jongsun Park

Keyword(s):

Neural Network ◽

Deep Neural Network ◽

Low Complexity ◽

Neural Network Training ◽

Computation Techniques ◽

Network Training ◽

Gradient Computation

Download Full-text