Batch Normalization Processor Design for Convolution Neural Network Training and Inference

Author(s):  
Yu-Sheng Ting ◽  
Yu-Fan Teng ◽  
Tzi-Dar Chiueh
T-Comm ◽  
2021 ◽  
Vol 15 (4) ◽  
pp. 49-56
Author(s):  
Vadim V. Ziyadinov ◽  
◽  
Maxim V. Tereshonok ◽  

The challenge of mobile subscribers’ groups and crowd’s behavior prediction during the mass events is now increasingly important. Operative methods application of this task solution is difficult; accordingly, development and application of technical methods is necessary. The method of this problem solution consists of subscribers’ telephone conversations recording in a zone of mass action, and the following speech recognition, the semantic analysis and statistical processing application. However, there is a tendency demand decrease for mobile systems voice services with simultaneous demand growth for data traffic nowadays. The purpose of this paper is to create a mathematical model of mobile networks subscribers’ mutual placement types, applicable for automatization of the subscribers’ activities nature prediction systems. The research method consists of mathematical simulation model development for pseudo-random examples generation of subscribers’ mutual placement types set, creation of training dataset, convolution neural network training and usage of training results to recognize the new examples. The results obtained. A mathematical model is proposed allowing to create a representative training and validation dataset of mobile networks subscribers’ mutual placement types for neural network training and testing. The convolution neural network trained using these samples has shown high classification accuracy results with a wide class of subscribers’ mutual placement types.


Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 711
Author(s):  
Mina Basirat ◽  
Bernhard C. Geiger ◽  
Peter M. Roth

Information plane analysis, describing the mutual information between the input and a hidden layer and between a hidden layer and the target over time, has recently been proposed to analyze the training of neural networks. Since the activations of a hidden layer are typically continuous-valued, this mutual information cannot be computed analytically and must thus be estimated, resulting in apparently inconsistent or even contradicting results in the literature. The goal of this paper is to demonstrate how information plane analysis can still be a valuable tool for analyzing neural network training. To this end, we complement the prevailing binning estimator for mutual information with a geometric interpretation. With this geometric interpretation in mind, we evaluate the impact of regularization and interpret phenomena such as underfitting and overfitting. In addition, we investigate neural network learning in the presence of noisy data and noisy labels.


2020 ◽  
pp. 106878
Author(s):  
H. M. Dipu Kabir ◽  
Abbas Khosravi ◽  
Abdollah Kavousi-Fard ◽  
Saeid Nahavandi ◽  
Dipti Srinivasan

Sign in / Sign up

Export Citation Format

Share Document