scholarly journals Effect of Architectural Composition of MLP ANN in Neural Network Learning for Signal Power Loss Prediction

2021 ◽  
pp. 20-29
Author(s):  
Virginia C. Ebhota ◽  
◽  
Viranjay M. Srivastava
Keyword(s):  
Neural Network ◽  
Power Loss ◽  
Prediction Errors ◽  
Signal Power ◽  
Training Algorithm ◽  
Ann Model ◽  
Training Time ◽  
Mlp Neural Network ◽  
Network Training ◽  
Target Values

This work analyzes the architectural complexity of a Multi-Layer Perceptron (MLP) Artificial Neural Network (ANN) model suitable for modeling and predicting signal power loss in micro-cellular environments. The MLP neural network model with one, two, and three hidden layers respectively were trained using measurement datasets used as the target values collected from a micro-cell environment that is suitable to describe different propagation paths and conditions. The neural network training has been performed by applying different training techniques to ensure a well-trained network for good generalization and avoid over-fitting during network training. Bayesian regularization algorithm (that updates weights and biases during network training) following the Levenberg-Marquardt optimization training algorithm was used as the training algorithm. A comparative analysis of training results from one, two, and three hidden layers MLP neural networks show the best prediction result of the signal power loss using a neural network with one hidden layer. A complex architectural composition of the MLP neural network involved very high training time and higher prediction errors.

scholarly journals Enhanced Error Reduction of Signal Power Loss During Electromagnetic Propagation: Architectural Composition and Learning Rate Selection

2021 ◽  
pp. 450-456
Author(s):  
Virginia C. Ebhota ◽  
◽  
Viranjay M. Srivastava
Keyword(s):  
Neural Network ◽  
Power Loss ◽  
Single Layer ◽  
Signal Propagation ◽  
Learning Rate ◽  
Signal Power ◽  
Multi Layer Perceptron ◽  
Coefficient Of Correlation ◽  
Network Training ◽  
Hidden Layer

This research work analyses the effect of the architectural composition of Multi-Layer Perceptron (MLP) Artificial Neural Network (ANN) combined with the effect of the learning rate for effective prediction of signal power loss during electromagnetic signal propagation. A single hidden layer and two hidden layers of MLP ANN have been considered. Different configurations of the neural network architecture ranging from 4 to 100 for both MLP networks have been analyzed. The required hidden layer neurons for optimal training of a single layer multi-layer network were 40 neurons with 0.99670 coefficient of correlation and 1.28020 standard deviations, while [68 72] trained two hidden layers multi-layer perceptron with 0.98880 coefficient of correlation and standard deviation of 1.42820. Different learning rates were also adopted for the network training. The results further validate better MLP neural network training for signal power loss prediction using single-layer perceptron network compared to two hidden layers perceptron network with the coefficient of correlation of 0.99670 for single-layer network and 0.9888 for two hidden layers network. Furthermore, the learning rate of 0.003 shows the best training capability with lower mean squared error and higher training regression compared to other values of learning rate used for both single layer and two hidden layers perceptron MLP networks.

scholarly journals Machine-learning in astronomy

2014 ◽  
Vol 10 (S306) ◽  
pp. 279-287 ◽  
Author(s):  
Michael Hobson ◽  
Philip Graff ◽  
Farhan Feroz ◽  
Anthony Lasenby
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Gamma Ray ◽  
Neural Network Training ◽  
Training Algorithm ◽  
Data Description ◽  
Astronomical Data ◽  
Machine Learning Methods ◽  
Network Training

AbstractMachine-learning methods may be used to perform many tasks required in the analysis of astronomical data, including: data description and interpretation, pattern recognition, prediction, classification, compression, inference and many more. An intuitive and well-established approach to machine learning is the use of artificial neural networks (NNs), which consist of a group of interconnected nodes, each of which processes information that it receives and then passes this product on to other nodes via weighted connections. In particular, I discuss the first public release of the generic neural network training algorithm, calledSkyNet, and demonstrate its application to astronomical problems focusing on its use in the BAMBI package for accelerated Bayesian inference in cosmology, and the identification of gamma-ray bursters. TheSkyNetand BAMBI packages, which are fully parallelised using MPI, are available athttp://www.mrao.cam.ac.uk/software/.

scholarly journals Parallelization of Neural Network Training for NLP with Hogwild!

2017 ◽  
Vol 109 (1) ◽  
pp. 29-38 ◽  
Author(s):  
Valentin Deyringer ◽  
Alexander Fraser ◽  
Helmut Schmid ◽  
Tsuyoshi Okita
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Suitable Method ◽  
Neural Network Training ◽  
Training Time ◽  
Pos Tagging ◽  
Network Training ◽  
Speed Up

Abstract Neural Networks are prevalent in todays NLP research. Despite their success for different tasks, training time is relatively long. We use Hogwild! to counteract this phenomenon and show that it is a suitable method to speed up training Neural Networks of different architectures and complexity. For POS tagging and translation we report considerable speedups of training, especially for the latter. We show that Hogwild! can be an important tool for training complex NLP architectures.

Research on the Optimized Algorithms on Neural Network

2012 ◽  
Vol 605-607 ◽  
pp. 2175-2178
Author(s):  
Xiao Qin Wu
Keyword(s):  
Neural Network ◽  
Bp Neural Network ◽  
Simulated Annealing Algorithm ◽  
Fitness Function ◽  
Strong Stability ◽  
Training Algorithm ◽  
Network Training ◽  
The Neural Network ◽  
Annealing Algorithm ◽  
Proper Operation

In order to overcome the disadvantage of neural networks that their structure and parameters were decided stochastically or by one’s experience, an improved BP neural network training algorithm based on genetic algorithm was proposed.In this paper,genetic algorithms and simulated annealing algorithm that optimizes neural network is proposed which is used to scale the fitness function and select the proper operation according to the expected value in the course of optimization,and the weights and thresholds of the neural network is optimized. This method is applied to the stock prediction system.The experimental results show that the proposed approach have high accuracy,strong stability and improved confidence.

scholarly journals Prediction of Sensory Parameters of Cured Ham: A Study of the Viability of the Use of NIR Spectroscopy and Artificial Neural Networks

Sensors ◽  
2020 ◽  
Vol 20 (19) ◽  
pp. 5624
Author(s):  
Pedro Hernández-Ramos ◽  
Ana María Vivar-Quintana ◽  
Isabel Revilla ◽  
María Inmaculada González-Martín ◽  
Miriam Hernández-Jiménez ◽  
...  
Keyword(s):  
Neural Network ◽  
Nir Spectroscopy ◽  
Sensory Profile ◽  
Training Algorithm ◽  
Ann Model ◽  
Fiber Optic Probe ◽  
Organoleptic Characteristics ◽  
Dry Cured Ham ◽  
Artificial Neural ◽  
Sensory Parameters

Dry-cured ham is a high-quality product owing to its organoleptic characteristics. Sensory analysis is an essential part of assessing its quality. However, sensory assessment is a laborious process which implies the availability of a trained tasting panel. The aim of this study was the prediction of dry-ham sensory characteristics by means of an instrumental technique. To do so, an artificial neural network (ANN) model for the prediction of sensory parameters of dry-cured hams based on NIR spectral information was developed and optimized. The NIR spectra were obtained with a fiber-optic probe applied directly to the ham sample. In order to achieve this objective, the neural network was designed using 28 sensory parameters analyzed by a trained panel for sensory profile analysis as output data. A total of 91 samples of dry-cured ham matured for 24 months were analyzed. The hams corresponded to two different breeds (Iberian and Iberian x Duroc) and two different feeding systems (feeding outdoors with acorns or feeding with concentrates). The training algorithm and ANN architecture (the number of neurons in the hidden layer) used for the training were optimized. The parameters of ANN architecture analyzed have been shown to have an effect on the prediction capacity of the network. The Levenberg–Marquardt training algorithm has been shown to be the most suitable for the application of an ANN to sensory parameters

Sign in / Sign up

Export Citation Format

Share Document