Image Caption Generation Using Neural Network Models and LSTM Hierarchical Structure

2021 ◽  
pp. 109-117
Author(s):  
Prachi M. Waghmare ◽  
Swati V. Shinde
Keyword(s):  
Neural Network ◽  
Hierarchical Structure ◽  
Network Models ◽  
Neural Network Models ◽  
Image Caption Generation ◽  
Image Caption

scholarly journals Does Syntax Need to Grow on Trees? Sources of Hierarchical Inductive Bias in Sequence-to-Sequence Networks

2020 ◽  
Vol 8 ◽  
pp. 125-140
Author(s):  
R. Thomas McCoy ◽  
Robert Frank ◽  
Tal Linzen
Keyword(s):  
Neural Network ◽  
Hierarchical Structure ◽  
Syntactic Structure ◽  
Network Models ◽  
Training Data ◽  
Training Set ◽  
Neural Network Models ◽  
Structured Model ◽  
Inductive Bias ◽  
Question Formation

Learners that are exposed to the same training data might generalize differently due to differing inductive biases. In neural network models, inductive biases could in theory arise from any aspect of the model architecture. We investigate which architectural factors affect the generalization behavior of neural sequence-to-sequence models trained on two syntactic tasks, English question formation and English tense reinflection. For both tasks, the training set is consistent with a generalization based on hierarchical structure and a generalization based on linear order. All architectural factors that we investigated qualitatively affected how models generalized, including factors with no clear connection to hierarchical structure. For example, LSTMs and GRUs displayed qualitatively different inductive biases. However, the only factor that consistently contributed a hierarchical bias across tasks was the use of a tree-structured model rather than a model with sequential recurrence, suggesting that human-like syntactic generalization requires architectural syntactic structure.

Method of complex copper-zinc ore typification using neural network models

2020 ◽  
Vol 5 ◽  
pp. 140-147 ◽  
Author(s):  
T.N. Aleksandrova ◽  
◽  
E.K. Ushakov ◽  
A.V. Orlova ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Neural Network Models ◽  
Copper Zinc ◽  
Complex Copper

Digital twin of equipment as a basis for the consumer in digital production

2020 ◽  
Keyword(s):  
Neural Network ◽  
Tool Wear ◽  
Chip Formation ◽  
Network Models ◽  
Machining Accuracy ◽  
Neural Network Models ◽  
Digital Twin ◽  
The Neural Network ◽  
Digital Production ◽  
Cyberphysical System

The neural network models series used in the development of an aggregated digital twin of equipment as a cyber-physical system are presented. The twins of machining accuracy, chip formation and tool wear are examined in detail. On their basis, systems for stabilization of the chip formation process during cutting and diagnose of the cutting too wear are developed. Keywords cyberphysical system; neural network model of equipment; big data, digital twin of the chip formation; digital twin of the tool wear; digital twin of nanostructured coating choice

scholarly journals Prediction of Stress in Power Transformer Winding Conductors Using Artificial Neural Networks: Hyperparameter Analysis

Energies ◽  
2021 ◽  
Vol 14 (14) ◽  
pp. 4242
Author(s):  
Fausto Valencia ◽  
Hugo Arcos ◽  
Franklin Quilumba
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Finite Element ◽  
Power Transformer ◽  
Network Models ◽  
Activation Function ◽  
Neural Network Models ◽  
Transformer Winding ◽  
Artificial Neural ◽  
Femm Software

The purpose of this research is the evaluation of artificial neural network models in the prediction of stresses in a 400 MVA power transformer winding conductor caused by the circulation of fault currents. The models were compared considering the training, validation, and test data errors’ behavior. Different combinations of hyperparameters were analyzed based on the variation of architectures, optimizers, and activation functions. The data for the process was created from finite element simulations performed in the FEMM software. The design of the Artificial Neural Network was performed using the Keras framework. As a result, a model with one hidden layer was the best suited architecture for the problem at hand, with the optimizer Adam and the activation function ReLU. The final Artificial Neural Network model predictions were compared with the Finite Element Method results, showing good agreement but with a much shorter solution time.

scholarly journals The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand

2021 ◽  
Vol 11 (3) ◽  
pp. 908
Author(s):  
Jie Zeng ◽  
Panagiotis G. Asteris ◽  
Anna P. Mamou ◽  
Ahmed Salih Mohammed ◽  
Emmanuil A. Golias ◽  
...  
Keyword(s):  
Neural Network ◽  
Numerical Models ◽  
Correlation Coefficients ◽  
Network Models ◽  
Small Scale ◽  
Offshore Platforms ◽  
Neural Network Models ◽  
Buried Pipes ◽  
Ensemble Techniques ◽  
Uplift Resistance

Buried pipes are extensively used for oil transportation from offshore platforms. Under unfavorable loading combinations, the pipe’s uplift resistance may be exceeded, which may result in excessive deformations and significant disruptions. This paper presents findings from a series of small-scale tests performed on pipes buried in geogrid-reinforced sands, with the measured peak uplift resistance being used to calibrate advanced numerical models employing neural networks. Multilayer perceptron (MLP) and Radial Basis Function (RBF) primary structure types have been used to train two neural network models, which were then further developed using bagging and boosting ensemble techniques. Correlation coefficients in excess of 0.954 between the measured and predicted peak uplift resistance have been achieved. The results show that the design of pipelines can be significantly improved using the proposed novel, reliable and robust soft computing models.

An evaluation of deep neural network models for music classification using spectrograms

2021 ◽  
Author(s):  
Jingxian Li ◽  
Lixin Han ◽  
Xiaoshuang Li ◽  
Jun Zhu ◽  
Baohua Yuan ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Network Models ◽  
Neural Network Models ◽  
Music Classification
Sign in / Sign up

Export Citation Format

Share Document