scholarly journals Neural Sign Language Translation Based on Human Keypoint Estimation

2019 ◽  
Vol 9 (13) ◽  
pp. 2683 ◽  
Author(s):  
Sang-Ki Ko ◽  
Chang Jo Kim ◽  
Hyedong Jung ◽  
Choongsang Cho
Keyword(s):  
Neural Network ◽  
Sign Language ◽  
Language Translation ◽  
Network Models ◽  
Training Data ◽  
Translation System ◽  
Body Parts ◽  
Neural Network Models ◽  
Translation Model ◽  
Starting Point

We propose a sign language translation system based on human keypoint estimation. It is well-known that many problems in the field of computer vision require a massive dataset to train deep neural network models. The situation is even worse when it comes to the sign language translation problem as it is far more difficult to collect high-quality training data. In this paper, we introduce the KETI (Korea Electronics Technology Institute) sign language dataset, which consists of 14,672 videos of high resolution and quality. Considering the fact that each country has a different and unique sign language, the KETI sign language dataset can be the starting point for further research on the Korean sign language translation. Using the KETI sign language dataset, we develop a neural network model for translating sign videos into natural language sentences by utilizing the human keypoints extracted from the face, hands, and body parts. The obtained human keypoint vector is normalized by the mean and standard deviation of the keypoints and used as input to our translation model based on the sequence-to-sequence architecture. As a result, we show that our approach is robust even when the size of the training data is not sufficient. Our translation model achieved 93.28% (55.28%, respectively) translation accuracy on the validation set (test set, respectively) for 105 sentences that can be used in emergency situations. We compared several types of our neural sign translation models based on different attention mechanisms in terms of classical metrics for measuring the translation performance.

Analysis of Fin-Tube Evaporator Performance With Limited Experimental Data Using Artificial Neural Networks

2000 ◽  
Author(s):  
Arturo Pacheco-Vega ◽  
Mihir Sen ◽  
Rodney L. McClain
Keyword(s):  
Neural Network ◽  
Heat Rate ◽  
Network Models ◽  
Activation Function ◽  
Operating Conditions ◽  
Training Data ◽  
Neural Network Models ◽  
The Neural Network ◽  
Artificial Neural ◽  
Fin Tube

Abstract In the current study we consider the problem of accuracy in heat rate estimations from artificial neural network models of heat exchangers used for refrigeration applications. The network configuration is of the feedforward type with a sigmoid activation function and a backpropagation algorithm. Limited experimental measurements from a manufacturer are used to show the capability of the neural network technique in modeling the heat transfer in these systems. Results from this exercise show that a well-trained network correlates the data with errors of the same order as the uncertainty of the measurements. It is also shown that the number and distribution of the training data are linked to the performance of the network when estimating the heat rates under different operating conditions, and that networks trained from few tests may give large errors. A methodology based on the cross-validation technique is presented to find regions where not enough data are available to construct a reliable neural network. The results from three tests show that the proposed methodology gives an upper bound of the estimated error in the heat rates.

scholarly journals Forecasting variance of NiftyIT index with RNN and DNN

2022 ◽  
Vol 2161 (1) ◽  
pp. 012005
Author(s):  
C R Karthik ◽  
Raghunandan ◽  
B Ashwath Rao ◽  
N V Subba Reddy
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Series Analysis ◽  
Short Term Memory ◽  
Stock Exchange ◽  
Network Models ◽  
Training Data ◽  
Complex Data ◽  
Neural Network Models ◽  
Series Analysis

Abstract A time series is an order of observations engaged serially in time. The prime objective of time series analysis is to build mathematical models that provide reasonable descriptions from training data. The goal of time series analysis is to forecast the forthcoming values of a series based on the history of the same series. Forecasting of stock markets is a thought-provoking problem because of the number of possible variables as well as volatile noise that may contribute to the prices of the stock. However, the capability to analyze stock market leanings could be vital to investors, traders and researchers, hence has been of continued interest. Plentiful arithmetical and machine learning practices have been discovered for stock analysis and forecasting/prediction. In this paper, we perform a comparative study on two very capable artificial neural network models i) Deep Neural Network (DNN) and ii) Long Short-Term Memory (LSTM) a type of recurrent neural network (RNN) in predicting the daily variance of NIFTYIT in BSE (Bombay Stock Exchange) and NSE (National Stock Exchange) markets. DNN was chosen due to its capability to handle complex data with substantial performance and better generalization without being saturated. LSTM model was decided, as it contains intermediary memory which can hold the historic patterns and occurrence of the next prediction depends on the values that preceded it. With both networks, measures were taken to reduce overfitting. Daily predictions of the NIFTYIT index were made to test the generalizability of the models. Both networks performed well at making daily predictions, and both generalized admirably to make daily predictions of the NiftyIT data. The LSTM-RNN outpaced the DNN in terms of forecasting and thus, grips more potential for making longer-term estimates.

scholarly journals Use of Modular Neural Network for Heart Disease

2010 ◽  
pp. 196-201
Author(s):  
Harsh Vazirani ◽  
Rahul Kala ◽  
Anupam Shukla ◽  
Ritu Tiwari
Keyword(s):  
Neural Network ◽  
Heart Disease ◽  
Network Models ◽  
Training Data ◽  
Neural Network Models ◽  
Modular Neural Network ◽  
Medical Disease ◽  
Research Areas ◽  
Product Method ◽  
Testing Accuracy

The medical field is very versatile field and one of the interested research areas for the scientist. It deals with many medical disease problems starting with the diagnosis of the disease, preventing from the disease and treatment for the disease. There are various types of medical disease and accordingly various types of treatment methods. In this paper we mostly concern about the diagnosis of the heart disease. Mainly two types of the diagnosis method are used one is manual and other is automatic diagnosis which consists of diagnosis of disease with the help of intelligent expert system. In this paper the modular neural network is used to diagnosis the heart disease. The attributes are divided and given to the two neural network models Backpropagation Neural Network (BPNN) and Radial Basis Function Neural Network (RBFNN) for training and testing. The two integration techniques are used two integrate the results and provide the final training accuracy and testing accuracy. The modular neural network with probabilistic product method gave an accuracy of 87.02% over training data and 85.88% over testing accuracy and with probabilistic product method gave an accuracy of 89.72% over training data and 84.70% over testing accuracy, which was experimentally determined to be better than monolithic neural networks.

System Identification for Nonlinear Maneuvering of Ships Using Neural Network

2010 ◽  
Vol 54 (01) ◽  
pp. 1-14
Author(s):  
G. Rajesh ◽  
G. Giri Rajasekhar ◽  
S. K. Bhattacharyya
Keyword(s):  
Neural Network ◽  
System Identification ◽  
Simulated Data ◽  
Network Models ◽  
Training Data ◽  
Neural Network Models ◽  
The Neural Network ◽  
Marquardt Algorithm ◽  
Hydrodynamic Derivatives ◽  
Hidden Layer

This paper deals with the application of nonparametric system identification to the nonlinear maneuvering of ships using neural network method. The maneuvering equations contain linear as well as nonlinear terms, and one does not attempt to determine the parameters (or hydrodynamic derivatives) associated with nonlinear terms, rather all nonlinear terms are clubbed together to form one unknown time function per equation, which are sought to be represented by neural network coefficients. The time series used in training the network are obtained from simulated data of zigzag and spiral maneuvers. The neural network has one middle or hidden layer of neurons and the Levenberg-Marquardt algorithm is used to obtain the network coefficients. Using the best choices for number of hidden layer neurons, length of training data, convergence tolerance, and so forth, the performances of the proposed neural network models have been investigated and conclusions drawn.

scholarly journals A Hybrid Short-term Traffic Flow Forecasting Method Based on Neural Networks Combined with K-Nearest Neighbor

2018 ◽  
Vol 30 (4) ◽  
pp. 445-456 ◽  
Author(s):  
Zhao Liu ◽  
Jianhua Guo ◽  
Jinde Cao ◽  
Yun Wei ◽  
Wei Huang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Traffic Flow ◽  
Nearest Neighbor ◽  
Network Models ◽  
Training Data ◽  
K Nearest Neighbor ◽  
Short Term ◽  
Neural Network Models ◽  
Traffic Forecasting

It is critical to implement accurate short-term traffic forecasting in traffic management and control applications. This paper proposes a hybrid forecasting method based on neural networks combined with the K-nearest neighbor (K-NN) method for short-term traffic flow forecasting. The procedure of training a neural network model using existing traffic input-output data, i.e., training data, is indispensable for fine-tuning the prediction model. Based on this point, the K-NN method was employed to reconstruct the training data for neural network models while considering the similarity of traffic flow patterns. This was done through collecting the specific state vectors that were closest to the current state vectors from the historical database to enhance the relationship between the inputs and outputs for the neural network models. In this study, we selected four different neural network models, i.e., back-propagation (BP) neural network, radial basis function (RBF) neural network, generalized regression (GR) neural network, and Elman neural network, all of which have been widely applied for short-term traffic forecasting. Using real world traffic data, the  experimental results primarily show that the BP and GR neural networks combined with the K-NN method have better prediction performance, and both are sensitive to the size of the training data. Secondly, the forecast accuracies of the RBF and Elman neural networks combined with the K-NN method both remain fairly stable with the increasing size of the training data. In summary, the proposed hybrid forecasting  approach outperforms the conventional forecasting models, facilitating the implementation of short-term  traffic forecasting in traffic management and control applications.

scholarly journals Severity Classification of Conjunctival Hyperaemia by Deep Neural Network Ensembles

2019 ◽  
Vol 2019 ◽  
pp. 1-10 ◽  
Author(s):  
Hiroki Masumoto ◽  
Hitoshi Tabuchi ◽  
Tsuyoshi Yoneda ◽  
Shunsuke Nakakura ◽  
Hideharu Ohsugi ◽  
...  
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Training Data ◽  
Neural Network Models ◽  
Conjunctival Hyperaemia ◽  
Severity Classification ◽  
Ocular Disorders ◽  
Neural Network Ensembles ◽  
Network Ensembles

Conjunctival hyperaemia is a common clinical ophthalmological finding and can be a symptom of various ocular disorders. Although several severity classification criteria have been proposed, none include objective severity criteria. Neural networks and deep learning have been utilised in ophthalmology, but not for the purpose of classifying the severity of conjunctival hyperaemia objectively. To develop a conjunctival hyperaemia grading software, we used 3700 images as the training data and 923 images as the validation test data. We trained the nine neural network models and validated the performance of these networks. We finally chose the best combination of these networks. The DenseNet201 model was the best individual model. The combination of the DenseNet201, DenseNet121, VGG19, and ResNet50 were the best model. The correlation between the multimodel responses, and the vessel-area occupied was 0.737 (p<0.01). This system could be as accurate and comprehensive as specialists but would be significantly faster and consistent with objective values.

Deformation Prediction of Mouse Embryos in Cell Injection Experiment by a Feedforward Artificial Neural Network

2011 ◽  
Author(s):  
Ali A. Abbasi ◽  
M. T. Ahmadian ◽  
G. R. Vossoughi
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Mouse Embryos ◽  
Training Data ◽  
Cell Manipulation ◽  
Data Sets ◽  
Neural Network Models ◽  
Federal Institute ◽  
The Neural Network ◽  
Institute Of Technology

In this study, neural network models have been used to predict the mechanical behaviors of mouse embryos. In addition, sensitivity analysis has been carried out to investigate the influence of the significance of input parameters on the mechanical behavior of mouse embryos. In order to reach these purposes two neural network models have been implemented. Experimental data earlier deduced-by [Flu¨ckiger, M. (2004). Cell Membrane Mechanical Modeling for Microrobotic Cell Manipulation. Diploma Thesis, ETHZ Swiss Federal Institute of Technology, Zurich, WS03/04] –were collected to obtain training and test data for the neural network. The results of these investigations show that the correlation values of the test and training data sets are between0.9988 and 1.0000, which are in good agreement with the experimental observations.

scholarly journals A Study on the Effect of DropConnect to Control Overfitting in Designing Neural Networks

2020 ◽  
Author(s):  
Hyun-il Lim
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Neural Network Model ◽  
Network Models ◽  
Training Data ◽  
Neural Network Models ◽  
Structural Problems ◽  
The Neural Network ◽  
Training Neural Network

The neural network is an approach of machine learning by training the connected nodes of a model to predict the results of specific problems. The prediction model is trained by using previously collected training data. In training neural network models, overfitting problems can occur from the excessively dependent training of data and the structural problems of the models. In this paper, we analyze the effect of DropConnect for controlling overfitting in neural networks. It is analyzed according to the DropConnect rates and the number of nodes in designing neural networks. The analysis results of this study help to understand the effect of DropConnect in neural networks. To design an effective neural network model, the DropConnect can be applied with appropriate parameters from the understanding of the effect of the DropConnect in neural network models.

scholarly journals Pemodelan Generator Uap Berbasis Jaringan Saraf Tiruan dengan Algoritme Pelatihan BPGD-ALAM

2016 ◽  
Vol 6 (1) ◽  
pp. 1
Author(s):  
Fadhlia Annisa ◽  
Agfianto Eko Putra
Keyword(s):  
Neural Network ◽  
Steam Generator ◽  
Multiple Input Multiple Output ◽  
Network Models ◽  
Training Data ◽  
Training Process ◽  
Training Simulator ◽  
Neural Network Models ◽  
Validation Data ◽  
Testing Data

Steam generator is unit plant which has nonlinear and complex system with multiple-input-multiple-output (MIMO) configuration which is hard to be modeled. Whereas, steam generator model is very useful to create simulation such as operator training simulator (OTS). The purpose of this research is to obtain model of steam generator which has 8 output parameters and 9 input parameters based neural network (NN) with BPGD-ALAM training algorithm. Data had been taken from steam generator of PT. Chevron Pacific Indonesia, Duri and it is divided into three types, i.e training data, validation data and testing data. Training data was used to obtain model for each ouput through training process. Verification model is also done for each epoch using validation data to monitor training process whether overfitting occurs or not. Eight NN model of each output which is obtained from training and verification, is tested using testing data for getting its performance. From the reseach results, architecture of neural network models are obtained with various configuration for each output with RMSE value under 9.71 %. It shows that model which has been obtained, close with steam generator real system.

Sign in / Sign up

Export Citation Format

Share Document