A Constrained Multi-Objective Learning Algorithm for Feed-Forward Neural Network Classifiers

Parallel corpora have become an essential resource for work in multi lingual natural language processing. However, sentence aligned parallel corpora are more efficient than non-aligned parallel corpora for cross language information retrieval and machine translation applications. In this paper, we present a new approach to align sentences in bilingual parallel corpora based on feed forward neural network classifier. A feature parameter vector is extracted from the text pair under consideration. This vector contains text features such as length, punctuate score, and cognate score values. A set of manually prepared training data has been assigned to train the feed forward neural network. Another set of data was used for testing. Using this new approach, we could achieve an error reduction of 60% over length based approach when applied on English–Arabic parallel documents. Moreover this new approach is valid for any language pair and it is quite flexible approach since the feature parameter vector may contain more/less or different features than that we used in our system such as lexical match feature.

Download Full-text

Classification properties and classification mechanisms of feed-forward neural network classifiers

10.1117/12.341368 ◽

1999 ◽

Cited By ~ 1

Author(s):

De-Shuang Huang

Keyword(s):

Neural Network ◽

Feed Forward Neural Network ◽

Feed Forward ◽

Neural Network Classifiers

Download Full-text

A Survey and Analysis of Extreme Machine Learning Models and Its Techniques

10.21203/rs.3.rs-599856/v1 ◽

2021 ◽

Author(s):

Shubhangi Pande ◽

Neeraj Kumar Rathore ◽

Anuradha Purohit

Keyword(s):

Neural Network ◽

Machine Learning ◽

Support Vector Machine ◽

Learning Algorithm ◽

Feature Learning ◽

Global Optimum ◽

Least Square ◽

Support Vector ◽

Feed Forward Neural Network ◽

Feed Forward

Abstract Machine learning applications employ FFNN (Feed Forward Neural Network) in their discipline enormously. But, it has been observed that the FFNN requisite speed is not up the mark. The fundamental causes of this problem are: 1) for training neural networks, slow gradient descent methods are broadly used and 2) for such methods, there is a need for iteratively tuning hidden layer parameters including biases and weights. To resolve these problems, a new emanant machine learning algorithm, which is a substitution of the feed-forward neural network, entitled as Extreme Learning Machine (ELM) introduced in this paper. ELM also come up with a general learning scheme for the immense diversity of different networks (SLFNs and multilayer networks). According to ELM originators, the learning capacity of networks trained using backpropagation is a thousand times slower than the networks trained using ELM, along with this, ELM models exhibit good generalization performance. ELM is more efficient in contradiction of Least Square Support Vector Machine (LS-SVM), Support Vector Machine (SVM), and rest of the precocious approaches. ELM’s eccentric outline has three main targets: 1) high learning accuracy 2) less human intervention 3) fast learning speed. ELM consider as a greater capacity to achieve global optimum. The distribution of application of ELM incorporates: feature learning, clustering, regression, compression, and classification. With this paper, our goal is to familiarize various ELM variants, their applications, ELM strengths, ELM researches and comparison with other learning algorithms, and many more concepts related to ELM.

Download Full-text

An Analysis of Extreme Machine Learning Models

10.21203/rs.3.rs-667827/v1 ◽

2021 ◽

Author(s):

Shubhangi Pande ◽

Neeraj Rathore ◽

Anuradha Purohit

Keyword(s):

Neural Network ◽

Machine Learning ◽

Support Vector Machine ◽

Learning Algorithm ◽

Feature Learning ◽

Global Optimum ◽

Least Square ◽

Support Vector ◽

Feed Forward Neural Network ◽

Feed Forward

Abstract Machine learning applications employ FFNN (Feed Forward Neural Network) in their discipline enormously. But, it has been observed that the FFNN requisite speed is not up the mark. The fundamental causes of this problem are: 1) for training neural networks, slow gradient descent methods are broadly used and 2) for such methods, there is a need for iteratively tuning hidden layer parameters including biases and weights. To resolve these problems, a new emanant machine learning algorithm, which is a substitution of the feed-forward neural network, entitled as Extreme Learning Machine (ELM) introduced in this paper. ELM also come up with a general learning scheme for the immense diversity of different networks (SLFNs and multilayer networks). According to ELM originators, the learning capacity of networks trained using backpropagation is a thousand times slower than the networks trained using ELM, along with this, ELM models exhibit good generalization performance. ELM is more efficient in contradiction of Least Square Support Vector Machine (LS-SVM), Support Vector Machine (SVM), and rest of the precocious approaches. ELM’s eccentric outline has three main targets: 1) high learning accuracy 2) less human intervention 3) fast learning speed. ELM consider as a greater capacity to achieve global optimum. The distribution of application of ELM incorporates: feature learning, clustering, regression, compression, and classification. With this paper, our goal is to familiarize various ELM variants, their applications, ELM strengths, ELM researches and comparison with other learning algorithms, and many more concepts related to ELM.

Download Full-text