Generalization ability of Extreme Learning Machine using different Sample Selection Methods

2021 ◽  
Vol 3 (1) ◽  
pp. 57-72
Author(s):  
Saher Fatima ◽  
Rana Aamir Raza ◽  
Maruf Pasha ◽  
Asghar Ali
Keyword(s):  
Neural Network ◽  
Extreme Learning Machine ◽  
Data Reduction ◽  
Sample Selection ◽  
Single Layer ◽  
Knowledge Discovery In Databases ◽  
Instance Selection ◽  
Feed Forward Neural Network ◽  
Generalization Ability ◽  
Learning Machine

The recent explosion of data has triggered the need of data reduction for completing the effective data mining task in the process of knowledge discovery in databases (KDD). The process of instance selection (IS) plays a significant role for data reduction by eliminating the redundant, noisy, unreliable and irrelevant instances, which, in-turn reduces the computational resources, and helps to increase the capabilities and generalization abilities of the learning models. . This manuscript expounds the concept and functionalities of seven different instance selection techniques (i.e., ENN, AllKNN, MENN, ENNTh, Mul- tiEdit, NCNEdit, and RNG), and also evaluates their effectiveness by using single layer feed-forward neural network (SLFN), which is trained with extreme learning machine (ELM). Unlike traditional neural network, ELM randomly chooses the weights and biases of hidden layer nodes and analytically determines the weights of output layer node. The generalization ability of ELM is analyzed by using both original and reduced datasets. Experiment results depict that ELM provides better generalization with these IS methods.

scholarly journals Toward deep neural networks: Mirror extreme learning machines for pattern classification

Filomat ◽  
2020 ◽  
Vol 34 (15) ◽  
pp. 4985-4996
Author(s):  
Bolin Liao ◽  
Chuan Ma ◽  
Meiling Liao ◽  
Shuai Li ◽  
Zhiguan Huang
Keyword(s):  
Neural Network ◽  
Extreme Learning Machine ◽  
Pattern Classification ◽  
Simple Structure ◽  
Layer Structure ◽  
Feed Forward Neural Network ◽  
Learning Machines ◽  
S Parameter ◽  
Learning Machine ◽  
Hidden Layer

In this paper, a novel type of feed-forward neural network with a simple structure is proposed and investigated for pattern classification. Because the novel type of forward neural network?s parameter setting is mirrored with those of the Extreme Learning Machine (ELM), it is termed the mirror extreme learning machine (MELM). For the MELM, the input weights are determined by the pseudoinverse method analytically, while the output weights are generated randomly, which are completely different from the conventional ELM. Besides, a growing method is adopted to obtain the optimal hidden-layer structure. Finally, to evaluate the performance of the proposed MELM, abundant comparative experiments based on different real-world classification datasets are performed. Experimental results validate the high classification accuracy and good generalization performance of the proposed neural network with a simple structure in pattern classification.

Comparison of the Extreme Learning Machine with the BP Neural Network for Short-Term Prediction of Wind Power

2012 ◽  
Vol 608-609 ◽  
pp. 564-568 ◽  
Author(s):  
Yi Hui Zhang ◽  
He Wang ◽  
Zhi Jian Hu ◽  
Meng Lin Zhang ◽  
Xiao Lu Gong ◽  
...  
Keyword(s):  
Neural Network ◽  
Wind Power ◽  
Extreme Learning Machine ◽  
Bp Neural Network ◽  
Learning Algorithm ◽  
Power Prediction ◽  
Feed Forward Neural Network ◽  
Wind Power Prediction ◽  
Learning Machine ◽  
Hidden Layer

Extreme learning machine (ELM) is a new and effective single-hidden layer feed forward neural network learning algorithm. Extreme learning machine only needs to set the number of hidden layer nodes of the network, and there is no need to adjust the neural network input weights and the hidden units bias, and it generates the only optimum solution, so it has the advantage of fast learning and good generalization ability. And the back propagation (BP) neural network is the most maturely applied. This paper has introduced the extreme learning machine into the wind power prediction. By comparing the wind power prediction method using the BP neural network. Study shows that the extreme learning machine has better prediction accuracy and shorter model training time.

scholarly journals Moving Object Detection and Tracking using Genetic Algorithm Enabled Extreme Learning Machine

2018 ◽  
Vol 13 (2) ◽  
pp. 162-174 ◽  
Author(s):  
G. Jemilda ◽  
S. Baulkani
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Extreme Learning Machine ◽  
Probabilistic Neural Network ◽  
Moving Object ◽  
Support Vector ◽  
Feed Forward Neural Network ◽  
Shape Information ◽  
Speeded Up Robust Features ◽  
Learning Machine

In this proposed work, the moving object is localized using curvelet transform, soft thresholding and frame differencing. The feature extraction techniques are applied on to the localized object and the texture, color and shape information of objects are considered. To extract the shape information, Speeded Up Robust Features (SURF) is used. To extract the texture features, the Enhanced Local Vector Pattern (ELVP) and to extract color features, Histogram of Gradient (HOG) are used and then reduced feature set obtained using genetic algorithm are fused to form a single feature vector and given into the Extreme Learning Machine (ELM) to classify the objects. The performance of the proposed work is compared with Naive Bayes, Support Vector Machine, Feed Forward Neural Network and Probabilistic Neural Network and inferred that the proposed method performs better.

scholarly journals PREDIKSI HARGA EMAS MENGGUNAKAN FEED FORWARD NEURAL NETWORK DENGAN METODE EXTREME LEARNING MACHINE

2019 ◽  
Vol 8 (2) ◽  
pp. 171-183
Author(s):  
Nisa Afida Izati ◽  
Budi Warsito ◽  
Tatik Widiharih
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Extreme Learning Machine ◽  
Gold Price ◽  
Good Prediction ◽  
Feed Forward Neural Network ◽  
Feed Forward ◽  
Artificial Neural ◽  
Learning Machine

The prediction of gold price aims to find out the gold price in the future on the basis of historical data on gold prices in the past, so it can be used as a consideration by gold investors to investing in gold. Prediction methods that do not require assumptions, one of which is Artificial Neural Networks. In this study, using Artificial Neural Networks, Feed Forward Neural Network with Extreme Learning Machine (ELM). ELM is a non-iterative algorithm so ELM has advantages in process speed. The input weight and bias for this method are determined randomly. After that, to find the final weight using the Moore-Penrose Generalized Inverse calculation on the hidden layer output matrix. The best model selection criteria uses the Mean Absolute Percentage Error (MAPE). This study shows that the results of the training and testing process from the model 1 input neuron and 7 hidden neurons are very good, because it produces MAPE training = 0.6752% and MAPE testing = 0.8065%. Also gives a very good prediction result because it has MAPE = 0.5499% Keywords: gold price, Extreme Learning Machine, MAPE

scholarly journals Label Rectification Learning through Kernel Extreme Learning Machine

2021 ◽  
Vol 2021 ◽  
pp. 1-6
Author(s):  
Qiang Cai ◽  
Fenghai Li ◽  
Yifan Chen ◽  
Haisheng Li ◽  
Jian Cao ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Extreme Learning Machine ◽  
Classification Performance ◽  
Considerable Progress ◽  
Strong Representation ◽  
Kernel Extreme Learning Machine ◽  
Classification Tasks ◽  
Learning Machine

Along with the strong representation of the convolutional neural network (CNN), image classification tasks have achieved considerable progress. However, majority of works focus on designing complicated and redundant architectures for extracting informative features to improve classification performance. In this study, we concentrate on rectifying the incomplete outputs of CNN. To be concrete, we propose an innovative image classification method based on Label Rectification Learning (LRL) through kernel extreme learning machine (KELM). It mainly consists of two steps: (1) preclassification, extracting incomplete labels through a pretrained CNN, and (2) label rectification, rectifying the generated incomplete labels by the KELM to obtain the rectified labels. Experiments conducted on publicly available datasets demonstrate the effectiveness of our method. Notably, our method is extensible which can be easily integrated with off-the-shelf networks for improving performance.

Sign in / Sign up

Export Citation Format

Share Document