Least Squares Twin Extreme Learning Machine for Pattern Classification

2018 ◽  
pp. 561-571 ◽  
Author(s):  
Reshma Rastogi ◽  
Amisha Bharti
Keyword(s):  
Least Squares ◽  
Extreme Learning Machine ◽  
Pattern Classification ◽  
Learning Machine

scholarly journals A Novel Orthogonal Extreme Learning Machine for Regression and Classification Problems

Symmetry ◽  
2019 ◽  
Vol 11 (10) ◽  
pp. 1284
Author(s):  
Licheng Cui ◽  
Huawei Zhai ◽  
Hongfei Lin
Keyword(s):  
Least Squares ◽  
Extreme Learning Machine ◽  
Weight Matrix ◽  
Testing Time ◽  
Least Squares Regression ◽  
Classification Problems ◽  
Training Time ◽  
Discrimination Ability ◽  
Learning Machine ◽  
Hidden Layer

An extreme learning machine (ELM) is an innovative algorithm for the single hidden layer feed-forward neural networks and, essentially, only exists to find the optimal output weight so as to minimize output error based on the least squares regression from the hidden layer to the output layer. With a focus on the output weight, we introduce the orthogonal constraint into the output weight matrix, and propose a novel orthogonal extreme learning machine (NOELM) based on the idea of optimization column by column whose main characteristic is that the optimization of complex output weight matrix is decomposed into optimizing the single column vector of the matrix. The complex orthogonal procrustes problem is transformed into simple least squares regression with an orthogonal constraint, which can preserve more information from ELM feature space to output subspace, these make NOELM more regression analysis and discrimination ability. Experiments show that NOELM has better performance in training time, testing time and accuracy than ELM and OELM.

scholarly journals On-line sequential extreme learning machine based on recursive partial least squares

2015 ◽  
Vol 27 ◽  
pp. 15-21 ◽  
Author(s):  
Tiago Matias ◽  
Francisco Souza ◽  
Rui Araújo ◽  
Nuno Gonçalves ◽  
João P. Barreto
Keyword(s):  
Least Squares ◽  
Partial Least Squares ◽  
Extreme Learning Machine ◽  
On Line ◽  
Learning Machine

scholarly journals An Internal Model Controller for Three-Phase APF Based on LS-Extreme Learning Machine

2014 ◽  
Vol 8 (1) ◽  
pp. 717-722
Author(s):  
Zhenhua Shao ◽  
Tianxiang Chen ◽  
Li-an Chen ◽  
Hong Tian
Keyword(s):  
Control System ◽  
Least Squares ◽  
Extreme Learning Machine ◽  
Internal Model ◽  
Internal Model Control ◽  
Support Vector ◽  
Three Phase ◽  
Model Control ◽  
Internal Model Controller ◽  
Learning Machine

Aiming at the problem that the three-phase APF’s dynamic model is a multi-variable, nonlinear and strong coupling system, an internal model controller for three-phase APF based on LS-Extreme Learning Machine is studied in this paper. As a novel single hidden layer feed-forward neural networks, extreme learning machine (ELM) has several advantages: simple net structural, fast learning speed, good generalization performance and so on. In order to improve the controller’s dynamic responses, a least squares extreme learning machine for internal model control is proposed. A least squares ELM regression (LS-ELMR) model for the three-phase APFS on-line monitoring was built from external factors with in-out datum. Moreover, the relative stable error is presented to evaluate the system performance and the features for the internal model control system based on extreme learning machine, neural network, kernel ridge regress and support vector machine. The experimental results show that the LS-internal model control system based on extreme learning machine has good dynamic performance and strong filtering result.

scholarly journals An Improved Autoencoder and Partial Least Squares Regression-Based Extreme Learning Machine Model for Pump Turbine Characteristics

2019 ◽  
Vol 9 (19) ◽  
pp. 3987 ◽  
Author(s):  
Zhang ◽  
Peng ◽  
Zhou ◽  
Ji ◽  
Wang
Keyword(s):  
Least Squares ◽  
Partial Least Squares ◽  
Extreme Learning Machine ◽  
Partial Least Squares Regression ◽  
Least Squares Regression ◽  
Machine Model ◽  
Pump Turbine ◽  
Characteristic Curves ◽  
Modeling Accuracy ◽  
Learning Machine

Complete characteristic curves of a pump turbine are fundamental for improving the modeling accuracy of the pump turbine in a pump turbine governing system. In view of the difficulty in modeling the "S" characteristic region of the complete characteristic curves in the pump turbine, a novel Autoencoder and partial least squares regression based extreme learning machine model (AE-PLS-ELM) was proposed to describe the pump turbine characteristics. First, a mathematical model was formulated to describe the flow and moment characteristic curves. The improved Suter transformation was employed to transfer the original curves into WH and WM curves. Second, the ELM-Autoencoder technique and the partial least squares regression (PLSR) method were introduced to the architecture of the original ELM network. The ELM-Autoencoder technique was employed to obtain the initial weights of the Autoencoder based extreme learning machine (AE-ELM) model. The PLS method was exploited to avoid the multicollinearity problem of the Moore-Penrose generalized inverse. Lastly, the effectiveness of the proposed AE-PLS-ELM model has been verified using real data from a pumped storage unit in China. The results demonstrated that the AE-PLS-ELM model can obtain better modeling accuracy and generalization performance than the traditional models and, thus, can be exploited as an effective and sufficient approach for the modeling of pump turbine characteristics.

scholarly journals A Comparison Study of Extreme Learning Machine and Least Squares Support Vector Machine for Structural Impact Localization

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Qingsong Xu
Keyword(s):  
Support Vector Machine ◽  
Least Squares ◽  
Extreme Learning Machine ◽  
Learning Algorithm ◽  
Support Vector ◽  
Comparison Study ◽  
Fast Learning ◽  
Structural Impact ◽  
Learning Machine ◽  
Impact Localization

Extreme learning machine (ELM) is a learning algorithm for single-hidden layer feedforward neural network dedicated to an extremely fast learning. However, the performance of ELM in structural impact localization is unknown yet. In this paper, a comparison study of ELM with least squares support vector machine (LSSVM) is presented for the application on impact localization of a plate structure with surface-mounted piezoelectric sensors. Both basic and kernel-based ELM regression models have been developed for the location prediction. Comparative studies of the basic ELM, kernel-based ELM, and LSSVM models are carried out. Results show that the kernel-based ELM requires the shortest learning time and it is capable of producing suboptimal localization accuracy among the three models. Hence, ELM paves a promising way in structural impact detection.

scholarly journals Deep Network Based on Stacked Orthogonal Convex Incremental ELM Autoencoders

2016 ◽  
Vol 2016 ◽  
pp. 1-17 ◽  
Author(s):  
Chao Wang ◽  
Jianhui Wang ◽  
Shusheng Gu
Keyword(s):  
Least Squares ◽  
Extreme Learning Machine ◽  
Incremental Learning ◽  
Learning Algorithm ◽  
Complex Data ◽  
Classification Problems ◽  
Deep Network ◽  
Least Squares Solution ◽  
Fast Learning ◽  
Learning Machine

Extreme learning machine (ELM) as an emerging technology has recently attracted many researchers’ interest due to its fast learning speed and state-of-the-art generalization ability in the implementation. Meanwhile, the incremental extreme learning machine (I-ELM) based on incremental learning algorithm was proposed which outperforms many popular learning algorithms. However, the incremental algorithms with ELM do not recalculate the output weights of all the existing nodes when a new node is added and cannot obtain the least-squares solution of output weight vectors. In this paper, we propose orthogonal convex incremental learning machine (OCI-ELM) with Gram-Schmidt orthogonalization method and Barron’s convex optimization learning method to solve the nonconvex optimization problem and least-squares solution problem, and then we give the rigorous proofs in theory. Moreover, in this paper, we propose a deep architecture based on stacked OCI-ELM autoencoders according to stacked generalization philosophy for solving large and complex data problems. The experimental results verified with both UCI datasets and large datasets demonstrate that the deep network based on stacked OCI-ELM autoencoders (DOC-IELM-AEs) outperforms the other methods mentioned in the paper with better performance on regression and classification problems.

Sign in / Sign up

Export Citation Format

Share Document