DIESEL ENGINE MODELLING USING EXTREME LEARNING MACHINE UNDER SCARCE AND EXPONENTIAL DATA SETS

2013 ◽  
Vol 21 (supp02) ◽  
pp. 87-98 ◽  
Author(s):  
PAK KIN WONG ◽  
CHI MAN VONG ◽  
CHUN SHUN CHEUNG ◽  
KA IN WONG
Keyword(s):  
Support Vector Machine ◽  
Diesel Engine ◽  
Extreme Learning Machine ◽  
Prediction Accuracy ◽  
Logarithmic Transformation ◽  
Training Data ◽  
Support Vector ◽  
Data Sets ◽  
Sample Data ◽  
Learning Machine

To predict the performance of a diesel engine, current practice relies on the use of black-box identification where numerous experiments must be carried out in order to obtain numerical values for model training. Although many diesel engine models based on artificial neural networks (ANNs) have already been developed, they have many drawbacks such as local minima, user burden on selection of optimal network structure, large training data size and poor generalization performance, making themselves difficult to be put into practice. This paper proposes to use extreme learning machine (ELM), which can overcome most of the aforementioned drawbacks, to model the emission characteristics and the brake-specific fuel consumption of the diesel engine under scarce and exponential sample data sets. The resulting ELM model is compared with those developed using popular ANNs such as radial basis function neural network (RBFNN) and advanced techniques such as support vector machine (SVM) and its variants, namely least squares support vector machine (LS-SVM) and relevance vector machine (RVM). Furthermore, some emission outputs of diesel engines suffer from the problem of exponentiality (i.e., the output y grows up exponentially along input x) that will deteriorate the prediction accuracy. A logarithmic transformation is therefore applied to preprocess and post-process the sample data sets in order to improve the prediction accuracy of the model. Evaluation results show that ELM with the logarithmic transformation is better than SVM, LS-SVM, RVM and RBFNN with/without the logarithmic transformation, regardless the model accuracy and training time.

scholarly journals Adaptive Hybrid Soft-Sensor Model of Grinding Process Based on Regularized Extreme Learning Machine and Least Squares Support Vector Machine Optimized by Golden Sine Harris Hawk Optimization Algorithm

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-26 ◽  
Author(s):  
Wei Xie ◽  
Jie-sheng Wang ◽  
Cheng Xing ◽  
Sha-Sha Guo ◽  
Meng-wei Guo ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Least Squares ◽  
Extreme Learning Machine ◽  
Prediction Accuracy ◽  
Soft Sensor ◽  
Support Vector ◽  
Structure Parameters ◽  
Generalization Ability ◽  
Sensor Model ◽  
Learning Machine

Soft-sensor technology plays a vital role in tracking and monitoring the key production indicators of the grinding and classifying process. Least squares support vector machine (LSSVM), as a soft-sensor model with strong generalization ability, can be used to predict key production indicators in complex grinding processes. The traditional crossvalidation method cannot obtain the ideal structure parameters of LSSVM. In order to improve the prediction accuracy of LSSVM, a golden sine Harris Hawk optimization (GSHHO) algorithm was proposed to optimize the structure parameters of LSSVM models with linear kernel, sigmoid kernel, polynomial kernel, and radial basis kernel, and the influences of GSHHO algorithm on the prediction accuracy under these LSSVM models were studied. In order to deal with the problem that the prediction accuracy of the model decreases due to changes of industrial status, this paper adopts moving window (MW) strategy to adaptively revise the LSSVM (MW-LSSVM), which greatly improves the prediction accuracy of the LSSVM. The prediction accuracy of the regularized extreme learning machine with MW strategy (MW-RELM) is higher than that of MW-LSSVM at some moments. Based on the training errors of LSSVM and RELM within the window, this paper proposes an adaptive hybrid soft-sensing model that switches between LSSVM and RELM. Compared with the previous MW-LSSVM, MW-neural network trained with extended Kalman filter(MW-KNN), and MW-RELM, the prediction accuracy of the hybrid model is further improved. Simulation results show that the proposed hybrid adaptive soft-sensor model has good generalization ability and prediction accuracy.

scholarly journals Pressure Prediction of Coal Slurry Transportation Pipeline Based on Particle Swarm Optimization Kernel Function Extreme Learning Machine

2015 ◽  
Vol 2015 ◽  
pp. 1-7
Author(s):  
Xue-cun Yang ◽  
Xiao-ru Yan ◽  
Chun-feng Song
Keyword(s):  
Support Vector Machine ◽  
Prediction Model ◽  
Extreme Learning Machine ◽  
Kernel Function ◽  
Particle Swarm ◽  
Support Vector ◽  
Particle Swarm Algorithm ◽  
Coal Slurry ◽  
Swarm Optimization ◽  
Learning Machine

For coal slurry pipeline blockage prediction problem, through the analysis of actual scene, it is determined that the pressure prediction from each measuring point is the premise of pipeline blockage prediction. Kernel function of support vector machine is introduced into extreme learning machine, the parameters are optimized by particle swarm algorithm, and blockage prediction method based on particle swarm optimization kernel function extreme learning machine (PSOKELM) is put forward. The actual test data from HuangLing coal gangue power plant are used for simulation experiments and compared with support vector machine prediction model optimized by particle swarm algorithm (PSOSVM) and kernel function extreme learning machine prediction model (KELM). The results prove that mean square error (MSE) for the prediction model based on PSOKELM is 0.0038 and the correlation coefficient is 0.9955, which is superior to prediction model based on PSOSVM in speed and accuracy and superior to KELM prediction model in accuracy.

scholarly journals Short-Term Traffic Flow Forecasting Based on Data-Driven Model

Mathematics ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 152 ◽  
Author(s):  
Su-qi Zhang ◽  
Kuo-Ping Lin
Keyword(s):  
Support Vector Machine ◽  
Traffic Flow ◽  
Extreme Learning Machine ◽  
Support Vector ◽  
Local Optimum ◽  
Short Term ◽  
Swarm Optimization ◽  
Traffic Flow Forecasting ◽  
Learning Machine ◽  
The One

Short-term traffic flow forecasting is the technical basis of the intelligent transportation system (ITS). Higher precision, short-term traffic flow forecasting plays an important role in alleviating road congestion and improving traffic management efficiency. In order to improve the accuracy of short-term traffic flow forecasting, an improved bird swarm optimizer (IBSA) is used to optimize the random parameters of the extreme learning machine (ELM). In addition, the improved bird swarm optimization extreme learning machine (IBSAELM) model is established to predict short-term traffic flow. The main researches in this paper are as follows: (1) The bird swarm optimizer (BSA) is prone to fall into the local optimum, so the distribution mechanism of the BSA optimizer is improved. The first five percent of the particles with better fitness values are selected as producers. The last ten percent of the particles with worse fitness values are selected as beggars. (2) The one-day and two-day traffic flows are predicted by the support vector machine (SVM), particle swarm optimization support vector machine (PSOSVM), bird swarm optimization extreme learning machine (BSAELM) and IBSAELM models, respectively. (3) The prediction results of the models are evaluated. For the one-day traffic flow sequence, the mean absolute percentage error (MAPE) values of the IBSAELM model are smaller than the SVM, PSOSVM and BSAELM models, respectively. The experimental analysis results show that the IBSAELM model proposed in this study can meet the actual engineering requirements.

scholarly journals Forecasting of Landslide Displacement Using a Probability-Scheme Combination Ensemble Prediction Technique

2020 ◽  
Vol 17 (13) ◽  
pp. 4788 ◽  
Author(s):  
Junwei Ma ◽  
Xiao Liu ◽  
Xiaoxu Niu ◽  
Yankun Wang ◽  
Tao Wen ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Quantile Regression ◽  
Extreme Learning Machine ◽  
Data Driven ◽  
Ensemble Prediction ◽  
Three Gorges Reservoir Area ◽  
Support Vector ◽  
Landslide Displacement Prediction ◽  
Learning Machine

Data-driven models have been extensively employed in landslide displacement prediction. However, predictive uncertainty, which consists of input uncertainty, parameter uncertainty, and model uncertainty, is usually disregarded in deterministic data-driven modeling, and point estimates are separately presented. In this study, a probability-scheme combination ensemble prediction that employs quantile regression neural networks and kernel density estimation (QRNNs-KDE) is proposed for robust and accurate prediction and uncertainty quantification of landslide displacement. In the ensemble model, QRNNs serve as base learning algorithms to generate multiple base learners. Final ensemble prediction is obtained by integration of all base learners through a probability combination scheme based on KDE. The Fanjiaping landslide in the Three Gorges Reservoir area (TGRA) was selected as a case study to explore the performance of the ensemble prediction. Based on long-term (2006–2018) and near real-time monitoring data, a comprehensive analysis of the deformation characteristics was conducted for fully understanding the triggering factors. The experimental results indicate that the QRNNs-KDE approach can perform predictions with perfect performance and outperform the traditional backpropagation (BP), radial basis function (RBF), extreme learning machine (ELM), support vector machine (SVM) methods, bootstrap-extreme learning machine-artificial neural network (bootstrap-ELM-ANN), and Copula-kernel-based support vector machine quantile regression (Copula-KSVMQR). The proposed QRNNs-KDE approach has significant potential in medium-term to long-term horizon forecasting and quantification of uncertainty.

A Modified Incremental Support Vector Machine for Regression

2011 ◽  
Vol 135-136 ◽  
pp. 63-69 ◽  
Author(s):  
Jian Guo Wang ◽  
Liang Wu Cheng ◽  
Wen Xing Zhang ◽  
Bo Qin
Keyword(s):  
Support Vector Machine ◽  
Predictive Power ◽  
Training Data ◽  
Support Vector ◽  
Mechanical Equipment ◽  
Final Decision ◽  
Data Sets ◽  
Regression Problems ◽  
Traditional Approaches ◽  
Speed And Accuracy

support vector machine (SVM) has been shown to exhibit superior predictive power compared to traditional approaches in many studies, such as mechanical equipment monitoring and diagnosis. However, SVM training is very costly in terms of time and memory consumption due to the enormous amounts of training data and the quadratic programming problem. In order to improve SVM training speed and accuracy, we propose a modified incremental support vector machine (MISVM) for regression problems in this paper. The main concepts are that using the distance from the margin vectors which violate the Karush-Kuhn-Tucker (KKT) condition to the final decision hyperplane to evaluate the importance of each margin vectors, and the margin vectors whose distance is below the specified value are preserved, the others are eliminated. Then the original SVs and the remaining margin vectors are used to train a new SVM. The proposed MISVM can not only eliminate the unimportant samples such as noise samples, but also preserved the important samples. The effectiveness of the proposed MISVMs is demonstrated with two UCI data sets. These experiments also show that the proposed MISVM is competitive with previously published methods.

scholarly journals Automatic Task Classification via Support Vector Machine and Crowdsourcing

2018 ◽  
Vol 2018 ◽  
pp. 1-9 ◽  
Author(s):  
Hyungsik Shin ◽  
Jeongyeup Paek
Keyword(s):  
Support Vector Machine ◽  
Mobile Devices ◽  
Prediction Accuracy ◽  
Training Data ◽  
Amazon Mechanical Turk ◽  
Support Vector ◽  
Data Set ◽  
English Sentence ◽  
Task Classification ◽  
Personal Assistant

Automatic task classification is a core part of personal assistant systems that are widely used in mobile devices such as smartphones and tablets. Even though many industry leaders are providing their own personal assistant services, their proprietary internals and implementations are not well known to the public. In this work, we show through real implementation and evaluation that automatic task classification can be implemented for mobile devices by using the support vector machine algorithm and crowdsourcing. To train our task classifier, we collected our training data set via crowdsourcing using the Amazon Mechanical Turk platform. Our classifier can classify a short English sentence into one of the thirty-two predefined tasks that are frequently requested while using personal mobile devices. Evaluation results show high prediction accuracy of our classifier ranging from 82% to 99%. By using large amount of crowdsourced data, we also illustrate the relationship between training data size and the prediction accuracy of our task classifier.

Sign in / Sign up

Export Citation Format

Share Document