Multiple-Instance Learning via an RBF Kernel-Based Extreme Learning Machine

2017 ◽  
Vol 26 (1) ◽  
pp. 185-195 ◽  
Author(s):  
Jie Wang ◽  
Liangjian Cai ◽  
Xin Zhao
Keyword(s):  
Extreme Learning Machine ◽  
State Of The Art ◽  
Multiple Instance Learning ◽  
Training Data ◽  
Data Sets ◽  
Rbf Kernel ◽  
Kernel Extreme Learning Machine ◽  
Learning Machine ◽  
Hidden Layer ◽  
Instance Space

AbstractAs we are usually confronted with a large instance space for real-word data sets, it is significant to develop a useful and efficient multiple-instance learning (MIL) algorithm. MIL, where training data are prepared in the form of labeled bags rather than labeled instances, is a variant of supervised learning. This paper presents a novel MIL algorithm for an extreme learning machine called MI-ELM. A radial basis kernel extreme learning machine is adapted to approach the MIL problem using Hausdorff distance to measure the distance between the bags. The clusters in the hidden layer are composed of bags that are randomly generated. Because we do not need to tune the parameters for the hidden layer, MI-ELM can learn very fast. The experimental results on classifications and multiple-instance regression data sets demonstrate that the MI-ELM is useful and efficient as compared to the state-of-the-art algorithms.

scholarly journals A Novel Multiple Instance Learning Method Based on Extreme Learning Machine

2015 ◽  
Vol 2015 ◽  
pp. 1-6 ◽  
Author(s):  
Jie Wang ◽  
Liangjian Cai ◽  
Jinzhu Peng ◽  
Yuheng Jia
Keyword(s):  
Extreme Learning Machine ◽  
Multiple Instance Learning ◽  
Data Sets ◽  
Feedforward Network ◽  
Real World Data ◽  
Benchmark Data ◽  
Input And Output ◽  
Learning Machine ◽  
Hidden Layer

Since real-world data sets usually contain large instances, it is meaningful to develop efficient and effective multiple instance learning (MIL) algorithm. As a learning paradigm, MIL is different from traditional supervised learning that handles the classification of bags comprising unlabeled instances. In this paper, a novel efficient method based on extreme learning machine (ELM) is proposed to address MIL problem. First, the most qualified instance is selected in each bag through a single hidden layer feedforward network (SLFN) whose input and output weights are both initialed randomly, and the single selected instance is used to represent every bag. Second, the modified ELM model is trained by using the selected instances to update the output weights. Experiments on several benchmark data sets and multiple instance regression data sets show that the ELM-MIL achieves good performance; moreover, it runs several times or even hundreds of times faster than other similar MIL algorithms.

OMP-ELM: Orthogonal Matching Pursuit-Based Extreme Learning Machine for Regression

2015 ◽  
Vol 24 (1) ◽  
pp. 135-143 ◽  
Author(s):  
Omer F. Alcin ◽  
Abdulkadir Sengur ◽  
Jiang Qian ◽  
Melih C. Ince
Keyword(s):  
Extreme Learning Machine ◽  
Matching Pursuit ◽  
Computational Cost ◽  
Machine Intelligence ◽  
Orthogonal Matching Pursuit ◽  
Training Data ◽  
Singularity Problem ◽  
Data Set ◽  
Learning Machine ◽  
Hidden Layer

AbstractExtreme learning machine (ELM) is a recent scheme for single hidden layer feed forward networks (SLFNs). It has attracted much interest in the machine intelligence and pattern recognition fields with numerous real-world applications. The ELM structure has several advantages, such as its adaptability to various problems with a rapid learning rate and low computational cost. However, it has shortcomings in the following aspects. First, it suffers from the irrelevant variables in the input data set. Second, choosing the optimal number of neurons in the hidden layer is not well defined. In case the hidden nodes are greater than the training data, the ELM may encounter the singularity problem, and its solution may become unstable. To overcome these limitations, several methods have been proposed within the regularization framework. In this article, we considered a greedy method for sparse approximation of the output weight vector of the ELM network. More specifically, the orthogonal matching pursuit (OMP) algorithm is embedded to the ELM. This new technique is named OMP-ELM. OMP-ELM has several advantages over regularized ELM methods, such as lower complexity and immunity to the singularity problem. Experimental works on nine commonly used regression problems indicate that the investigated OMP-ELM method confirms these advantages. Moreover, OMP-ELM is compared with the ELM method, the regularized ELM scheme, and artificial neural networks.

scholarly journals Fault Diagnosis for Engine Based on Single-Stage Extreme Learning Machine

2016 ◽  
Vol 2016 ◽  
pp. 1-10 ◽  
Author(s):  
Fei Gao ◽  
Jiangang Lv
Keyword(s):  
Fault Diagnosis ◽  
Extreme Learning Machine ◽  
Feature Space ◽  
Single Stage ◽  
Training Data ◽  
Learning Machine ◽  
Hidden Layer ◽  
Signal Processing Methods ◽  
Hidden Nodes ◽  
Selection Of

Single-Stage Extreme Learning Machine (SS-ELM) is presented to dispose of the mechanical fault diagnosis in this paper. Based on it, the traditional mapping type of extreme learning machine (ELM) has been changed and the eigenvectors extracted from signal processing methods are directly regarded as outputs of the network’s hidden layer. Then the uncertainty that training data transformed from the input space to the ELM feature space with the ELM mapping and problem of the selection of the hidden nodes are avoided effectively. The experiment results of diesel engine fault diagnosis show good performance of the SS-ELM algorithm.

scholarly journals An Effective Turkey Marble Classification System: Convolutional Neural Network with Genetic Algorithm -Wavelet Kernel - Extreme Learning Machine

2021 ◽  
Vol 38 (4) ◽  
pp. 1229-1235
Author(s):  
Derya Avci ◽  
Eser Sert
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Convolutional Neural Network ◽  
Extreme Learning Machine ◽  
Optical Illusions ◽  
Factors Affecting ◽  
Kernel Extreme Learning Machine ◽  
Learning Machine ◽  
Hidden Layer ◽  
Elm Classifier

Marble is one of the most popular decorative elements. Marble quality varies depending on its vein patterns and color, which are the two most important factors affecting marble quality and class. The manual classification of marbles is likely to lead to various mistakes due to different optical illusions. However, computer vision minimizes these mistakes thanks to artificial intelligence and machine learning. The present study proposes the Convolutional Neural Network- (CNN-) with genetic algorithm- (GA) Wavelet Kernel- (WK-) Extreme Learning Machine (ELM) (CNN–GA-WK-ELM) approach. Using CNN architectures such as AlexNet, VGG-19, SqueezeNet, and ResNet-50, the proposed approach obtained 4 different feature vectors from 10 different marble images. Later, Genetic Algorithm (GA) was used to optimize adjustable parameters, i.e. k, 1, and m, and hidden layer neuron number in Wavelet Kernel (WK) – Extreme Learning Machine (ELM) and to increase the performance of ELM. Finally, 4 different feature vector parameters were optimized and classified using the WK-ELM classifier. The proposed CNN–GA-WK-ELM yielded an accuracy rate of 98.20%, 96.40%, 96.20%, and 95.60% using AlexNet, SequeezeNet, VGG-19, and ResNet-50, respectively.

scholarly journals Sistem Pendukung Keputusan Peramalan Jumlah Kunjungan Pasien Menggunakan Metode Extreme Learning Machine (Studi Kasus : Poli Gigi Rsu Dr. Wahidin Sudiro Husodo Mojokerto)

2015 ◽  
Vol 1 (1) ◽  
pp. 33
Author(s):  
Delia Putri Fardani ◽  
Eto Wuryanto ◽  
Indah Werdiningsih
Keyword(s):  
Decision Support ◽  
Extreme Learning Machine ◽  
Support System ◽  
Training Data ◽  
Number Of Patients ◽  
Testing Data ◽  
Decision Supporting ◽  
Decision Supporting System ◽  
Learning Machine ◽  
Hidden Layer

Abstrak— Penelitian ini bertujuan merancang dan membangun sistem pendukung keputusan untuk meramalkan jumlah kunjungan pasien RSU Dr. Wahidin Sudiro Husodo Kota Mojokerto dengan menggunakan metode Extreme Learning Machine (ELM). Dengan adanya  sistem pendukung keputusan ini direktur Rumah Sakit dapat meramalkan jumlah kunjungan pasien dan membantu dalam pembuatan kebijakan rumah sakit, mengatur sumber daya manusia dan keuangan, serta mendistribusikan sumber daya material dengan benar khususnya pada poli gigi. Dalam rancang bangun sistem pendukung keputusan ini dilakukan dalam beberapa tahap. Tahap yang pertama, pengumpulan data untuk mengidentifikasi inputan yang dibutuhkan dalam penghitungan metode ELM. Tahap kedua, pengolahan data, data dibagi menjadi data training dan data testing dengan komposisi data training sebanyak 80% (463 data) dari total 579 data dan 20% (116 data) sisanya sebagai data testing yang kemudian di normalisasi. Tahap ketiga, peramalan jumlah kunjungan pasien menggunakan metode ELM. Tahap terakhir, perancangan sistem menggunakan sysflow dan pembangunan sistem berbasis desktop serta evaluasi sistem. Hasil penelitian berupa aplikasi sistem pendukung keputusan untuk meramalkan jumlah kunjungan pasien. Dan melalui uji coba menggunakan 116 data testing berdasarkan fungsi aktivasi sigmoid biner dengan jumlah hidden layer sebanyak 7 unit dan Epoch 500 diperoleh hasil optimal MSE sebesar 0.027 Kata Kunci— Sistem Pendukung Keputusan, Peramalan, Jaringan Syaraf Tiruan, Extreme Learning MachineAbstract— In this research, a decision support system to predict the number of patients visit RSU Dr. Wahidin Sudiro Husodo Kota Mojokerto was designed and developed using Extreme Learning Machine (ELM) method which aims to assist director in making decision for the hospital, managing human and financial resource, as well as distributing material resource properly especially in the Department of Dentistry. The design of this decision support system to predict the number of patients visit with ELM method is divided into several stages. The first stage is to identify the input data collection needed in the calculation method of ELM. The next stage is processing the data; the data is divided into training data and testing data and then normalized, in which training data is 80% (452 data) and testing 579 data 20% (116 data). The third stage is problem solving using ELM. The last stage is the design and development of systems using sysflow and desktop-based system that includes the implementation and evaluation of the system. The result of this research is an application of decision supporting system to predict number of patients. By using 116 testing data based on the binary sigmoid activation function using 7 units of hidden layer and 500 Epoch then Optimal MSE value that was obtained is 0.027. Keywords— Decision Supporting System, Prediction, Artificial Neural Network, Extreme Learning Machine

scholarly journals Imam Safii Heart Disease Classification using Gain Ratio Feature Selection with Hidden Layer Modification in Extreme Learning Machine

2021 ◽  
Vol 2 (02) ◽  
pp. 71-76
Author(s):  
Imam Safii ◽  
Made Kamisutara ◽  
Tresna Maulana Faahrudin
Keyword(s):  
Heart Disease ◽  
Extreme Learning Machine ◽  
Missing Values ◽  
Communicable Disease ◽  
Disease Classification ◽  
Training Data ◽  
Gain Ratio ◽  
Splitting Test ◽  
Learning Machine ◽  
Hidden Layer

Heart disease is a non-communicable disease that causes a high mortality rate and is still a problem both in developed and developing countries. This disease often occurs because of the narrowing of blood vessels which causes the functioning of the heart is disturbed. The number of cases of heart disease in Indonesia is still quite high, making medical staff require a fairly in diagnosing the patient's conditional. The research proposed to implement Gain Ratio in selecting the most important feature that influences heart disease and building the classification models based on the modification of hidden layer weight on Extreme Learning Machine. The research collected the heart disease dataset which was obtained from Kaggle UCI Machine Learning consist of 1.025 samples, 14 attributes, and 2 labels. The data preprocessing include using data cleaning and normalization to find out dirty data or missing values. The experiment reported that Gain Ratio succeeds to generate the attribute ranking of heart disease dataset, then Gain Ratio score was added to the weighting of the hidden layer input on learning methods. The research used various validation sampling using the splitting test between training data and testing such as 70:30, 80:20, 90:10%, and set up 1500 hidden layers. The accuracy average performance of Extreme Learning Machine with modification using Gain Ratio reached 100% for the training phase and 97.67% for the testing phase.   Keyword: Heart Disease, Gain Ratio, Modification, Classification, Extreme Learning Machine

EVOLVING EXTREME LEARNING MACHINE PARADIGM WITH ADAPTIVE OPERATOR SELECTION AND PARAMETER CONTROL

2013 ◽  
Vol 21 (supp02) ◽  
pp. 143-154 ◽  
Author(s):  
KE LI ◽  
RAN WANG ◽  
SAM KWONG ◽  
JINGJING CAO
Keyword(s):  
Extreme Learning Machine ◽  
Empirical Studies ◽  
Data Sets ◽  
Classification Problems ◽  
Generalization Capability ◽  
Adaptive Operator Selection ◽  
Recent Classification ◽  
Learning Machine ◽  
Hidden Layer ◽  
Offspring Generation

Extreme Learning Machine (ELM) is an emergent technique for training Single-hidden Layer Feedforward Networks (SLFNs). It attracts significant interest during the recent years, but the randomly assigned network parameters might cause high learning risks. This fact motivates our idea in this paper to propose an evolving ELM paradigm for classification problems. In this paradigm, a Differential Evolution (DE) variant, which can online select the appropriate operator for offspring generation and adaptively adjust the corresponding control parameters, is proposed for optimizing the network. In addition, a 5-fold cross validation is adopted in the fitness assignment procedure, for improving the generalization capability. Empirical studies on several real-world classification data sets have demonstrated that the evolving ELM paradigm can generally outperform the original ELM as well as several recent classification algorithms.

scholarly journals Dual-Weighted Kernel Extreme Learning Machine for Hyperspectral Imagery Classification

2021 ◽  
Vol 13 (3) ◽  
pp. 508
Author(s):  
Xumin Yu ◽  
Yan Feng ◽  
Yanlong Gao ◽  
Yingbiao Jia ◽  
Shaohui Mei
Keyword(s):  
Extreme Learning Machine ◽  
Dimensional Space ◽  
Hyperspectral Imagery ◽  
Data Sets ◽  
Spatial Features ◽  
Weighted Extreme Learning Machine ◽  
Public Data ◽  
Weighted Kernel ◽  
Kernel Extreme Learning Machine ◽  
Learning Machine

Due to its excellent performance in high-dimensional space, the kernel extreme learning machine has been widely used in pattern recognition and machine learning fields. In this paper, we propose a dual-weighted kernel extreme learning machine for hyperspectral imagery classification. First, diverse spatial features are extracted by guided filtering. Then, the spatial features and spectral features are composited by a weighted kernel summation form. Finally, the weighted extreme learning machine is employed for the hyperspectral imagery classification task. This dual-weighted framework guarantees that the subtle spatial features are extracted, while the importance of minority samples is emphasized. Experiments carried on three public data sets demonstrate that the proposed dual-weighted kernel extreme learning machine (DW-KELM) performs better than other kernel methods, in terms of accuracy of classification, and can achieve satisfactory results.

DIESEL ENGINE MODELLING USING EXTREME LEARNING MACHINE UNDER SCARCE AND EXPONENTIAL DATA SETS

2013 ◽  
Vol 21 (supp02) ◽  
pp. 87-98 ◽  
Author(s):  
PAK KIN WONG ◽  
CHI MAN VONG ◽  
CHUN SHUN CHEUNG ◽  
KA IN WONG
Keyword(s):  
Support Vector Machine ◽  
Diesel Engine ◽  
Extreme Learning Machine ◽  
Prediction Accuracy ◽  
Logarithmic Transformation ◽  
Training Data ◽  
Support Vector ◽  
Data Sets ◽  
Sample Data ◽  
Learning Machine

To predict the performance of a diesel engine, current practice relies on the use of black-box identification where numerous experiments must be carried out in order to obtain numerical values for model training. Although many diesel engine models based on artificial neural networks (ANNs) have already been developed, they have many drawbacks such as local minima, user burden on selection of optimal network structure, large training data size and poor generalization performance, making themselves difficult to be put into practice. This paper proposes to use extreme learning machine (ELM), which can overcome most of the aforementioned drawbacks, to model the emission characteristics and the brake-specific fuel consumption of the diesel engine under scarce and exponential sample data sets. The resulting ELM model is compared with those developed using popular ANNs such as radial basis function neural network (RBFNN) and advanced techniques such as support vector machine (SVM) and its variants, namely least squares support vector machine (LS-SVM) and relevance vector machine (RVM). Furthermore, some emission outputs of diesel engines suffer from the problem of exponentiality (i.e., the output y grows up exponentially along input x) that will deteriorate the prediction accuracy. A logarithmic transformation is therefore applied to preprocess and post-process the sample data sets in order to improve the prediction accuracy of the model. Evaluation results show that ELM with the logarithmic transformation is better than SVM, LS-SVM, RVM and RBFNN with/without the logarithmic transformation, regardless the model accuracy and training time.

Sign in / Sign up

Export Citation Format

Share Document