scholarly journals Fpga Implementation of Precise Convolutional Neural Network for Extreme Learning Machine

2020 ◽  
Vol 9 (8) ◽  
pp. 470-480
Keyword(s):  
Neural Network ◽  
Receptive Field ◽  
Convolutional Neural Network ◽  
Computation Time ◽  
Field Approach ◽  
Pixel Array ◽  
Gradient Based ◽  
Feed Forward Neural Networks ◽  
Learning Machine ◽  
Hidden Layer

Feed-forward neural networks can be trained based on a gradient-descent based backpropagation algorithm. But, these algorithms require more computation time. Extreme Learning Machines (ELM’s) are time-efficient, and they are less complicated than the conventional gradient-based algorithm. In previous years, an SRAM based convolutional neural network using a receptive – field Approach was proposed. This neural network was used as an encoder for the ELM algorithm and was implemented on FPGA. But, this neural network used an inaccurate 3-stage pipelined parallel adder. Hence, this neural network generates imprecise stimuli to the hidden layer neurons. This paper presents an implementation of precise convolutional neural network for encoding in the ELM algorithm based on the receptive - field approach at the hardware level. In the third stage of the pipelined parallel adder, instead of approximating the output by using one 2-input 15-bit adder, one 4-input 14-bit adder is used. Also, an additional weighted pixel array block is used. This weighted pixel array improves the accuracy of generating 128 weighted pixels. This neural network was simulated using ModelSim-Altera 10.1d and synthesized using Quartus II 13.0 sp1. This neural network is implemented on Cyclone V FPGA and used for pattern recognition applications. Although this design consumes slightly more hardware resources, this design is more accurate compared to previously existing encoders

scholarly journals An Effective Turkey Marble Classification System: Convolutional Neural Network with Genetic Algorithm -Wavelet Kernel - Extreme Learning Machine

2021 ◽  
Vol 38 (4) ◽  
pp. 1229-1235
Author(s):  
Derya Avci ◽  
Eser Sert
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Convolutional Neural Network ◽  
Extreme Learning Machine ◽  
Optical Illusions ◽  
Factors Affecting ◽  
Kernel Extreme Learning Machine ◽  
Learning Machine ◽  
Hidden Layer ◽  
Elm Classifier

Marble is one of the most popular decorative elements. Marble quality varies depending on its vein patterns and color, which are the two most important factors affecting marble quality and class. The manual classification of marbles is likely to lead to various mistakes due to different optical illusions. However, computer vision minimizes these mistakes thanks to artificial intelligence and machine learning. The present study proposes the Convolutional Neural Network- (CNN-) with genetic algorithm- (GA) Wavelet Kernel- (WK-) Extreme Learning Machine (ELM) (CNN–GA-WK-ELM) approach. Using CNN architectures such as AlexNet, VGG-19, SqueezeNet, and ResNet-50, the proposed approach obtained 4 different feature vectors from 10 different marble images. Later, Genetic Algorithm (GA) was used to optimize adjustable parameters, i.e. k, 1, and m, and hidden layer neuron number in Wavelet Kernel (WK) – Extreme Learning Machine (ELM) and to increase the performance of ELM. Finally, 4 different feature vector parameters were optimized and classified using the WK-ELM classifier. The proposed CNN–GA-WK-ELM yielded an accuracy rate of 98.20%, 96.40%, 96.20%, and 95.60% using AlexNet, SequeezeNet, VGG-19, and ResNet-50, respectively.

scholarly journals Brain Tumor Classification with Hybrid Algorithm Convolutional Neural Network-Extreme Learning Machine

2021 ◽  
Vol 3 (1) ◽  
pp. 29-33
Author(s):  
Radical Rakhman Wahid ◽  
Fetty Tri Anggraeni ◽  
Budi Nugroho
Keyword(s):  
Neural Network ◽  
Brain Tumor ◽  
Convolutional Neural Network ◽  
Extreme Learning Machine ◽  
Hybrid Algorithm ◽  
Extraction Process ◽  
Machine Learning Algorithms ◽  
Average Value ◽  
Learning Machine ◽  
Hidden Layer

Brain tumor is a disease that attacks the brains of living things in which brain cells grow abnormally in the area around the brain. Various ways have been done to detect this disease, one of which is through the anatomical approach to medical images. In this study, the authors propose a Convolutional Neural Network (CNN)-Extreme Learning Machine (ELM) hybrid algorithm through Magnetic Resonance Imaging (MRI). ELM was chosen because of its superiority in the training process, which is faster than iterative machine learning algorithms, while CNN was chosen to replace the traditional feature extraction process. The result is CNN-ELM, which has 8 filters in the convolution layer and 6000 nodes in the hidden layer, has the best performance compared to CNN-ELM another model which has different number of filters and number of nodes in the hidden layer. This is evidenced by the average value of precision, recall, and F1-score which is 0.915 while the accuracy of the test is 91.4%.

Study on Deep Structure of Extreme Learning Machine (DS-ELM) for Datasets with Noise

2014 ◽  
Vol 989-994 ◽  
pp. 3679-3682 ◽  
Author(s):  
Meng Meng Ma ◽  
Bo He
Keyword(s):  
Extreme Learning Machine ◽  
Simple Structure ◽  
Learning Algorithm ◽  
Deep Structure ◽  
Noisy Data ◽  
Machine Learning Algorithm ◽  
Feed Forward Neural Networks ◽  
Learning Machine ◽  
Hidden Layer ◽  
Auto Associative Neural Network

Extreme learning machine (ELM), a relatively novel machine learning algorithm for single hidden layer feed-forward neural networks (SLFNs), has been shown competitive performance in simple structure and superior training speed. To improve the effectiveness of ELM for dealing with noisy datasets, a deep structure of ELM, short for DS-ELM, is proposed in this paper. DS-ELM contains three level networks (actually contains three nets ): the first level network is trained by auto-associative neural network (AANN) aim to filter out noise as well as reduce dimension when necessary; the second level network is another AANN net aim to fix the input weights and bias of ELM; and the last level network is ELM. Experiments on four noisy datasets are carried out to examine the new proposed DS-ELM algorithm. And the results show that DS-ELM has higher performance than ELM when dealing with noisy data.

scholarly journals Applying of machine learning in the construction of a voice-controlled interface on the example of a music player

2019 ◽  
Vol 13 ◽  
pp. 302-309
Author(s):  
Jakub Basiakowski
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Convolutional Neural Network ◽  
Feedforward Neural Network ◽  
Hidden Layer ◽  
Music Player ◽  
The Impact

The following paper presents the results of research on the impact of machine learning in the construction of a voice-controlled interface. Two different models were used for the analysys: a feedforward neural network containing one hidden layer and a more complicated convolutional neural network. What is more, a comparison of the applied models was presented. This comparison was performed in terms of quality and the course of training.

scholarly journals Label Rectification Learning through Kernel Extreme Learning Machine

2021 ◽  
Vol 2021 ◽  
pp. 1-6
Author(s):  
Qiang Cai ◽  
Fenghai Li ◽  
Yifan Chen ◽  
Haisheng Li ◽  
Jian Cao ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Extreme Learning Machine ◽  
Classification Performance ◽  
Considerable Progress ◽  
Strong Representation ◽  
Kernel Extreme Learning Machine ◽  
Classification Tasks ◽  
Learning Machine

Along with the strong representation of the convolutional neural network (CNN), image classification tasks have achieved considerable progress. However, majority of works focus on designing complicated and redundant architectures for extracting informative features to improve classification performance. In this study, we concentrate on rectifying the incomplete outputs of CNN. To be concrete, we propose an innovative image classification method based on Label Rectification Learning (LRL) through kernel extreme learning machine (KELM). It mainly consists of two steps: (1) preclassification, extracting incomplete labels through a pretrained CNN, and (2) label rectification, rectifying the generated incomplete labels by the KELM to obtain the rectified labels. Experiments conducted on publicly available datasets demonstrate the effectiveness of our method. Notably, our method is extensible which can be easily integrated with off-the-shelf networks for improving performance.

Intelligent Models Applied to Elastic Modulus of Jointed Rock Mass

2018 ◽  
pp. 1-30 ◽  
Author(s):  
Jagan Jayabalan ◽  
Sanjiban Sekhar Roy ◽  
Pijush Samui ◽  
Pradeep Kurup
Keyword(s):  
Neural Network ◽  
Rock Mass ◽  
Elastic Modulus ◽  
Roughness Parameter ◽  
Jointed Rock ◽  
Jointed Rock Mass ◽  
Artificial Neural Network Ann ◽  
Learning Machine ◽  
Hidden Layer ◽  
Intelligent Models

Elastic Modulus (Ej) of jointed rock mass is a key parameter for deformation analysis of rock mass. This chapter adopts three intelligent models {Extreme Learning Machine (ELM), Minimax Probability Machine Regression (MPMR) and Generalized Regression Neural Network (GRNN)} for determination of Ej of jointed rock mass. MPMR is derived in a probability framework. ELM is the modified version of Single Hidden Layer Feed forward network. GRNN approximates any arbitrary function between the input and output variables. Joint frequency (Jn), joint inclination parameter (n), joint roughness parameter (r), confining pressure (s3) (MPa), and elastic modulus (Ei) (GPa) of intact rock have been taken as inputs of the ELM, GRNN and MPMR models. The output of ELM, GRNN and MPMR is Ej of jointed rock mass. In this study, ELM, GRNN and MPMR have been used as regression techniques. The developed GRNN, ELM and MPMR have been compared with the Artificial Neural Network (ANN) models.

A novel adaptive and fast deep convolutional neural network for bearing fault diagnosis under different working conditions

2019 ◽  
Vol 234 (4) ◽  
pp. 1167-1182 ◽  
Author(s):  
Kun Xu ◽  
Shunming Li ◽  
Jinrui Wang ◽  
Zenghui An ◽  
Yu Xin
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Receptive Field ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Working Conditions ◽  
Neural Network Model ◽  
Network Architecture ◽  
Deep Convolutional Neural Network ◽  
Mechanical Equipment

Deep learning method is gradually applied in the field of mechanical equipment fault diagnosis because it can learn complex and useful features automatically from the vibration signals. Among the many intelligent diagnostic models, convolutional neural network has been gradually applied to intelligent fault diagnosis of bearings due to its advantages of local connection and weight sharing. However, there are still some drawbacks. (1) The training process of convolutional neural network is slow and unstable. It has more training parameters. (2) It cannot perform well under different working conditions, such as noisy environment and different workloads. In this paper, a novel model named adaptive and fast convolutional neural network with wide receptive field is presented to overcome the aforementioned deficiencies. The prime innovations include the following. First, a deep convolutional neural network architecture is constructed using the scaled exponential linear unit activation function and global average pooling. The model has fewer training parameters and can converge rapidly and stably. Second, the model has a wide receptive field with two medium and three small length convolutional kernels. It also has high diagnostic accuracy and robustness when the environment is noisy and workloads are changed compared with other models. Furthermore, to demonstrate how the wide receptive field convolutional neural network model works, the reasons for high model performance are analyzed and the learned features are also visualized. Finally, the wide receptive field convolutional neural network model is verified by the vibration dataset collected in the background of high noise, and the results indicate that it has high diagnostic performance.

FUSION OF EXTREME LEARNING MACHINE WITH FUZZY INTEGRAL

2013 ◽  
Vol 21 (supp02) ◽  
pp. 23-34 ◽  
Author(s):  
JUNHAI ZHAI ◽  
HONGYU XU ◽  
YAN LI
Keyword(s):  
Extreme Learning Machine ◽  
Learning Algorithm ◽  
Fuzzy Integral ◽  
Fast Learning ◽  
Original Dataset ◽  
Learning Speed ◽  
Feed Forward Neural Networks ◽  
Three Stages ◽  
Learning Machine ◽  
Hidden Layer

Extreme learning machine (ELM) is an efficient and practical learning algorithm used for training single hidden layer feed-forward neural networks (SLFNs). ELM can provide good generalization performance at extremely fast learning speed. However, ELM suffers from instability and over-fitting, especially on relatively large datasets. Based on probabilistic SLFNs, an approach of fusion of extreme learning machine (F-ELM) with fuzzy integral is proposed in this paper. The proposed algorithm consists of three stages. Firstly, the bootstrap technique is employed to generate several subsets of original dataset. Secondly, probabilistic SLFNs are trained with ELM algorithm on each subset. Finally, the trained probabilistic SLFNs are fused with fuzzy integral. The experimental results show that the proposed approach can alleviate to some extent the problems mentioned above, and can increase the prediction accuracy.

Sign in / Sign up

Export Citation Format

Share Document