scholarly journals Implementation of Incremental Learning in Artificial Neural Networks

10.29007/8559 ◽  
2018 ◽  
Author(s):  
Mariela Andrade ◽  
Eduardo Gasca ◽  
Eréndira Rendón
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Incremental Learning ◽  
Learning Algorithm ◽  
Human Memory ◽  
Support Vector ◽  
Training Set ◽  
New Knowledge ◽  
Target Network ◽  
Artificial Neural

Nowadays, the use of artificial neural networks (ANN), in particular the Multilayer Perceptron (MLP), is very popular for executing different tasks such as pattern recognition, data mining, and process automation. However, there are still weaknesses in these models when compared with human capabilities. A characteristic of human memory is the ability for learning new concepts without forgetting what we learned in the past, which has been a disadvantage in the field of artificial neural networks. How can we add new knowledge to the network without forgetting what has already been learned, without repeating the exhaustive ANN process? In an exhaustively training is used a complete training set, with all objects of all classes.In this work, we present a novel incremental learning algorithm for the MLP. New knowledge is incorporated into the target network without executing an exhaustive retraining. Objects of a new class integrate this knowledge, which was not included in the training of a source network. The algorithm consists in taking the final weights from the source network, doing a correction of these with the Support Vector Machine tools, and transferring the obtained weights to a target network. This last net is trained with a training set that it is previously preprocessed. The efficiency resulted of the target network is comparable with a net that is exhaustively trained.

scholarly journals Transfer Learning–Based Artificial Neural Networks Post-Equalizers for Underwater Visible Light Communication

2021 ◽  
Vol 2 ◽  
Author(s):  
Yiheng Zhao ◽  
Shaohua Yu ◽  
Nan Chi
Keyword(s):  
Neural Networks ◽  
Big Data ◽  
Artificial Neural Networks ◽  
Visible Light ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Visible Light Communication ◽  
Training Data ◽  
Training Set ◽  
Artificial Neural

In this article, we demonstrate two transfer learning–based dual-branch multilayer perceptron post-equalizers (TL-DBMLPs) in carrierless amplitude and phase (CAP) modulation-based underwater visible light communication (UVLC) system. The transfer learning algorithm could reduce the dependence of artificial neural networks (ANN)–based post-equalizer on big data and extended training cycles. Compared with DBMLP, the TL-DBMLP is more robust to the jitter of the bias current (Ibias) of light-emitting diode (LED), which indicates that TL-DBMLP does not require further training in Ibias varying UVLC system. In terms of voltage peak-to-peak (Vpp) varying VLC system, DBMLP requires a training set with a size of more than 105 and 50 training epochs, which quantitatively prove the effectiveness of DBMLP in reducing reliance on large amount of training epochs. On the counterpart, the TL-DBMLP only requires a training set with a size of less than 2×104 and 10 training epochs, which quantitatively prove the effectiveness of DBMLP in reducing reliance on big data. Finally, we experimentally demonstrate that transfer learning can effectively reduce ANN dependence on extensive size training data and large amount of training epochs, whether in VLC systems with varying Ibias and varying Vpp.

An Efficient Hybrid Forecasting Approach for Wind Speed Time Series

2017 ◽  
Vol 7 (9) ◽  
pp. 13
Author(s):  
Bhargavi Munnaluri ◽  
K. Ganesh Reddy
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Wind Speed ◽  
Fossil Fuels ◽  
Renewable Energy Sources ◽  
Support Vector ◽  
Hybrid Forecasting ◽  
Artificial Neural ◽  
Future Utilization

Wind forecasting is one of the best efficient ways to deal with the challenges of wind power generation. Due to the depletion of fossil fuels renewable energy sources plays a major role for the generation of power. For future management and for future utilization of power, we need to predict the wind speed.  In this paper, an efficient hybrid forecasting approach with the combination of Support Vector Machine (SVM) and Artificial Neural Networks(ANN) are proposed to improve the quality of prediction of wind speed. Due to the different parameters of wind, it is difficult to find the accurate prediction value of the wind speed. The proposed hybrid model of forecasting is examined by taking the hourly wind speed of past years data by reducing the prediction error with the help of Mean Square Error by 0.019. The result obtained from the Artificial Neural Networks improves the forecasting quality.

scholarly journals The Budapest Amyloid Predictor and Its Applications

Biomolecules ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 500
Author(s):  
László Keresztes ◽  
Evelin Szögi ◽  
Bálint Varga ◽  
Viktor Farkas ◽  
András Perczel ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
User Needs ◽  
Computational Technique ◽  
Linear Support Vector Machine ◽  
Β Sheets ◽  
Artificial Neural ◽  
Amorphous Aggregation

The amyloid state of proteins is widely studied with relevance to neurology, biochemistry, and biotechnology. In contrast with nearly amorphous aggregation, the amyloid state has a well-defined structure, consisting of parallel and antiparallel β-sheets in a periodically repeated formation. The understanding of the amyloid state is growing with the development of novel molecular imaging tools, like cryogenic electron microscopy. Sequence-based amyloid predictors were developed, mainly using artificial neural networks (ANNs) as the underlying computational technique. From a good neural-network-based predictor, it is a very difficult task to identify the attributes of the input amino acid sequence, which imply the decision of the network. Here, we present a linear Support Vector Machine (SVM)-based predictor for hexapeptides with correctness higher than 84%, i.e., it is at least as good as the best published ANN-based tools. Unlike artificial neural networks, the decisions of the linear SVMs are much easier to analyze and, from a good predictor, we can infer rich biochemical knowledge. In the Budapest Amyloid Predictor webserver the user needs to input a hexapeptide, and the server outputs a prediction for the input plus the 6 × 19 = 114 distance-1 neighbors of the input hexapeptide.

IMPROVEMENT OF DOSE ESTIMATION PROCESS USING ARTIFICIAL NEURAL NETWORKS

2018 ◽  
Vol 184 (1) ◽  
pp. 36-43 ◽  
Author(s):  
Gal Amit ◽  
Hanan Datz
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
Physical Parameters ◽  
Machine Method ◽  
Algorithm Performance ◽  
Artificial Neural ◽  
First Time ◽  
Automatic Algorithm

Abstract We present here for the first time a fast and reliable automatic algorithm based on artificial neural networks for the anomaly detection of a thermoluminescence dosemeter (TLD) glow curves (GCs), and compare its performance with formerly developed support vector machine method. The GC shape of TLD depends on numerous physical parameters, which may significantly affect it. When integrated into a dosimetry laboratory, this automatic algorithm can classify ‘anomalous’ (having any kind of anomaly) GCs for manual review, and ‘regular’ (acceptable) GCs for automatic analysis. The new algorithm performance is then compared with two kinds of formerly developed support vector machine classifiers—regular and weighted ones—using three different metrics. Results show an impressive accuracy rate of 97% for TLD GCs that are correctly classified to either of the classes.

Predicting Students Grades Using Artificial Neural Networks and Support Vector Machine

2019 ◽  
pp. 751-766
Author(s):  
Sajid Umair ◽  
Muhammad Majid Sharif
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Artificial Neural Networks ◽  
Student Performance ◽  
Semantic Analysis ◽  
Vital Role ◽  
Support Vector ◽  
Data Set ◽  
Important Research Topic ◽  
Artificial Neural

Prediction of student performance on the basis of habits has been a very important research topic in academics. Studies show that selection of the correct data set also plays a vital role in these predictions. In this chapter, the authors took data from different schools that contains student habits and their comments, analyzed it using latent semantic analysis to get semantics, and then used support vector machine to classify the data into two classes, important for prediction and not important. Finally, they used artificial neural networks to predict the grades of students. Regression was also used to predict data coming from support vector machine, while giving only the important data for prediction.

Sign in / Sign up

Export Citation Format

Share Document