Convergence rate of semi-supervised gradient learning algorithms

2015 ◽  
Vol 13 (04) ◽  
pp. 1550021 ◽  
Author(s):  
Baohuai Sheng ◽  
Daohong Xiang ◽  
Peixin Ye
Keyword(s):  
Convergence Rate ◽  
Error Analysis ◽  
Supervised Learning ◽  
Convex Analysis ◽  
Learning Algorithms ◽  
Learning Rate ◽  
Learning Ability ◽  
Regularization Scheme ◽  
Unlabeled Sample ◽  
Gradient Learning

Semi-supervised learning deals with learning with a small amount labeled sample and a large amount of unlabeled sample to improve the learning ability. The purpose of the semi-supervised gradient learning is to increase the smoothness of the solution using unlabeled gradient data. In this paper, we study the semi-supervised kernel-based regularization scheme involving function gradient value. We show that the learning rate can be bounded by a K-functional with gradients of the function, which verify how the unlabeled gradient data quantitatively influences the learning rate. Some approaches from convex analysis play a key role in our error analysis.

Supervised learning algorithms in the classification of plant populations with different degrees of kinship

2021 ◽  
Author(s):  
Leandro Skowronski ◽  
Paula Martin de Moraes ◽  
Mario Luiz Teixeira de Moraes ◽  
Wesley Nunes Gonçalves ◽  
Michel Constantino ◽  
...  
Keyword(s):  
Supervised Learning ◽  
Learning Algorithms ◽  
Plant Populations ◽  
Supervised Learning Algorithms

New Supervised Learning Theory Applied to Cerebellar Modeling for Suppression of Variability of Saccade End Points

2013 ◽  
Vol 25 (6) ◽  
pp. 1440-1471 ◽  
Author(s):  
Masahiko Fujita
Keyword(s):  
Supervised Learning ◽  
Cerebellar Cortex ◽  
Learning Theory ◽  
Learning System ◽  
Learning Ability ◽  
Motor Center ◽  
End Points ◽  
Noise Effects ◽  
End Point ◽  
Control Scheme

A new supervised learning theory is proposed for a hierarchical neural network with a single hidden layer of threshold units, which can approximate any continuous transformation, and applied to a cerebellar function to suppress the end-point variability of saccades. In motor systems, feedback control can reduce noise effects if the noise is added in a pathway from a motor center to a peripheral effector; however, it cannot reduce noise effects if the noise is generated in the motor center itself: a new control scheme is necessary for such noise. The cerebellar cortex is well known as a supervised learning system, and a novel theory of cerebellar cortical function developed in this study can explain the capability of the cerebellum to feedforwardly reduce noise effects, such as end-point variability of saccades. This theory assumes that a Golgi-granule cell system can encode the strength of a mossy fiber input as the state of neuronal activity of parallel fibers. By combining these parallel fiber signals with appropriate connection weights to produce a Purkinje cell output, an arbitrary continuous input-output relationship can be obtained. By incorporating such flexible computation and learning ability in a process of saccadic gain adaptation, a new control scheme in which the cerebellar cortex feedforwardly suppresses the end-point variability when it detects a variation in saccadic commands can be devised. Computer simulation confirmed the efficiency of such learning and showed a reduction in the variability of saccadic end points, similar to results obtained from experimental data.

An Opcode-Based Malware Detection Model Using Supervised Learning Algorithms

2021 ◽  
Vol 15 (4) ◽  
pp. 18-30
Author(s):  
Om Prakash Samantray ◽  
Satya Narayan Tripathy
Keyword(s):  
Supervised Learning ◽  
Learning Algorithms ◽  
Malware Detection ◽  
Support Vector ◽  
Detection Accuracy ◽  
Detection Techniques ◽  
Detection Model ◽  
Proposed Model ◽  
Tree Classifier ◽  
Supervised Learning Algorithms

There are several malware detection techniques available that are based on a signature-based approach. This approach can detect known malware very effectively but sometimes may fail to detect unknown or zero-day attacks. In this article, the authors have proposed a malware detection model that uses operation codes of malicious and benign executables as the feature. The proposed model uses opcode extract and count (OPEC) algorithm to prepare the opcode feature vector for the experiment. Most relevant features are selected using extra tree classifier feature selection technique and then passed through several supervised learning algorithms like support vector machine, naive bayes, decision tree, random forest, logistic regression, and k-nearest neighbour to build classification models for malware detection. The proposed model has achieved a detection accuracy of 98.7%, which makes this model better than many of the similar works discussed in the literature.

Sign in / Sign up

Export Citation Format

Share Document