stochastic learning
Recently Published Documents


TOTAL DOCUMENTS

265
(FIVE YEARS 34)

H-INDEX

30
(FIVE YEARS 3)

2021 ◽  
Vol 25 (6) ◽  
pp. 45-52
Author(s):  
A. A. Solodov

The aim of the study is to develop a mathematical model of the trained Markov cognitive system in the presence of discrete training and interfering random stimuli arising at random times at its input. The research method consists in the application of the simplest Markov learning model of Estes with a stochastic matrix with two states, in which the transition probabilities are calculated in accordance with the optimal Neуman-Pearson algorithm for detecting stimuli affecting the system. The paper proposes a model of the random appearance of images at the input of the cognitive system (in terms of learning theory, these are stimuli to which the system reacts). The model assumes an exponential distribution of the system’s response time to stimuli that is widely used to describe intellectual work, while their number is distributed according to the Poisson law. It is assumed that the cognitive system makes a decision about the presence or absence of a stimulus at its input in accordance with the Neуman-Pearson optimality criterion, i.e. maximizes the probability of correct detection of the stimulus with a fixed probability of false detection. The probabilities calculated in this way are accepted as transition probabilities in the stochastic learning matrix of the system. Thus, the following assumptions are accepted in the work, apparently corresponding to the behavior of the system assuming human reactions, i.e. the cognitive system.The images analyzed by the system arise at random moments of time, while the duration of time between neighboring appearances of images is distributed exponentially.The system analyzes the resulting images and makes a decision about the presence or absence of an image at its input in accordance with the optimal Neуman-Pearson algorithm that maximizes the probability of correct identification of the image with a fixed probability of false identification.The system is trainable in the sense that decisions about the presence or absence of an image are made sequentially on a set of identical situations, and the probability of making a decision depends on the previous decision of the system.The new results of the study are analytical expressions for the probabilities of the system staying in each of the possible states, depending on the number of steps of the learning process and the intensities of useful and interfering stimuli at the input of the system. These probabilities are calculated for an interesting case in which the discreteness of the appearance of stimuli in time is clearly manifested and the corresponding graphs are given. Stationary probabilities are also calculated, i.e. for an infinite number of training steps, the probabilities of the system staying in each of the states and the corresponding graph is presented.In conclusion, it is noted that the presented graphs of the behavior of the trained system correspond to an intuitive idea of the reaction of the cognitive system to the appearance of stimuli. Some possible directions of further research on the topic mentioned in the paper are indicated.


Author(s):  
Samuel King Opoku

The choice of users’ activity in a context-aware environment depends on users’ preferences and background. Users tend to rank concurrent activities and select their preferred activity. Researchers and developers of context-aware applications have sought various mechanisms to implement context reasoning engines. Recent implementations use Artificial Neural Networks (ANN) and other machine learning techniques to develop a context-aware reasoning engine to predict users’ activities. However, the complexities of these mechanisms overwhelm the processing capabilities and storage capacity of mobile devices. The study models a context-aware reasoning engine using a multi-layered perceptron with a gradient descent back-propagation algorithm to predict activity from user-ranked activities using a stochastic learning mode with a constant learning rate. The work deduced that working with specific rules in training a neural network is not always applicable. Training a network without approximation of neuron’s output to the nearest whole number increases the accuracy level of the network at the end of the training.


2021 ◽  
Author(s):  
André Forster ◽  
Johannes Hewig ◽  
John JB Allen ◽  
Johannes Rodrigues ◽  
Philipp Ziebell ◽  
...  

The lateral frontal Cortex serves an important integrative function for converging information from a number of neural networks. It thus provides context and direction to both stimulus processing and accompanying responses. Especially in emotion related processing, the right hemisphere has often been described to serve a special role including a special sensitivity to stochastic learning and model building. In this study, the right inferior frontal gyrus (riFG) of 41 healthy participants was targeted via ultrasound neuromodulation to shed light on the involvement of this area in the representation of probabilistic context information and the processing of currently presented emotional faces. Analyses reveal that the riFG does not directly contribute to processing of currently depicted emotional stimuli but provides for information about the estimated likelihood of occurrence of stimulus features.


Author(s):  
Yadira Quiñonez

Technology is currently a crucial benchmark in any application area. In general, society is immersed in the era of digitalization; therefore, incorporating digital technology in different application areas has been more accessible. Nowadays, claiming that adopting artificial intelligence systems in any area is already an emerging need. In this chapter, several artificial intelligence techniques are presented, as well as algorithms and tools that have been used to provide a variety of solutions such as artificial neural networks, convolutional neural networks architecture, AI models, machine learning, deep learning, and bio-inspired algorithms focused mainly on ant colony optimization, response threshold models, and stochastic learning automata. Likewise, the main applications that use AI techniques are described, and the main trends in this discipline are mentioned. This chapter ends with a critical discussion of artificial intelligence advances.


Sign in / Sign up

Export Citation Format

Share Document