scholarly journals An active inference model of hierarchical action understanding, learning and imitation

2021 ◽  
Author(s):  
Riccardo Proietti ◽  
Giovanni Pezzulo ◽  
Alessia Tessari

We advance a novel computational model of the acquisition of a hierarchical action repertoire and its use for observation, understanding and motor control. The model is grounded in a principled framework to understand brain and cognition: active inference. We exemplify the functioning of the model by presenting four simulations of a tennis learner who observes a teacher performing tennis shots and forms hierarchical representations of the observed actions - including both actions that are already in her repertoire and novel actions - and finally imitates them. Our simulations that show that the agent’s oculomotor activity implements an active information sampling strategy that permits inferring the kinematics aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions, such as their proximal goals and intentions. Finally, the inferred action representations can steer imitative motor responses, but interfere with the execution of different actions. Taken together, our simulations show that the same hierarchical active inference model provides a unified account of action observation, understanding, learning and imitation. Finally, our model provides a computational rationale to explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.

2019 ◽  
Vol 15 (1) ◽  
pp. e1006267 ◽  
Author(s):  
Anna C. Sales ◽  
Karl J. Friston ◽  
Matthew W. Jones ◽  
Anthony E. Pickering ◽  
Rosalyn J. Moran

2019 ◽  
Vol 10 ◽  
Author(s):  
Axel Constant ◽  
Maxwell J. D. Ramstead ◽  
Samuel P. L. Veissière ◽  
Karl Friston

2013 ◽  
Vol 14 (3) ◽  
pp. 329-350 ◽  
Author(s):  
Alessandra Sciutti ◽  
Ambra Bisio ◽  
Francesco Nori ◽  
Giorgio Metta ◽  
Luciano Fadiga ◽  
...  

Understanding the goals of others is fundamental for any kind of interpersonal interaction and collaboration. From a neurocognitive perspective, intention understanding has been proposed to depend on an involvement of the observer’s motor system in the prediction of the observed actions (Nyström et al. 2011; Rizzolatti & Sinigaglia 2010; Southgate et al. 2009). An open question is if a similar understanding of the goal mediated by motor resonance can occur not only between humans, but also for humanoid robots. In this study we investigated whether goal-oriented robotic actions can induce motor resonance by measuring the appearance of anticipatory gaze shifts to the goal during action observation. Our results indicate a similar implicit processing of humans’ and robots’ actions and propose to use anticipatory gaze behaviour as a tool for the evaluation of human-robot interactions. Keywords: Humanoid robot; motor resonance; anticipation; proactive gaze; action understanding


2015 ◽  
Vol 27 (2) ◽  
pp. 306-328 ◽  
Author(s):  
Thomas H. B. FitzGerald ◽  
Philipp Schwartenbeck ◽  
Michael Moutoussis ◽  
Raymond J. Dolan ◽  
Karl Friston

Deciding how much evidence to accumulate before making a decision is a problem we and other animals often face, but one that is not completely understood. This issue is particularly important because a tendency to sample less information (often known as reflection impulsivity) is a feature in several psychopathologies, such as psychosis. A formal understanding of information sampling may therefore clarify the computational anatomy of psychopathology. In this theoretical letter, we consider evidence accumulation in terms of active (Bayesian) inference using a generic model of Markov decision processes. Here, agents are equipped with beliefs about their own behavior—in this case, that they will make informed decisions. Normative decision making is then modeled using variational Bayes to minimize surprise about choice outcomes. Under this scheme, different facets of belief updating map naturally onto the functional anatomy of the brain (at least at a heuristic level). Of particular interest is the key role played by the expected precision of beliefs about control, which we have previously suggested may be encoded by dopaminergic neurons in the midbrain. We show that manipulating expected precision strongly affects how much information an agent characteristically samples, and thus provides a possible link between impulsivity and dopaminergic dysfunction. Our study therefore represents a step toward understanding evidence accumulation in terms of neurobiologically plausible Bayesian inference and may cast light on why this process is disordered in psychopathology.


2021 ◽  
Author(s):  
Joni Kemppainen ◽  
Ben Scales ◽  
Keivan Razban Haghighi ◽  
Jouni Takalo ◽  
Neveen Mansour ◽  
...  

Neural mechanisms behind stereopsis, which requires simultaneous disparity inputs from two eyes, have remained mysterious. Here we show how ultrafast mirror-symmetric photomechanical contractions in the frontal forward-facing left and right eye photoreceptors give Drosophila super-resolution 3D-vision. By interlinking multiscale in vivo assays with multiscale simulations, we reveal how these photoreceptor microsaccades - by verging, diverging and narrowing the eyes' overlapping receptive fields - channel depth information, as phasic binocular image motion disparity signals in time. We further show how peripherally, outside stereopsis, microsaccadic sampling tracks a forward flying fly's optic flow field to better resolve the world in motion. These results change our understanding of how insect compound eyes work and suggest a general dynamic stereo-information sampling strategy for animals, robots and sensors.


2011 ◽  
Vol 104 (1-2) ◽  
pp. 137-160 ◽  
Author(s):  
Karl Friston ◽  
Jérémie Mattout ◽  
James Kilner

2016 ◽  
Vol 115 (3) ◽  
pp. 1085-1087
Author(s):  
Michelle Marneweck ◽  
Ann-Maree Vallence

Many have recently questioned whether all levels of actions understanding, from lower kinematic levels to the higher goal or intention levels of action understanding, are processed in the action observation network (a network of neurons that are active during action execution and observation). A recent study by Wurm and Lingnau ( J Neurosci 35: 7727–7735, 2015) gave evidence to the contrary, by showing that higher levels of action understanding are processed in the lateral occipitotemporal cortex. An important next step is to differentiate between the role of the lateral occipitotemporal cortex in processing the visual form of an observed action and the goal of an observed action.


2009 ◽  
Vol 364 (1528) ◽  
pp. 2311-2323 ◽  
Author(s):  
P. F. Ferrari ◽  
L. Bonini ◽  
L. Fogassi

The discovery of mirror neurons (MNs), deemed to be at the basis of action understanding, could constitute the potential solution to the ‘correspondence problem’ between one's own and others' action that is crucial for of imitative behaviours. However, it is still to be clarified whether, and how, several imitative phenomena, differing in terms of complexity and cognitive effort, could be explained within a unified framework based on MNs. Here we propose that MNs could differently contribute to distinct imitative behaviours by means of two anatomo-functional pathways, subjected to changes during development. A ‘direct mirror pathway’, directly influencing the descending motor output, would be responsible for neonatal and automatic imitation. This proposal is corroborated by some new behavioural evidences provided here. During development, the increased control of voluntary movements and the capacity to efficiently suppress automatic motor activation during action observation assign to the core MNs regions essentially perceptuo-cognitive functions. These functions would be exploited by an ‘indirect mirror pathway’ from the core regions of the MN system to prefrontal cortex. This latter would play a key role in parsing, storing and organizing motor representations, allowing the emergence of more efficient and complex imitative behaviours such as response facilitation and true imitation.


2021 ◽  
Author(s):  
Francesco Mannella ◽  
Federico Maggiore ◽  
Manuel Baltieri ◽  
Giovanni Pezzulo

Rodents use whisking to probe actively their environment and to locate objects in space, hence providing a paradigmatic biological example of active sensing. Numerous studies show that the control of whisking has anticipatory aspects. For example, rodents target their whisker protraction to the distance at which they expect objects, rather than just reacting fast to contacts with unexpected objects. Here we characterize the anticipatory control of whisking in rodents as an active inference process. In this perspective, the rodent is endowed with a prior belief that it will touch something at the end of the whisker protraction, and it continuously modulates its whisking amplitude to minimize (proprioceptive and somatosensory) prediction errors arising from an unexpected whisker-object contact, or from a lack of an expected contact. We will use the model to qualitatively reproduce key empirical findings about the ways rodents modulate their whisker amplitude during exploration and the scanning of (expected or unexpected) objects. Furthermore, we will discuss how the components of active inference model can in principle map to the neurobiological circuits of rodent whisking.


Sign in / Sign up

Export Citation Format

Share Document