scholarly journals Bidirectional interaction between visual and motor generative models using Predictive Coding and Active Inference

2021 ◽  
Author(s):  
Louis Annabi ◽  
Alexandre Pitti ◽  
Mathias Quoy
Keyword(s):  
Predictive Coding ◽  
Generative Models ◽  
Active Inference

scholarly journals A tale of two densities: active inference is enactive inference

2019 ◽  
Vol 28 (4) ◽  
pp. 225-239 ◽  
Author(s):  
Maxwell JD Ramstead ◽  
Michael D Kirchhoff ◽  
Karl J Friston
Keyword(s):  
Predictive Coding ◽  
Generative Models ◽  
Predictive Processing ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
The One ◽  
And Control ◽  
The Brain ◽  
Selection Of

The aim of this article is to clarify how best to interpret some of the central constructs that underwrite the free-energy principle (FEP) – and its corollary, active inference – in theoretical neuroscience and biology: namely, the role that generative models and variational densities play in this theory. We argue that these constructs have been systematically misrepresented in the literature, because of the conflation between the FEP and active inference, on the one hand, and distinct (albeit closely related) Bayesian formulations, centred on the brain – variously known as predictive processing, predictive coding or the prediction error minimisation framework. More specifically, we examine two contrasting interpretations of these models: a structural representationalist interpretation and an enactive interpretation. We argue that the structural representationalist interpretation of generative and recognition models does not do justice to the role that these constructs play in active inference under the FEP. We propose an enactive interpretation of active inference – what might be called enactive inference. In active inference under the FEP, the generative and recognition models are best cast as realising inference and control – the self-organising, belief-guided selection of action policies – and do not have the properties ascribed by structural representationalists.

scholarly journals The evolution of brain architectures for predictive coding and active inference

2021 ◽  
Vol 377 (1844) ◽  
Author(s):  
Giovanni Pezzulo ◽  
Thomas Parr ◽  
Karl Friston
Keyword(s):  
Predictive Control ◽  
Animal Species ◽  
Spatial Scales ◽  
Predictive Coding ◽  
Generative Models ◽  
Predictive Processing ◽  
Active Inference ◽  
Biological Regulation ◽  
Systems Neuroscience ◽  
Behavioural Repertoire

This article considers the evolution of brain architectures for predictive processing. We argue that brain mechanisms for predictive perception and action are not late evolutionary additions of advanced creatures like us. Rather, they emerged gradually from simpler predictive loops (e.g. autonomic and motor reflexes) that were a legacy from our earlier evolutionary ancestors—and were key to solving their fundamental problems of adaptive regulation. We characterize simpler-to-more-complex brains formally, in terms of generative models that include predictive loops of increasing hierarchical breadth and depth. These may start from a simple homeostatic motif and be elaborated during evolution in four main ways: these include the multimodal expansion of predictive control into an allostatic loop; its duplication to form multiple sensorimotor loops that expand an animal's behavioural repertoire; and the gradual endowment of generative models with hierarchical depth (to deal with aspects of the world that unfold at different spatial scales) and temporal depth (to select plans in a future-oriented manner). In turn, these elaborations underwrite the solution to biological regulation problems faced by increasingly sophisticated animals. Our proposal aligns neuroscientific theorising—about predictive processing—with evolutionary and comparative data on brain architectures in different animal species. This article is part of the theme issue ‘Systems neuroscience through the lens of evolutionary theory’.

scholarly journals The encoding of stochastic regularities is facilitated by action-effect predictions

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Betina Korka ◽  
Erich Schröger ◽  
Andreas Widmann
Keyword(s):  
Coding Theory ◽  
Predictive Coding ◽  
Event Related Potentials ◽  
Random Order ◽  
Generative Models ◽  
Higher Order ◽  
Action Effect ◽  
Related Potentials ◽  
Sensory Prediction ◽  
Action Intention

AbstractOur brains continuously build and update predictive models of the world, sources of prediction being drawn for example from sensory regularities and/or our own actions. Yet, recent results in the auditory system indicate that stochastic regularities may not be easily encoded when a rare medium pitch deviant is presented between frequent high and low pitch standard sounds in random order, as reflected in the lack of sensory prediction error event-related potentials [i.e., mismatch negativity (MMN)]. We wanted to test the implication of the predictive coding theory that predictions based on higher-order generative models—here, based on action intention, are fed top-down in the hierarchy to sensory levels. Participants produced random sequences of high and low pitch sounds by button presses in two conditions: In a “specific” condition, one button produced high and the other low pitch sounds; in an “unspecific” condition, both buttons randomly produced high or low-pitch sounds. Rare medium pitch deviants elicited larger MMN and N2 responses in the “specific” compared to the “unspecific” condition, despite equal sound probabilities. These results thus demonstrate that action-effect predictions can boost stochastic regularity-based predictions and engage higher-order deviance detection processes, extending previous notions on the role of action predictions at sensory levels.

scholarly journals Active Inference: Applicability to Different Types of Social Organization Explained through Reference to Industrial Engineering and Quality Management

Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 198
Author(s):  
Stephen Fox
Keyword(s):  
Artificial Intelligence ◽  
Quality Management ◽  
Social Organization ◽  
Generative Models ◽  
Industrial Engineering ◽  
Prediction Errors ◽  
Active Inference ◽  
For Profit ◽  
Different Types ◽  
Inference Theory

Active inference is a physics of life process theory of perception, action and learning that is applicable to natural and artificial agents. In this paper, active inference theory is related to different types of practice in social organization. Here, the term social organization is used to clarify that this paper does not encompass organization in biological systems. Rather, the paper addresses active inference in social organization that utilizes industrial engineering, quality management, and artificial intelligence alongside human intelligence. Social organization referred to in this paper can be in private companies, public institutions, other for-profit or not-for-profit organizations, and any combination of them. The relevance of active inference theory is explained in terms of variational free energy, prediction errors, generative models, and Markov blankets. Active inference theory is most relevant to the social organization of work that is highly repetitive. By contrast, there are more challenges involved in applying active inference theory for social organization of less repetitive endeavors such as one-of-a-kind projects. These challenges need to be addressed in order for active inference to provide a unifying framework for different types of social organization employing human and artificial intelligence.

scholarly journals Implementing Predictive Processing and Active Inference: Preliminary Steps and Results

2019 ◽  
Author(s):  
Beren Millidge
Keyword(s):  
Predictive Coding ◽  
Predictive Processing ◽  
Active Inference ◽  
Inference Models ◽  
Perceptual Model ◽  
Challenging Tasks ◽  
Generalised Coordinates

Initial and preliminary implementations of predictive processing and active inference models are presented. These include the baseline hierarchical predictive coding models of (Friston 2003, 2005), and dynamical predictive coding models using generalised coordinates (Friston 2008, 2010, Buckley 2017). Additionally, we re-implement and experiment with the active inference thermostat presented in (Buckley 2017) and also implement an active inference agent with a hierarchical predictive coding perceptual model on the more challenging cart-pole task from OpanAI gym. We discuss the initial performance, capabilities, and limitations of these models in their preliminary stages and consider how they might be further scaled up to tackle more challenging tasks.

scholarly journals ‘Through others we become ourselves’: The dialectics of predictive coding and active inference

2019 ◽  
Author(s):  
Dimitris Bolis ◽  
Leonhard Schilbach
Keyword(s):  
Free Energy ◽  
Social Interaction ◽  
Predictive Coding ◽  
Real Life ◽  
Other Minds ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
Multiscale Dynamics ◽  
Cultural Processes

Thinking Through Other Minds (TTOM) creatively situates the free energy principle within real-life cultural processes, thereby enriching both sociocultural theories and Bayesian accounts of cognition. Here, shifting the attention from thinking to becoming, we suggest complementing such an account by focusing on the empirical, computational and conceptual investigation of the multiscale dynamics of social interaction.

scholarly journals Future-Proofing Startups: Stress Management Principles Based on Adaptive Calibration Model and Active Inference Theory

Entropy ◽  
2021 ◽  
Vol 23 (9) ◽  
pp. 1155
Author(s):  
Stephen Fox
Keyword(s):  
Stress Management ◽  
Life Histories ◽  
Internal State ◽  
Generative Models ◽  
Calibration Model ◽  
Active Inference ◽  
Ecological Fitness ◽  
Adaptive Calibration ◽  
Stress Responsivity ◽  
Inference Theory

In this paper, the Adaptive Calibration Model (ACM) and Active Inference Theory (AIT) are related to future-proofing startups. ACM encompasses the allocation of energy by the stress response system to alternative options for action, depending upon individuals’ life histories and changing external contexts. More broadly, within AIT, it is posited that humans survive by taking action to align their internal generative models with sensory inputs from external states. The first contribution of the paper is to address the need for future-proofing methods for startups by providing eight stress management principles based on ACM and AIT. Future-proofing methods are needed because, typically, nine out of ten startups do not survive. A second contribution is to relate ACM and AIT to startup life cycle stages. The third contribution is to provide practical examples that show the broader relevance ACM and AIT to organizational practice. These contributions go beyond previous literature concerned with entrepreneurial stress and organizational stress. In particular, rather than focusing on particular stressors, this paper is focused on the recalibrating/updating of startups’ stress responsivity patterns in relation to changes in the internal state of the startup and/or changes in the external state. Overall, the paper makes a contribution to relating physics of life constructs concerned with energy, action and ecological fitness to human organizations.

scholarly journals The cutaneous borders of interoception: Active and social inference of pain and pleasure on the skin

2018 ◽  
Author(s):  
Mariana von Mohr ◽  
Aikaterini Fotopoulou
Keyword(s):  
Social Factors ◽  
Predictive Coding ◽  
Active Inference ◽  
Top Down ◽  
Bottom Up ◽  
Social Inference ◽  
Brain Levels ◽  
The Brain

Pain and pleasant touch have been recently classified as interoceptive modalities. This reclassification lies at the heart of long-standing debates questioning whether these modalities should be defined as sensations on their basis of neurophysiological specificity at the periphery or as homeostatic emotions on the basis of top-down convergence and modulation at the spinal and brain levels. Here, we outline the literature on the peripheral and central neurophysiology of pain and pleasant touch. We next recast this literature within a recent Bayesian predictive coding framework, namely active inference. This recasting puts forward a unifying model of bottom-up and top-down determinants of pain and pleasant touch and the role of social factors in modulating the salience of peripheral signals reaching the brain.

scholarly journals Combining Active Inference and Hierarchical Predictive Coding: A Tutorial Introduction and Case Study

2019 ◽  
Author(s):  
Beren Millidge
Keyword(s):  
Free Energy ◽  
Reinforcement Learning ◽  
Predictive Coding ◽  
Action Selection ◽  
Proof Of Concept ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
Perceptual Model

This paper combines the active inference formulation of action (Friston, 2009) with hierarchical predictive coding models (Friston, 2003) to provide a proof-of-concept implementation of an active inference agent able to solve a common reinforcement learning baseline -- the cart-pole environment in OpenAI gym. It demonstrates empirically that predictive coding and active inference approaches can be successfully scaled up to tasks more challenging than the mountain car (Friston 2009, 2012). We show that hierarchical predictive coding models can be learned from scratch during the task, and can successfully drive action selection via active inference. To our knowledge, it is the first implemented active inference agent to combine active inference with a hierarchical predictive coding perceptual model. We also provide a tutorial walk-through of the free-energy principle, hierarchical predictive coding, and active inference, including an in-depth derivation of our agent.

Sign in / Sign up

Export Citation Format

Share Document