scholarly journals Integrated World Modeling Theory (IWMT) Expanded: Implications for Theories of Consciousness and Artificial Intelligence

2021 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Graphical Models ◽  
Turbo Codes ◽  
Intelligent Systems ◽  
Causal Structure ◽  
Predictive Processing ◽  
Active Inference ◽  
Energy Principle ◽  
World Modeling ◽  
Modeling Theory ◽  
Integrated Information

Integrated World Modeling Theory (IWMT) is a synthetic theory of consciousness that uses the Free Energy Principle and Active Inference (FEP-AI) framework to combine insights from Integrated Information Theory (IIT) and Global Neuronal Workspace Theory (GNWT). Here, I first review philosophical principles and neural systems contributing to IWMT’s integrative perspective. I then go on to describe predictive processing models of brains and their connections to machine learning architectures, with particular emphasis on autoencoders (perceptual and active inference), turbo-codes (establishment of shared latent spaces for multi-modal integration and inferential synergy), and graph neural networks (spatial and somatic modeling and control). Particular emphasis is placed on the hippocampal/entorhinal system, which may provide a source of high-level reasoning via predictive contrasting and generalized navigation, so affording multiple kinds of conscious access. Future directions for IIT and GNWT are considered by exploring ways in which modules and workspaces may be evaluated as both complexes of integrated information and arenas for iterated Bayesian model selection. Based on these considerations, I suggest novel ways in which integrated information might be estimated using concepts from probabilistic graphical models, flow networks, and game theory. Mechanistic and computational principles are also considered with respect to the ongoing debate between IIT and GNWT regarding the physical substrates of different kinds of conscious and unconscious phenomena. I further explore how these ideas might relate to the “Bayesian blur problem”, or how it is that a seemingly discrete experience can be generated from probabilistic modeling, with some consideration of analogies from quantum mechanics as potentially revealing different varieties of inferential dynamics. Finally, I go on to describe parallels between FEP-AI and theories of universal intelligence, including with respect to implications for the future of artificially intelligent systems. Particular emphasis is given to recurrent computation and its relationships with feedforward processing, including potential means of addressing critiques of causal structure theories based on network unfolding, and the seeming absurdity of conscious expander graphs (without cybernetic symbol grounding). While not quite solving the Hard problem, this article expands on IWMT as a unifying model of consciousness and the potential future evolution of minds.

scholarly journals An Integrated World Modeling Theory (IWMT) of consciousness: Combining Integrated Information and Global Neuronal Workspace Theories with the Free Energy Principle and Active Inference Framework; towards solving the Hard problem and characterizing agentic causation

2019 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Free Energy ◽  
Turbo Codes ◽  
Subjective Experience ◽  
Synthetic Approach ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
World Modeling ◽  
Modeling Theory ◽  
Integrated Information

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement loopy message passing (cf. turbo-codes) over predictive (autoencoding) networks, so generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, so affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, so enabling inferential synergy.

scholarly journals Integrated World Modeling Theory (IWMT) Implemented: Towards Reverse Engineering Consciousness with the Free Energy Principle and Active Inference

2020 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Free Energy ◽  
Reference Frames ◽  
Phenomenal Consciousness ◽  
Predictive Processing ◽  
Active Inference ◽  
Perceptual Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
World Modeling ◽  
Modeling Theory

Integrated World Modeling Theory (IWMT) is a synthetic model that attempts to unify theories of consciousness within the Free Energy Principle and Active Inference framework, with particular emphasis on Integrated Information Theory (IIT) and Global Neuronal Workspace Theory (GNWT). IWMT further suggests predictive processing in sensory hierarchies may be well-modeled as (folded, sparse, partially disentangled) variational autoencoders, with beliefs discretely-updated via the formation of synchronous complexes—as self-organizing harmonic modes (SOHMs)—potentially entailing maximal a posteriori (MAP) estimation via turbo coding. In this account, alpha-synchronized SOHMs across posterior cortices may constitute the kinds of maximal complexes described by IIT, as well as samples (or MAP estimates) from multimodal shared latent space, organized according to egocentric reference frames, entailing phenomenal consciousness as mid-level perceptual inference. When these posterior SOHMs couple with frontal complexes, this may enable various forms of conscious access as a kind of mental act(ive inference), affording higher order cognition/control, including the kinds of attentional/intentional processing and reportability described by GNWT. Across this autoencoding heterarchy, intermediate-level beliefs may be organized into spatiotemporal trajectories by the entorhinal/hippocampal system, so affording episodic memory, counterfactual imaginings, and planning.

scholarly journals An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation

2020 ◽  
Vol 3 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Free Energy ◽  
Subjective Experience ◽  
Reference Frames ◽  
Synthetic Approach ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
World Modeling ◽  
Modeling Theory ◽  
Integrated Information

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement turbo coding via loopy message-passing over predictive (autoencoding) networks, thus generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, thus affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, thus enabling inferential synergy.

scholarly journals A tale of two densities: active inference is enactive inference

2019 ◽  
Vol 28 (4) ◽  
pp. 225-239 ◽  
Author(s):  
Maxwell JD Ramstead ◽  
Michael D Kirchhoff ◽  
Karl J Friston
Keyword(s):  
Predictive Coding ◽  
Generative Models ◽  
Predictive Processing ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
The One ◽  
And Control ◽  
The Brain ◽  
Selection Of

The aim of this article is to clarify how best to interpret some of the central constructs that underwrite the free-energy principle (FEP) – and its corollary, active inference – in theoretical neuroscience and biology: namely, the role that generative models and variational densities play in this theory. We argue that these constructs have been systematically misrepresented in the literature, because of the conflation between the FEP and active inference, on the one hand, and distinct (albeit closely related) Bayesian formulations, centred on the brain – variously known as predictive processing, predictive coding or the prediction error minimisation framework. More specifically, we examine two contrasting interpretations of these models: a structural representationalist interpretation and an enactive interpretation. We argue that the structural representationalist interpretation of generative and recognition models does not do justice to the role that these constructs play in active inference under the FEP. We propose an enactive interpretation of active inference – what might be called enactive inference. In active inference under the FEP, the generative and recognition models are best cast as realising inference and control – the self-organising, belief-guided selection of action policies – and do not have the properties ascribed by structural representationalists.

scholarly journals World Modeling, Integrated Information, and the Physical Substrates of Consciousness; Hidden Sources of the Stream of Experience?

2021 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Information Theory ◽  
Subjective Experience ◽  
Hard Problem ◽  
Synthetic Theory ◽  
World Modeling ◽  
Modeling Theory ◽  
The Hard Problem ◽  
Integrated Information Theory ◽  
Integrated Information

In this brief commentary on The Hidden Spring: A Journey to the Source of Consciousness, I describe ways in which Mark Solms’ account of the origins of subjective experience relates to Integrated World Modeling Theory (IWMT). IWMT is a synthetic theory that brings together different perspectives, with the ultimate goal of solving the enduring problems of consciousness, including the Hard problem. I describe points of compatibility and incompatibility between Solms’ proposal and IWMT, with particular emphasis on how a Bayesian interpretation of Integrated Information Theory and Global (Neuronal) Workspace Theory may help identify the physical and computational substrates of consciousness.

scholarly journals Integrated World Modeling Theory (IWMT) Revisited

2019 ◽  
Author(s):  
Adam Safron
Keyword(s):  
Hard Problem ◽  
Energy Principle ◽  
Brain Functioning ◽  
Practical Applications ◽  
Theories Of Mind ◽  
Third Person ◽  
Impossible Task ◽  
World Modeling ◽  
Modeling Theory ◽  
The Hard Problem

Here, I provide clarifications and discuss further issues relating to Safron (2020), “An Integrated World Modeling Theory (IWMT) of consciousness: Combining Integrated Information and Global Workspace Theories with the Free Energy Principle and Active Inference Framework; towards solving the Hard problem and characterizing agentic causation.” As a synthesis of major theories of complex systems and consciousness, with IWMT we may be able to address some of the most difficult problems in the sciences. This is a claim deserving of close scrutiny and much skepticism. What would it take to solve the Hard problem? One could answer the question of how it is possible that something like subjectivity could emerge from objective brain functioning (i.e., moving from a third person to a first person ontology), but a truly satisfying account might still require solving all the “easy” and “real” problems of consciousness. In this way, IWMT does not claim to definitively solve the Hard problem, as explaining all the particular ways that things feel across all relevant aspects of experience is likely an impossible task. Nonetheless, IWMT does claim to have made major inroads into our understanding of consciousness, and here I will attempt to justify this position by discussing challenging problems and outstanding questions with respect to philosophy, (neuro)phenomenology, computational principles, practical applications, and implications for existing theories of mind and life.

scholarly journals Bayesian theories of consciousness: a review in search for a minimal unifying model

2021 ◽  
Vol 2021 (2) ◽  
Author(s):  
Wiktor Rorot
Keyword(s):  
Free Energy ◽  
Conscious Experience ◽  
Generative Model ◽  
Predictive Processing ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle

Abstract The goal of the paper is to review existing work on consciousness within the frameworks of Predictive Processing, Active Inference, and Free Energy Principle. The emphasis is put on the role played by the precision and complexity of the internal generative model. In the light of those proposals, these two properties appear to be the minimal necessary components for the emergence of conscious experience—a Minimal Unifying Model of consciousness.

scholarly journals Predicting green: really radical (plant) predictive processing

2017 ◽  
Vol 14 (131) ◽  
pp. 20170096 ◽  
Author(s):  
Paco Calvo ◽  
Karl Friston
Keyword(s):  
Free Energy ◽  
Biological Systems ◽  
Local Environment ◽  
Sensory Stimulation ◽  
Predictive Processing ◽  
Active Inference ◽  
Energy Principle ◽  
Free Energy Principle ◽  
Adaptive Value ◽  
Plant Behaviour

In this article we account for the way plants respond to salient features of their environment under the free-energy principle for biological systems. Biological self-organization amounts to the minimization of surprise over time. We posit that any self-organizing system must embody a generative model whose predictions ensure that (expected) free energy is minimized through action. Plants respond in a fast, and yet coordinated manner, to environmental contingencies. They pro-actively sample their local environment to elicit information with an adaptive value. Our main thesis is that plant behaviour takes place by way of a process (active inference) that predicts the environmental sources of sensory stimulation. This principle, we argue, endows plants with a form of perception that underwrites purposeful, anticipatory behaviour. The aim of the article is to assess the prospects of a radical predictive processing story that would follow naturally from the free-energy principle for biological systems; an approach that may ultimately bear upon our understanding of life and cognition more broadly.

scholarly journals Predictive Processing in Cognitive Robotics: A Review

2021 ◽  
Vol 33 (5) ◽  
pp. 1402-1432
Author(s):  
Alejandra Ciria ◽  
Guido Schillaci ◽  
Giovanni Pezzulo ◽  
Verena V. Hafner ◽  
Bruno Lara
Keyword(s):  
Prediction Error ◽  
Predictive Coding ◽  
Cognitive Robotics ◽  
Predictive Processing ◽  
Limited Attention ◽  
Active Inference ◽  
Perceptual Inference ◽  
Energy Principle ◽  
Clear Cut ◽  
Processing Framework

Abstract Predictive processing has become an influential framework in cognitive sciences. This framework turns the traditional view of perception upside down, claiming that the main flow of information processing is realized in a top-down, hierarchical manner. Furthermore, it aims at unifying perception, cognition, and action as a single inferential process. However, in the related literature, the predictive processing framework and its associated schemes, such as predictive coding, active inference, perceptual inference, and free-energy principle, tend to be used interchangeably. In the field of cognitive robotics, there is no clear-cut distinction on which schemes have been implemented and under which assumptions. In this letter, working definitions are set with the main aim of analyzing the state of the art in cognitive robotics research working under the predictive processing framework as well as some related nonrobotic models. The analysis suggests that, first, research in both cognitive robotics implementations and nonrobotic models needs to be extended to the study of how multiple exteroceptive modalities can be integrated into prediction error minimization schemes. Second, a relevant distinction found here is that cognitive robotics implementations tend to emphasize the learning of a generative model, while in nonrobotics models, it is almost absent. Third, despite the relevance for active inference, few cognitive robotics implementations examine the issues around control and whether it should result from the substitution of inverse models with proprioceptive predictions. Finally, limited attention has been placed on precision weighting and the tracking of prediction error dynamics. These mechanisms should help to explore more complex behaviors and tasks in cognitive robotics research under the predictive processing framework.

Sign in / Sign up

Export Citation Format

Share Document