scholarly journals Sensory Substitution and Perceptual Emergence

2018 ◽  
pp. 205-235
Author(s):  
Jonathan Cohen
Keyword(s):  
Light Intensity ◽  
Full Range ◽  
Sensory Substitution ◽  
Basic Form ◽  
Simple Idea ◽  
Emergent Features ◽  
Sensory Modalities ◽  
Perceptual Modalities

Designers of sensory substitution devices (SSDs) typically aim to capture a wide representational scope by requiring their devices to present in the substituting modality the full range of basic energy available to the substituted modality, and then using this information to code up any further representations needed. On this view, if we could build a device that represents to touch (say) the distal distribution of light intensity—the basic form of energy to which visual receptors are normally responsive—our device could, in principle, represent everything available to vision: colour, shape, form, motion, and so on. Unfortunately, I will argue, this simple idea fails. For perceptual modalities represent ‘emergent’ features —i.e. features whose exemplification is not fixed by the representation of the distribution of basic energy. Hence, an SSD whose basic representational vocabulary is limited to the distribution of such basic energy will leave things out. None of this shows that SSDs will inevitably fail to represent what sensory modalities normally represent. It does suggest, however, that if we want them to represent what sensory modalities normally represent, we will have to do more than preserve the representation of basic energy to which the substituted modalities are sensitive.

Sensory Substitution Devices as Advanced Sensory Tools

2018 ◽  
pp. 188-204
Author(s):  
Thomas D. Wright ◽  
Jamie Ward
Keyword(s):  
Nervous System ◽  
Sensory Information ◽  
Sensory Substitution ◽  
Considerable Effort ◽  
Conceptual Space ◽  
System P ◽  
Starting Point ◽  
Sensory Modalities ◽  
Magnetic Sense ◽  
Definition Of

There has been considerable effort devoted towards understanding sensory substitution devices in terms of their relationship to canonical sensory modalities. The approach taken in this essay is rather different, although complementary, in that we seek to define a broad conceptual space of ‘sensory tools’ in which sensory substitution devices can be situated. Such devices range from telescopes, to cochlear implants, to attempts to create a magnetic sense. One feature of these devices is that they operate at the level of ‘raw’ sensory information. As such, systems such as Braille which operate at a symbolic/conceptual level do not count as a sensory tool (or a sensory substitution device) and nor would a device such as CCTV which, although capturing raw sensory information, would not meet a conventional definition of a tool. With this approach, we hope to avoid the circularity inherent in previous attempts at defining sensory substitution and provide a better starting point to explore the effects of sensory tools, more generally, on the functioning of the nervous system.

scholarly journals Interoception: the forgotten modality in perceptual grounding of abstract and concrete concepts

2018 ◽  
Vol 373 (1752) ◽  
pp. 20170143 ◽  
Author(s):  
Louise Connell ◽  
Dermot Lynott ◽  
Briony Banks
Keyword(s):  
The Body ◽  
Abstract Concepts ◽  
Conceptual Content ◽  
Sensory Modalities ◽  
Perceptual Modalities ◽  
Five Senses ◽  
Concrete Concepts ◽  
Taste And Smell ◽  
The Brain ◽  
Emotion Concepts

Conceptual representations are perceptually grounded, but when investigating which perceptual modalities are involved, researchers have typically restricted their consideration to vision, touch, hearing, taste and smell. However, there is another major modality of perceptual information that is distinct from these traditional five senses; that is, interoception, or sensations inside the body. In this paper, we use megastudy data (modality-specific ratings of perceptual strength for over 32 000 words) to explore how interoceptive information contributes to the perceptual grounding of abstract and concrete concepts. We report how interoceptive strength captures a distinct form of perceptual experience across the abstract–concrete spectrum, but is markedly more important to abstract concepts (e.g. hungry , serenity ) than to concrete concepts (e.g. capacity , rainy ). In particular, interoception dominates emotion concepts, especially negative emotions relating to fear and sadness , moreso than other concepts of equivalent abstractness and valence. Finally, we examine whether interoceptive strength represents valuable information in conceptual content by investigating its role in concreteness effects in word recognition, and find that it enhances semantic facilitation over and above the traditional five sensory modalities. Overall, these findings suggest that interoception has comparable status to other modalities in contributing to the perceptual grounding of abstract and concrete concepts. This article is part of the theme issue ‘Varieties of abstract concepts: development, use and representation in the brain'.

Perceptual recalibration in sensory substitution and perceptual modification

2005 ◽  
Vol 13 (3) ◽  
pp. 481-500 ◽  
Author(s):  
Juan C. González ◽  
Paul Bach-y-Rita ◽  
Steven J. Haase
Keyword(s):  
Nervous System ◽  
Adaptive Capacity ◽  
Spatial Perception ◽  
Sensory Substitution ◽  
Dynamic Character ◽  
Sensory Modalities ◽  
Theoretical Issues

This paper analyzes the process of perceptual recalibration (PR) in light of two cases of technologically-mediated cognition: sensory substitution and perceptual modification. We hold that PR is a very useful concept — perhaps necessary — for explaining the adaptive capacity that natural perceptive systems display as they respond to functional demands from the environment. We also survey critically related issues, such as the role of learning, training, and nervous system plasticity in the recalibrating process. Attention is given to the interaction between technology and cognition, and the case of epistemic prostheses is presented as an illustration. Finally, we address the following theoretical issues: (1) the dynamic character of spatial perception; (2) the role of functional demands in perception; (3) the nature and interaction of sensory modalities. We aim to show that these issues may be addressed empirically and conceptually — hence, the usefulness of sensory-substitution and perceptual-modification studies in the analysis of perception, technologically-mediated cognition, and cognition in general.

scholarly journals Backward spatial perception can be augmented through a novel visual-to-auditory sensory substitution algorithm

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Ophir Netzer ◽  
Benedetta Heimler ◽  
Amir Shur ◽  
Tomer Behor ◽  
Amir Amedi
Keyword(s):  
Spatial Perception ◽  
Sensory Information ◽  
Sensory Systems ◽  
Sensory Substitution ◽  
Sensory Augmentation ◽  
Visual Spatial ◽  
Sensory Modalities ◽  
Human Perceptions ◽  
Key Features ◽  
Spatial Fields

AbstractCan humans extend and augment their natural perceptions during adulthood? Here, we address this fascinating question by investigating the extent to which it is possible to successfully augment visual spatial perception to include the backward spatial field (a region where humans are naturally blind) via other sensory modalities (i.e., audition). We thus developed a sensory-substitution algorithm, the “Topo-Speech” which conveys identity of objects through language, and their exact locations via vocal-sound manipulations, namely two key features of visual spatial perception. Using two different groups of blindfolded sighted participants, we tested the efficacy of this algorithm to successfully convey location of objects in the forward or backward spatial fields following ~ 10 min of training. Results showed that blindfolded sighted adults successfully used the Topo-Speech to locate objects on a 3 × 3 grid either positioned in front of them (forward condition), or behind their back (backward condition). Crucially, performances in the two conditions were entirely comparable. This suggests that novel spatial sensory information conveyed via our existing sensory systems can be successfully encoded to extend/augment human perceptions. The implications of these results are discussed in relation to spatial perception, sensory augmentation and sensory rehabilitation.

scholarly journals Proprioception Has Limited Influence on Tactile Reference Frame Selection

2020 ◽  
Author(s):  
Or Yizhar ◽  
Galit Buchs ◽  
Benedetta Heimler ◽  
Doron Friedman ◽  
Amir Amedi
Keyword(s):  
Reference Frame ◽  
Visual Information ◽  
Spatial Location ◽  
Sensory Substitution ◽  
Visual Modality ◽  
Localization Task ◽  
Sensory Modalities ◽  
Reference Frame Selection ◽  
Proprioceptive Inputs

ABSTRACTPerceiving the spatial location and physical dimensions of objects that we touch is crucial for goal-directed actions. To achieve this, our brain transforms skin-based coordinates into a reference frame by integrating visual and proprioceptive cues, a process known as tactile remapping. In the current study, we examine the role of proprioception in the remapping process when information from the more dominant visual modality is withheld. We developed a new visual-to-touch sensory substitution device and asked participants to perform a spatial localization task in three different arm postures that included posture switches between blocks of trials. We observed that in the absence of visual information novel proprioceptive inputs can be overridden after switching postures. This behavior demonstrates effective top-down modulations of proprioception and points to the unequal contribution of different sensory modalities to tactile remapping.

Sensory Substitution: From Sensations to Phenomenology

2018 ◽  
pp. 43-59
Author(s):  
Laurent Renier
Keyword(s):  
Brain Plasticity ◽  
Sensory Modality ◽  
Human Perception ◽  
Sensory Substitution ◽  
Short Overview ◽  
Technological Advances ◽  
Sensory Modalities ◽  
Original Sense ◽  
New Form ◽  
Definition Of

Sensory substitution refers to the use of one sensory modality (e.g. hearing) to supply environmental information normally gathered by another sense (e.g. vision) while still preserving some of the key functions of the original sense. For example, the use of auditory signals might give information about visual scenes. The development of sensory substitution devices has profoundly changed the classical definition of sensory modalities and contributed to the emergence of a new form of perception. In the last decade, our knowledge about cognitive and brain mechanisms involved in sensory substitution has grown considerably, bringing new insights into human perception. The phenomenological experience of perceiving via a sensory substitution device can now be discussed in the light of current scientific knowledge. Thanks to technological advances and scientific achievements, sensory substitution has become a real alternative for restoring some functions of a defective sensory organ (e.g. sight in the case of blindness or hearing in the case of deafness). This essay addresses some of the major questions raised by sensory substitution, including discussions regarding the nature of perception arising from the use of such devices, demonstrates how the study of sensory substitution enhances our understanding of human perception and brain plasticity and provides a short overview of rehabilitation potentialities.

scholarly journals Looking into Task-Specific Activation Using a Prosthesis Substituting Vision with Audition

2012 ◽  
Vol 2012 ◽  
pp. 1-15 ◽  
Author(s):  
Paula Plaza ◽  
Isabel Cuevas ◽  
Cécile Grandin ◽  
Anne G. De Volder ◽  
Laurent Renier
Keyword(s):  
Brain Activity ◽  
Sensory Substitution ◽  
Functional Magnetic Resonance ◽  
Resonance Imaging ◽  
Brain Areas ◽  
Visual Stream ◽  
Sensory Modalities ◽  
The Right ◽  
Dorsal Visual Stream ◽  
The Brain

A visual-to-auditory sensory substitution device initially developed for the blind is known to allow visual-like perception through sequential exploratory strategies. Here we used functional magnetic resonance imaging (fMRI) to test whether processing the location versus the orientation of simple (elementary) “visual” stimuli encoded into sounds using the device modulates the brain activity within the dorsal visual stream in the absence of sequential exploration of these stimuli. Location and orientation detection with the device induced a similar recruitment of frontoparietal brain areas in blindfolded sighted subjects as the corresponding tasks using the same stimuli in the same subjects in vision. We observed a similar preference of the right superior parietal lobule for spatial localization over orientation processing in both sensory modalities. This provides evidence that the parietal cortex activation during the use of the prosthesis is task related and further indicates the multisensory recruitment of the dorsal visual pathway in spatial processing.

scholarly journals Dutch Sensory Modality Norms

2020 ◽  
Author(s):  
Laura Jane Speed ◽  
Marc Brysbaert
Keyword(s):  
Word Processing ◽  
Sensory Modality ◽  
Word Meaning ◽  
Open Science ◽  
Perceptual Modality ◽  
Sensory Modalities ◽  
Perceptual Modalities ◽  
Word Classes ◽  
Science Framework ◽  
The Relationship

Word meaning is thought to be grounded in the sensory modalities. In order to test such hypotheses in experiments, linguistic stimuli needs to be carefully selected and controlled for. To aid in such investigations, we present a new set of sensory modality norms for over 24,000 Dutch words. The sensory norms comprise perceptual strength ratings in six perceptual modalities: audition, gustation, haptics, olfaction, vision, and interoception. The new norms improve on existing Dutch sensory norms in three ways: 1) they significantly expand on the number of words rated; 2) they include multiple word classes; 3) they add a new perceptual modality: interoception. We show that the sensory norms are able to predict word processing behavior and outperform existing ratings of sensory experience: concreteness and imageability. The data are available via the Open Science Framework (https://osf.io/ubvy2) and serve as a valuable resource for research into the relationship between language and perception.

Fine structure of the retina of the giant scallop, Placopecten magellanicus

1984 ◽  
Vol 42 ◽  
pp. 312-313
Author(s):  
C.V.L. Powell
Keyword(s):  
Fine Structure ◽  
Electron Microscope ◽  
Light Intensity ◽  
Scanning Electron Microscope ◽  
Eye Development ◽  
Preliminary Observation ◽  
Columnar Epithelium ◽  
Placopecten Magellanicus ◽  
Environmental Light ◽  
Scanning Electron

The overall fine structure of the eye in Placopecten is similar to that of other scallops. The optic tentacle consists of an outer columnar epithelium which is modified into a pigmented iris and a cornea (Fig. 1). This capsule encloses the cellular lens, retina, reflecting argentea and the pigmented tapetum. The retina is divided into two parts (Fig. 2). The distal retina functions in the detection of movement and the proximal retina monitors environmental light intensity. The purpose of the present study is to describe the ultrastructure of the retina as a preliminary observation on eye development. This is also the first known presentation of scanning electron microscope studies of the eye of the scallop.

Effect of light intensity on the ultrastructure of the filamentous cyanobacterium, Anabaena variabilis

1988 ◽  
Vol 46 ◽  
pp. 300-301
Author(s):  
C. S. Bricker ◽  
S. R. Barnum ◽  
B. Huang ◽  
J. G. Jaworskl
Keyword(s):  
Fatty Acid ◽  
Light Intensity ◽  
Acid Content ◽  
Fatty Acid Content ◽  
Anabaena Variabilis ◽  
Chloroplast Envelope ◽  
Major Constituent ◽  
Filamentous Cyanobacterium ◽  
Photosynthetic Membrane ◽  
Effect Of Light

Cyanobacteria are Gram negative prokaryotes that are capable of oxygenic photosynthesis. Although there are many similarities between eukaryotes and cyanobacteria in electron transfer and phosphorylation during photosynthesis, there are two features of the photosynthetic apparatus in cyanobacteria which distinguishes them from plants. Cyanobacteria contain phycobiliproteins organized in phycobilisomes on the surface of photosynthetic membrane. Another difference is in the organization of the photosynthetic membranes. Instead of stacked thylakolds within a chloroplast envelope membrane, as seen In eukaryotes, IntracytopIasmlc membranes generally are arranged in three to six concentric layers. Environmental factors such as temperature, nutrition and light fluency can significantly affect the physiology and morphology of cells. The effect of light Intensity shifts on the ultrastructure of Internal membrane in Anabaena variabilis grown under controlled environmental conditions was examined. Since a major constituent of cyanobacterial thylakolds are lipids, the fatty acid content also was measured and correlated with uItrastructural changes. The regulation of fatty acid synthesis in cyanobacteria ultimately can be studied if the fatty acid content can be manipulated.

Sign in / Sign up

Export Citation Format

Share Document