scholarly journals Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval

2021 ◽  
Vol 15 ◽  
Author(s):  
Viorica Marian ◽  
Sayuri Hayakawa ◽  
Scott R. Schroeder

How we perceive and learn about our environment is influenced by our prior experiences and existing representations of the world. Top-down cognitive processes, such as attention and expectations, can alter how we process sensory stimuli, both within a modality (e.g., effects of auditory experience on auditory perception), as well as across modalities (e.g., effects of visual feedback on sound localization). Here, we demonstrate that experience with different types of auditory input (spoken words vs. environmental sounds) modulates how humans remember concurrently-presented visual objects. Participants viewed a series of line drawings (e.g., picture of a cat) displayed in one of four quadrants while listening to a word or sound that was congruent (e.g., “cat” or <meow>), incongruent (e.g., “motorcycle” or <vroom–vroom>), or neutral (e.g., a meaningless pseudoword or a tonal beep) relative to the picture. Following the encoding phase, participants were presented with the original drawings plus new drawings and asked to indicate whether each one was “old” or “new.” If a drawing was designated as “old,” participants then reported where it had been displayed. We find that words and sounds both elicit more accurate memory for what objects were previously seen, but only congruent environmental sounds enhance memory for where objects were positioned – this, despite the fact that the auditory stimuli were not meaningful spatial cues of the objects’ locations on the screen. Given that during real-world listening conditions, environmental sounds, but not words, reliably originate from the location of their referents, listening to sounds may attune the visual dorsal pathway to facilitate attention and memory for objects’ locations. We propose that audio-visual associations in the environment and in our previous experience jointly contribute to visual memory, strengthening visual memory through exposure to auditory input.

Author(s):  
Shima Habib Zadeh ◽  
Nematollah Rouhbakhsh ◽  
Ghasem Mohammadkhani

Background and Aim: Early experience, prov­ide opportunity for later associative experiential learning by affecting multisensory systems. This phenomenon may because of the influences which sensory stimuli as sounds would have on non-auditory neural centers rather than just dep-loying hearing system, so the question is wheth­er music as a kind of complex sound source, could help in general cognitive functions such as memory circuits or, conversely, it acts as a distracting factor. This study was investigated the effect of auditory experience with special kind of music, called polyphonic music, on auditory, visual and logical memories function. Methods: Forty volunteers with normal hear­ing, aged 18 to 40 years, were participated in this experimental study. They were performed with Ray auditory verbal learning test, Kim Karad visual memory test, and Wechsler logical memory subtest in two states: no-music con­dition and music condition with a polyphonic piece as background music. Memory functions in these two conditions, and the effect of gender on performances, were compared between con­ditions. Results: Polyphonic music significantly inc­reased auditory, visual and logical memory performance compared with the no-music con­ditions (p < 0.05). No significant difference bet­ween genders was found in memory tasks in both music and no-music conditions (p > 0.05). Conclusion: It seems that presence of poly­phonic music while people had enough auditory experience about it, impress memory perfor­mance. It is possibly owning to multisensory functions of brain and the effect of auditory experiences on cognitive system.


2021 ◽  
pp. 1-12
Author(s):  
Rachael A. Lawson ◽  
Caroline H. Williams-Gray ◽  
Marta Camacho ◽  
Gordon W. Duncan ◽  
Tien K. Khoo ◽  
...  

Background: Cognitive impairment is common in Parkinson’s disease (PD), with 80% cumulatively developing dementia (PDD). Objective: We sought to identify tests that are sensitive to change over time above normal ageing so as to refine the neuropsychological tests predictive of PDD. Methods: Participants with newly diagnosed PD (n = 211) and age-matched controls (n = 99) completed a range of clinical and neuropsychological tests as part of the ICICLE-PD study at 18-month intervals over 72 months. Impairments on tests were determined using control means (<1-2SD) and median scores. Mild cognitive impairment (PD-MCI) was classified using 1-2SD below normative values. Linear mixed effects modelling assessed cognitive decline, while Cox regression identified baseline predictors of PDD. Results: At 72 months, 46 (cumulative probability 33.9%) participants had developed PDD; these participants declined at a faster rate in tests of global cognition, verbal fluency, memory and attention (p <  0.05) compared to those who remained dementia-free. Impaired baseline global cognition, visual memory and attention using median cut-offs were the best predictors of early PDD (area under the curve [AUC] = 0.88, p <  0.001) compared to control-generated cut-offs (AUC = 0.76–0.84, p <  0.001) and PD-MCI (AUC] = 0.64–0.81, p <  0.001). Impaired global cognition and semantic fluency were the most useful brief tests employable in a clinical setting (AUC = 0.79, p <  0.001). Conclusion: Verbal fluency, attention and memory were sensitive to change in early PDD and may be suitable tests to measure therapeutic response in future interventions. Impaired global cognition, attention and visual memory were the most accurate predictors for developing a PDD. Future studies could consider adopting these tests for patient clinical trial stratification.


2002 ◽  
Vol 45 (5) ◽  
pp. 891-901 ◽  
Author(s):  
Lisa Goffman ◽  
David J. Ertmer ◽  
Christa Erdle

A method is presented for examining change in motor patterns used to produce linguistic contrasts. In this case study, the method is applied to a child receiving new auditory input following cochlear implantation. This child experienced hearing loss at age 3 years and received a multichannel cochlear implant at age 7 years. Data collection points occurred both pre- and postimplant and included acoustic and kinematic analyses. Overall, this child's speech output was transcribed as accurate across the pre- and postimplant periods. Postimplant, with the onset of new auditory experience, acoustic durations showed a predictable maturational change, usually decreasing in duration. Conversely, the spatiotemporal stability of speech movements initially became more variable postimplantation. The auditory perturbations experienced by this child during development led to changes in the physiological underpinnings of speech production, even when speech output was perceived as accurate.


2020 ◽  
Author(s):  
Timothy P. McNamara ◽  
Xiaoli Chen

Spatial navigation is a complex cognitive activity that depends on perception, action, memory, reasoning, and problem solving. Effective navigation depends on the ability to combine information from multiple spatial cues to estimate one’s position and the locations of goals. Spatial cues include landmarks, and other visible features of the environment, and body-based cues generated by self-motion (vestibular, proprioceptive, &amp; efferent information). A number of projects have investigated the extent to which visual cues and body-based cues are combined optimally according to statistical principles. Possible limitations of these investigations are that they have not accounted for navigators’ prior experiences with or assumptions about the task environment and have not tested complete decision models. We examine cue combination in spatial navigation from a Bayesian perspective and present the fundamental principles of Bayesian decision theory. We show that a complete Bayesian decision model with an explicit loss function can explain a discrepancy between optimal cue weights and empirical cues weights observed by Chen, McNamara, Kelly and Wolbers (2017) and that the use of informative priors to represent cue bias can explain the incongruity between heading variability and heading direction observed by Zhao and Warren (2015b). We conclude that Bayesian decision theory offers a productive theoretical framework for investigating human spatial navigation and believe that it will lead to a deeper understanding of navigational behaviors.


2019 ◽  
Vol 12 (2) ◽  
pp. 61-74
Author(s):  
O. Razumnikova

It is known that aging is accompanied by a weakening of the processes of inhibition in the central nervous system, but with a significant individual variability. In connection with this, the purpose of the study was to study the patterns of these age effects using experimental models of executive control of attention and memory. It is shown that relationships between the intelligence, the speed of information selection, the volume of short-term visual memory and the indicator of proactive interference that obtained in twenty-year-old adults are disrupted in the sixty-year-olds. For both age groups, differentiation of memory strategies is characterized by either Retrieval-Induced Forgetting or Retrieval-Based Learning. Young with the dominance of the Retrieval-Induced Forgetting effect differ in higher intelligence from those who are characterized by the predominance of Retrieval-Based Learning strategies, and the elderly — the best executive control of attention. Therefore, despite the positive impact of Retrieval-Based Learning on memory, the effectiveness of cognitive activity in the elderly is more closely related to preserving of inhibitory functions in information interference processes.


2013 ◽  
Vol 2013 ◽  
pp. 1-10 ◽  
Author(s):  
Livia M. M. Pontes ◽  
Camila B. Martins ◽  
Isabel C. Napolitano ◽  
Juliana R. Fonseca ◽  
Graça M. R. Oliveira ◽  
...  

Cognitive deficits in schizophrenia can massively impact functionality and quality of life, furthering the importance of cognitive training. Despite the development of the field in Europe and in the United States, no programmes have been developed and tested in developing countries. Different cultural backgrounds, budget restrictions, and other difficulties may render treatment packages created in high income countries difficult for adoption by developing nations. We performed a pilot double-blind, randomized, controlled trial in order to investigate the efficacy and feasibility of an attention and memory training programme specially created in a developing nation. The intervention used simple, widely available materials, required minimal infrastructure, and was conducted in groups. The sample included seventeen stable Brazilians with schizophrenia. Sessions were conducted weekly during five months. The cognitive training group showed significant improvements in inhibitory control and set-shifting over time. Both groups showed improvements in symptoms, processing speed, selective attention, executive function, and long-term visual memory. Improvements were found in the control group in long-term verbal memory and concentration. Our findings reinforce the idea that cognitive training in schizophrenia can be constructed using simple resources and infrastructure, facilitating its adoption by developing countries, and it may improve cognition.


2019 ◽  
Vol 51 (4) ◽  
pp. 267-274
Author(s):  
Paul G. Nestor ◽  
Mayte Forte ◽  
Toshiyuki Ohtani ◽  
James J. Levitt ◽  
Dominick T. Newell ◽  
...  

We hypothesized that neuropsychological disturbance in schizophrenia (SZ) may reflect faulty interactions of executive attention and episodic memory, emanating, in part, from reduced prefrontal cortex (PFC) gray matter volume. Participants with SZ (n = 84) and age-matched (n = 77) controls completed both the Wisconsin Card Sorting Test (WCST) and the Wechsler Memory Scale–Third Edition (WMS-III), used, respectively, as measures of executive attention and episodic memory. A subset of SZ (n = 27) and control (n = 17) groups also had available 3-T magnetic resonance imaging (MRI) studies of the PFC. For SZ, but not control groups, neuropsychological results indicated that executive attention interacted significantly with episodic memory, with failures of executive attention, as reflected by increased WCST perseverative errors, directly linked to poor performance on the WMS-III measure of delayed visual recall of action scenes. MRI results indicated reduced left PFC gray matter volume for SZ group, which in turn correlated significantly with their deficits in visual memory but not in executive attention. Results showed that 61% of the variance in neuropsychological performance in the SZ group was attributed to gray matter volume of left inferior prefrontal gyrus gray matter volume. PFC-mediated failure of executive attention-episodic memory interactions may represent an important mechanism in neuropsychological disturbance in SZ.


2019 ◽  
Vol 34 (6) ◽  
pp. 910-910
Author(s):  
P Perez Delgadillo ◽  
L Hernandez ◽  
C Sadurni ◽  
C Santiago

Abstract Objective Neonatal jaundice (hyperbilirubinemia) remains present in 60% of births in the United States1. Current literature links hyperbilirubinemia with neurodevelopmental problems, particularly with attention deficit hyperactivity disorder (ADHD), general learning difficulties, and non-progressive developmental delays. Moderate elevations in bilirubin are also suggested to increase the risk for cognitive, perceptual, motor, and auditory disorders. Imaging studies have shown selective patterns of injury to specific brain regions associated with deficits in executive function, including impulse control and working memory as well as different subtypes of attention problems grounded in reward circuitry system dysfunction in children with bilirubin encephalopathy. Method Neuropsychological functioning of a 12-year old Hispanic female with a history of high levels of perinatal bilirubin, and subsequent developmental and cognitive difficulties in speech, learning, attention and memory as well as problems with socialization and anxiety is presented with the purpose of adding to existing literature. Comprehensive neuropsychiatric interview and neuropsychological testing was completed. Results Results revealed several areas of neurocognitive weaknesses with deficits in areas of intellectual functioning, learning (reading and mathematics), expressive language, visual memory, attention, and auditory processing. Emotional and behavioral measures evidenced significant deficits in social-emotional functioning, particularly with interpersonal skills, sense of adequacy, and self-reliance, which resulted in increased anxiety contributing to cognitive and academic deficits. Conclusions Neuropsychological profile was consistent with cognitive, academic, behavioral and emotional manifestations theoretically associated with neuropathological findings in hyperbilirubinemia. Furthermore, similar to existing literature, cognitive deficits were observed in the absence of a clear cause of neonatal jaundice following a full-term, uncomplicated pregnancy.


2021 ◽  
Vol 2 ◽  
Author(s):  
DeAnna Pinnow ◽  
H. Isabel Hubbard ◽  
Peter A. Meulenbroek

Introduction: Deficits in the cognitive domains of attention and memory leave a large impact on everyday activities that are not easily captured in the clinical environment. Therefore, clinicians are compelled to utilize assessment tools that elicit everyday functioning that include real-world contexts and distractions. As a result, the use of computer-assisted assessment has emerged as a tool for capturing everyday functioning in a variety of environments. The purpose of this scoping review is to map how virtual reality, augmented reality, and computer-based programs have implemented distractions for clinical populations.Methods: A scoping review of peer reviewed publications was conducted by searching Pubmed, PsychInfo, Web of Science, Rehabdata, and Scopus databases (1960-October 20, 2020). Authors completed hand-searches for additional published and unpublished studies.Results: Of 616 titles screened, 23 articles met inclusion criteria to include in this review. Primary distraction display modalities included computer monitor displays (n = 12) and head mounted displays (HMD) (n = 7). While computer-assisted assessments included distractions, no systematic approach was utilized to implement them. Primary distractions included both auditory and visual stimuli that were relevant to the task and/or simulated environment. Additional distraction characteristics emerged including location, timing, and intensity that can contribute to overall noticeability.Conclusion: From this review, the authors examined the literature on the implementation of distractions in simulated programming. The authors make recommendations regarding identification, measurement, and programming with suggestions that future studies examining metrics of attention to implement distraction in measurable and meaningful ways. Further, the authors propose that distraction does not universally impact performance negatively but can also enhance performance for clinical populations (e.g. additional sensory stimuli to support focused attention).


Sign in / Sign up

Export Citation Format

Share Document