scholarly journals Skilled lipreaders read and listen to lips

2017 ◽  
Author(s):  
S. Saalasti ◽  
J. Alho ◽  
J.M. Lahnakoski ◽  
M. Bacha-Trams ◽  
E. Glerean ◽  
...  

ABSTRACTOnly a few of us are skilled lipreaders while most struggle at the task. To illuminate the poorly understood neural substrate of this variability, we estimated the similarity of brain activity during lipreading, listening, and reading of the same 8-min narrative with subjects whose lipreading skill varied extensively. The similarity of brain activity was estimated by voxel-wise comparison of the BOLD signal time courses. Inter-subject correlation of the time courses revealed that lipreading and listening are supported by the same brain areas in temporal, parietal and frontal cortices, precuneus and cerebellum. However, lipreading activated only a small part of the neural network that is active during listening/reading the narrative, demonstrating that neural processing during lipreading vs. listening/reading differs substantially. Importantly, skilled lipreading was specifically associated with bilateral activity in the superior and middle temporal cortex, which also encode auditory speech. Our novel results both confirm previous results from few previous studies using isolated speech segments as stimuli but also extend in an important way understanding of neural mechanisms of lipreading.

2017 ◽  
Author(s):  
Raúl Hernández-Pérez ◽  
Luis Concha ◽  
Laura V. Cuaya

AbstractDogs can interpret emotional human faces (especially the ones expressing happiness), yet the cerebral correlates of this process are unknown. Using functional magnetic resonance imaging (fMRI) we studied eight awake and unrestrained dogs. In Experiment 1 dogs observed happy and neutral human faces, and found increased brain activity when viewing happy human faces in temporal cortex and caudate. In Experiment 2 the dogs were presented with human faces expressing happiness, anger, fear, or sadness. Using the resulting cluster from Experiment 1 we trained a linear support vector machine classifier to discriminate between pairs of emotions and found that it could only discriminate between happiness and the other emotions. Finally, evaluation of the whole-brain fMRI time courses through a similar classifier allowed us to predict the emotion being observed by the dogs. Our results show that human emotions are specifically represented in dogs’ brains, highlighting their importance for inter-species communication.


2019 ◽  
Vol 375 (1791) ◽  
pp. 20190299 ◽  
Author(s):  
Liina Pylkkänen

Language is our mind's most powerful generative system for the expression of meaning and thought. What are the neural mechanisms of our ability to compose complex meanings from simpler representations? This question is impossible to answer unless we decompose the notion of ‘meaning composition’ in some theoretically guided way and then begin to assess the extent to which brain activity tracks the posited subroutines. Here, I summarize results from a body of MEG research that has begun to address this question from the ground up, first focusing on simple combinations of two words. The work sets off with a hypothesis space offered by theoretical linguistics, positing syntactic and logico-semantic composition as the main combinatory routines, but then reveals that the most consistent and prominent reflection of composition, localized in the left anterior temporal cortex at 200–250 ms, cannot be described with this toolkit. Instead, this activity tracks a much more conceptually driven process, robustly sensitive to the density of the conceptual feature space of the composing items. I will describe our functional understanding of this activity and how it may operate within a broader ‘combinatory network.’ This article is part of the theme issue ‘Towards mechanistic models of meaning composition’.


2016 ◽  
Vol 371 (1697) ◽  
pp. 20150256 ◽  
Author(s):  
HyunGoo R. Kim ◽  
Dora E. Angelaki ◽  
Gregory C. DeAngelis

In addition to depth cues afforded by binocular vision, the brain processes relative motion signals to perceive depth. When an observer translates relative to their visual environment, the relative motion of objects at different distances (motion parallax) provides a powerful cue to three-dimensional scene structure. Although perception of depth based on motion parallax has been studied extensively in humans, relatively little is known regarding the neural basis of this visual capability. We review recent advances in elucidating the neural mechanisms for representing depth-sign (near versus far) from motion parallax. We examine a potential neural substrate in the middle temporal visual area for depth perception based on motion parallax, and we explore the nature of the signals that provide critical inputs for disambiguating depth-sign. This article is part of the themed issue ‘Vision in our three-dimensional world’.


Author(s):  
Dimitra Flouri ◽  
Daniel Lesnic ◽  
Constantina Chrysochou ◽  
Jehill Parikh ◽  
Peter Thelwall ◽  
...  

Abstract Introduction Model-driven registration (MDR) is a general approach to remove patient motion in quantitative imaging. In this study, we investigate whether MDR can effectively correct the motion in free-breathing MR renography (MRR). Materials and methods MDR was generalised to linear tracer-kinetic models and implemented using 2D or 3D free-form deformations (FFD) with multi-resolution and gradient descent optimization. MDR was evaluated using a kidney-mimicking digital reference object (DRO) and free-breathing patient data acquired at high temporal resolution in multi-slice 2D (5 patients) and 3D acquisitions (8 patients). Registration accuracy was assessed using comparison to ground truth DRO, calculating the Hausdorff distance (HD) between ground truth masks with segmentations and visual evaluation of dynamic images, signal-time courses and parametric maps (all data). Results DRO data showed that the bias and precision of parameter maps after MDR are indistinguishable from motion-free data. MDR led to reduction in HD (HDunregistered = 9.98 ± 9.76, HDregistered = 1.63 ± 0.49). Visual inspection showed that MDR effectively removed motion effects in the dynamic data, leading to a clear improvement in anatomical delineation on parametric maps and a reduction in motion-induced oscillations on signal-time courses. Discussion MDR provides effective motion correction of MRR in synthetic and patient data. Future work is needed to compare the performance against other more established methods.


Author(s):  
Yiwen Wang ◽  
Yuxiao Lin ◽  
Chao Fu ◽  
Zhihua Huang ◽  
Rongjun Yu ◽  
...  

Abstract The desire for retaliation is a common response across a majority of human societies. However, the neural mechanisms underlying aggression and retaliation remain unclear. Previous studies on social intentions are confounded by low-level response related brain activity. Using an EEG-based brain-computer interface (BCI) combined with the Chicken Game, our study examined the neural dynamics of aggression and retaliation after controlling for nonessential response related neural signals. Our results show that aggression is associated with reduced alpha event-related desynchronization (ERD), indicating reduced mental effort. Moreover, retaliation and tit-for-tat strategy use are also linked with smaller alpha-ERD. Our study provides a novel method to minimize motor confounds and demonstrates that choosing aggression and retaliation is less effortful in social conflicts.


2000 ◽  
Vol 12 (4) ◽  
pp. 622-634 ◽  
Author(s):  
Matti Laine ◽  
Riitta Salmelin ◽  
Päivi Helenius ◽  
Reijo Marttila

Magnetoencephalographic (MEG) changes in cortical activity were studied in a chronic Finnish-speaking deep dyslexic patient during single-word and sentence reading. It has been hypothesized that in deep dyslexia, written word recognition and its lexical-semantic analysis are subserved by the intact right hemisphere. However, in our patient, as well as in most nonimpaired readers, lexical-semantic processing as measured by sentence-final semantic-incongruency detection was related to the left superior-temporal cortex activation. Activations around this same cortical area could be identified in single-word reading as well. Another factor relevant to deep dyslexic reading, the morphological complexity of the presented words, was also studied. The effect of morphology was observed only during the preparation for oral output. By performing repeated recordings 1 year apart, we were able to document significant variability in both the spontaneous activity and the evoked responses in the lesioned left hemisphere even though at the behavioural level, the patient's performance was stable. The observed variability emphasizes the importance of estimating consistency of brain activity both within and between measurements in brain-damaged individuals.


2010 ◽  
Vol 21 (7) ◽  
pp. 931-937 ◽  
Author(s):  
C. Nathan DeWall ◽  
Geoff MacDonald ◽  
Gregory D. Webster ◽  
Carrie L. Masten ◽  
Roy F. Baumeister ◽  
...  

Pain, whether caused by physical injury or social rejection, is an inevitable part of life. These two types of pain—physical and social—may rely on some of the same behavioral and neural mechanisms that register pain-related affect. To the extent that these pain processes overlap, acetaminophen, a physical pain suppressant that acts through central (rather than peripheral) neural mechanisms, may also reduce behavioral and neural responses to social rejection. In two experiments, participants took acetaminophen or placebo daily for 3 weeks. Doses of acetaminophen reduced reports of social pain on a daily basis (Experiment 1). We used functional magnetic resonance imaging to measure participants’ brain activity (Experiment 2), and found that acetaminophen reduced neural responses to social rejection in brain regions previously associated with distress caused by social pain and the affective component of physical pain (dorsal anterior cingulate cortex, anterior insula). Thus, acetaminophen reduces behavioral and neural responses associated with the pain of social rejection, demonstrating substantial overlap between social and physical pain.


2020 ◽  
Author(s):  
Jonathan E Peelle ◽  
Brent Spehar ◽  
Michael S Jones ◽  
Sarah McConkey ◽  
Joel Myerson ◽  
...  

In everyday conversation, we usually process the talker's face as well as the sound of their voice. Access to visual speech information is particularly useful when the auditory signal is degraded. Here we used fMRI to monitor brain activity while adults (n = 60) were presented with visual-only, auditory-only, and audiovisual words. As expected, audiovisual speech perception recruited both auditory and visual cortex, with a trend towards increased recruitment of premotor cortex in more difficult conditions (for example, in substantial background noise). We then investigated neural connectivity using psychophysiological interaction (PPI) analysis with seed regions in both primary auditory cortex and primary visual cortex. Connectivity between auditory and visual cortices was stronger in audiovisual conditions than in unimodal conditions, including a wide network of regions in posterior temporal cortex and prefrontal cortex. Taken together, our results suggest a prominent role for cross-region synchronization in understanding both visual-only and audiovisual speech.


2022 ◽  
Vol 23 (1) ◽  
Author(s):  
Jing Ren ◽  
Qun Yao ◽  
Minjie Tian ◽  
Feng Li ◽  
Yueqiu Chen ◽  
...  

Abstract Background Migraine is a common and disabling primary headache, which is associated with a wide range of psychiatric comorbidities. However, the mechanisms of emotion processing in migraine are not fully understood yet. The present study aimed to investigate the neural network during neutral, positive, and negative emotional stimuli in the migraine patients. Methods A total of 24 migraine patients and 24 age- and sex-matching healthy controls were enrolled in this study. Neuromagnetic brain activity was recorded using a whole-head magnetoencephalography (MEG) system upon exposure to human facial expression stimuli. MEG data were analyzed in multi-frequency ranges from 1 to 100 Hz. Results The migraine patients exhibited a significant enhancement in the effective connectivity from the prefrontal lobe to the temporal cortex during the negative emotional stimuli in the gamma frequency (30–90 Hz). Graph theory analysis revealed that the migraine patients had an increased degree and clustering coefficient of connectivity in the delta frequency range (1–4 Hz) upon exposure to positive emotional stimuli and an increased degree of connectivity in the delta frequency range (1–4 Hz) upon exposure to negative emotional stimuli. Clinical correlation analysis showed that the history, attack frequency, duration, and neuropsychological scales of the migraine patients had a negative correlation with the network parameters in certain frequency ranges. Conclusions The results suggested that the individuals with migraine showed deviant effective connectivity in viewing the human facial expressions in multi-frequencies. The prefrontal-temporal pathway might be related to the altered negative emotional modulation in migraine. These findings suggested that migraine might be characterized by more universal altered cerebral processing of negative stimuli. Since the significant result in this study was frequency-specific, more independent replicative studies are needed to confirm these results, and to elucidate the neurocircuitry underlying the association between migraine and emotional conditions.


2014 ◽  
Vol 16 (1) ◽  
pp. 75-81 ◽  

It has been long established that psychological interventions can markedly alter patients' thinking patterns, beliefs, attitudes, emotional states, and behaviors. Little was known about the neural mechanisms mediating such alterations before the advent of functional neuroimaging techniques. Since the turn of the new millenium, several functional neuroimaging studies have been conducted to tackle this important issue. Some of these studies have explored the neural impact of various forms of psychotherapy in individuals with major depressive disorder. Other neuroimaging studies have investigated the effects of psychological interventions for anxiety disorders. I review these studies in the present article, and discuss the putative neural mechanisms of change in psychotherapy. The findings of these studies suggest that mental and behavioral changes occurring during psychotherapeutic interventions can lead to a normalization of functional brain activity at a global level.


Sign in / Sign up

Export Citation Format

Share Document