scholarly journals Delta and theta neural entrainment during phonological and semantic processing in speech perception

2019 ◽  
Author(s):  
Guangting Mai ◽  
William S-Y. Wang

AbstractNeural entrainment of acoustic envelopes is important for speech intelligibility in spoken language processing. However, it is unclear how it contributes to processing at different linguistic hierarchical levels. The present EEG study investigated this issue when participants responded to stimuli that dissociated phonological and semantic processing (real-word, pseudo-word and backward utterances). Multivariate Temporal Response Function (mTRF) model was adopted to map speech envelopes from multiple spectral bands onto EEG signals, providing a direct approach to measure neural entrainment. We tested the hypothesis that entrainment at delta (supra-syllabic) and theta (syllabic and sub-syllabic) bands take distinct roles at different hierarchical levels. Results showed that both types of entrainment involve speech-specific processing, but their underlying mechanisms were different. Theta-band entrainment was modulated by phonological but not semantic contents, reflecting the possible mechanism of tracking syllabic- and sub-syllabic patterns during phonological processing. Delta-band entrainment, on the other hand, was modulated by semantic information, indexing more attention-demanding, effortful phonological encoding when higher-level (semantic) information is deficient. Interestingly, we further demonstrated that the statistical capacity of mTRFs at the delta band and theta band to classify utterances is affected by their semantic (real-word vs. pseudo-word) and phonological (real-word and pseudo-word vs. backward) contents, respectively. Moreover, analyses on the response weighting of mTRFs showed that delta-band entrainment sustained across neural processing stages up to higher-order timescales (~ 300 ms), while theta-band entrainment occurred mainly at early, perceptual processing stages (< 160 ms). This indicates that, compared to theta-band entrainment, delta-band entrainment may reflect increased involvement of higher-order cognitive functions during interactions between phonological and semantic processing. As such, we conclude that neural entrainment is not only associated with speech intelligibility, but also with the hierarchy of linguistic (phonological and semantic) content. The present study thus provide a new insight into cognitive mechanisms of neural entrainment for spoken language processing.HighlightsLow-frequency neural entrainment was examined via mTRF models in EEG during phonological and semantic processing.Delta entrainment take roles in effortful listening for phonological recognitionTheta entrainment take roles in tracking syllabic and subsyllabic patterns for phonological processingDelta and theta entrainment sustain at different timescales of neural processing

2004 ◽  
Vol 10 (6) ◽  
pp. 818-827 ◽  
Author(s):  
MARY H. KOSMIDIS ◽  
KYRANA TSAPKINI ◽  
VASILIKI FOLIA ◽  
CHRISTINA H. VLAHOU ◽  
GRIGORIS KIOSSEOGLOU

Researchers of cognitive processing in illiteracy have proposed that the acquisition of literacy modifies the functional organization of the brain. They have suggested that, while illiterate individuals have access only to innate semantic processing skills, those who have learned the correspondence between graphemes and phonemes have several mechanisms available to them through which to process oral language. We conducted 2 experiments to verify that suggestion with respect to language processing, and to elucidate further the differences between literate and illiterate individuals in the cognitive strategies used to process oral language, as well as hemispheric specialization for these processes. Our findings suggest that semantic processing strategies are qualitatively the same in literates and illiterates, despite the fact that overall performance is augmented by increased education. In contrast, explicit processing of oral information based on phonological characteristics appears to be qualitatively different between literates and illiterates: effective strategies in the processing of phonological information depend upon having had a formal education, regardless of the level of education. We also confirmed the differential abilities needed for the processing of semantic and phonological information and related them to hemisphere-specific processing. (JINS, 2004,10, 818–827.)


2013 ◽  
Vol 756-759 ◽  
pp. 1344-1348
Author(s):  
Hasi ◽  
En Bo Tang

With the development of natural language processing technology, a powerful tool containing semantic information is in great need in lexical semantic processing. Aiming at automatic processing of words in machine translation and automatic proofreading, Wordnet mainly provides semantic information in the form of a semantic knowledge database. The Mongolian Wordnet management and application platform includes two parts----the user searching function and the administrator maintaining function. Users can search semantic knowledge online and the administrator can maintain the adding, deleting, revising and searching functions of the database online as well. This article mainly introduces the construction theory of Mongolian Wordnet, the designing frame of the management and application platform, and the designing methods of the main function modules.


2018 ◽  
Author(s):  
Jonas Vanthornhout ◽  
Lien Decruy ◽  
Jan Wouters ◽  
Jonathan Z. Simon ◽  
Tom Francart

AbstractSpeech intelligibility is currently measured by scoring how well a person can identify a speech signal. The results of such behavioral measures reflect neural processing of the speech signal, but are also influenced by language processing, motivation and memory. Very often electrophysiological measures of hearing give insight in the neural processing of sound. However, in most methods non-speech stimuli are used, making it hard to relate the results to behavioral measures of speech intelligibility. The use of natural running speech as a stimulus in electrophysiological measures of hearing is a paradigm shift which allows to bridge the gap between behavioral and electrophysiological measures. Here, by decoding the speech envelope from the electroencephalogram, and correlating it with the stimulus envelope, we demonstrate an electrophysiological measure of neural processing of running speech. We show that behaviorally measured speech intelligibility is strongly correlated with our electrophysiological measure. Our results pave the way towards an objective and automatic way of assessing neural processing of speech presented through auditory prostheses, reducing confounds such as attention and cognitive capabilities. We anticipate that our electrophysiological measure will allow better differential diagnosis of the auditory system, and will allow the development of closed-loop auditory prostheses that automatically adapt to individual users.


2020 ◽  
Author(s):  
Satoshi Nishida ◽  
Antione Blanc ◽  
Naoya Maeda ◽  
Masataka Kado ◽  
Shinji Nishimoto

AbstractThe quantitative modeling of semantic representations in the brain plays a key role in understanding the neural basis of semantic processing. Previous studies have demonstrated that word vectors, which were originally developed for use in the field of natural language processing, provide a powerful tool for such quantitative modeling. However, whether semantic representations revealed by the word vector-based models actually capture our perception of semantic information remains unclear, as there has been no study explicitly examining the behavioral correlates of the modeled semantic representations. To address this issue, we compared the semantic structure of nouns and adjectives estimated from word vector-based brain models with that evaluated from human behavior. The brain models were constructed using voxelwise modeling to predict the functional magnetic resonance imaging (fMRI) response to natural movies from semantic contents in each movie scene through a word vector space. The semantic dissimilarity of word representations was then evaluated using the brain models. Meanwhile, data on human behavior reflecting the perception of semantic dissimilarity between words were collected in psychological experiments. We found a significant correlation between brain model- and behavior-derived semantic dissimilarities of words. This finding suggests that semantic representations in the brain modeled via word vectors appropriately capture our perception of word meanings.Author summeryWord vectors, which have been originally developed in the field of engineering (natural language processing), have been extensively leveraged in neuroscience studies to model semantic representations in the human brain. These studies have attempted to model brain semantic representations by associating them with the meanings of thousands of words via a word vector space. However, there has been no study explicitly examining whether the modeled semantic representations actually capture our perception of semantic information. To address this issue, we compared the semantic representational structure of words estimated from word vector-based brain models with that evaluated from behavioral data in psychological experiments. The results revealed a significant correlation between these model- and behavior-derived semantic representational structures of words. This indicates that the brain semantic representations modeled using word vectors actually reflect the human perception of word meanings. Our findings contribute to the establishment of word vector-based brain modeling as a useful tool in studying human semantic processing.


Interpreting ◽  
2017 ◽  
Vol 19 (1) ◽  
pp. 1-20 ◽  
Author(s):  
Ena Hodzik ◽  
John N. Williams

We report a study on prediction in shadowing and simultaneous interpreting (SI), both considered as forms of real-time, ‘online’ spoken language processing. The study comprised two experiments, focusing on: (i) shadowing of German head-final sentences by 20 advanced students of German, all native speakers of English; (ii) SI of the same sentences into English head-initial sentences by 22 advanced students of German, again native English speakers, and also by 11 trainee and practising interpreters. Latency times for input and production of the target verbs were measured. Drawing on studies of prediction in English-language reading production, we examined two cues to prediction in both experiments: contextual constraints (semantic cues in the context) and transitional probability (the statistical likelihood of words occurring together in the language concerned). While context affected prediction during both shadowing and SI, transitional probability appeared to favour prediction during shadowing but not during SI. This suggests that the two cues operate on different levels of language processing in SI.


2021 ◽  
Vol 11 (3) ◽  
pp. 359
Author(s):  
Katharina Hogrefe ◽  
Georg Goldenberg ◽  
Ralf Glindemann ◽  
Madleen Klonowski ◽  
Wolfram Ziegler

Assessment of semantic processing capacities often relies on verbal tasks which are, however, sensitive to impairments at several language processing levels. Especially for persons with aphasia there is a strong need for a tool that measures semantic processing skills independent of verbal abilities. Furthermore, in order to assess a patient’s potential for using alternative means of communication in cases of severe aphasia, semantic processing should be assessed in different nonverbal conditions. The Nonverbal Semantics Test (NVST) is a tool that captures semantic processing capacities through three tasks—Semantic Sorting, Drawing, and Pantomime. The main aim of the current study was to investigate the relationship between the NVST and measures of standard neurolinguistic assessment. Fifty-one persons with aphasia caused by left hemisphere brain damage were administered the NVST as well as the Aachen Aphasia Test (AAT). A principal component analysis (PCA) was conducted across all AAT and NVST subtests. The analysis resulted in a two-factor model that captured 69% of the variance of the original data, with all linguistic tasks loading high on one factor and the NVST subtests loading high on the other. These findings suggest that nonverbal tasks assessing semantic processing capacities should be administered alongside standard neurolinguistic aphasia tests.


2021 ◽  
pp. 1-7
Author(s):  
Vasudha Hande ◽  
Shantala Hegde

BACKGROUND: A specific learning disability comes with a cluster of deficits in the neurocognitive domain. Phonological processing deficits have been the core of different types of specific learning disabilities. In addition to difficulties in phonological processing and cognitive deficits, children with specific learning disability (SLD) are known to also found have deficits in more innate non-language-based skills like musical rhythm processing. OBJECTIVES: This paper reviews studies in the area of musical rhythm perception in children with SLD. An attempt was made to throw light on beneficial effects of music and rhythm-based intervention and their underlying mechanism. METHODS: A hypothesis-driven review of research in the domain of rhythm deficits and rhythm-based intervention in children with SLD was carried out. RESULTS: A summary of the reviewed literature highlights that music and language processing have shared neural underpinnings. Children with SLD in addition to difficulties in language processing and other neurocognitive deficits are known to have deficits in music and rhythm perception. This is explained in the background of deficits in auditory skills, perceptuo-motor skills and timing skills. Attempt has been made in the field to understand the effect of music training on the children’s auditory processing and language development. Music and rhythm-based intervention emerges as a powerful intervention method to target language processing and other neurocognitive functions. Future studies in this direction are highly underscored. CONCLUSIONS: Suggestions for future research on music-based interventions have been discussed.


Author(s):  
Emme O’Rourke ◽  
Emily L. Coderre

AbstractWhile many individuals with autism spectrum disorder (ASD) experience difficulties with language processing, non-linguistic semantic processing may be intact. We examined neural responses to an implicit semantic priming task by comparing N400 responses—an event-related potential related to semantic processing—in response to semantically related or unrelated pairs of words or pictures. Adults with ASD showed larger N400 responses than typically developing adults for pictures, but no group differences occurred for words. However, we also observed complex modulations of N400 amplitude by age and by level of autistic traits. These results offer important implications for how groups are delineated and compared in autism research.


2001 ◽  
Vol 153 (2) ◽  
pp. 258-263 ◽  
Author(s):  
David M. Warburton ◽  
Abigail Skinner ◽  
Christopher D. Martin

Sign in / Sign up

Export Citation Format

Share Document