prosodic cues
Recently Published Documents


TOTAL DOCUMENTS

265
(FIVE YEARS 70)

H-INDEX

29
(FIVE YEARS 2)

2021 ◽  
Vol 15 ◽  
Author(s):  
Hatice Zora ◽  
Valéria Csépe

How listeners handle prosodic cues of linguistic and paralinguistic origin is a central question for spoken communication. In the present EEG study, we addressed this question by examining neural responses to variations in pitch accent (linguistic) and affective (paralinguistic) prosody in Swedish words, using a passive auditory oddball paradigm. The results indicated that changes in pitch accent and affective prosody elicited mismatch negativity (MMN) responses at around 200 ms, confirming the brain’s pre-attentive response to any prosodic modulation. The MMN amplitude was, however, statistically larger to the deviation in affective prosody in comparison to the deviation in pitch accent and affective prosody combined, which is in line with previous research indicating not only a larger MMN response to affective prosody in comparison to neutral prosody but also a smaller MMN response to multidimensional deviants than unidimensional ones. The results, further, showed a significant P3a response to the affective prosody change in comparison to the pitch accent change at around 300 ms, in accordance with previous findings showing an enhanced positive response to emotional stimuli. The present findings provide evidence for distinct neural processing of different prosodic cues, and statistically confirm the intrinsic perceptual and motivational salience of paralinguistic information in spoken communication.


2021 ◽  
Author(s):  
◽  
Mengzhu Yan

<p>It is well established that focus plays an important role in facilitating language processing, i.e., focused words are recognised faster and remembered better. In addition, more recent research shows that alternatives to a word (e.g., sailor as an alternative to captain) are more activated when listeners hear the word with contrastive prominence (e.g., ‘The captain put on the raincoat) (bold indicates contrastive prominence). The mechanism behind these processing advantages is focus. Focus has two broad conceptions in relation to its effect on language processing: focus as updating the common ground and focus as indicating alternatives. Considerable psycholinguistic evidence has been obtained for processing advantages consistent with the first conception, and this evidence comes from studies across a reasonably wide range of languages. But the evidence for the second conception only comes from a handful of closely related languages (i.e., English, Dutch and German). Further, it has largely been confined to contrastive accenting as a marker of focus. Therefore, it is not clear if other types of focus marking (e.g., clefts) have similar processing effects. It is also not known if all this is true in Mandarin, as there is very little research in these areas in Mandarin. Mandarin uses pitch expansion to mark contrastive prominence, rather than the pitch accenting found in Germanic languages. Therefore, the investigation of Mandarin expands our knowledge of these speech processing effects to a different language and language family. It also expands our knowledge of the relative roles of prosody and syntax in marking focus and in speech processing in Mandarin, and in general.  This thesis tested how different types of focus marking affect the perception of focus and two aspects of language processing related to focus: the encoding and activation of discourse information (focused words and focus alternatives). The aim was to see whether there is a link between the relative importance of prosodic and syntactic focus marking in Mandarin and their effectiveness in these aspects of language processing. For focus perception, contrastive prominence and clefting have been claimed to mark focus in Mandarin, but it has not been well tested whether listeners perceive them as focus marking. For the first aspect of processing, it is not yet clear what cues listeners use to encode focused information beyond prominence when processing a discourse. For the second aspect, there has been rapidly growing interest in the role of alternatives in language processing, but little is known regarding the effect of clefting. In addition, it is not clear whether the prosodic and syntactic cues are equally effective, and again little research has been devoted to Mandarin. Therefore, the following experiments were conducted to look at these cues in Mandarin.  Experiment 1, a norming study, was conducted to help select stimuli for the following Experiments 2, 3, 4A and 4B. Experiment 2 investigated the relative weights of prosodic and syntactic focus cues in a question-answer appropriateness rating task. The findings show that in canonical word order sentences, the focus was perceived to be on the word that was marked by contrastive prominence. In clefts where the prominence and syntactic cues were on the same word, that word was perceived as being in focus. However, in ‘mismatch’ cases, e.g., 是[船长]F 穿上的[雨衣]F ‘It was the [captain]F who put on the [raincoat]F’ (F indicates focus), the focus was perceived to be on raincoat, the word that had contrastive prominence. In other words, participants weighted prosodic cues more highly. This suggests that prosodic prominence is a stronger focus cue than syntax in Mandarin.  Experiment 3 looked at the role of prosodic and syntactic cues in listeners’ encoding of discourse information in a speeded ‘false alternative’ rejection task. This experiment shows that false alternatives to a word in a sentence (e.g., sailor to captain in ‘The captain put on the raincoat’) were more easily rejected if captain was marked with prosodic cues than with syntactic cues. This experiment shows congruent results to those of Experiment 2, in that prosodic cues were more effective than syntactic cues in encoding discourse information. It seems that a more important marker of focus provides more effective encoding of discourse information.  Experiments 4A and 4B investigated the role of prosodic and syntactic focus cues in the activation of discourse information in Mandarin, using the cross-modal lexical priming paradigm. Both studies consistently show that prosodic focus marking, but not syntactic focus marking, facilitates the activation of identical targets (e.g., captain after hearing ‘The captain put on the raincoat’). Similarly, prosodic focus marking, but not syntactic focus marking, primes alternatives (e.g., sailor). But focus marking does not prime noncontrastive associates (e.g., deck). These findings, together with previous findings on focus particles (e.g., only), suggest that alternative priming is particularly related to contrastive prominence, at least in languages looked at to date. The relative priming effects of prosodic and syntactic focus cues in Experiments 4A and 4B are in line with their relative weights in Experiments 2 and 3.   This thesis presents a crucial link between the relative weights of prosodic and syntactic cues in marking focus, their degrees of effectiveness in encoding discourse information and their ability to activate discourse information in Mandarin. This research contributes significantly to our cross-linguistic understanding of prosodic and syntactic focus in speech processing, showing the processing advantages of focus may be common across languages, but what cues trigger the effects differ by language.</p>


2021 ◽  
Author(s):  
◽  
Mengzhu Yan

<p>It is well established that focus plays an important role in facilitating language processing, i.e., focused words are recognised faster and remembered better. In addition, more recent research shows that alternatives to a word (e.g., sailor as an alternative to captain) are more activated when listeners hear the word with contrastive prominence (e.g., ‘The captain put on the raincoat) (bold indicates contrastive prominence). The mechanism behind these processing advantages is focus. Focus has two broad conceptions in relation to its effect on language processing: focus as updating the common ground and focus as indicating alternatives. Considerable psycholinguistic evidence has been obtained for processing advantages consistent with the first conception, and this evidence comes from studies across a reasonably wide range of languages. But the evidence for the second conception only comes from a handful of closely related languages (i.e., English, Dutch and German). Further, it has largely been confined to contrastive accenting as a marker of focus. Therefore, it is not clear if other types of focus marking (e.g., clefts) have similar processing effects. It is also not known if all this is true in Mandarin, as there is very little research in these areas in Mandarin. Mandarin uses pitch expansion to mark contrastive prominence, rather than the pitch accenting found in Germanic languages. Therefore, the investigation of Mandarin expands our knowledge of these speech processing effects to a different language and language family. It also expands our knowledge of the relative roles of prosody and syntax in marking focus and in speech processing in Mandarin, and in general.  This thesis tested how different types of focus marking affect the perception of focus and two aspects of language processing related to focus: the encoding and activation of discourse information (focused words and focus alternatives). The aim was to see whether there is a link between the relative importance of prosodic and syntactic focus marking in Mandarin and their effectiveness in these aspects of language processing. For focus perception, contrastive prominence and clefting have been claimed to mark focus in Mandarin, but it has not been well tested whether listeners perceive them as focus marking. For the first aspect of processing, it is not yet clear what cues listeners use to encode focused information beyond prominence when processing a discourse. For the second aspect, there has been rapidly growing interest in the role of alternatives in language processing, but little is known regarding the effect of clefting. In addition, it is not clear whether the prosodic and syntactic cues are equally effective, and again little research has been devoted to Mandarin. Therefore, the following experiments were conducted to look at these cues in Mandarin.  Experiment 1, a norming study, was conducted to help select stimuli for the following Experiments 2, 3, 4A and 4B. Experiment 2 investigated the relative weights of prosodic and syntactic focus cues in a question-answer appropriateness rating task. The findings show that in canonical word order sentences, the focus was perceived to be on the word that was marked by contrastive prominence. In clefts where the prominence and syntactic cues were on the same word, that word was perceived as being in focus. However, in ‘mismatch’ cases, e.g., 是[船长]F 穿上的[雨衣]F ‘It was the [captain]F who put on the [raincoat]F’ (F indicates focus), the focus was perceived to be on raincoat, the word that had contrastive prominence. In other words, participants weighted prosodic cues more highly. This suggests that prosodic prominence is a stronger focus cue than syntax in Mandarin.  Experiment 3 looked at the role of prosodic and syntactic cues in listeners’ encoding of discourse information in a speeded ‘false alternative’ rejection task. This experiment shows that false alternatives to a word in a sentence (e.g., sailor to captain in ‘The captain put on the raincoat’) were more easily rejected if captain was marked with prosodic cues than with syntactic cues. This experiment shows congruent results to those of Experiment 2, in that prosodic cues were more effective than syntactic cues in encoding discourse information. It seems that a more important marker of focus provides more effective encoding of discourse information.  Experiments 4A and 4B investigated the role of prosodic and syntactic focus cues in the activation of discourse information in Mandarin, using the cross-modal lexical priming paradigm. Both studies consistently show that prosodic focus marking, but not syntactic focus marking, facilitates the activation of identical targets (e.g., captain after hearing ‘The captain put on the raincoat’). Similarly, prosodic focus marking, but not syntactic focus marking, primes alternatives (e.g., sailor). But focus marking does not prime noncontrastive associates (e.g., deck). These findings, together with previous findings on focus particles (e.g., only), suggest that alternative priming is particularly related to contrastive prominence, at least in languages looked at to date. The relative priming effects of prosodic and syntactic focus cues in Experiments 4A and 4B are in line with their relative weights in Experiments 2 and 3.   This thesis presents a crucial link between the relative weights of prosodic and syntactic cues in marking focus, their degrees of effectiveness in encoding discourse information and their ability to activate discourse information in Mandarin. This research contributes significantly to our cross-linguistic understanding of prosodic and syntactic focus in speech processing, showing the processing advantages of focus may be common across languages, but what cues trigger the effects differ by language.</p>


2021 ◽  
pp. 002383092110460
Author(s):  
Martin Ho Kwan Ip ◽  
Anne Cutler

Many different prosodic cues can help listeners predict upcoming speech. However, no research to date has assessed listeners’ processing of preceding prosody from different speakers. The present experiments examine (1) whether individual speakers (of the same language variety) are likely to vary in their production of preceding prosody; (2) to the extent that there is talker variability, whether listeners are flexible enough to use any prosodic cues signaled by the individual speaker; and (3) whether types of prosodic cues (e.g., F0 versus duration) vary in informativeness. Using a phoneme-detection task, we examined whether listeners can entrain to different combinations of preceding prosodic cues to predict where focus will fall in an utterance. We used unsynthesized sentences recorded by four female native speakers of Australian English who happened to have used different preceding cues to produce sentences with prosodic focus: a combination of pre-focus overall duration cues, F0 and intensity (mean, maximum, range), and longer pre-target interval before the focused word onset (Speaker 1), only mean F0 cues, mean and maximum intensity, and longer pre-target interval (Speaker 2), only pre-target interval duration (Speaker 3), and only pre-focus overall duration and maximum intensity (Speaker 4). Listeners could entrain to almost every speaker’s cues (the exception being Speaker 4’s use of only pre-focus overall duration and maximum intensity), and could use whatever cues were available even when one of the cue sources was rendered uninformative. Our findings demonstrate both speaker variability and listener flexibility in the processing of prosodic focus.


2021 ◽  
pp. 002383092110420
Author(s):  
Hyunah Baek

This study investigates the use of prosodic cues for syntactic ambiguity resolution by first language (L1) and second language (L2) speakers. In a production experiment, sentences with relative clause attachment ambiguity were elicited in three language conditions: native English speakers’ L1 productions as well as Korean-English bilingual speakers’ L1 Korean and L2 English productions. The results show that English uses both boundary marking (pause) and relative word prominence (elevated pitch and intensity) for disambiguation, while Korean mainly relies on boundary marking (pre-boundary lengthening and pause). The bilingual speakers have learned to use the English phonological categories such as pitch accents for disambiguation, but their use of phonetic cues to realize these categories still differed from that of native English speakers. In addition, they did not show a significant use of boundary cues. These results are discussed in relation to the typological differences between the prosody of English and of Korean.


2021 ◽  
Vol 11 (10) ◽  
pp. 1303
Author(s):  
Tamara Rathcke ◽  
Chia-Yuan Lin

Developmental dyslexia is typically defined as a difficulty with an individual’s command of written language, arising from deficits in phonological awareness. However, motor entrainment difficulties in non-linguistic synchronization and time-keeping tasks have also been reported. Such findings gave rise to proposals of an underlying rhythm processing deficit in dyslexia, even though to date, evidence for impaired motor entrainment with the rhythm of natural speech is rather scarce, and the role of speech rhythm in phonological awareness is unclear. The present study aimed to fill these gaps. Dyslexic adults and age-matched control participants with variable levels of previous music training completed a series of experimental tasks assessing phoneme processing, rhythm perception, and motor entrainment abilities. In a rhythm entrainment task, participants tapped along to the perceived beat of natural spoken sentences. In a phoneme processing task, participants monitored for sonorant and obstruent phonemes embedded in nonsense strings. Individual sensorimotor skills were assessed using a number of screening tests. The results lacked evidence for a motor impairment or a general motor entrainment difficulty in dyslexia, at least among adult participants of the study. Instead, the results showed that the participants’ performance in the phonemic task was predictive of their performance in the rhythmic task, but not vice versa, suggesting that atypical rhythm processing in dyslexia may be the consequence, but not the cause, of dyslexic difficulties with phoneme-level encoding. No evidence for a deficit in the entrainment to the syllable rate in dyslexic adults was found. Rather, metrically weak syllables were significantly less often at the center of rhythmic attention in dyslexic adults as compared to neurotypical controls, with an increased tendency in musically trained participants. This finding could not be explained by an auditory deficit in the processing of acoustic-prosodic cues to the rhythm structure, but it is likely to be related to the well-documented auditory short-term memory issue in dyslexia.


2021 ◽  
Vol 55 (1) ◽  
Author(s):  
Maaten Renckens ◽  
Leo De Raeve ◽  
Erik Nuyts ◽  
María Pérez Mena ◽  
Ann Beesemans

Type enriched with visual prosody is a powerful tool to encourage expressive reading. Visual prosody adds cues to text to guide vocal variations in loud-ness, duration, and pitch. More vocal variations result in a less monotonous voice and thus more expression. A positive e!ect of visual prosody is known on the voice of normal hearing readers and of signed bilingual deaf readers who developed signed language and spoken language. These deaf readers rely on speech as well as sign language and both modalities can be used interchangeably to compensate each other. This preliminary study explores visual prosody in text in relation to Flemish Sign Language to see if sign language can be used to explain prosody. We asked deaf readers between 7 and 18 to relate prosodic cues to videos presenting prosodic components of Flemish Sign Language. We found that those readers connect the prosodic cues with the components in Flemish Sign Language as intended. Larger word-spacing cor-relates with a pause between signs, a wider font with a sign with ‘longer du-ration’, a thicker font with more ‘displacement’ in the sign, a raised font with a ‘faster velocity’ in the sign. However, some confusion occurred as participants seemed to extract only two prosodic components in the sign language: both the ‘faster velocity’ and ‘longer duration’ were referred to in terms of 'speed' and were not perceived as separate prosodic components. Participants were confused about why there were three cues in the text. Therefore, it is advised to re-evaluate and to re-design visual prosody for sign language with only ‘displacement’ and ‘speed’ in mind.


2021 ◽  
Author(s):  
Constantijn L van der Burght ◽  
Ole Numssen ◽  
Benito Schlaak ◽  
Tomás Goucha ◽  
Gesa Hartwigsen

Auditory language comprehension involves processing the content (semantics), grammar (syntax), and intonation (prosody) of a sentence. Sentence processing guided by prosody has been shown to involve the left inferior frontal gyrus (IFG). Prosodic cues are known to interact closely with both syntax and semantics, yet, whether these two processing domains can be attributed to separate subregions within the left IFG is highly debated. We probed the causal role of the posterior IFG (pIFG) for syntactic processing and the anterior IFG (aIFG) for semantic processing in a task that required the interpretation of the sentence’s prosodic realisation. Healthy participants performed a sentence completion task with syntactic and semantic decisions, while receiving 10 Hz repetitive transcranial magnetic stimulation (rTMS) over either left aIFG, pIFG, or vertex (control). Although the behavioural analysis showed no significant interaction between rTMS site and decision, electrical field simulations revealed a task-specific facilitation effect: stronger pIFG stimulation led to faster syntactic processing without significantly modulating semantic decisions. In contrast, aIFG stimulation had an unspecific inhibitory effect. These results provide evidence for the functional relevance of left pIFG in grammatical processing guided by intonation. The unspecific inhibitory effect of aIFG rTMS highlights this subregion’s role in domain-general processes.


2021 ◽  
Author(s):  
Lucas Benjamin ◽  
Ana Fló ◽  
Marie Palu ◽  
Shruti Naik ◽  
Lucia Melloni ◽  
...  

Since speech is a continuous stream with no systematic boundaries between words, how do pre-verbal infants manage to discover words? A proposed solution is that they might use the transitional probability between adjacent syllables, which drops at word boundaries. Here, we tested the limits of this mechanism by increasing the size of the word-unit to 4 syllables, and its automaticity by testing asleep neonates. Using markers of statistical learning in neonates' EEG, compared to adult' behavioral performances in the same task, we confirmed that statistical learning is automatic enough to be efficient even in sleeping neonates. But we also revealed that : 1) Successfully tracking transition probabilities in a sequence is not sufficient to segment it 2) Prosodic cues, as subtle as subliminal pauses, enable to recover segmenting capacities 3) Adults' and neonates' capacities are remarkably similar despite the difference of maturation and expertise. Finally, we observed that learning increased the similarity of neural responses across infants, providing a new neural marker to monitor learning. Thus, from birth, infants are equipped with adult-like tools, allowing to extract small coherent word-like units within auditory streams, based on the combination of statistical analyses and prosodic cues.


Sign in / Sign up

Export Citation Format

Share Document