Interactions of stimulus quality and semantic context on N400 in visual word recognition

The joint effects of stimulus quality and semantic context in visual word recognition were examined with event-related potential (ERP) recordings. In one-character Chinese word recognition, we manipulated stimulus quality at two degradation levels (highly vs. slightly degraded) and semantic context at two priming levels (semantically related vs. unrelated). In a prime–target–probe trial flow, ERPs were recorded to the target character which was presented in either high or slight degradation and which was preceded by either a semantically related or unrelated prime character. The target character was then followed by a probe character which was either identical to or different from the target character. Subjects were instructed to make target–probe matching judgments. The ERP results demonstrated a degradation by priming interaction, with larger N400 semantic priming effects for slightly degraded targets. Moreover, the degradation effects were observed on the P200, N250, and N400. These findings provided evidence for the cascaded model of visual word recognition such that the visual processing cascaded into the semantic stage and thus interacted on the N400 amplitude. The results were compared to an earlier study with a null ERP degradation by priming interaction. The ramifications of these results for models of visual word recognition are discussed.

Aspect in Heritage Greek: evidence from elicited production and online judgments

This study tests grammatical aspect in adult Heritage Speakers (HSs) of Greek in Germany (HSs-Germany) and the US (HSs-US), a topic which has not been investigated before for this language, exploring the role of the dominant language and the default value as an acquisition strategy. In an oral elicitation task (Experiment 1) targeting the production of aspectual marking in Greek, Greek monolinguals (MSs) and HSs-Germany exhibited ceiling performance, while HSs-US were significantly less accurate. Education in Greek reliably predicted their accuracy. In a speeded Grammaticality Judgment task (Experiment 2) targeting the comprehension of aspect in a Grammaticality x Aspect repeated measures design, similar results were obtained for the grammatical conditions as in Experiment 1. In ungrammatical conditions, accuracy on aspect was affected for all groups, and this was more evident for HSs. HSs-US were overall less accurate with the morphologically marked form (perfective). Decision Times (DTs) revealed that only MSs and HSs-Germany were sensitive to aspect violations exhibiting longer DTs. Education in Greek reliably predicted accuracy and DTs. The results are discussed within the realm of heritage languages, language contact, and aspect acquisition in Greek bilingual populations. Finally, certain novel verbal forms produced by HSs are also discussed.

NS and NNS processing of idioms and nonidiom formulaic sequences: What can reaction times and think-alouds tell us?

Although researchers generally agree that native speakers (NSs) process formulaic sequences (FSs) holistically to some extent, findings about nonnative speakers (NNSs) are conflicting, potentially because not all FSs are psychologically equal or because in some studies NNSs may not have fully understood the FSs. We address these issues by investigating Chinese NSs and NNSs processing of idioms and matched nonidiom FSs in phrase acceptability judgment tasks with and without think-alouds (TAs). Reaction times show that NSs processed idioms faster than nonidioms regardless of length, but NNSs processed 3-character FSs faster than 4-character FSs regardless of type. TAs show NSs’ understanding of FSs has reached ceiling, but NNSs’ understanding was incomplete, with idioms being understood more poorly than nonidioms. Although we conclude that idioms and nonidioms have different mental statuses in NSs’ lexicons, it is inconclusive how they are represented by NNSs. TAs also show that NNSs employed various strategies to compensate for limited idiom knowledge, causing comparable processing speed for idioms and nonidioms. The findings highlight the importance of distinguishing subtypes of FSs and considering NNSs’ quality of understanding in discussions of the psychological reality of FSs.

Phonological characteristics of novel gesture production in children with developmental language disorder: Longitudinal findings

Children with developmental language disorder (DLD; aka specific language impairment) are characterized based on deficits in language, especially morphosyntax, in the absence of other explanatory conditions. However, deficits in speech production, as well as fine and gross motor skill, have also been observed, implicating both the linguistic and motor systems. Situated at the intersection of these domains, and providing insight into both, is manual gesture. In the current work, we asked whether children with DLD showed phonological deficits in the production of novel gestures and whether gesture production at 4 years of age is related to language and motor outcomes two years later. Twenty-eight children (14 with DLD) participated in a two-year longitudinal novel gesture production study. At the first and final time points, language and fine motor skills were measured and gestures were analyzed for phonological feature accuracy, including handshape, path, and orientation. Results indicated that, while early deficits in phonological accuracy did not persist for children with DLD, all children struggled with orientation while handshape was the most accurate. Early handshape and orientation accuracy were also predictive of later language skill, but only for the children with DLD. Theoretical and clinical implications of these findings are discussed.

Why subtitle speed matters: Evidence from word skipping and rereading

High subtitle speed undoubtedly impacts the viewer experience. However, little is known about how fast subtitles might impact the reading of individual words. This article presents new findings on the effect of subtitle speed on viewers’ reading behavior using word-based eye-tracking measures with specific attention to word skipping and rereading. In multimodal reading situations such as reading subtitles in video, rereading allows people to correct for oculomotor error or comprehension failure during linguistic processing or integrate words with elements of the image to build a situation model of the video. However, the opportunity to reread words, to read the majority of the words in the subtitle and to read subtitles to completion, is likely to be compromised when subtitles are too fast. Participants watched videos with subtitles at 12, 20, and 28 characters per second (cps) while their eye movements were recorded. It was found that comprehension declined as speed increased. Eye movement records also showed that faster subtitles resulted in more incomplete reading of subtitles. Furthermore, increased speed also caused fewer words to be reread following both horizontal eye movements (likely resulting in reduced lexical processing) and vertical eye movements (which would likely reduce higher-level comprehension and integration).

The impact of audio on the reading of intralingual versus interlingual subtitles: Evidence from eye movements

This study investigated how semantically relevant auditory information might affect the reading of subtitles, and if such effects might be modulated by the concurrent video content. Thirty-four native Chinese speakers with English as their second language watched video with English subtitles in six conditions defined by manipulating the nature of the audio (Chinese/L1 audio vs. English/L2 audio vs. no audio) and the presence versus absence of video content. Global eye-movement analyses showed that participants tended to rely less on subtitles with Chinese or English audio than without audio, and the effects of audio were more pronounced in the presence of video presentation. Lexical processing of subtitles was not modulated by the audio. However, Chinese audio, which presumably obviated the need to read the subtitles, resulted in more superficial post-lexical processing of the subtitles relative to either the English or no audio. On the contrary, English audio accentuated post-lexical processing of the subtitles compared with Chinese audio or no audio, indicating that participants might use English audio to support subtitle reading (or vice versa) and thus engaged in deeper processing of the subtitles. These findings suggest that, in multimodal reading situations, eye movements are not only controlled by processing difficulties associated with properties of words (e.g., their frequency and length) but also guided by metacognitive strategies involved in monitoring comprehension and its online modulation by different information sources.

What are the letters e and é in a language with vowel reduction? The case of Catalan

Although the Latin-based orthographies of most Western languages employ vowels with accent marks (e.g., é vs. e), extant models of letter and word recognition are agnostic as to whether these accented letters and their non-accented counterparts are represented by common or separate abstract units. Recent research in French with a masked priming alphabetic decision task was interpreted as favoring the idea that accented and non-accented vowels are represented by separate abstract orthographic units (orthographic account: é↛e and e↛é; Chetail & Boursain, 2019). However, a more parsimonious explanation is that salient (accented) vowels are less perceptually similar to non-salient (non-accented) vowels than vice versa (perceptual account: e→é, but é↛e; Perea et al., 2021a; Tversky, 1977). To adjudicate between the two accounts, we conducted a masked priming alphabetic decision experiment in Catalan, a language with a complex orthography-to-phonology mapping for non-accented vowels (e.g., e→/e/, /ə/, /ε/). Results showed faster responses in the identity than in the visually similar condition for accented targets (é–É < e–É), but not for non-accented targets (e–E = é–E). Neither of the above accounts can fully capture this pattern. We propose an explanation based on the rapid activation of both orthographic and phonological codes.

Novel metaphor translation is modulated by translation direction

Previous translation process research has pointed to an increased cognitive load when translating metaphoric compared to literal language. Yet, studies conducted thus far have not examined the role of translation direction (i.e., L1–L2 vs. L2–L1) in novel metaphor translation and have not tested whether and how this process might be modulated by the linguistic form of a novel meaning. In the present study, Polish (L1) – English (L2) translation students translated novel nominal metaphors (A is B), novel similes (A is like B), and literal sentences, in either L1–L2 or L2–L1 translation directions, while their translation behavior was recorded using a keystroke logging method. The results revealed longer translation durations for both metaphors and similes relative to literal utterances. Furthermore, we found slower translation times for novel nominal metaphors compared to novel similes and literal sentences, yet only in the L2–L1 translation direction. Such results might indicate that novel meaning translation is more cognitively taxing in the case of novel nominal metaphors, which require a more robust activation of comparison mechanisms, relative to novel similes. Importantly, this effect might be stronger when translating in the direction in which access to semantic representations is potentially more automatic (i.e., L2–L1 translation).