The ‘hookability’of multimodal impact captions

The use of captions has grown in recent years in both traditional and new media, particularly in terms of the diversity of style, content, and function. Impact captions have emerged as a popular form of captions for hearing viewers and contain rich multimodal information which is employed to capture viewer attention and enhance engagement, particularly in situations where there is competition for viewer attention. Drawing upon relevance theory, we argue how impact captions could effectively attract and hold visual attention owing to their balance between processing effort and contextual effects. This exploratory study employs a dual-task paradigm and uses authentic materials and viewing situations to further examine the ability of multimodal impact captions to attract and retain overt visual attention amongst a small sample of TV viewers. Our results provide novel insight into the apparent highly individualised efficacy of impact captions, where we identify several variables of interest in participants’ viewing behaviours. We conclude with a discussion of the study’s contributions, limitations, and an outline for future work.

Assessing a Sensory-Motor-Cognition Triad in Amnestic Mild Cognitive Impairment With Dichotic Listening While Walking: A Dual-Task Paradigm

A contemporary topic in aging research relates to the significance of cognitive changes proper to mild cognitive impairment (MCI) to higher risk of falls and gait deteriorations. The present study addresses this question in the amnestic type of MCI (aMCI) by examining a triad of interrelated comorbidities occurring in the MCI condition: attentional impairments, hearing loss and gait disturbances. To this end, we applied a dichotic listening (DL) test during over-ground walking. DL assesses spontaneous and lateralized auditory attention in three conditions (i.e., free report or Non-forced (NF), Forced-Right (FR) ear and Forced-Left (FL) ear). Earlier reports suggest that this dual-task paradigm evoke asymmetric gait effects on healthy controls, which are moderated by degree of hearing loss. Therefore, the aim of the present study was to evaluate the effects of DL on bilateral (data from both limbs) and lateralized (each limb separately) gait outcomes in a group of forty-three aMCI participants (mean = 71.19) and fifty-two healthy older controls (mean = 70.90) by using hearing loss as a covariate in all analyses. Results showed the aMCI group presented overall compromised gait parameters, especially higher gait variability in all DL conditions during lateralized attentional control. These findings were observed bilaterally, and no lateralized effects on gait were observed. Only after controlling for hearing acuity, gait asymmetries on step length variability emerged almost exclusively in healthy controls. It was concluded that hearing loss in the aMCI group together with higher attentional impairments preclude aMCI individuals to properly execute DL and therefore, they do not display gait asymmetries. The present data demonstrate that varied demands on attentional control dependent on hearing acuity affects gait negatively in healthy older adults and aMCI individuals in very different ways. The appearance of asymmetric effects seems to be a perturbation related to normal aging, while the lack of asymmetries but exaggerated gait variability characterizes aMCI. The present findings show the intricate interplay of sensory, cognitive, and motor deteriorations in different group of older adults, which stresses the need of addressing co-occurring comorbidities behind gait perturbations in individuals prone to develop a dementia state.

A Dual-Task Paradigm Using the Oral Trail Making Test While Walking to Study Cognitive-Motor Interactions in Older Adults

Objective: With aging, gait becomes more dependent on executive functions, especially on switching abilities. Therefore, cognitive-motor dual-task (DT) paradigms should study the interferences between gait and switching tasks. This study aimed to test a DT paradigm based on a validated cognitive switching task to determine whether it could distinguish older-old adults (OO) from younger-old adults (YO).Methods: Sixty-five healthy older participants divided into 29 younger-old (<70 years) and 36 older-old (≥70 years) age groups were evaluated in three single-task (ST) conditions as follows: a cognitive task including a processing speed component [Oral Trail Making Test part A (OTMT-A)], a cognitive task including a switching component [Oral Trail Making Test part B (OTMT-B)], and a gait evaluation at normal speed. They were also evaluated under two DT conditions, i.e., one associating gait with OTMT-A and the other associating gait with OTMT-B. Cognitive and gait performances were measured. The comparison of cognitive and gait performances between condition, logistic regression, and receiver operating characteristic (ROC) analyses were performed.Results: The cognitive and gait performances were differently affected by the different conditions (i.e., ST, DT, OTMT-A, and OTMT-B). The OTMT-B produced higher interference on gait and cognitive performances. Moreover, a higher number of errors on the OTMT-B performed while walking was associated with the older-old age group.Conclusion: Using validated cognitive flexibility tasks, this DT paradigm confirms the high interference between switching tasks and gait in older age. It is easily implemented, and its sensitivity to age may highlight its possible usefulness to detect cognitive or motor declines.

Influence of homophone processing during auditory language comprehension on executive control processes: A dual-task paradigm

In the present preregistered study, we evaluated the possibility of a shared cognitive mechanism during verbal and non-verbal tasks and therefore the implication of domain-general cognitive control during language comprehension. We hypothesized that a behavioral cost will be observed during a dual-task including both verbal and non-verbal difficult processing. Specifically, to test this claim, we designed a dual-task paradigm involving: an auditory language comprehension task (sentence comprehension) and a non-verbal Flanker task (including congruent and incongruent trials). We manipulated sentence ambiguity and evaluated if the ambiguity effect modified behavioral performances in the non-verbal Flanker task. Under the assumption that ambiguous sentences induce a more difficult process than unambiguous sentences, we expected non-verbal flanker task performances to be impaired only when a simultaneous difficult language processing is performed. This would be specifically reflected by a performance cost during incongruent Flanker items only during ambiguous sentence presentation. Conversely, we observed a facilitatory effect for the incongruent Flanker items during ambiguous sentence suggesting better non-verbal inhibitory performances when an ambiguous sentence was simultaneously processed. Exploratory data analysis suggests that this effect is not only related to a more difficult language processing but also to the previous (n-1) Flanker item. Indeed, results showed that incongruent n-1 Flanker items led to a facilitation of the incongruent synchronized Flanker items only when ambiguous sentences were conjointly presented. This result, even if it needs to be corroborated in future studies, suggests that the recruitment of executive control mechanisms facilitates subsequent executive control implication during difficult language processing. The present study suggests a common executive control mechanism during difficult verbal and non-verbal tasks.

Effects of dual-task interference on swallowing in healthy aging adults

A wide body of literature has demonstrated that the neural representation of healthy swallowing is mostly bilateral, with one hemisphere dominant over the other. While several studies have demonstrated the presence of laterality for swallowing related functions among young adults, the data on older adults are still growing. The purpose of this paper is to investigate potential changes in hemispheric dominance in healthy aging adults for swallowing related tasks using a behavioral dual-task paradigm. A modified dual-task paradigm was designed to investigate the potential reduction in hemispherical specialization for swallowing function. Eighty healthy right-handed participants in the study were divided into two groups [Group 1: young adults (18–40 years) and Group 2: older adults (65 and above)]. All the participants performed a timed water swallow test at baseline and with two interference conditions (silent word repetition, and facial recognition). The results of the study revealed the following 1) a statistically significant effect of age on swallow performance; 2) statistically significant effect of each of the interference tasks on two of the swallow measures (VPS and VPT) in younger adults; and 3) no significant effect of the interference tasks on the swallowing performance of older adults. These findings suggest that aging substantially affects swallowing in older individuals, and this potentially accompanies a reduction in the hemispheric specialization for swallowing related tasks.

Neural Correlates of Task-order Preparation in Dual Tasks: An EEG Study

Dual-task scenarios require a coordinated regulation of the processing order of component tasks in light of capacity limitations during response selection. A number of behavioral and neuroimaging findings suggest a distinct set of control processes involved in preparing this task order. In this study, we investigated electrophysiological correlates of task-order preparation in a variant of the overlapping dual-task paradigm with cue-determined task order that resulted in trials with blockwise fixed task order as well as trials with repeated and switched task order in blocks with variable task order. During the cue–stimulus interval, we found an earlier centroparietal order-mixing positivity and a later parietal order-switch positivity. A decoding approach based on multivariate pattern analysis showed that the order-mixing positivity is a necessary prerequisite for successful order selection, whereas the order-switch positivity appears to facilitate the implementation of a new task order after its selection. These correlates of order preparation share striking similarities to commonly found potentials involved in the preparation of individual tasks in the (single-)task-switching paradigm, which is strong empirical support for the account that the underlying preparatory processes are to be considered as higher-level control signals that are implemented independently of specific task representations.

Singing in the Brain

Music that gets “stuck” in the head is commonly conceptualized as an intrusive “thought”; however, we argue that this experience is better characterized as automatic mental singing without an accompanying sense of agency. In two experiments, a dual-task paradigm was employed, in which participants undertook a phonological task once while hearing music, and then again in silence following its presentation. We predicted that the music would be maintained in working memory, interfering with the task. Experiment 1 (N = 30) used songs predicted to be more or less catchy; half of the sample heard truncated versions. Performance was indeed poorer following catchier songs, particularly if the songs were unfinished. Moreover, the effect was stronger for songs rated higher in terms of the desire to sing along. Experiment 2 (N = 50) replicated the effect using songs with which the participants felt compelled to sing along. Additionally, results from a lexical decision task indicated that many participants’ keystrokes synchronized with the tempo of the song just heard. Together, these findings suggest that an earworm results from an unconscious desire to sing along to a familiar song.