The Effects of Bilateral and Ipsilateral Auditory Stimuli on the Subcomponents of Visual Attention

Attention contains three functional network subcomponents of alerting, orienting, and executive control. The attention network test (ANT) is usually used to measure the efficiency of three attention subcomponents. Previous researches have focused on examining the unimodal attention with visual or auditory ANT paradigms. However, it is still unclear how an auditory stimulus influences the visual attention networks. This study investigated the effects of bilateral auditory stimuli (Experiment 1) and ipsilateral auditory stimulus (Experiment 2) on the visual attention subcomponents. We employed an ANT paradigm and manipulated the target modality types, including visual and audiovisual modalities. The participants were instructed to distinguish the direction of the central arrow surrounded by distractor arrows. In Experiment 1, we found that the simultaneous bilateral auditory stimuli reduced the efficiency of visual alerting and orienting, but had no significant effect on the efficiency of visual executive control. In Experiment 2, the ipsilateral auditory stimulus reduced the efficiency of visual executive control, but had no significant effect on the efficiency of visual alerting and orienting. We also observed a reduced relative multisensory response enhancement (rMRE) effect in cue condition relative to no cue condition (Experiment 1), and an increased rMRE effect in congruent condition compared with incongruent condition (Experiment 2). These results firstly provide evidence for the alerting, orienting and executive control effects in audiovisual condition. And the bilateral and ipsilateral auditory stimuli have different effects on the subcomponents of visual attention.

Semantically Congruent Bimodal Presentation with Divided-Modality Attention Accelerates Unisensory Working Memory Retrieval

Although previous studies have shown that semantic multisensory integration can be differentially modulated by attention focus, it remains unclear whether attentionally mediated multisensory perceptual facilitation could impact further cognitive performance. Using a delayed matching-to-sample paradigm, the present study investigated the effect of semantically congruent bimodal presentation on subsequent unisensory working memory (WM) performance by manipulating attention focus. The results showed that unisensory WM retrieval was faster in the semantically congruent condition than in the incongruent multisensory encoding condition. However, such a result was only found in the divided-modality attention condition. This result indicates that a robust multisensory representation was constructed during semantically congruent multisensory encoding with divided-modality attention; this representation then accelerated unisensory WM performance, especially auditory WM retrieval. Additionally, an overall faster unisensory WM retrieval was observed under the modality-specific selective attention condition compared with the divided-modality condition, indicating that the division of attention to address two modalities demanded more central executive resources to encode and integrate crossmodal information and to maintain a constructed multisensory representation, leaving few resources for WM retrieval. Additionally, the present finding may support the amodal view that WM has an amodal central storage component that is used to maintain modal-based attention-optimized multisensory representations.

Can Masked Emotion-Laden Words Prime Emotion-Label Words? An ERP Test on the Mediated Account

The present event-related potential (ERP) study explored whether masked emotion-laden words could facilitate the processing of both emotion-label words and emotion-laden words in a valence judgment task. The results revealed that emotion-laden words as primes failed to influence target emotion-label word processing, whereas emotion-laden words facilitated target emotion-laden words in the congruent condition. Specifically, decreased late positivity complex (LPC) was elicited by emotion-laden words primed by emotion-laden words of the same valence than those primed by emotion-laden words of different valence. Nevertheless, no difference was observed for emotion-label words as targets. These findings supported the mediated account that claimed emotion-laden words engendered emotion via the mediation of emotion-label words and hypothesized that emotion-laden words could not prime emotion-label words in the masked priming paradigm. Moreover, this study provided additional evidence showing the distinction between emotion-laden words and emotion-label words.

Cross-modal individual recognition in the African penguin and the effect of partnership

An animal's ability to recognize another individual by matching their image to their voice suggests they form internal representations of other individuals. To what extent this ability, termed cross-modal individual recognition, extends to birds other than corvids is unknown. Here, we used an expectancy violation paradigm to determine whether a monogamous territorial seabird ( Spheniscus demersus ) can cross-modally recognize familiar conspecifics (partners or colony-mates). After pairs of penguins spent time together in an isolated area, one of the penguins was released from the area leaving the focal penguin alone. Subsequently, we played contact calls of the released penguin (congruent condition) or a different penguin (incongruent condition). After being paired with a colony-mate, focal penguins' response latency to the auditory stimulus was faster in the incongruent compared to congruent condition, indicating the mismatch violated their expectations. This behavioural pattern was not observed in focal penguins after being paired with their partner. We discuss these different results in the light of penguins’ natural behaviour and the evolution of social communication strategies. Our results suggest that cross-modal individual recognition extends to penguins and reveals, in contrast with previously thought, that social communication between members of this endangered species can also use visual cues.

Can Optic Flow Further Stimulate Treadmill-Elicited Stepping in Newborns?

Typically developing 3-day-old newborns take significantly more forward steps on a moving treadmill belt than on a static belt. The current experiment examined whether projecting optic flows that specified forward motion onto the moving treadmill surface (black dots moving on the white treadmill surface) would further enhance forward stepping. Twenty newborns were supported on a moving treadmill without optic flow (No OF), with optic flow matching the treadmill’s direction and speed (Congruent), with optic flow in the same direction but at a faster speed (Faster), and in a control condition with an incoherent optic flow moving at the same speed as in the Congruent condition but in random directions (Random). The results revealed no significant differences in the number or coordination of forward treadmill steps taken in each condition. However, the Faster condition generated significantly fewer leg pumping movements than the Random control condition. When highly aroused, newborns made significantly fewer single steps and significantly more parallel steps and pumping movements. We speculate the null findings may be a function of the high friction material that covered the treadmill surface.

Forest Before Trees: Letter Stimulus and Sex Modulate Global Precedence in Visual Perception

The global precedence effect (GPE), originally referring to processing hierarchical visual stimuli composed of letters, is characterised by both global advantage and global interference. We present herein a study of how this effect is modulated by the variables letter and sex. The Navon task, using the letters “H” and “S,” was administered to 78 males and 168 females (69 follicular women, 52 luteal women, and 47 hormonal contraceptive users). No interaction occurred between the letter and sex variables, but significant main effects arose from each of these. Reaction times (RTs) revealed that the letter “H” was identified more rapidly in the congruent condition both in the global and the local task, and the letter “S” in the incongruent condition for the local task. Also, although RTs showed a GPE in both males and females, males displayed shorter reaction times in both global and local tasks. Furthermore, luteal women showed higher d’ index (discrimination sensitivity) in the congruent condition for the local task than both follicular women and hormonal contraceptive users, as well as longer exploration time of the irrelevant level during the global task than males. We conclude that, according to the linear periodicity law, the GPE is enhanced for compound letters with straight vs. curved strokes, whereas it is stronger in males than in females. Relevantly, luteal phase of the menstrual cycle seems to tilt women to rely on finer grained information, thus exhibiting an analytical processing style in global/local visual processing.

Normatively Irrelevant Affective Cues Affect Risk-Taking under Uncertainty: Insights from the Iowa Gambling Task (IGT), Skin Conductance Response, and Heart Rate Variability

Being able to distinguish between safe and risky options is paramount in making functional choices. However, deliberate manipulation of decision-makers emotions can lead to risky behaviors. This study aims at understanding how affective reactions driven by normatively irrelevant affective cues can interfere with risk-taking. Good and Bad decks of the Iowa Gambling Task have been manipulated to make them unpleasant through a negative auditory manipulation. Anticipatory skin conductance response (SCR) and heart rate variability (HRV) have been investigated in line with the somatic marker hypothesis. Results showed fewer selections from Good decks when they were negatively manipulated (i.e., Incongruent condition). No effect of the manipulation was detected when Bad decks were negatively manipulated (i.e., Congruent condition). Higher anticipatory SCR was associated with Bad decks in Congruent condition. Slower heart rate was found before selections from Good decks in Control and Congruent condition and from Bad decks in Incongruent condition. Differences in heart rate between Bad and Good decks were also detected in Congruent condition. Results shed light on how normatively irrelevant affective cues can interfere with risk-taking.

Towards and away from the body: The relevance of the direction of use in the coding of object-related actions

This study examines whether the perception of an object automatically activates the representation of the direction of use of that object. To this aim, we carried out two experiments. In Experiment 1, participants were asked to explicitly categorise objects as used either away from the body (AB, for example, a hammer) or towards the body (TB, for example, a toothbrush). In Experiment 2, participants were asked to judge whether the same objects were natural or manmade. In both experiments, they were asked to respond by moving a joystick backwards (i.e., TB) or frontwards (i.e., AB). Therefore, their response could either be congruent (i.e., backward response with TB objects, frontward response with AB objects) or incongruent (i.e., backward response with AB objects, frontward response with TB objects) with the direction of object use. Results from Experiment 1 showed that in the congruent condition, participants were faster in judging the direction of object use than those in the incongruent condition (congruency effect). Crucially, results from Experiment 2 showed the presence of a congruency effect even when the direction of object use was task-irrelevant. However, this effect was found only for TB objects. These results suggest that the perception of TB objects automatically activates the direction of object use with respect to the body, thus showing evidence of direct connection between perception and action. A specific role of the body might account for different action representation processes involved in TB and AB object-related actions.

Arithmetic processing in children with dyscalculia: an event-related potential study

Introduction Dyscalculia is a specific learning disorder affecting the ability to learn certain math processes, such as arithmetic data recovery. The group of children with dyscalculia is very heterogeneous, in part due to variability in their working memory (WM) deficits. To assess the brain response to arithmetic data recovery, we applied an arithmetic verification task during an event-related potential (ERP) recording. Two effects have been reported: the N400 effect (higher negative amplitude for incongruent than for congruent condition), associated with arithmetic incongruency and caused by the arithmetic priming effect, and the LPC effect (higher positive amplitude for the incongruent compared to the congruent condition), associated with a reevaluation process and modulated by the plausibility of the presented condition. This study aimed to (a) compare arithmetic processing between children with dyscalculia and children with good academic performance (GAP) using ERPs during an addition verification task and (b) explore, among children with dyscalculia, the relationship between WM and ERP effects. Materials and Methods EEGs of 22 children with dyscalculia (DYS group) and 22 children with GAP (GAP group) were recorded during the performance of an addition verification task. ERPs synchronized with the probe stimulus were computed separately for the congruent and incongruent probes, and included only epochs with correct answers. Mixed 2-way ANOVAs for response times and correct answers were conducted. Comparisons between groups and correlation analyses using ERP amplitude data were carried out through multivariate nonparametric permutation tests. Results The GAP group obtained more correct answers than the DYS group. An arithmetic N400 effect was observed in the GAP group but not in the DYS group. Both groups displayed an LPC effect. The larger the LPC amplitude was, the higher the WM index. Two subgroups were found within the DYS group: one with an average WM index and the other with a lower than average WM index. These subgroups displayed different ERPs patterns. Discussion The results indicated that the group of children with dyscalculia was very heterogeneous and therefore failed to show a robust LPC effect. Some of these children had WM deficits. When WM deficits were considered together with dyscalculia, an atypical ERP pattern that reflected their processing difficulties emerged. Their lack of the arithmetic N400 effect suggested that the processing in this step was not useful enough to produce an answer; thus, it was necessary to reevaluate the arithmetic-calculation process (LPC) in order to deliver a correct answer. Conclusion Given that dyscalculia is a very heterogeneous deficit, studies examining dyscalculia should consider exploring deficits in WM because the whole group of children with dyscalculia seems to contain at least two subpopulations that differ in their calculation process.

All Eyes on Me

Duo musicians exhibit a broad variety of bodily gestures, but it is unclear how soloists’ and accompanists’ movements differ and to what extent they attract observers’ visual attention. In Experiment 1, seven musical duos’ body movements were tracked while they performed two pieces in two different conditions. In a congruent condition, soloist and accompanist behaved according to their expected musical roles; in an incongruent condition, the soloist behaved as accompanist and vice versa. Results revealed that behaving as soloist, regardless of the condition, led to more, smoother, and faster head and shoulder movements over a larger area than behaving as accompanist. Moreover, accompanists in the incongruent condition moved more than soloists in the congruent condition. In Experiment 2, observers watched videos of the duo performances with and without audio, while eye movements were tracked. Observers looked longer at musicians behaving as soloists compared to musicians behaving as accompanists, independent of their respective musical role. This suggests that visual attention was allocated to the most salient visuo-kinematic cues (i.e., expressive bodily gestures) rather than the most salient musical cues (i.e., the solo part). Findings are discussed regarding auditory-motor couplings and theories of motor control as well as auditory-visual integration and attention.