scholarly journals Value-driven attentional capture enhances distractor representations in early visual cortex

2019 ◽  
Author(s):  
Sirawaj Itthipuripat ◽  
Vy A. Vo ◽  
Thomas C. Sprague ◽  
John T. Serences

ABSTRACTWhen a behaviorally relevant stimulus has been previously associated with reward, behavioral responses are faster and more accurate compared to equally relevant but less valuable stimuli. Conversely, task irrelevant stimuli that were previously associated with a high reward can capture attention and distract processing away from relevant stimuli (e.g. the chocolate bar in the pantry when you are looking for a nice healthy apple). While increasing the value of task-relevant stimuli systematically up-regulates neural responses in early visual cortex to facilitate information processing, it is not clear if the value of task-irrelevant distractors influences behavior via competition in early visual cortex or via competition at later stages of decision-making and response selection. Here, we measured fMRI in human visual cortex while subjects performed a value-based learning task, and applied a multivariate inverted encoding model to assess the fidelity of distractor representations in early visual cortex. We found that the fidelity of neural representations related to task-irrelevant distractors increased when the distractors were previously associated with a high reward. Moreover, this value-based modulation of distractor representations only occurred when the distractors were previously selected as targets on preceding trials. Together, these findings suggest that value-driven attentional capture begins with sensory modulations of distractor representations in early areas of visual cortex.

2019 ◽  
Vol 31 (4) ◽  
pp. 469-481 ◽  
Author(s):  
Haydee G. Garcia-Lazaro ◽  
Mandy V. Bartsch ◽  
Carsten N. Boehler ◽  
Ruth M. Krebs ◽  
Sarah E. Donohue ◽  
...  

Objects that promise rewards are prioritized for visual selection. The way this prioritization shapes sensory processing in visual cortex, however, is debated. It has been suggested that rewards motivate stronger attentional focusing, resulting in a modulation of sensory selection in early visual cortex. An open question is whether those reward-driven modulations would be independent of similar modulations indexing the selection of attended features that are not associated with reward. Here, we use magnetoencephalography in human observers to investigate whether the modulations indexing global color-based selection in visual cortex are separable for target- and (monetary) reward-defining colors. To assess the underlying global color-based activity modulation, we compare the event-related magnetic field response elicited by a color probe in the unattended hemifield drawn either in the target color, the reward color, both colors, or a neutral task-irrelevant color. To test whether target and reward relevance trigger separable modulations, we manipulate attention demands on target selection while keeping reward-defining experimental parameters constant. Replicating previous observations, we find that reward and target relevance produce almost indistinguishable gain modulations in ventral extratriate cortex contralateral to the unattended color probe. Importantly, increasing attention demands on target discrimination increases the response to the target-defining color, whereas the response to the rewarded color remains largely unchanged. These observations indicate that, although task relevance and reward influence the very same feature-selective area in extrastriate visual cortex, the associated modulations are largely independent.


2019 ◽  
Vol 30 (8) ◽  
pp. 1174-1185 ◽  
Author(s):  
Poppy Watson ◽  
Daniel Pearson ◽  
Michelle Chow ◽  
Jan Theeuwes ◽  
Reinout W. Wiers ◽  
...  

Physically salient but task-irrelevant distractors can capture attention in visual search, but resource-dependent, executive-control processes can help reduce this distraction. However, it is not only physically salient stimuli that grab our attention: Recent research has shown that reward history also influences the likelihood that stimuli will capture attention. Here, we investigated whether resource-dependent control processes modulate the effect of reward on attentional capture, much as for the effect of physical salience. To this end, we used eye tracking with a rewarded visual search task and compared performance under conditions of high and low working memory load. In two experiments, we demonstrated that oculomotor capture by high-reward distractor stimuli is enhanced under high memory load. These results highlight the role of executive-control processes in modulating distraction by reward-related stimuli. Our findings have implications for understanding the neurocognitive processes involved in real-life conditions in which reward-related stimuli may influence behavior, such as addiction.


PLoS Biology ◽  
2019 ◽  
Vol 17 (8) ◽  
pp. e3000186 ◽  
Author(s):  
Sirawaj Itthipuripat ◽  
Vy A. Vo ◽  
Thomas C. Sprague ◽  
John T. Serences

2015 ◽  
Vol 114 (1) ◽  
pp. 560-569 ◽  
Author(s):  
Sirawaj Itthipuripat ◽  
Kexin Cha ◽  
Napat Rangsipat ◽  
John T. Serences

Normative theories posit that value-based decision-making is context independent. However, decisions between two high-value options can be suboptimally biased by the introduction of a third low-value option. This context-dependent modulation is consistent with the divisive normalization of the value of each stimulus by the total value of all stimuli. In addition, an independent line of research demonstrates that pairing a stimulus with a high-value outcome can lead to attentional capture that can mediate the efficiency of visual information processing. Here we tested the hypothesis that value-based attentional capture interacts with value-based normalization to influence the optimality of decision-making. We used a binary-choice paradigm in which observers selected between two targets and the color of each target indicated the magnitude of their reward potential. Observers also had to simultaneously ignore a task-irrelevant distractor rendered in a color that was previously associated with a specific reward magnitude. When the color of the task-irrelevant distractor was previously associated with a high reward, observers responded more slowly and less optimally. Moreover, as the learned value of the distractor increased, electrophysiological data revealed an attenuation of the lateralized N1 and N2Pc responses evoked by the relevant choice stimuli and an attenuation of the late positive deflection (LPD). Collectively, these behavioral and electrophysiological data suggest that value-based attentional capture and value-based normalization jointly mediate the influence of context on free-choice decision-making.


2020 ◽  
Author(s):  
Ke Bo ◽  
Siyang Yin ◽  
Yuelu Liu ◽  
Zhenhong Hu ◽  
Sreenivasan Meyyapan ◽  
...  

AbstractThe perception of opportunities and threats in complex scenes represents one of the main functions of the human visual system. In the laboratory, its neurophysiological basis is often studied by having observers view pictures varying in affective content. This body of work has consistently shown that viewing emotionally engaging, compared to neutral, pictures (1) heightens blood flow in limbic structures and frontoparietal cortex, as well as in anterior ventral and dorsal visual cortex, and (2) prompts an increase in the late positive event-related potential (LPP), a scalp-recorded and time-sensitive index of engagement within the network of aforementioned neural structures. The role of retinotopic visual cortex in this process has, however, been contentious, with competing theoretical notions predicting the presence versus absence of emotion-specific signals in retinotopic visual areas. The present study used multimodal neuroimaging and machine learning to address this question by examining the large-scale neural representations of affective pictures. Recording EEG and fMRI simultaneously while observers viewed pleasant, unpleasant, and neutral affective pictures, and applying multivariate pattern analysis to single-trial BOLD activities in retinotopic visual cortex, we identified three robust findings: First, unpleasant-versus-neutral decoding accuracy, as well as pleasant-versus-neutral decoding accuracy, were well above chance level in all retinotopic visual areas, including primary visual cortex. Second, the decoding accuracy in ventral visual cortex, but not in early visual cortex or dorsal visual cortex, was significantly correlated with LPP amplitude. Third, effective connectivity from amygdala to ventral visual cortex predicted unpleasant-versus-neutral decoding accuracy, and effective connectivity from ventral frontal cortex to ventral visual cortex predicted pleasant-versus-neutral decoding accuracy. These results suggest that affective pictures evoked valence-specific multivoxel neural representations in retinotopic visual cortex and that these multivoxel representations were influenced by reentry signals from limbic and frontal brain regions.


2007 ◽  
Vol 19 (4) ◽  
pp. 587-593 ◽  
Author(s):  
Notger G. Müller ◽  
Andreas Kleinschmidt

A stimulus that suddenly appears in the corner of the eye inevitably captures our attention, and this in turn leads to faster detection of a second stimulus presented at the same position shortly thereafter. After about 250 msec, however, this effect reverses and the second stimulus is detected faster when it appears far away from the first. Here, we report a potential physiological correlate of this time-dependent attentional facilitation and inhibition. We measured the activity in visual cortex representations of the second (target) stimulus' location depending on the stimulus onset asynchrony (SOA) and spatial distance that separated the target from the preceding cue stimulus. At an SOA of 100 msec, the target yielded larger responses when it was presented near to than far away from the cue. At an SOA of 850 msec, however, the response to the target was more pronounced when it appeared far away from the cue. Our data show how the neural substrate of visual orienting is guided by immediately preceding sensory experience and how a fast-reacting brain system modulates sensory processing by briefly increasing and subsequently decreasing responsiveness in parts of the visual cortex. We propose these activity modulations as the neural correlate of the sequence of perceptual facilitation and inhibition after attentional capture.


2019 ◽  
Vol 31 (1) ◽  
pp. 155-173 ◽  
Author(s):  
J. Brendan Ritchie ◽  
Hans Op de Beeck

The human capacity for visual categorization is core to how we make sense of the visible world. Although a substantive body of research in cognitive neuroscience has localized this capacity to regions of human visual cortex, relatively few studies have investigated the role of abstraction in how representations for novel object categories are constructed from the neural representation of stimulus dimensions. Using human fMRI coupled with formal modeling of observer behavior, we assess a wide range of categorization models that vary in their level of abstraction from collections of subprototypes to representations of individual exemplars. The category learning tasks range from simple linear and unidimensional category rules to complex crisscross rules that require a nonlinear combination of multiple dimensions. We show that models based on neural responses in primary visual cortex favor a variable, but often limited, extent of abstraction in the construction of representations for novel categories, which differ in degree across tasks and individuals.


2006 ◽  
Vol 20 (2) ◽  
pp. 79-93 ◽  
Author(s):  
R.C. Howard ◽  
A. Chaiwutikornwanich

This study combined an individual differences approach to interrogative suggestibility (IS) with ERP recordings to examine two alternative hypotheses regarding the source of individual differences in IS: (1) differences in attention to task-relevant vis-à-vis task-irrelevant stimuli, and (2) differences in one or more memory processes, indexed by ERP old/new effects. Sixty-five female participants underwent an ERP recording during the 50 min interval between immediate and delayed recall of a short story. ERPs elicited by pictures that either related to the story (“old”), or did not relate to the story (“new”), were recorded using a three-stimulus visual oddball paradigm. ERP old/new effects were examined at selected scalp regions of interest at three post-stimulus intervals: early (250-350 ms), middle (350-700 ms), and late (700-1100 ms). In addition, attention-related ERP components (N1, P2, N2, and P3) evoked by story-relevant pictures, story-irrelevant pictures, and irrelevant distractors were measured from midline electrodes. Late (700-1100 ms) frontal ERP old/new differences reflected individual differences in IS, while early (250-350 ms) and middle latency (350-700 ms) ERP old/new differences distinguished good from poor performers in memory and oddball tasks, respectively. Differences in IS were not reflected in ERP indices of attention. Results supported an account of IS as reflecting individual differences in postretrieval memory processes.


Sign in / Sign up

Export Citation Format

Share Document