Mesoscale cortical dynamics reflect the interaction of sensory evidence and temporal expectation during perceptual decision-making

AbstractPerceptual decisions rely on accumulating sensory evidence. This computation has been studied using either drift diffusion models or neurobiological network models exhibiting winner-take-all attractor dynamics. Although both models can account for a large amount of data, it remains unclear whether their dynamics are qualitatively equivalent. Here we show that in the attractor model, but not in the drift diffusion model, an increase in the stimulus fluctuations or the stimulus duration promotes transitions between decision states. The increase in the number of transitions leads to a crossover between weighting mostly early evidence (primacy) to weighting late evidence (recency), a prediction we validate with psychophysical data. Between these two limiting cases, we found a novel flexible categorization regime, in which fluctuations can reverse initially-incorrect categorizations. This reversal asymmetry results in a non-monotonic psychometric curve, a distinctive feature of the attractor model. Our findings point to correcting decision reversals as an important feature of perceptual decision making.

Download Full-text

Integration of sensory evidence and reward expectation in mouse perceptual decision-making task with various sensory uncertainties.

iScience ◽

10.1016/j.isci.2021.102826 ◽

2021 ◽

pp. 102826

Author(s):

Akihiro Funamizu

Keyword(s):

Decision Making ◽

Perceptual Decision Making ◽

Perceptual Decision ◽

Sensory Evidence

Download Full-text

Decoupling sensory from decisional choice biases in perceptual decision making

10.1101/062380 ◽

2016 ◽

Author(s):

Daniel Linares ◽

David Aguilar-Lleyda ◽

Joan López-Moliner

Keyword(s):

Decision Making ◽

Theory Model ◽

Decision Makers ◽

Perceptual Decision Making ◽

Perceptual Decision ◽

Response Mapping ◽

Task Instructions ◽

Detection Theory Model ◽

Sensory Evidence ◽

Choice Bias

ABSTRACTThe contribution of sensory and decisional processes to perceptual decision making is still unclear, even in simple perceptual tasks. When decision makers need to select an action from a set of balanced alternatives, any tendency to choose one alternative more often— choice bias—is consistent with a bias in the sensory evidence, but also with a preference to select that alternative independently of the sensory evidence. To decouple sensory from decisional biases, here we asked humans to perform a simple perceptual discrimination task with two symmetric alternatives under two different task instructions. The instructions varied the response mapping between perception and the category of the alternatives. We found that from 32 participants, 30 exhibited sensory biases and 15 decisional biases. The decisional biases were consistent with a criterion change in a simple signal detection theory model. Perceptual decision making, thus, even in simple scenarios, is affected by sensory and decisional choice biases.IMPACT STATEMENTPerceptual decision making, even in simple scenarios, is affected by sensory and decisional choice biases.

Download Full-text

Slow drift of neural activity as a signature of impulsivity in macaque visual and prefrontal cortex

10.1101/2020.01.10.902403 ◽

2020 ◽

Cited By ~ 2

Author(s):

Benjamin R. Cowley ◽

Adam C. Snyder ◽

Katerina Acar ◽

Ryan C. Williamson ◽

Byron M. Yu ◽

...

Keyword(s):

Decision Making ◽

Prefrontal Cortex ◽

Neural Activity ◽

Internal State ◽

Sensory Stimulus ◽

Perceptual Decision Making ◽

Population Activity ◽

Perceptual Decision ◽

Slow Drift ◽

Sensory Evidence

AbstractAn animal’s decision depends not only on incoming sensory evidence but also on its fluctuating internal state. This internal state is a product of cognitive factors, such as fatigue, motivation, and arousal, but it is unclear how these factors influence the neural processes that encode the sensory stimulus and form a decision. We discovered that, over the timescale of tens of minutes during a perceptual decision-making task, animals slowly shifted their likelihood of reporting stimulus changes. They did this unprompted by task conditions. We recorded neural population activity from visual area V4 as well as prefrontal cortex, and found that the activity of both areas slowly drifted together with the behavioral fluctuations. We reasoned that such slow fluctuations in behavior could either be due to slow changes in how the sensory stimulus is processed or due to a process that acts independently of sensory processing. By analyzing the recorded activity in conjunction with models of perceptual decision-making, we found evidence for the slow drift in neural activity acting as an impulsivity signal, overriding sensory evidence to dictate the final decision. Overall, this work uncovers an internal state embedded in the population activity across multiple brain areas, hidden from typical trial-averaged analyses and revealed only when considering the passage of time within each experimental session. Knowledge of this cognitive factor was critical in elucidating how sensory signals and the internal state together contribute to the decision-making process.

Download Full-text

An accumulation-of-evidence task using visual pulses for mice navigating in virtual reality

10.1101/232702 ◽

2017 ◽

Author(s):

Lucas Pinto ◽

Sue Ann Koay ◽

Ben Engelhard ◽

Alice M. Yoon ◽

Ben Deverett ◽

...

Keyword(s):

Decision Making ◽

Virtual Reality ◽

Single Pulse ◽

Model Organisms ◽

Perceptual Decision Making ◽

Perceptual Decision ◽

Crucial Component ◽

Wide Availability ◽

Multiple Pulses ◽

Sensory Evidence

ABSTRACTThe gradual accumulation of sensory evidence is a crucial component of perceptual decision making, but its neural mechanisms are still poorly understood. Given the wide availability of genetic and optical tools for mice, they can be useful model organisms for the study of these phenomena; however, behavioral tools are largely lacking. Here, we describe a new evidence-accumulation task for head-fixed mice navigating in a virtual reality environment. As they navigate down the stem of a virtual T-maze, they see brief pulses of visual evidence on either side, and retrieve a reward on the arm with the highest number of pulses. The pulses occur randomly with Poisson statistics, yielding a diverse yet well-controlled stimulus set, making the data conducive to a variety of computational approaches. A large number of mice of different genotypes were able to learn and consistently perform the task, at levels similar to rats in analogous tasks. They are sensitive to side differences of a single pulse, and their memory of the cues is stable over time. Moreover, using non-parametric as well as modeling approaches, we show that the mice indeed accumulate evidence: they use multiple pulses of evidence from throughout the cue region of the maze to make their decision, albeit with a small overweighting of earlier cues, and their performance is affected by the magnitude but not the duration of evidence. Additionally, analysis of the mice's running patterns revealed that trajectories are fairly stereotyped yet modulated by the amount of sensory evidence, suggesting that the navigational component of this task may provide a continuous readout correlated to the underlying cognitive variables. Our task, which can be readily integrated with state-of-the-art techniques, is thus a valuable tool to study the circuit mechanisms and dynamics underlying perceptual decision making, particularly under more complex behavioral contexts.

Download Full-text

Trial-by-trial fluctuations in amygdala activity track motivational enhancement of desirable sensory evidence during perceptual decision-making

10.1101/2021.12.03.471135 ◽

2021 ◽

Author(s):

Ren Paterson ◽

Yizhou Lyu ◽

Yuan Chang Leong

Keyword(s):

Decision Making ◽

Sensory Processing ◽

Behavior Modeling ◽

Perceptual Decision Making ◽

Sports Fans ◽

Perceptual Decision ◽

Amygdala Activity ◽

Sensory Evidence ◽

Human Participants

AbstractPeople are biased towards seeing outcomes that they are motivated to see. For example, sports fans of opposing teams often perceive the same ambiguous foul in favor of the team they support. Here, we test the hypothesis that amygdala-dependent allocation of visual attention facilitates motivational biases in perceptual decision-making. Human participants were rewarded for correctly categorizing an ambiguous image into one of two categories while undergoing fMRI. On each trial, we used a financial bonus to motivate participants to see one category over another. The reward maximizing strategy was to perform the categorization task accurately, but participants were biased towards categorizing the images as the category we motivated them to see. Heightened amygdala activity preceded motivation consistent categorizations, and participants with higher amygdala activation exhibited stronger motivational biases in their perceptual reports. Trial-by-trial amygdala activity was associated with stronger enhancement of neural activity encoding desirable percepts in sensory cortices, suggesting that amygdala-dependent effects on perceptual decisions arose from biased sensory processing. Analyses using a drift diffusion model provide converging evidence that trial-by-trial amygdala activity was associated with stronger motivational biases in the accumulation of sensory evidence. Prior work examining biases in perceptual decision-making have focused on the role of frontoparietal regions. Our work highlights an important contribution of the amygdala. When people are motivated to see one outcome over another, the amygdala biases perceptual decisions towards those outcomes.Significance StatementForming accurate perceptions of the environment is essential for adaptive behavior. People however are biased towards seeing what they want to see, giving rise to inaccurate perceptions and erroneous decisions. Here, we combined behavior, modeling, and fMRI to show that the bias towards seeing desirable percepts is related to trial-by-trial fluctuations in amygdala activity. In particular, during moments with higher amygdala activity, sensory processing is biased in favor of desirable percepts, such that participants are more likely to see what they want to see. These findings highlight the role of the amygdala in biasing visual perception, and shed light on the neural mechanisms underlying the influence of motivation and reward on how people decide what they see.

Download Full-text

Complementary Roles of Systems Representing Sensory Evidence and Systems Detecting Task Difficulty During Perceptual Decision Making

Frontiers in Neuroscience ◽

10.3389/fnins.2010.00190 ◽

2010 ◽

Vol 4 ◽

Cited By ~ 8

Author(s):

Douglas A. Ruff ◽

Sean Marrett ◽

Hauke R. Heekeren ◽

Peter A. Bandettini ◽

Leslie G. Ungerleider

Keyword(s):

Decision Making ◽

Task Difficulty ◽

Perceptual Decision Making ◽

Perceptual Decision ◽

Sensory Evidence

Download Full-text

Predictive activation of sensory representations as a source of evidence in perceptual decision-making

10.31234/osf.io/rk7ef ◽

2020 ◽

Author(s):

Daniel Feuerriegel ◽

Tessel Blom ◽

Hinze Hogendoorn

Keyword(s):

Decision Making ◽

Decision Model ◽

Perceptual Decision Making ◽

Specific Stimulus ◽

Perceptual Decision ◽

Evidence Accumulation ◽

Neural Representations ◽

Sensory Environment ◽

Sensory Evidence ◽

Diffusion Decision Model

Our brains can represent expected future states of our sensory environment. Recent work has shown that, when we expect a specific stimulus to appear at a specific time, we can predictively generate neural representations of that stimulus even before it is physically presented. These observations raise two exciting questions: Are pre-activated sensory representations used for perceptual decision-making? And, are there instances in which we transiently perceive an expected stimulus that does not actually appear? To address these questions, we propose that pre-activated neural representations provide sensory evidence that is used for perceptual decision-making. This can be understood within the framework of the Diffusion Decision Model as an early accumulation of decision evidence in favour of the expected percept. Our proposal makes novel predictions relating to expectation effects on neural markers of decision evidence accumulation, and also provides an explanation for why we do not typically perceive stimuli that are expected, but do not appear.

Download Full-text

Effects of Category-Specific Costs on Neural Systems for Perceptual Decision-Making

Journal of Neurophysiology ◽

10.1152/jn.01084.2009 ◽

2010 ◽

Vol 103 (6) ◽

pp. 3238-3247 ◽

Cited By ~ 22

Author(s):

Stephen M. Fleming ◽

Louise Whiteley ◽

Oliver J. Hulme ◽

Maneesh Sahani ◽

Raymond J. Dolan

Keyword(s):

Decision Making ◽

Anterior Cingulate ◽

Extrastriate Cortex ◽

Parahippocampal Gyrus ◽

Perceptual Decision Making ◽

Decision Criteria ◽

Specific Cost ◽

Perceptual Decision ◽

Sensory Evidence ◽

The Brain

Perceptual judgments are often biased by prospective losses, leading to changes in decision criteria. Little is known about how and where sensory evidence and cost information interact in the brain to influence perceptual categorization. Here we show that prospective losses systematically bias the perception of noisy face-house images. Asymmetries in category-specific cost were associated with enhanced blood-oxygen-level-dependent signal in a frontoparietal network. We observed selective activation of parahippocampal gyrus for changes in category-specific cost in keeping with the hypothesis that loss functions enact a particular task set that is communicated to visual regions. Across subjects, greater shifts in decision criteria were associated with greater activation of the anterior cingulate cortex (ACC). Our results support a hypothesis that costs bias an intermediate representation between perception and action, expressed via general effects on frontal cortex, and selective effects on extrastriate cortex. These findings indicate that asymmetric costs may affect a neural implementation of perceptual decision making in a similar manner to changes in category expectation, constituting a step toward accounting for how prospective losses are flexibly integrated with sensory evidence in the brain.

Download Full-text