scholarly journals Confluence of timing and reward biases in perceptual decision-making dynamics

2019 ◽  
Author(s):  
Maxwell Shinn ◽  
Daniel Ehrlich ◽  
Daeyeol Lee ◽  
John D. Murray ◽  
Hyojung Seo

AbstractAlthough the decisions of our daily lives often occur in the context of temporal and reward structures, the impact of such regularities on decision-making strategy is poorly understood. Here, to explore how temporal and reward context modulate strategy, we trained rhesus monkeys to perform a novel perceptual decision-making task with asymmetric rewards and time-varying evidence reliability. To model the choice and response time patterns, we developed a computational framework for fitting generalized drift-diffusion models (GDDMs) which flexibly accommodates diverse evidence accumulation strategies. We found that a dynamic urgency signal and leaky integration, in combination with two independent forms of reward biases, best capture behavior. We also tested how temporal structure influences urgency by systematically manipulating the temporal structure of sensory evidence, and found that the time course of urgency was affected by temporal context. Overall, our approach identified key components of cognitive mechanisms for incorporating temporal and reward structure into decisions.


2019 ◽  
Vol 31 (7) ◽  
pp. 1044-1053 ◽  
Author(s):  
Gerard M. Loughnane ◽  
Méadhbh B. Brosnan ◽  
Jessica J. M. Barnes ◽  
Angela Dean ◽  
Sanjay L. Nandam ◽  
...  

Recent behavioral modeling and pupillometry studies suggest that neuromodulatory arousal systems play a role in regulating decision formation but neurophysiological support for these observations is lacking. We employed a randomized, double-blinded, placebo-controlled, crossover design to probe the impact of pharmacological enhancement of catecholamine levels on perceptual decision-making. Catecholamine levels were manipulated using the clinically relevant drugs methylphenidate and atomoxetine, and their effects were compared with those of citalopram and placebo. Participants performed a classic EEG oddball paradigm that elicits the P3b, a centro-parietal potential that has been shown to trace evidence accumulation, under each of the four drug conditions. We found that methylphenidate and atomoxetine administration shortened RTs to the oddball targets. The neural basis of this behavioral effect was an earlier P3b peak latency, driven specifically by an increase in its buildup rate without any change in its time of onset or peak amplitude. This study provides neurophysiological evidence for the catecholaminergic enhancement of a discrete aspect of human decision-making, that is, evidence accumulation. Our results also support theoretical accounts suggesting that catecholamines may enhance cognition via increases in neural gain.



2015 ◽  
Vol 48 (1) ◽  
pp. 184-200 ◽  
Author(s):  
Leendert van Maanen ◽  
Birte U. Forstmann ◽  
Max C. Keuken ◽  
Eric-Jan Wagenmakers ◽  
Andrew Heathcote


2021 ◽  
Author(s):  
Kyra Schapiro ◽  
Kresimir Josic ◽  
Zachary Kilpatrick ◽  
Joshua I Gold

Deliberative decisions based on an accumulation of evidence over time depend on working memory, and working memory has limitations, but how these limitations affect deliberative decision-making is not understood. We used human psychophysics to assess the impact of working-memory limitations on the fidelity of a continuous decision variable. Participants decided the average location of multiple visual targets. This computed, continuous decision variable degraded with time and capacity in a manner that depended critically on the strategy used to form the decision variable. This dependence reflected whether the decision variable was computed either: 1) immediately upon observing the evidence, and thus stored as a single value in memory; or 2) at the time of the report, and thus stored as multiple values in memory. These results provide important constraints on how the brain computes and maintains temporally dynamic decision variables.



2021 ◽  
Vol 15 ◽  
Author(s):  
Clara Saleri Lunazzi ◽  
Amélie J. Reynaud ◽  
David Thura

Recent theories and data suggest that adapted behavior involves economic computations during which multiple trade-offs between reward value, accuracy requirement, energy expenditure, and elapsing time are solved so as to obtain rewards as soon as possible while spending the least possible amount of energy. However, the relative impact of movement energy and duration costs on perceptual decision-making and movement initiation is poorly understood. Here, we tested 31 healthy subjects on a perceptual decision-making task in which they executed reaching movements to report probabilistic choices. In distinct blocks of trials, the reaching duration (“Time” condition) and energy (“Effort” condition) costs were independently varied compared to a “Reference” block, while decision difficulty was maintained similar at the block level. Participants also performed a simple delayed-reaching (DR) task aimed at estimating movement initiation duration in each motor condition. Results in that DR task show that long duration movements extended reaction times (RTs) in most subjects, whereas energy-consuming movements led to mixed effects on RTs. In the decision task, about half of the subjects decreased their decision durations (DDs) in the Time condition, while the impact of energy on DDs were again mixed across subjects. Decision accuracy was overall similar across motor conditions. These results indicate that movement duration and, to a lesser extent, energy expenditure, idiosyncratically affect perceptual decision-making and action initiation. We propose that subjects who shortened their choices in the time-consuming condition of the decision task did so to limit a drop of reward rate.



Author(s):  
Elaheh Imani ◽  
Ahad Harati ◽  
Hamidreza Pourreza ◽  
Morteza Moazami Goudarzi

AbstractPerceptual decision making, as a process of detecting and categorizing information, has been studied extensively over the last two decades. In this study, we investigated the neural characterization of the whole decision-making process by discovering the information processing stages. Such that, the timing and the neural signature of the processing stages were identified for individual trials. The association of stages duration with the stimulus coherency and spatial prioritization factors also revealed the importance of the evidence accumulation process on the speed of the whole decision-making process. We reported that the impact of the stimulus coherency and spatial prioritization on the neural representation of the decision-making process was consistent with the behavioral characterization as well. This study demonstrated that uncovering the cognitive processing stages provided more insights into the decision-making process.



2021 ◽  
Author(s):  
Clara Saleri Lunazzi ◽  
Amélie J. Reynaud ◽  
David Thura

Recent theories and data suggest that adapted behavior involves economic computations during which multiple trade-offs between reward value, accuracy requirement, energy expenditure and elapsing time are solved so as to obtain rewards as soon as possible while spending the least possible amount of energy. However, the relative impact of movement energy and duration costs on perceptual decision-making and movement initiation is poorly understood. Here, we tested 31 healthy subjects on a perceptual decision-making task in which they executed reaching movements to report probabilistic choices. In three distinct blocks of trials, the reaching time and energy costs were independently varied while decision difficulty was maintained similar at the block level. Participants also performed a fully instructed delayed-reaching (DR) task in each motor condition. Results in that DR task show that time-consuming movements extended reaction times (RTs) in most subjects, whereas energy-consuming movements led to mixed effects on RTs. In the choice task, about half of the subjects decreased their decision durations (DDs) in the time consuming condition, while the impact of energy costs on DDs were again mixed across subjects. Decision accuracy was overall similar across motor conditions. These results indicate that movement duration and, to a lesser extent, energy expenditure, idiosyncratically affect perceptual decision-making and action initiation. We propose that subjects who shortened their decisions in the time consuming condition of the choice task did so to limit a drop of their rate of reward.



Author(s):  
Yvette Karvay ◽  
Gabriella Imbriano ◽  
Jingwen Jin ◽  
Aprajita Mohanty ◽  
Johanna M. Jarcho


2018 ◽  
Author(s):  
Gerard M. Loughnane ◽  
Méadhbh B. Brosnan ◽  
Jessica J.M. Barnes ◽  
Angela Dean ◽  
L. Sanjay Nandam ◽  
...  

AbstractRecent behavioural modelling and pupillometry studies suggest that neuromodulatory arousal systems play a role in regulating decision formation but neurophysiological support for these observations is lacking. We employed a randomised, double-blinded, placebo-controlled, crossover design to probe the impact of pharmacological enhancement of catecholamine levels on perceptual decision making. Catecholamine levels were manipulated using the clinically relevant drugs methylphenidate (MPH) and atomoxetine (ATM) and their effects were compared to those of citalopram (CIT), and placebo (PLA). Participants performed a classic EEG oddball paradigm which elicits the P3b, a centro-parietal potential that has been shown to trace evidence accumulation, under each of the four drug conditions. We found that MPH and ATM administration shortened RTs to the oddball targets. The neural basis of this behavioural effect was an earlier P3b peak latency, driven specifically by an increase in its build-up rate without any change in its time of onset or peak amplitude. This study provides neurophysiological evidence for the catecholaminergic enhancement of a discrete aspect of human decision making, i.e. evidence accumulation. Our results also support theoretical accounts suggesting that catecholamines may enhance cognition via increases in neural gain.



2016 ◽  
Vol 113 (21) ◽  
pp. 6059-6064 ◽  
Author(s):  
Dobromir Rahnev ◽  
Derek Evan Nee ◽  
Justin Riddle ◽  
Alina Sue Larson ◽  
Mark D’Esposito

Although recent research has shown that the frontal cortex has a critical role in perceptual decision making, an overarching theory of frontal functional organization for perception has yet to emerge. Perceptual decision making is temporally organized such that it requires the processes of selection, criterion setting, and evaluation. We hypothesized that exploring this temporal structure would reveal a large-scale frontal organization for perception. A causal intervention with transcranial magnetic stimulation revealed clear specialization along the rostrocaudal axis such that the control of successive stages of perceptual decision making was selectively affected by perturbation of successively rostral areas. Simulations with a dynamic model of decision making suggested distinct computational contributions of each region. Finally, the emergent frontal gradient was further corroborated by functional MRI. These causal results provide an organizational principle for the role of frontal cortex in the control of perceptual decision making and suggest specific mechanistic contributions for its different subregions.



2018 ◽  
Vol 355 ◽  
pp. 48-55 ◽  
Author(s):  
Jessica Dully ◽  
David P. McGovern ◽  
Redmond G. O’Connell


Sign in / Sign up

Export Citation Format

Share Document