scholarly journals Tuning the speed-accuracy trade-off to maximize reward rate in multisensory decision-making

eLife ◽  
2015 ◽  
Vol 4 ◽  
Author(s):  
Jan Drugowitsch ◽  
Gregory C DeAngelis ◽  
Dora E Angelaki ◽  
Alexandre Pouget

For decisions made under time pressure, effective decision making based on uncertain or ambiguous evidence requires efficient accumulation of evidence over time, as well as appropriately balancing speed and accuracy, known as the speed/accuracy trade-off. For simple unimodal stimuli, previous studies have shown that human subjects set their speed/accuracy trade-off to maximize reward rate. We extend this analysis to situations in which information is provided by multiple sensory modalities. Analyzing previously collected data (<xref ref-type="bibr" rid="bib4">Drugowitsch et al., 2014</xref>), we show that human subjects adjust their speed/accuracy trade-off to produce near-optimal reward rates. This trade-off can change rapidly across trials according to the sensory modalities involved, suggesting that it is represented by neural population codes rather than implemented by slow neuronal mechanisms such as gradual changes in synaptic weights. Furthermore, we show that deviations from the optimal speed/accuracy trade-off can be explained by assuming an incomplete gradient-based learning of these trade-offs.

2016 ◽  
Vol 113 (45) ◽  
pp. 12868-12873 ◽  
Author(s):  
Mehdi Keramati ◽  
Peter Smittenaar ◽  
Raymond J. Dolan ◽  
Peter Dayan

Behavioral and neural evidence reveal a prospective goal-directed decision process that relies on mental simulation of the environment, and a retrospective habitual process that caches returns previously garnered from available choices. Artificial systems combine the two by simulating the environment up to some depth and then exploiting habitual values as proxies for consequences that may arise in the further future. Using a three-step task, we provide evidence that human subjects use such a normative plan-until-habit strategy, implying a spectrum of approaches that interpolates between habitual and goal-directed responding. We found that increasing time pressure led to shallower goal-directed planning, suggesting that a speed-accuracy tradeoff controls the depth of planning with deeper search leading to more accurate evaluation, at the cost of slower decision-making. We conclude that subjects integrate habit-based cached values directly into goal-directed evaluations in a normative manner.


Author(s):  
Jan Drugowitsch ◽  
Gregory C DeAngelis ◽  
Dora E Angelaki ◽  
Alexandre Pouget

2012 ◽  
Vol 11 (3) ◽  
pp. 118-126 ◽  
Author(s):  
Olive Emil Wetter ◽  
Jürgen Wegge ◽  
Klaus Jonas ◽  
Klaus-Helmut Schmidt

In most work contexts, several performance goals coexist, and conflicts between them and trade-offs can occur. Our paper is the first to contrast a dual goal for speed and accuracy with a single goal for speed on the same task. The Sternberg paradigm (Experiment 1, n = 57) and the d2 test (Experiment 2, n = 19) were used as performance tasks. Speed measures and errors revealed in both experiments that dual as well as single goals increase performance by enhancing memory scanning. However, the single speed goal triggered a speed-accuracy trade-off, favoring speed over accuracy, whereas this was not the case with the dual goal. In difficult trials, dual goals slowed down scanning processes again so that errors could be prevented. This new finding is particularly relevant for security domains, where both aspects have to be managed simultaneously.


2016 ◽  
Author(s):  
Miriam C Klein-Flügge ◽  
Steven W Kennerley ◽  
Karl Friston ◽  
Sven Bestmann

AbstractIntegrating costs and benefits is crucial for optimal decision-making. While much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human functional magnetic resonance imaging during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area (SMA) and the caudal portion of dorsal anterior cingulate cortex (dACC) encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modelled effort-discounted subjective values using a novel behavioural model. This revealed that the same network of regions involving dACC and SMA encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in SMA and ventro-medial PFC (vmPFC) correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not vmPFC as typically reported for outcome-based choice. Furthermore, distinct frontal circuits ‘drive’ behaviour towards reward-maximization and effort-minimization.Significance StatementThe neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behaviour, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioural characterization of how humans trade-off reward-maximization with effort-minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits ‘drive’ behaviour towards reward-maximization or effort-minimization.


2018 ◽  
Author(s):  
James Marshall ◽  
Ralf H.J.M. Kurvers ◽  
Jens Krause ◽  
Max Wolf

Majority-voting and the Condorcet Jury Theorem pervade thinking about collective decision-making. Thus, it is typically assumed that majority-voting is the best possible decision mechanism, and that scenarios exist where individually-weak decision-makers should not pool information. Condorcet and its applications implicitly assume that only one kind of error can be made, yet signal detection theory shows two kinds of errors exist, ‘false positives’ and ‘false negatives’. We apply signal detection theory to collective decision-making to show that majority voting is frequently sub-optimal, and can be optimally replaced by quorum decision-making. While quorums have been proposed to resolve within-group conflicts, or manage speed-accuracy trade-offs, our analysis applies to groups with aligned interests undertaking single-shot decisions. Our results help explain the ubiquity of quorum decision-making in nature, relate the use of sub- and super-majority quorums to decision ecology, and may inform the design of artificial decision-making systems.Impact StatementTheory typically assumes that majority voting is optimal; this is incorrect – majority voting is typically sub-optimal, and should be replaced by sub-majority or super-majority quorum voting. This helps explain the prevalence of quorum-sensing in even the simplest collective systems, such as bacterial communities.


2019 ◽  
Vol 9 (4) ◽  
pp. 41 ◽  
Author(s):  
Wu ◽  
Struys ◽  
Lochtman

The effect of bilingualism on inhibition control is increasingly under ongoing exploration. The present study primarily investigated the effect of within bilingual factors (i.e., dominance types of Uyghur-Chinese bilinguals) on a Stimulus-Stimulus task (Flanker) and a Stimulus-Response task (Simon). We also compared the bilinguals' performance on each type of cognitive control task in respect to a possible trade-off between speed and accuracy. The findings showed no explicit differences on performance in response time or accuracy among balanced, L1-dominant and L2-dominant bilinguals but balanced bilinguals demonstrated a significant speed-accuracy trade-off in the overall context switching between non-conflict and conflict trials in both cognitive control tasks where monitoring process is highly demanded. Additionally, all bilinguals across all language dominance types showed a trade-off strategy in inhibition during a Stimulus-Stimulus conflict (flanker task). This evidence indicates that the differences of within bilinguals in cognitive control could lie in the monitoring process, while for all bilinguals, inhibition during a Stimulus-Stimulus conflict could be a major component in the mechanism of bilingual language processing.


2019 ◽  
Vol 2019 ◽  
pp. 1-7 ◽  
Author(s):  
M. Ammar Alzarrad ◽  
Gary P. Moynihan ◽  
Muhammad T. Hatamleh ◽  
Siyuan Song

As is often the case in project scheduling, when the project duration is shortened to decrease total cost, the total float is lost resulting in added critical or nearly critical activities. This, in turn, results in decreasing the probability of completing the project on time and increases the risk of schedule delays. To solve this problem, this research developed a fuzzy multicriteria decision-making (FMCDM) model. The objective of this model is to help project managers improve their decisions regarding time-cost-risk trade-offs (TCRTO) in construction projects. In this model, an optimization algorithm based on fuzzy logic and analytic hierarchy process (AHP) has been used to analyze the time-cost-risk trade-off alternatives and select the best one based on selected criteria. The algorithm was implemented in the MATLAB software and applied to two case studies to verify and validate the presented model. The presented FMCDM model could help produce a more reliable schedule and mitigate the risk of projects running overbudget or behind schedule. Further, this model is a powerful decision-making instrument to help managers reduce uncertainties and improve the accuracy of time-cost-risk trade-offs. The presented FMCDM model employed fuzzy linguistic terms, which provide decision-makers with the opportunity to give their judgments as intervals comparing to fixed value judgments. In conclusion, the presented FMCDM model has high robustness, and it is an attractive alternative to the traditional methods to solve the time-cost-risk trade-off problem in construction.


1997 ◽  
Vol 20 (2) ◽  
pp. 306-307 ◽  
Author(s):  
Willem P. De Jong ◽  
Gerard P. Van Galen

Notwithstanding its overwhelming descriptive power for existing data, it is not clear whether the kinematic theory of Plamondon & Alimi could generate new insights into biomechanical constraints and psychological processes underlying the way organisms trade off speed for accuracy. The kinematic model should elaborate on the role of neuromotor noise and on biomechanical strategies for reducing endpoint variability related to such noise.


2014 ◽  
Vol 34 (49) ◽  
pp. 16442-16454 ◽  
Author(s):  
David Thura ◽  
Ignasi Cos ◽  
Jessica Trung ◽  
Paul Cisek

Sign in / Sign up

Export Citation Format

Share Document