scholarly journals Bayesian adaptive model estimation to solve the speed accuracy tradeoff problem in psychophysical experiments

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Jongsoo Baek ◽  
Hae-Jeong Park

AbstractMost psychological experiments measure human cognitive function through the response time and accuracy of the response to a set of stimuli. Since response time and accuracy complement each other, it is often difficult to interpret cognitive performance based on only one dependent measurement and raises a speed-accuracy tradeoff (SAT) problem. In overcoming this problem, SAT experimental paradigms and models that integrate response time and accuracy have been proposed to understand information processing in human cognitive function. However, due to a lengthy SAT experiment for reliable model estimation, SAT experiments' practical limitations have been pointed out. Thus, these limitations call for an efficient technique to shorten the number of trials required to estimate the SAT function reliably. Instead of using a block's stimulus-onset asynchrony (SOA) accuracy with long block-based task trials, we introduced a Bayesian SAT function estimation using trial-by-trial response time and correctness, which makes SAT tasks flexible and easily extendable to multiple trials. We then proposed a Bayesian adaptive method to select optimal SOA by maximizing information gain to estimate model parameters. Simulation results showed that the proposed Bayesian adaptive estimation was highly efficient and robust for accuracy and precision of estimating SAT function by enabling "multiple-step ahead search."

1983 ◽  
Vol 27 (5) ◽  
pp. 359-363
Author(s):  
Robert E. Schlegel ◽  
William F. Storm

A study was conducted to further evaluate the Manikin Task, a test of spatial orientation information processing. The objectives of the study were to determine the speed vs. accuracy tradeoff characteristics of the task and to assess performance on the task under the influence of ethyl alcohol. Response times and accuracy were measured on five subjects over a five-week period. Analysis of the data indicated a definite decline in accuracy corresponding to a forced decrease in response time. The effect of alcohol was evidenced by a change in the slope of the speed-accuracy tradeoff function.


2020 ◽  
Author(s):  
Benjamin Domingue ◽  
Klint Kanopka ◽  
Ben Stenhaug ◽  
Michael Sulik ◽  
Tanesia Beverly ◽  
...  

The speed-accuracy tradeoff suggests that responses generated under time constraints will be less accurate. While it has undergone extensive experimental verification, it is less clear whether it applies in settings where time pressures are not being experimentally manipulated (but where respondents still vary in their utilization of time). Using a large corpus of 29 response time datasets containing data from cognitive tasks without experimental manipulation of time pressure, we probe whether the speed-accuracy tradeoff holds across a variety of tasks using idiosyncratic within-person variation in speed. We find inconsistent relationships between marginal increases in time spent responding and accuracy; in many cases, marginal increases in time do not predict increases in accuracy. However, we do observe time pressures (in the form of time limits) to consistently reduce accuracy and for rapid responses to typically show the anticipated relationship (i.e., they are more accurate if they are slower). We also consider analysis of items and individuals. We find substantial variation in the item-level associations between speed and accuracy. On the person side, respondents who exhibit more within-person variation in response speed are typically of lower ability. Finally, we consider the predictive power of a person's response time in predicting out-of-sample responses; it is generally a weak predictor. Collectively, our findings suggest the speed-accuracy tradeoff may be limited as a conceptual model in its application in non-experimental settings and, more generally, offer empirical results and an analytic approach that will be useful as more response time data is collected.


2010 ◽  
Vol 31 (3) ◽  
pp. 130-137 ◽  
Author(s):  
Hagen C. Flehmig ◽  
Michael B. Steinborn ◽  
Karl Westhoff ◽  
Robert Langner

Previous research suggests a relationship between neuroticism (N) and the speed-accuracy tradeoff in speeded performance: High-N individuals were observed performing less efficiently than low-N individuals and compensatorily overemphasizing response speed at the expense of accuracy. This study examined N-related performance differences in the serial mental addition and comparison task (SMACT) in 99 individuals, comparing several performance measures (i.e., response speed, accuracy, and variability), retest reliability, and practice effects. N was negatively correlated with mean reaction time but positively correlated with error percentage, indicating that high-N individuals tended to be faster but less accurate in their performance than low-N individuals. The strengthening of the relationship after practice demonstrated the reliability of the findings. There was, however, no relationship between N and distractibility (assessed via measures of reaction time variability). Our main findings are in line with the processing efficiency theory, extending the relationship between N and working style to sustained self-paced speeded mental addition.


1997 ◽  
Author(s):  
Jeffry S. Kellogg ◽  
Xiangen Hu ◽  
William Marks

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Roger Ratcliff ◽  
Inhan Kang

AbstractRafiei and Rahnev (2021) presented an analysis of an experiment in which they manipulated speed-accuracy stress and stimulus contrast in an orientation discrimination task. They argued that the standard diffusion model could not account for the patterns of data their experiment produced. However, their experiment encouraged and produced fast guesses in the higher speed-stress conditions. These fast guesses are responses with chance accuracy and response times (RTs) less than 300 ms. We developed a simple mixture model in which fast guesses were represented by a simple normal distribution with fixed mean and standard deviation and other responses by the standard diffusion process. The model fit the whole pattern of accuracy and RTs as a function of speed/accuracy stress and stimulus contrast, including the sometimes bimodal shapes of RT distributions. In the model, speed-accuracy stress affected some model parameters while stimulus contrast affected a different one showing selective influence. Rafiei and Rahnev’s failure to fit the diffusion model was the result of driving subjects to fast guess in their experiment.


2013 ◽  
Vol 2013 ◽  
pp. 1-9 ◽  
Author(s):  
Ali Kargarnejad ◽  
Mohsen Taherbaneh ◽  
Amir Hosein Kashefi

Tracking maximum power point of a solar panel is of interest in most of photovoltaic applications. Solar panel modeling is also very interesting exclusively based on manufacturers data. Knowing that the manufacturers generally give the electrical specifications of their products at one operating condition, there are so many cases in which the specifications in other conditions are of interest. In this research, a comprehensive one-diode model for a solar panel with maximum obtainable accuracy is fully developed only based on datasheet values. The model parameters dependencies on environmental conditions are taken into consideration as much as possible. Comparison between real data and simulations results shows that the proposed model has maximum obtainable accuracy. Then a new fuzzy-based controller to track the maximum power point of the solar panel is also proposed which has better response from speed, accuracy and stability point of view respect to the previous common developed one.


Author(s):  
Gerard Derosiere ◽  
David Thura ◽  
Paul Cisek ◽  
Julie Duqué

Humans and other animals often need to balance the desire to gather sensory information (to make the best choice) with the urgency to act, facing a speed-accuracy tradeoff (SAT). Given the ubiquity of SAT across species, extensive research has been devoted to understanding the computational mechanisms allowing its regulation at different timescales, including from one context to another, and from one decision to another. However, animals must frequently change their SAT on even shorter timescales - i.e., over the course of an ongoing decision - and little is known about the mechanisms that allow such rapid adaptations. The present study aimed at addressing this issue. Human subjects performed a decision task with changing evidence. In this task, subjects received rewards for correct answers but incurred penalties for mistakes. An increase or a decrease in penalty occurring halfway through the trial promoted rapid SAT shifts, favoring speeded decisions either in the early or in the late stage of the trial. Importantly, these shifts were associated with stage-specific adjustments in the accuracy criterion exploited for committing to a choice. Those subjects who decreased the most their accuracy criterion at a given decision stage exhibited the highest gain in speed, but also the highest cost in terms of performance accuracy at that time. Altogether, the current findings offer a unique extension of previous work, by suggesting that dynamic changes in accuracy criterion allow the regulation of the SAT within the timescale of a single decision.


Sign in / Sign up

Export Citation Format

Share Document