scholarly journals The Accuracy and Precision of Measurement

2021 ◽  
Vol 3 (2) ◽  
pp. 1-20
Author(s):  
Leandro Calcagnotto ◽  
Richard Huskey ◽  
Gerald M. Kosicki

Abstract Measurement noise differs by instrument and limits the validity and reliability of findings. Researchers collecting reaction time data introduce noise in the form of response time latency from hardware and software, even when collecting data on standardized computer-based experimental equipment. Reaction time is a measure with broad application for studying cognitive processing in communication research that is vulnerable to response latency noise. In this study, we utilized an Arduino microcontroller to generate a ground truth value of average response time latency in Asteroid Impact, an open source, naturalistic, experimental video game stimulus. We tested if response time latency differed across computer operating system, software, and trial modality. Here we show that reaction time measurements collected using Asteroid Impact were susceptible to response latency variability on par with other response-latency measuring software tests. These results demonstrate that Asteroid Impact is a valid and reliable stimulus for measuring reaction time data. Moreover, we provide researchers with a low-cost and open-source tool for evaluating response time latency in their own labs. Our results highlight the importance of validating measurement tools and support the philosophy of contributing methodological improvements in communication science.

2021 ◽  
Author(s):  
Leandro Avila Calcagnotto ◽  
Richard Huskey ◽  
Gerald M. Kosicki

Measurement noise differs by instrument and limits the validity and reliability of findings. Researchers collecting reaction time data introduce noise in the form of response time latency from hardware and software, even when collecting data on standardized computer-based experimental equipment. Reaction time is a measure with broad application for studying cognitive processing in communication research that is vulnerable to response latency noise. In this study, we utilized an Arduino microcontroller to generate a ground truth value of average response time latency in Asteroid Impact, an open source, naturalistic, experimental video game stimulus. We tested if response time latency differed across computer operating system, software, and trial modality. Here we show that reaction time measurements collected using Asteroid Impact were susceptible to response latency variability on par with other response-latency measuring software tests. These results demonstrate that Asteroid Impact is a valid and reliable stimulus for measuring reaction time data. Moreover, we provide researchers with a low-cost and open-source tool for evaluating response time latency in their own labs. Our results highlight the importance of validating measurement tools and support the philosophy of contributing methodological improvements in communication science.


GeroPsych ◽  
2011 ◽  
Vol 24 (4) ◽  
pp. 169-176 ◽  
Author(s):  
Philippe Rast ◽  
Daniel Zimprich

In order to model within-person (WP) variance in a reaction time task, we applied a mixed location scale model using 335 participants from the second wave of the Zurich Longitudinal Study on Cognitive Aging. The age of the respondents and the performance in another reaction time task were used to explain individual differences in the WP variance. To account for larger variances due to slower reaction times, we also used the average of the predicted individual reaction time (RT) as a predictor for the WP variability. Here, the WP variability was a function of the mean. At the same time, older participants were more variable and those with better performance in another RT task were more consistent in their responses.


1994 ◽  
Vol 12 (2) ◽  
pp. 267-270 ◽  
Author(s):  
Jasba Simpson ◽  
David Huron

An analysis of reaction time data collected by Miyazaki (1989) provides additional support for absolute pitch as a learned phenomenon. Specifically, the data are shown to be consistent with the Hick- Hyman law, which relates the reaction time for a given stimulus to its expected frequency of occurrence. The frequencies of occurrence are estimated by analyzing a computer-based sample of Western music. The results are consistent with the view that absolute pitch is acquired through ordinary exposure to the pitches of Western music.


1981 ◽  
Vol 23 (2) ◽  
pp. 115-133 ◽  
Author(s):  
Joseph B Kadane ◽  
Jill H Larkin ◽  
Richard H Mayer

2003 ◽  
Vol 12 (2) ◽  
pp. 195 ◽  
Author(s):  
Ralph M. Nelson, Jr.

Catchpole et al. (1998) reported rates of spread for 357 heading and no-wind fires burned in the wind tunnel facility of the USDA Forest Service's Fire Sciences Laboratory in Missoula, Montana for the purpose of developing models of wildland fire behavior. The fires were burned in horizontal fuel beds with differing characteristics due to various combinations of fuel type, particle size, packing ratio, bed depth, moisture content, and wind speed. In the present paper, fuel particle and fuel bed data for 260 heading fires from that study (plus as-yet unreported combustion efficiency and reaction time data) are used to develop models for predicting fuel bed reaction time and mass loss rate. Reaction time is computed from the flameout time of a single particle and fuel bed structural properties. It is assumed that the beds burn in a combustion regime controlled by the rate at which air mixes with volatiles produced during pyrolysis, and that not all air entering the fuel bed reaction zone participates in combustion. Comparison of reaction time and burning rate predictions with experimental values is encouraging in view of the simplified modeling approach and uncertainties associated with the experimental measurements.


2018 ◽  
Vol 12 (3) ◽  
pp. 351-356 ◽  
Author(s):  
Mauricio Tejo ◽  
Sebastián Niklitschek-Soto ◽  
Fernando Marmolejo-Ramos

2020 ◽  
Vol 2 (2) ◽  
Author(s):  
Mark Tommerdahl ◽  
Eric Francisco ◽  
Jameson Holden ◽  
Rachel Lensch ◽  
Anna Tommerdahl ◽  
...  

There have been numerous reports of neurological assessments of post-concussed athletes and many deploy some type of reaction time assessment. However, most of the assessment tools currently deployed rely on consumer-grade computer systems to collect this data. In a previous report, we demonstrated the inaccuracies that typical computer systems introduce to hardware and software to collect these metrics with robotics (Holden et al, 2020). In that same report, we described the accuracy of a tactile based reaction time test (administered with the Brain Gauge) as approximately 0.3 msec and discussed the shortcoming of other methods for collecting reaction time. The latency errors introduced with those alternative methods were reported as high as 400 msec and the system variabilities could be as high as 80 msec, and these values are several orders of magnitude above the control values previously reported for reaction time (200-220msec) and reaction time variability (10-20 msec). In this report, we examined the reaction time and reaction time variability from 396 concussed individuals and found that there were significant differences in the reaction time metrics obtained from concussed and non-concussed individuals for 14-21 days post-concussion. A survey of the literature did not reveal comparable sensitivity in reaction time testing in concussion studies using alternative methods. This finding was consistent with the prediction put forth by Holden and colleagues with robotics testing of the consumer grade computer systems that are commonly utilized by researchers conducting reaction time testing on concussed individuals. The significant difference in fidelity between the methods commonly used by concussion researchers is attributed to the differences in accuracy of the measures deployed and/or the increases in biological fidelity introduced by tactile based reaction times over visually administered reaction time tests. Additionally, while most of the commonly used computerized testing assessment tools require a pre-season baseline test to predict a neurological insult, the tactile based methods reported in this paper did not utilize any baselines for comparisons. The reaction time data reported was one test of a battery of tests administered to the population studied, and this is the first of a series of papers that will examine each of those tests independently.  


Sign in / Sign up

Export Citation Format

Share Document