A Differential Approach to Microcomputer Test Battery Development and Implementation

1988 ◽  
Vol 32 (14) ◽  
pp. 838-842
Author(s):  
Kennedy ◽  
D. R. Baltzley ◽  
M. K. Osteen ◽  
J. J. Turnage
Keyword(s):  
Individual Differences ◽  
Repeated Measures ◽  
Performance Test ◽  
Sensory Deprivation ◽  
Field Studies ◽  
Test System ◽  
Test Battery ◽  
Retest Reliability ◽  
The Stability ◽  
Low Sensitivity

The Automated Performance Test System (APTS), a microcomputer-based performance test battery, has been under development for over five years. The emphasis has been on psychometric theory and utility for repeated-measures applications during extended exposure to various environmental stressors. Stability of means and variances and retest reliability have been the criteria for suitability of a test. In addition, differential stability (i.e., parallelism of individual differences over sessions) is a unique requirement for test acceptability in this battery. In the present menu of “qualified” mental tests, there are presently more than 30 fully up-and-running on portable Zenith and NEC microcomputers as well as floppy disks for IBM compatible systems. Qualified tests stabilize in less than 10 minutes and possess test-retest reliabilities of r 0.70 for a three-minute test/work period. The battery includes tests of cognition, information processing, psychomotor skill, memory, mood, and others. More than a dozen normative laboratory and field studies have been conducted to validate the stability and reliability requirements of the tests in the battery and more than a dozen “sensitivity” studies have been or are in the process of being completed. To date, one or more tests have been shown sensitive to chemoradiotherapy, sleep loss, hypoxia, amphetamine, hyoscine, mood disorders, thermal stress, sensory deprivation, motion stress, altitude, fatigue, and alcohol use. The present paper describes our experiences with these tests and reports on a recommended menu for a short battery (6 minutes), a middle length battery (12 minutes), and a longer battery (22 minutes). Other test batteries which are presently under development do not pay as much attention to individual differences. The consequence of this inattention is low sensitivity if test-retest reliability is poor and inability to properly attribute effects if instability occurs.

Test-Retest Reliability and Practice Effects of the Stability Evaluation Test

2017 ◽  
Vol 26 (3) ◽  
Author(s):  
Richelle M. Williams ◽  
Matthew A. Corvo ◽  
Kenneth C. Lam ◽  
Travis A. Williams ◽  
Lesley K. Gilmer ◽  
...  
Keyword(s):  
Postural Control ◽  
Repeated Measures ◽  
Healthy Adults ◽  
Composite Score ◽  
Practice Effects ◽  
Stability Evaluation ◽  
Retest Reliability ◽  
Evaluation Test ◽  
The Stability ◽  
Test Retest Reliability

Context: Postural control plays an essential role in concussion evaluation. The Stability Evaluation Test (SET) aims to objectively analyze postural control by measuring sway velocity on the NeuroCom VSR portable force platform (Natus, San Carlos, CA). Objective: To assess the test-retest reliability and practice effects of the SET protocol. Design: Cohort. Setting: Research laboratory. Patients or Other Participants: 50 healthy adults (20 men, 30 women, age 25.30 ± 3.60 y, height 166.60± 12.80 cm, mass 68.80 ± 13.90 kg). Interventions: All participants completed 4 trials of the SET. Each trial consisted of six 20-s balance tests with eyes closed, under the following conditions: double-leg firm (DFi), single-leg firm (SFi), tandem firm (TFi), double-leg foam (DFo), single-leg foam (SFo), and tandem foam (TFo). Each trial was separated by a 5-min seated rest period. Main Outcome Measures: The dependent variable was sway velocity (deg/s), with lower values indicating better balance. Sway velocity was recorded for each of the 6 conditions as well as a composite score for each trial. Test-retest reliability was analyzed across 4 trials with intraclass correlation coefficients (ICCs). Practice effects analyzed with repeated measures analysis of variance, followed by Tukey post hoc comparisons for any significant main effects (P < .05). Results: Sway-velocity reliability values were good to excellent: DFi (ICC = .88; 95%CI: .81, .92), SFi (ICC = .75; 95%CI: .61, .85), TFi (ICC = .84; 95%CI: .75, .90), DFo (ICC = .83; 95%CI: .74, .90), SFo (ICC = .82; 95%CI: .72, .89), TFo (ICC = .81; 95%CI: .69, .88), and composite score (ICC = .93; 95%CI: .88, .95). Significant practice effects (P < .05) were noted on the SFi, DFo, SFo, TFo conditions and composite scores. Conclusions: Our results suggest the SET has good to excellent reliability for the assessment of postural control in healthy adults. Due to the practice effects noted, a familiarization session is recommended (ie, all 6 conditions) before data are recorded. Future studies should evaluate injured patients to determine meaningful change scores during various injuries.

Age, Sex, and Repeated Measures Effects on NASA’s “Cognition” Test Battery in STEM Educated Adults

2020 ◽  
Vol 91 (1) ◽  
pp. 18-25 ◽  
Author(s):  
Grace Lee ◽  
Tyler M. Moore ◽  
Mathias Basner ◽  
Jad Nasrini ◽  
David R. Roalf ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Spatial Reasoning ◽  
Repeated Administration ◽  
Test Battery ◽  
University Of Pennsylvania ◽  
Retest Reliability ◽  
Neurocognitive Test ◽  
Test Retest Reliability ◽  
Multiple Domains ◽  
The University

BACKGROUND: Cognition is a neurocognitive test battery created at the University of Pennsylvania and adapted by the National Aeronautics and Space Administration (NASA). It comprises 10 neurocognitive tests that examine multiple domains, and has been validated in a normative sample of STEM-educated adults and compared to NASA’s WinSCAT battery.METHODS: The purpose of this study was to follow the original sample to assess Cognition and WinSCAT’s test-retest reliability and age, sex, and test-retest interval effects on performance.RESULTS: Performance on both Cognition and WinSCAT decreased with age but improved with repeated administration due to practice effects, and men had higher scores than women on tasks that required vigilant attention, spatial reasoning, and risk-taking behaviors. Assessment of test-retest reliability showed intraclass coefficients for efficiency ranging from 0.417 to 0.810, reflecting the broad nature of constructs assessed by Cognition.DISCUSSION: Results largely matched predictions, with some counter-intuitive results for test-retest reliability interval.Lee G, Moore TM, Basner M, Nasrini J, Roalf DR, Ruparel K, Port AM, Dinges DF, Gur RC. Age, sex, and repeated measures effects on NASA’s “Cognition” Test Battery in STEM educated adults. Aerosp Med Hum Perform. 2020; 91(1):18–25.

Performance Evaluation Tests for Environmental Research (PETER): Landolt C Reading Test

1980 ◽  
Vol 24 (1) ◽  
pp. 335-339 ◽  
Author(s):  
John C. Guignard ◽  
Alvah C. Bittner ◽  
Steven W. Einbender ◽  
Robert S. Kennedy
Keyword(s):  
Visual Acuity ◽  
Performance Evaluation ◽  
Fine Structure ◽  
Repeated Measures ◽  
Performance Test ◽  
Environmental Research ◽  
Future Performance ◽  
Error Measures ◽  
The Stability ◽  
Landolt C

A Landolt C visual acuity test was evaluated for inclusion in a battery of Performance Evaluation Tests for Environmental Research (PETER) for use in repeated measures experiments. Eight subjects were tested for 12 days to determine stability of means, standard deviations and cross-day correlations. Mixed results for these cross-day correlation analyses made questionable the stability of speed and error measures. Fine-structure analyses indicated that the task was more a measure of response accuracy than acuity. Fine-structure analyses in future performance test evaluation and exploration of alternative visual acuity tests are recommended. It is concluded that the Landolt C test in the form used is not stable and cannot be recommended as a test of visual acuity for inclusion in PETER.

Development of an Automated Performance Test System for Environmental and Behavioral Toxicology Studies

1987 ◽  
Vol 65 (3) ◽  
pp. 947-962 ◽  
Author(s):  
R. S. Kennedy ◽  
R. L. Wilkes ◽  
W. P. Dunlap ◽  
L. A. Kuntz
Keyword(s):  
Repeated Measures ◽  
Performance Test ◽  
Test System ◽  
Adult Intelligence Scale ◽  
Wechsler Adult Intelligence Scale ◽  
Metric Properties ◽  
Marker Test ◽  
Cross Correlations ◽  
Paper And Pencil ◽  
Wechsler Adult Intelligence

In developing a menu of computerized performance tests for repeated-measures applications the metric properties of selected tests have been examined. Factors of chief concern have been stability and reliability, as well as the practical issue of the length of time it takes to achieve high levels of both. In this study, these factors, as well as predictive validity, are examined. 25 subjects were tested repeatedly (10 sessions) with 11 tests previously identified as “good” candidates for repeated-measures research in paper-and-pencil (marker test) versions. The 11 tests were administered concurrently in their traditional paper-and-pencil modes and newly implemented microcomputer-based versions, along with the Wechsler Adult Intelligence Scale (WAIS). Nine of the 11 microcomputer-based tests achieved stability. Reliabilities were generally high, with r ≥ .77 for 3 min. of testing. Cross-correlations of microbased tests with traditional paper-and-pencil versions suggest equivalency between the test constructs in the different media. Correlations between six of the microbased subtests and the WAIS identified common variance, and these might comprise an efficient short (6 min.) battery of tests.

High Pressure Pneumatic Control Valve Performance Test System

2013 ◽  
Vol 579-580 ◽  
pp. 295-299
Author(s):  
Xu Dong Pan ◽  
Guang Lin Wang ◽  
Guo Yu Shen ◽  
Rui Qi Song
Keyword(s):  
Performance Test ◽  
Control Valve ◽  
Test System ◽  
Normal Operation ◽  
Direct Influence ◽  
Pneumatic Control ◽  
Automatic Test System ◽  
Specialized Software ◽  
Control Precision ◽  
The Stability

As a pressure regulating component, pneumatic control valve has been widely used in control system. The stability of its performance not only concerns the control precision, but also has direct influence on the systems normal operation. Thus, a test on the valves characteristics before putting into use is rather important. According to analysis of testing requirements, this paper determined the overall program of this pneumatic measurement system, designed the gas-circuit, provided specialized software for measurement, and developed an automatic test system. The experimental data shows the system is with high precision and can satisfy the needs of valve test well.

Diagnosis of Alcohol Intoxication: Effectiveness of Cognitive and Neurovestibular Field Sobriety Tests

1993 ◽  
Vol 37 (14) ◽  
pp. 964-968 ◽  
Author(s):  
Robert S. Kennedy ◽  
Janet J. Turnage ◽  
William P. Dunlap
Keyword(s):  
Prescription Drugs ◽  
Performance Test ◽  
Alcohol Intoxication ◽  
Test System ◽  
Test Battery ◽  
Driving Under The Influence ◽  
Blood Alcohol ◽  
Four Levels ◽  
The Individual ◽  
Composite Scores

Tests from an automated performance test battery of cognitive tests and the standardized field sobriety tests (FST) used nationwide by law enforcement officers were administered in three experiments involving graded dosages of alcohol. In the first experiment, subjects were raised to one of four levels of alcohol dosage in four different sessions. In the second experiment, the descending branch of the blood alcohol level (BAL) curve was monitored from .15 BAL, and cognitive and motor performances were assessed by the Automated Performance Test System (APTS) and FST. In the third experiment, the ascending and descending limbs of the alcohol dosage curve were followed. Dose-response relationships were conducted and were statistically significant (p < .001) in all three studies for all but one test when evaluated singly. Using either test battery, composite scores could be employed to index degraded performance from elevated blood alcohol levels. The best single test was gaze nystagmus from the FST battery and the next best was code substitution from the cognitive battery. Taken singly, the individual tests ranged from 66% to 81% in terms of correctly detecting the dichotomous criterion of < 0.10 versus 0.10 BAC and above. These results are discussed in the context of standards setting for driving under the influence (DUI) and the use of behavioral tests to evaluate over-the-counter and prescription drugs.

Visual-Neural Correlate of Speechreading Ability in Normal-Hearing Adults

1982 ◽  
Vol 25 (4) ◽  
pp. 521-527 ◽  
Author(s):  
David C. Shepherd
Keyword(s):  
Normal Hearing ◽  
Wave Form ◽  
Firing Time ◽  
Neural Firing ◽  
Neural Correlate ◽  
Retest Reliability ◽  
Repeated Word ◽  
Negative Peak ◽  
The Stability ◽  
Test Retest Reliability

In 1977, Shepherd and colleagues reported significant correlations (–.90, –.91) between speechreading scores and the latency of a selected negative peak (VN 130 measure) on the averaged visual electroencephalic wave form. The primary purpose of this current study was to examine the stability, or repeatability, of this relation between these cognitive and neurophysiologic measures over a period of several months and thus support its test-retest reliability. Repeated speechreading word and sentence scores were gathered during three test-retest sessions from each of 20 normal-hearing adults. An average of 56 days occurred from the end of one to the beginning of another speechreading sessions. During each of four other test-retest sessions, averaged visual electroencephalic responses (AVER s ) were evoked from each subject. An average of 49 clays intervened between AVER sessions. Product-moment correlations computed among repeated word scores and VN l30 measures ranged from –.61 to –.89. Based on these findings, it was concluded that the VN l30 measure of visual neural firing time is a reliable correlate of speech-reading in normal-hearing adults.

Respiratory Sinus Arrhythmia During Sleep and Waking

2019 ◽  
Vol 33 (1) ◽  
pp. 1-12 ◽  
Author(s):  
Elizabeth M. Stoakley ◽  
Karen J. Mathewson ◽  
Louis A. Schmidt ◽  
Kimberly A. Cote
Keyword(s):  
Individual Differences ◽  
Respiratory Sinus Arrhythmia ◽  
Slow Wave Sleep ◽  
Self Regulation ◽  
Nrem Sleep ◽  
Sinus Arrhythmia ◽  
Affective Style ◽  
Waking State ◽  
Optimal Period ◽  
The Stability

Abstract. Resting respiratory sinus arrhythmia (RSA) is related to individual differences in waking affective style and self-regulation. However, little is known about the stability of RSA between sleep/wake stages or the relations between RSA during sleep and waking affective style. We examined resting RSA in 25 healthy undergraduates during the waking state and one night of sleep. Stability of cardiac variables across sleep/wake states was highly reliable within participants. As predicted, greater approach behavior and lower impulsivity were associated with higher RSA; these relations were evident in early night Non-REM (NREM) sleep, particularly in slow wave sleep (SWS). The current research extends previous findings by establishing stability of RSA within individuals between wake and sleep states, and by identifying SWS as an optimal period of measurement for relations between waking affective style and RSA.

On the Robustness of Solution Strategy Classifications

2010 ◽  
Vol 31 (2) ◽  
pp. 68-73 ◽  
Author(s):  
María José Contreras ◽  
Víctor J. Rubio ◽  
Daniel Peña ◽  
José Santacreu
Keyword(s):  
Individual Differences ◽  
Study Strategies ◽  
Solution Strategy ◽  
Specific Test ◽  
Spatial Tasks ◽  
The Stability ◽  
Strategy Changes ◽  
Over Time

Individual differences in performance when solving spatial tasks can be partly explained by differences in the strategies used. Two main difficulties arise when studying such strategies: the identification of the strategy itself and the stability of the strategy over time. In the present study strategies were separated into three categories: segmented (analytic), holistic-feedback dependent, and holistic-planned, according to the procedure described by Peña, Contreras, Shih, and Santacreu (2008) . A group of individuals were evaluated twice on a 1-year test-retest basis. During the 1-year interval between tests, the participants were not able to prepare for the specific test used in this study or similar ones. It was found that 60% of the individuals kept the same strategy throughout the tests. When strategy changes did occur, they were usually due to a better strategy. These results prove the robustness of using strategy-based procedures for studying individual differences in spatial tasks.

Sign in / Sign up

Export Citation Format

Share Document