scholarly journals Development of the Criterion Task Set Performance Data Base

1986 ◽  
Vol 30 (1) ◽  
pp. 58-62 ◽  
Author(s):  
Robert E. Schlegel ◽  
Kirby Gilliland ◽  
Betina Schlegel

The initial phase of a large-scale experimental study was conducted involving the training and testing of fifty human subjects on the Criterion Task Set (Version 1.0). Testing was performed under baseline conditions and the stressors of noise and sleep loss. The resulting data base includes CTS performance data and subjective ratings obtained using the Subjective Workload Assessment Technique (SWAT) for each task, along with information on subject individual differences. This paper presents the methodology used for the data collection and analysis efforts and provides a summary of the performance and subjective assessment information. In general, no performance differences were found under the noise stress condition. Following sleep loss, response times for the central processing tasks deteriorated as did performance on the Unstable Tracking and Interval Production tasks.

1987 ◽  
Vol 31 (4) ◽  
pp. 389-393 ◽  
Author(s):  
Robert E. Schlegel ◽  
Kirby Gilliland ◽  
Betina Schlegel

A large-scale experimental study was conducted involving the training and testing of 123 human subjects on the Criterion Task Set (Version 1.0). Testing was performed under baseline and stressor conditions. The performance data and Subjective Workload Assessment Technique ratings for the first baseline trial (Trial 6) were analyzed using the SAS VARCLUS procedure to evaluate the structure of the CTS. Seven clusters of response time variables were identified for the nine tasks. In general, the Memory Search, Linguistic Processing and Mathematical Processing tasks were grouped in one cluster with each of the other clusters representing a single task. Five clusters were identified for the SWAT ratings with clusters differentiated along the dimensions of task difficulty and processing stage.


1988 ◽  
Vol 32 (14) ◽  
pp. 848-852
Author(s):  
Betina Schlegel ◽  
Robert E. Schlegel ◽  
Kirby Gilliland

This paper summarizes gender differences in performing various elements of the Criterion Task Set. Performance data and Subjective Workload Assessment Technique ratings were analyzed for 28 men and 28 women who participated in a large-scale CTS validation study. In general, women tended to perform slightly better than men on the majority of tasks. In particular, performance by women was better on Grammatical Reasoning, Linguistic Processing, Mathematical Processing, and Memory Search. Response times on Probability Monitoring were faster for women but at the expense of a greater number of False Alarms. Men performed better only on the high level of Continuous Recall and the medium level of Unstable Tracking. Women tended to give lower subjective ratings than men to those tasks with a high memory component and gave higher ratings than men to those tasks involving input/output and spatial elements.


1987 ◽  
Vol 31 (4) ◽  
pp. 402-404 ◽  
Author(s):  
Kirby Gilliland ◽  
Robert Schlegel ◽  
Sharon Dannels

The purpose of this study was to demonstrate the utility of the Criterion Task Set (CTS) as a method for personality theory testing. Subjects in a large CTS standardization study were administered the Sensation Seeking scale and the Stimulus Screening scale, two personality dimensions based theoretically on perceptual or biological processes that are believed to mediate task performance. Results indicated that high sensation seekers respond faster, but not necessarily more accurately, than low sensation seekers to central processing tasks. No differences were found for input/perceptual or motor/output tasks. Also, no differences were found between screeners and nonscreeners for any CTS tasks. The results of this study suggest that the CTS can be used profitably by personality researchers to test the basic assumptions of the theories of some personality dimensions.


1986 ◽  
Vol 30 (1) ◽  
pp. 57-57
Author(s):  
Clark A Shingledecker

The Criterion Task Set (CTS) is a battery of performance tasks which was developed at the Air Force Armstrong Aerospace Medical Research Laboratory. Based on an information processing stage/resource model of human performance, the CTS was designed to evaluate the relative sensitivity, diagnosticity and intrusiveness of available measures of operator workload. It has also been employed as a performance assessment instrument to evaluate the effects of stressors on hypothesized independent sources of performance capability. Since the completion of original developmental research and the implementation of the CTS in a standard hardware/software system, a number of researchers have employed the battery in applied human performance studies and in efforts which have contributed to its further refinement. The objectives of this symposium are to present accounts of six of these research projects and to provide a forum for individuals who are currently using the CTS or who are interested in potential applications of this performance assessment system. The papers presented in the symposium include a report of a large-scale validation project which has formed the basis for a CTS data base (Schlegel, Gilliland and Schlegel), as well as a study aimed at improvement of one of the tasks comprising the battery (Eggemeier and Amell). The remaining four papers describe applications of the CTS to the investigation of physiological (Wilson and McCloskey) and subjective (Acton, Reid and Perez) workload metrics, and to the study of individual differences (Gilliland, Schlegel and Dannels) and subjective arousal states (Kimball and Pond).


1989 ◽  
Vol 33 (14) ◽  
pp. 888-890 ◽  
Author(s):  
Kirby Gilliland ◽  
Robert Schlegel ◽  
Sharon Dannels ◽  
Scott Mills

Intelligence has been shown to be a mediating factor in the performance of many tasks. The purpose of this study is to examine the relationship between Wechsler Adult Intelligence Scale-Revised (WAIS-R) scores and performance on a multi-task performance battery, the USAF Criterion Task Set (CTS). Performance scores for high and low WAIS-R groups (N=26/group) were compared across each task component of the CTS. Results of this study indicate that there is a fairly strong relationship between intelligence, as measured by WAIS-R, and performance on the CTS central processing tasks. Subjects scoring high on the WAIS-R are likely to be more accurate and faster in their responses than subjects who scored low on the WAIS-R. Verbal and performance subscales of the WAIS-R did not appear to mediate task performance differentially. In general, WAIS-R performance does not seem to be related to perceptual input tasks or motor/output tasks of the CTS battery.


2018 ◽  
Vol 5 (2) ◽  
Author(s):  
Matthieu J. S. Brinkhuis ◽  
Alexander O. Savi ◽  
Abe D. Hofman ◽  
Frederik Coomans ◽  
Han L. J. Van der Maas ◽  
...  

With the advent of computers in education, and the ample availability of online learning and practice environments, enormous amounts of data on learning become available. The purpose of this paper is to present a decade of experience with analyzing and improving an online practice environment for math, which has thus far recorded over a billion responses. We present the methods we use to both steer and analyze this system in real-time, using scoring rules on accuracy and response times, a tailored rating system to provide both learners and items with current ability and difficulty ratings, and an adaptive engine that matches learners to items. Moreover, we explore the quality of fit by means of prediction accuracy and parallel item reliability. Limitations and pitfalls are discussed by diagnosing sources of misfit, like violations of unidimensionality and unforeseen dynamics. Finally, directions for development are discussed, including embedded learning analytics and a focus on online experimentation to evaluate both the system itself and the users’ learning gains. Though many challenges remain open, we believe that large steps have been made in providing methods to efficiently manage and research educational big data from a massive online learning system.


2018 ◽  
Vol 7 (12) ◽  
pp. 472 ◽  
Author(s):  
Bo Wan ◽  
Lin Yang ◽  
Shunping Zhou ◽  
Run Wang ◽  
Dezhi Wang ◽  
...  

The road-network matching method is an effective tool for map integration, fusion, and update. Due to the complexity of road networks in the real world, matching methods often contain a series of complicated processes to identify homonymous roads and deal with their intricate relationship. However, traditional road-network matching algorithms, which are mainly central processing unit (CPU)-based approaches, may have performance bottleneck problems when facing big data. We developed a particle-swarm optimization (PSO)-based parallel road-network matching method on graphics-processing unit (GPU). Based on the characteristics of the two main stages (similarity computation and matching-relationship identification), data-partition and task-partition strategies were utilized, respectively, to fully use GPU threads. Experiments were conducted on datasets with 14 different scales. Results indicate that the parallel PSO-based matching algorithm (PSOM) could correctly identify most matching relationships with an average accuracy of 84.44%, which was at the same level as the accuracy of a benchmark—the probability-relaxation-matching (PRM) method. The PSOM approach significantly reduced the road-network matching time in dealing with large amounts of data in comparison with the PRM method. This paper provides a common parallel algorithm framework for road-network matching algorithms and contributes to integration and update of large-scale road-networks.


1990 ◽  
Vol 43 (2) ◽  
pp. 301-311 ◽  
Author(s):  
WINNIE Y. YOUNG ◽  
JANIS S. HOUSTON ◽  
JAMES H. HARRIS ◽  
R. GENE HOFFMAN ◽  
LAURESS L. WISE

2017 ◽  
Vol 814 ◽  
pp. 592-613 ◽  
Author(s):  
Andras Nemes ◽  
Teja Dasari ◽  
Jiarong Hong ◽  
Michele Guala ◽  
Filippo Coletti

We report on optical field measurements of snow settling in atmospheric turbulence at $Re_{\unicode[STIX]{x1D706}}=940$. It is found that the snowflakes exhibit hallmark features of inertial particles in turbulence. The snow motion is analysed in both Eulerian and Lagrangian frameworks by large-scale particle imaging, while sonic anemometry is used to characterize the flow field. Additionally, the snowflake size and morphology are assessed by digital in-line holography. The low volume fraction and mass loading imply a one-way interaction with the turbulent air. Acceleration probability density functions show wide exponential tails consistent with laboratory and numerical studies of homogeneous isotropic turbulence. Invoking the assumption that the particle acceleration has a stronger dependence on the Stokes number than on the specific features of the turbulence (e.g. precise Reynolds number and large-scale anisotropy), we make inferences on the snowflakes’ aerodynamic response time. In particular, we observe that their acceleration distribution is consistent with that of particles of Stokes number in the range $St=0.1{-}0.4$ based on the Kolmogorov time scale. The still-air terminal velocities estimated for the resulting range of aerodynamic response times are significantly smaller than the measured snow particle fall speed. This is interpreted as a manifestation of settling enhancement by turbulence, which is observed here for the first time in a natural setting.


Sign in / Sign up

Export Citation Format

Share Document