The Criterion Task Set: Validation and Application

1986 ◽  
Vol 30 (1) ◽  
pp. 57-57
Author(s):  
Clark A Shingledecker
Keyword(s):  
Performance Assessment ◽  
Large Scale ◽  
Human Performance ◽  
Scale Validation ◽  
Relative Sensitivity ◽  
Assessment System ◽  
Assessment Instrument ◽  
Performance Tasks ◽  
Task Set ◽  
Criterion Task

The Criterion Task Set (CTS) is a battery of performance tasks which was developed at the Air Force Armstrong Aerospace Medical Research Laboratory. Based on an information processing stage/resource model of human performance, the CTS was designed to evaluate the relative sensitivity, diagnosticity and intrusiveness of available measures of operator workload. It has also been employed as a performance assessment instrument to evaluate the effects of stressors on hypothesized independent sources of performance capability. Since the completion of original developmental research and the implementation of the CTS in a standard hardware/software system, a number of researchers have employed the battery in applied human performance studies and in efforts which have contributed to its further refinement. The objectives of this symposium are to present accounts of six of these research projects and to provide a forum for individuals who are currently using the CTS or who are interested in potential applications of this performance assessment system. The papers presented in the symposium include a report of a large-scale validation project which has formed the basis for a CTS data base (Schlegel, Gilliland and Schlegel), as well as a study aimed at improvement of one of the tasks comprising the battery (Eggemeier and Amell). The remaining four papers describe applications of the CTS to the investigation of physiological (Wilson and McCloskey) and subjective (Acton, Reid and Perez) workload metrics, and to the study of individual differences (Gilliland, Schlegel and Dannels) and subjective arousal states (Kimball and Pond).

scholarly journals Factor Structure of the Criterion Task Set

1987 ◽  
Vol 31 (4) ◽  
pp. 389-393 ◽  
Author(s):  
Robert E. Schlegel ◽  
Kirby Gilliland ◽  
Betina Schlegel
Keyword(s):  
Task Difficulty ◽  
Large Scale ◽  
Human Subjects ◽  
Memory Search ◽  
Linguistic Processing ◽  
Baseline Trial ◽  
Task Set ◽  
Criterion Task ◽  
Mathematical Processing ◽  
Time Variables

A large-scale experimental study was conducted involving the training and testing of 123 human subjects on the Criterion Task Set (Version 1.0). Testing was performed under baseline and stressor conditions. The performance data and Subjective Workload Assessment Technique ratings for the first baseline trial (Trial 6) were analyzed using the SAS VARCLUS procedure to evaluate the structure of the CTS. Seven clusters of response time variables were identified for the nine tasks. In general, the Memory Search, Linguistic Processing and Mathematical Processing tasks were grouped in one cluster with each of the other clusters representing a single task. Five clusters were identified for the SWAT ratings with clusters differentiated along the dimensions of task difficulty and processing stage.

scholarly journals DEVELOPMENT OF PERFORMANCE ASSESSMENT INSTRUMENT FOR NURSES BASED ON WEB IN INPATIENT UNIT

Jurnal NERS ◽  
2017 ◽  
Vol 12 (1) ◽  
pp. 108
Author(s):  
Aprilia Nuryanti ◽  
Nursalam Nursalam ◽  
Mira Triharini
Keyword(s):  
Performance Assessment ◽  
Inpatient Unit ◽  
Assessment System ◽  
Assessment Instrument ◽  
Performance Standard ◽  
Second Phase ◽  
Purposive Sampling ◽  
Performance Assessment System ◽  
The Web

Introduction: Performance assessment instrument will be problematic when it is not representative in describing the competency because it is not obvious indicators and inappropriate performance standard to nursing’s task. The purpose of this study is to develop nurses’ performance assessment instrument based on the web from multi sources assessment inpatient unit at SMC Hospital. Methods: This study had two phases. The first phase was an explanatory overview of the performance assessment system using questionnaires completed by 53 respondents of nurses, selected by purposive sampling. Instrument development based on FGD with six decision makers in the hospital. Validity was tested by Pearson Product Moment Correlation and reliability of instrument’s was tested by alpha Cronbach. The second phase was socialization and instrument test to observe the quality of instrument using a questionnaire by 47 respondents and recommendations made by 8 participants of FGD. The samples were selected by purposive sampling technique. Performance assessment system was moderate at 58.49%. All questions which aimed to measure the performance of nurses were valid and reliable. The quality of nurses’ performance assessment instruments based on the web was a good category, which was functionality: 81.60; reliability: 78.16; efficiency: 80.85; usability: 81.70 and portability: 81.70. Results: The result was a web-based assessment format, scoring with Likert scale, resource assessment by the direct supervisor which was a multisource evaluator, the development of performance graph, and confidentiality of data on the database server. Discussion: Recommendations for hospital is to make policy based on the final value of the performance assessment by the supervisor which was multisource feedback and it needs a global writing on a form of performance assessment result.

scholarly journals Development of the Criterion Task Set Performance Data Base

1986 ◽  
Vol 30 (1) ◽  
pp. 58-62 ◽  
Author(s):  
Robert E. Schlegel ◽  
Kirby Gilliland ◽  
Betina Schlegel
Keyword(s):  
Data Base ◽  
Large Scale ◽  
Response Times ◽  
Human Subjects ◽  
Subjective Assessment ◽  
Sleep Loss ◽  
Performance Data ◽  
Task Set ◽  
Central Processing ◽  
Criterion Task

The initial phase of a large-scale experimental study was conducted involving the training and testing of fifty human subjects on the Criterion Task Set (Version 1.0). Testing was performed under baseline conditions and the stressors of noise and sleep loss. The resulting data base includes CTS performance data and subjective ratings obtained using the Subjective Workload Assessment Technique (SWAT) for each task, along with information on subject individual differences. This paper presents the methodology used for the data collection and analysis efforts and provides a summary of the performance and subjective assessment information. In general, no performance differences were found under the noise stress condition. Following sleep loss, response times for the central processing tasks deteriorated as did performance on the Unstable Tracking and Interval Production tasks.

Gender Differences in Criterion Task Set Performance and Subjective Ratings

1988 ◽  
Vol 32 (14) ◽  
pp. 848-852
Author(s):  
Betina Schlegel ◽  
Robert E. Schlegel ◽  
Kirby Gilliland
Keyword(s):  
Gender Differences ◽  
Large Scale ◽  
Response Times ◽  
Memory Search ◽  
False Alarms ◽  
Subjective Ratings ◽  
Task Set ◽  
Criterion Task ◽  
Number Of False Alarms ◽  
High Level

This paper summarizes gender differences in performing various elements of the Criterion Task Set. Performance data and Subjective Workload Assessment Technique ratings were analyzed for 28 men and 28 women who participated in a large-scale CTS validation study. In general, women tended to perform slightly better than men on the majority of tasks. In particular, performance by women was better on Grammatical Reasoning, Linguistic Processing, Mathematical Processing, and Memory Search. Response times on Probability Monitoring were faster for women but at the expense of a greater number of False Alarms. Men performed better only on the high level of Continuous Recall and the medium level of Unstable Tracking. Women tended to give lower subjective ratings than men to those tasks with a high memory component and gave higher ratings than men to those tasks involving input/output and spatial elements.

scholarly journals Implementasi Kebijakan Sabilulungan Sistem Penilaian Kinerja Pegawai (SASIKAP) di Lingkungan Pemerintah Kabupaten Bandung

2020 ◽  
Vol 5 (2) ◽  
pp. 208-227
Author(s):  
Shela Marlian ◽  
Deasy Silvya Sari
Keyword(s):  
Performance Assessment ◽  
Qualitative Method ◽  
Performance Monitoring ◽  
Employee Performance ◽  
Assessment System ◽  
Assessment Instrument ◽  
Performance Assessment System ◽  
Organizational Work ◽  
Different Characteristics ◽  
Appraisal Processes

The urgency of performance assessment in ASN management has led to innovations in employee performance assessment based on information technology. This article aims to describe the implementation condition of Sabilulungan Employee Performance Assessment System (SASIKAP) policy as a technology-based performance assessment instrument for the State Civil Service Apparatus (ASN), from various aspects such as policy, implementation and the environment. This is related to the phenomenon that there are still employees who do not fill out the application themselves, the inconsistency between individual work targets and organizational work targets and the lack of optimal performance monitoring and appraisal processes by appraisers. The authors use a descriptive qualitative method and examines the four locus of Regional Apparatus which have different characteristics and conditions in Bandung Regency Government. The authors found that: SASIKAP policy standards and objectives have been listed in the form of Bandung Regent Regulation Number 18 of 2019 and its technical guidelines; Human resources and infrastructure in Bandung Regency Government has supported the operationalization of SASIKAP; Communication between organizations and implementation activities is running properly; there is an executing agent that makes SASIKAP easier to operate; The economic, social and political environment supports the implementation of SASIKAP policies; and The implementation of SASIKAP policy has generally been responded positively by ASN within the Bandung Regency Government.  

PENERAPAN GREEN COMPUTING PADA KUISIONER INSTRUMEN PENILAIAN KINERJA DOSEN DI POLITEKNIK NEGERI SUBANG

2020 ◽  
Vol 1 (1) ◽  
Author(s):  
Nunu Nugraha Purnawan
Keyword(s):  
Data Collection ◽  
Literature Review ◽  
Performance Assessment ◽  
Research Method ◽  
Field Research ◽  
Green Computing ◽  
Assessment Instrument ◽  
Computer Hardware ◽  
Model Free ◽  
Collection Methods

The lecturer's performance assessment by students in the form of an online Lecturer Performance Assessment Instrument Questionnaire (KIPKD) is in line with the work concepts of Green Computing by utilizing computer hardware and software better, more efficiently and more useful. KIPKD online POLSUB uses Google Forms, because it has an attractive and responsive look, provides a fairly complete choice of stuffing model, free, the results are neatly arranged and can be analyzed easily. This research method uses literature review in the form of books, journals that discuss about topics related to the use of Google Forms as a medium in the manufacture of questionnaires for surveys and data collection, as well as related to the concept of Green Computing. While data collection methods used in field research by way of observation of the system running in the academic POLSUB. The use of KIPKD online illustrates that POLSUB participates in preserving the environment, with no 12 paper/year rims, equivalent to 12 tree trunks.

Sign in / Sign up

Export Citation Format

Share Document