Performance Assessment for Principal Licensure: Evidence From Content and Face Validation and Bias Review

2017 ◽  
Vol 13 (2) ◽  
pp. 109-138 ◽  
Author(s):  
Margaret Terry Orr ◽  
Ray Pecheone ◽  
Jon D. Snyder ◽  
Joseph Murphy ◽  
Ameetha Palanki ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Task Performance ◽  
Content Validity ◽  
Development Process ◽  
Empirical Work ◽  
Principal Licensure ◽  
Face Validation

This article presents the validity bias review feedback and outcomes of new performance-based assessments to evaluate candidates seeking principal licensure. Until now, there has been little empirical work on performance assessment for principal licensure. One state recently developed a multi-task performance assessment for leaders and has implemented it for statewide use in initial principal licensure decisions; this development process is described here, focusing on content validity and bias review, and incorporates candidate and program faculty validiation as well. The results demonstrate the content validity, relevance, and feasibility of this new performance assessment for leaders, and yield implications for leader assessment generally.

Task Modelling for the Web (Aufgabenmodellierung für interaktive Webanwendungen)

i-com ◽  
2008 ◽  
Vol 6 (3/2007) ◽  
pp. 23-29 ◽  
Author(s):  
Birgit Bomsdorf
Keyword(s):  
Task Performance ◽  
Web Application ◽  
Development Process ◽  
Web Applications ◽  
Web Engineering ◽  
Time Usage ◽  
Build Time ◽  
Object Models ◽  
The Web ◽  
Modelling Approach

SummaryTask modelling has entered the development process of web applications, strengthening the usage-centred view within the early steps in Web-Engineering (WE). In current approaches, however, this view is not kept up during subsequent activities to the same degree as this is the case in the field of Human-Computer-Interaction (HCI). The modelling approach presented in this contribution combines models as known from WE with models used in HCI to change this situation. Basically the WE-HCI-integration is supported by combining task and object models as known from HCI with conceptual modelling known from WE. In this paper, the main focus is on the WebTaskModel, a task model adapted to web application concerns, and its contribution towards a task-related web user interface. The main difference to existing task models is the build-time and run-time usage of a generic task lifecycle. Hereby the description of exceptions and erroneous situations during task performance (caused by, e.g., the stateless protocol or Browser interaction) is enabled and at the same time clearly separated from the flow of correct action.

scholarly journals COVID-19 patients in prone position: validation of instructional materials for pressure injury prevention

2021 ◽  
Vol 74 (suppl 1) ◽  
Author(s):  
Vinicius Batista Santos ◽  
Daniele Cristina Bosco Aprile ◽  
Camila Takáo Lopes ◽  
Juliana de Lima Lopes ◽  
Mônica Antar Gamba ◽  
...  
Keyword(s):  
Injury Prevention ◽  
Prone Position ◽  
Content Validity ◽  
Instructional Materials ◽  
Validity Index ◽  
Content Validity Index ◽  
A Value ◽  
Pressure Injury ◽  
Face Validation ◽  
Pressure Injury Prevention

ABSTRACT Objective: to perform the content and face validation of a checklist and a banner on pressure injury prevention in patients in prone position. Method: this is a methodological study of content and face validation with 26 nurses with specialization. Professionals assessed the checklist and the banner in relation to clarity, theoretical relevance, practical relevance, relation of the figures to the text and font size. The Content Validity Index was calculated for each item, considering one with a value equal to or greater than 0.8 as valid. Results: all the actions described in the checklist and in the banner had a Content Validity Index greater than 0.80, with standardization of verbal time and esthetic adjustments in the banner’s layout, as suggested. Conclusions: the checklist and the banner were validated and can be used in clinical practice to facilitate pressure injury preventions in patients in prone position.

scholarly journals Development and Alternate Form Reliability of the Complex Task Performance Assessment (CTPA) for People With Mild Stroke

2017 ◽  
Vol 71 (3) ◽  
pp. 7103190030p1
Author(s):  
Juan Pablo Saa ◽  
Meghan Doherty ◽  
Alexis Young ◽  
Meredith Spiers ◽  
Emily Leary ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Task Performance ◽  
Complex Task ◽  
Alternate Form ◽  
Mild Stroke ◽  
Alternate Form Reliability ◽  
Complex Task Performance

Complex Task Performance Assessment

2008 ◽  
Author(s):  
Timothy J. Wolf ◽  
Tracy Morrison ◽  
Leonard Matheson
Keyword(s):  
Performance Assessment ◽  
Task Performance ◽  
Complex Task ◽  
Complex Task Performance

DETERMINANTS OF AN EFFECTIVE PRODUCT DEVELOPMENT PROCESS: TOWARDS A CONCEPTUAL FRAMEWORK FOR PROCESS INDUSTRY

2006 ◽  
Vol 10 (03) ◽  
pp. 237-269 ◽  
Author(s):  
DIANA CHRONÉER ◽  
KRISTINA LAURELL-STENLUND
Keyword(s):  
Product Development ◽  
Conceptual Framework ◽  
Development Process ◽  
Empirical Work ◽  
Process Industry ◽  
Product Development Process ◽  
Main Determinants ◽  
Development Literature ◽  
Effective Product ◽  
Innovation Type

Organisation and management of the product development process have been an issue in both academia and industry for over three decades. The literature on product development is growing, but Process Industry is often lacking in these discussions. Therefore, this paper focuses on linking the determinants of an effective product development process to Process Industry and the implication this may have on a traditionally very process-oriented industry by nature. Further, the paper organises the burgeoning product development literature into three main determinants: innovation type, technology strategy and organisational aspect. The selection of determinants to the conceptual framework, adjusting for Process Industry origins in previous written research material and our own empirical work of product development in Process Industry, is briefly presented at the beginning of the paper. Our literature review focuses on the product development process and builds the framework of our conceptual model detailing the elements of intra- and inter-firm processes in the product development process of the Process Industry. Our purpose is to give an increased understanding of the changed innovation pattern in Process Industry and its implication on activities concerning organisation and management of the product development process.

scholarly journals Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM

2018 ◽  
Vol 22 (2) ◽  
pp. 219-230 ◽  
Author(s):  
Khoirul Bashooir ◽  
Supahar Supahar
Keyword(s):  
Performance Assessment ◽  
Item Response ◽  
Content Validity ◽  
Scientific Literacy ◽  
Multiple Choice ◽  
Validity And Reliability ◽  
Multiple Choice Tests ◽  
Choice Tests ◽  
Literacy Performance ◽  
Written Test

Penelitian ini merupakan bagian dari penelitian pengembangan asesmen kinerja literasi sains berbasis STEM pada pembelajaran fisika. Tujuan dari penelitian ini adalah untuk mengungkapkan validitas isi, validitas empiris, dan reliabilitas instrumen asesmen kinerja literasi sains berbasis STEM yang sebelumnya telah disusun. Instrumen yang dikembangkan berupa lembar pengamatan dan tes pilihan ganda. Analisis validitas isi dari lembar pengamatan menggunakan Koefisien V oleh Aiken sedangkan validitas isi instrumen tes dianalisis dengan menggunakan CVI (Content Validity Index) oleh Lawshe. Validitas empiris reliabilitas instrumen tes diestimasi dengan IRT (Item Response Theory). Reliabilitas lembar pengamatan ditentukan dengan ICC (Item Correlation Coefficient). Hasil dari penelitian ini menunjukan bahwa (1) Lembar pengamatan berupa rubrik penskoran dan penilaian diri  terbuktivalid dengan koefisien  V Aiken 0,75 dan reliabel dengan koefisien Reliabilitas Alfa > 0,8 dan ICC yang Excellent. (2) Instrumen tes terbukti realiabel untuk digunakan pada peserta didik dengan kategori sedang sampai dengan tinggi (-0,7 sampai dengan 6,7 ) dengan CVI=1 dan INFIT MNSQ sesuai model Rasch. Berdasarkan hasil penelitian tersebut maka asesmen kinerja Literasi Sains berbasis STEMlayak digunakan.Kata kunci:validitas isi, validitas empiris, asesmen kinerja, literasi sains, STEM VALIDITY AND RELIABILITY INSTRUMENT OF SCIENTIFIC LITERACY PERFORMANCE ASSESSMENT IN PHYSICS TEACHING BASED ON STEMAbstractThis research is part of the development of scientific literacy performance assessment based on STEM in teaching physics. The aim of this research is to reveal the validity (content and also empiric) and reliability of scientific literacy performance assessment instrument based on STEM. The kind of instruments were developed are observational sheet and multiple choice test. The content validity of observational sheet was revealed by used the Aiken’s V Coefficient. The content validity of multiple choice tests was revealed by used Content Validity Index (CVI) which proposed by Lawshe. The empirical validity and reliability of multiple choice tests was revealed by used Item Response Theory Analysis. The reliability of observational sheet was revealed by used ICC (Item Correlation Coefficient) Analysis. The results of this study are the validity from the contents and empirical trials from the developed instruments. The observation sheet from scoring rubric and self-assessment has been valid with Aiken’s V value that exceeds the standard of 0,75. The reliability of the scoring rubric has Alfa Reliability> 0.8 and Excellent of ICC. Validity values from The written test is shown with CVI of 1 and the MNSQ INFIT value which match to the Rasch model. Based on the TIC and SEM graphs, the written test is stated to be reliable for use in students with moderate to high categories (-0.7 to 6.7). STEM-based Science Literacy performance assessment with caloric material is appropriate to use.Keywords: content validity, empirical validity, performance assessment, scientific literacy, STEM

scholarly journals Development and Validation of a Physical Activity Educational Module for Overweight and Obese Adolescents: CERGAS Programme

2019 ◽  
Vol 16 (9) ◽  
pp. 1506 ◽  
Author(s):  
Xiao Chuan Lau ◽  
Yaw Loong Wong ◽  
Jyh Eiin Wong ◽  
Denise Koh ◽  
Razalee Sedek ◽  
...  
Keyword(s):  
Physical Activity ◽  
Content Validity ◽  
Phase Iii ◽  
Intervention Programme ◽  
Group Discussions ◽  
Educational Module ◽  
Needs Assessments ◽  
Development And Validation ◽  
Educational Modules ◽  
Face Validation

Educational modules can be effective in educating and motivating adolescents to participate in physical activity (PA). This paper describes the development and validation of a PA educational module for use in an obesity intervention programme, CEria Respek Gigih Aktif Sihat (CERGAS). The present study was conducted in three phases: Phase I was composed of needs assessments with four focus group discussions to elicit adolescents’ opinions regarding module content and design, Phase II was the development of the PA module, while Phase III was content and face validation. A content validity index (CVI) was used to assess content validity quantitatively, with a CVI of more than 0.79 being considered appropriate. The needs assessments indicated that content of interest to adolescents included: the benefits of exercise; exercise techniques; ways to increase PA and how to stay motivated. Attractive graphic design was determined as a way to draw the adolescents’ attention. The module covered five topics: “Let’s Be Active”; “Exercise and Fitness”; “Staying Safe during Exercise and Physical Activity”; “Planning for Success” and “How to Overcome Sedentariness and Get Moving”. The module was found to have good content validity (mean CVI = 0.85). Expert members made suggestions to improve the module. These suggestions were then accepted, and the module was modified accordingly. We concluded that the module has good content validity and can be used to improve PA knowledge amongst CERGAS participants.

Strategy-Related Task Performance Assessment

2013 ◽  
Author(s):  
Nina Schünemann ◽  
Nadine Spörer ◽  
Joachim C. Brunstein
Keyword(s):  
Performance Assessment ◽  
Task Performance
Sign in / Sign up

Export Citation Format

Share Document