scholarly journals Practical validation framework for competence measurement in VET: a validation study of an instrument for measuring basic commercial knowledge and skills in Switzerland

2021 ◽  
Vol 13 (1) ◽  
Author(s):  
Silja Rohr-Mentele ◽  
Sarah Forster-Heinzer
Keyword(s):  
Validation Studies ◽  
Measurement Instrument ◽  
Vocational Education And Training ◽  
Knowledge And Skills ◽  
Replication Studies ◽  
Validation Framework ◽  
Many Instruments ◽  
Practical Guidelines ◽  
Computer Based ◽  
Practical Validation

AbstractCompetence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an instrument actually measures is extremely important, inter alia, for evaluating test results, for conducting replication studies and for enforcing adaptation intentions. Therefore, more thorough and qualitative validation studies are required. This paper presents an approach to facilitate validation studies using the example of the simuLINCA test. The approach to validation applied in this study was developed in the field of medicine; nevertheless, it provides a promising means of assessing the validity of (computer-based) instruments in VET. We present the approach in detail along a newly developed computer-based simulation (simuLINCA) that measures basic commercial knowledge and skills of apprentices in Switzerland. The strength of the presented approach is that it provides practical guidelines that help perform the measurement process and support an increase in transparency. Still, it is flexible enough to allow different concepts to test development and validity. The approach applied proved to be practicable for VET and the measurement of occupational competence. After extending and slightly modifying the approach, a practical validation framework, including the description of each step and questions to support the application of it, is available for the VET context. The computer-based test instrument, simuLINCA, provides insights into how a computer-based test for measuring competence in various occupational fields can be developed and validated. SimuLINCA showed satisfying evidence for a valid measurement instrument. It could, however, be further developed, revised and extended.

Investigating Assistive Technologies using Computers to Simulate Basic Curriculum for Individuals with Cognitive Impairments

2010 ◽  
pp. 61-75 ◽  
Author(s):  
Carolyn Kinsell
Keyword(s):  
Assistive Technology ◽  
Transfer Of Learning ◽  
Cognitive Impairments ◽  
Assistive Technologies ◽  
Cognitively Impaired ◽  
Traditional Classrooms ◽  
Active Participant ◽  
Knowledge And Skills ◽  
Computer Based ◽  
Theoretical Foundations

Providing assistive technologies to cognitively impaired students, in the form of computer-based simulations, may improve the transfer of learning at a greater rate than other training media. The underlying premise for using computer-based simulations is that the cognitively impaired student is no longer the passive learner normally found in traditional classrooms. Instead, the cognitively impaired student becomes an active participant with the simulation and learning. In addition, this type of assistive technology provides the student with an opportunity for repeated exposure and practice at a speed in which the student feels comfortable. This chapter discusses the benefits of using computer-based simulations, defines the theoretical foundations that support the transfer of learning, and presents the processes that facilitate individual acquisition and refinement of knowledge and skills. It concludes with a review of the cognitive elements in the creation of mental models and schema.

Computer-Based Case Simulations for Assessment in Health Care: A Literature Review of Validity Evidence

2017 ◽  
Vol 42 (1) ◽  
pp. 82-102 ◽  
Author(s):  
Robyn C. Ward ◽  
Timothy J. Muckle ◽  
Michael J. Kremer ◽  
Mary Anne Krogh
Keyword(s):  
Health Care ◽  
Decision Making ◽  
Literature Review ◽  
Health Care Professionals ◽  
Assessment Tool ◽  
Replication Studies ◽  
Clinical Scenarios ◽  
Computer Based ◽  
Assessment Of Competence ◽  
Psychometric Evidence

Simulation for education and training in health-care professions has been widely applied. However, its value as an assessment tool for competence is not fully known. Logistical barriers of simulation-based assessments have led some health-care organizations to utilize computer-based case simulations (CCSs) for assessment. This article provides a review of the literature on the identification of psychometrically sound, CCS instruments designed to measure decision-making competence in health-care professionals. CINAHL, MEDLINE, and Ovid databases identified 84 potentially relevant articles published between January 2000 and May 2017. A total of 12 articles met criteria for inclusion in this review. Findings of these 12 articles indicate that summative assessment in health care using CCSs in the form of clinical scenarios is utilized to assess higher order performance aspects of competence in the form of decision-making. Psychometric strength was validated in eight articles and supported by four replication studies. Two of the eight articles reported evidence of construct validity and support the need for evidence based on a theoretical framework. This literature review offers implications for further research on the use of CCS tools as a method for assessment of competence in health-care professionals and the need for psychometric evidence to support it.

Intent Inferencing by an Intelligent Operator's Associate: A Validation Study

1988 ◽  
Vol 32 (5) ◽  
pp. 409-413
Author(s):  
Patricia M. Jones
Keyword(s):  
Dynamic System ◽  
Validation Study ◽  
Supervisory Control ◽  
Validation Studies ◽  
Human Operator ◽  
Complex Dynamic ◽  
Potential Form ◽  
Computer Based ◽  
Human Skills ◽  
And Control

In the supervisory control of a complex, dynamic system, one potential form of aiding for the human operator is a computer-based operator's associate. The design philosophy of the operator's associate is that of “amplifying” rather than automating human skills. In particular, the associate possesses understanding and control properties. Understanding allows it to infer operator intentions and thus form the basis for context-dependent advice and reminders; control properties allow the human operator to dynamically delegate individual tasks or subfunctions to the associate. This paper focuses on the design, implementation, and validation of the intent inferencing function. Two validation studies are described which empirically demonstrate the viability of the proposed approach to intent inferencing.

Being a student in the social media era: exploring educational affordances of an ePortfolio for managing academic performance

2020 ◽  
Vol 37 (4) ◽  
pp. 121-138
Author(s):  
Aikaterini Alexiou ◽  
Fotini Paraskeva
Keyword(s):  
Academic Performance ◽  
Undergraduate Students ◽  
Learning Technologies ◽  
Vocational Education And Training ◽  
Control Group ◽  
Instructional Designers ◽  
Content Type ◽  
Self Regulated Learning ◽  
Regulated Learning ◽  
Practical Guidelines

PurposeUndergraduate students often find it difficult to organize their learning activities and manage their learning. Also, teachers need dynamic pedagogical frameworks and learning technologies for supporting learners to advance their academic performance. The purpose of this paper is to investigate the effect of an ePortfolio intervention on self-regulated learning (SRL cognitive, affective, behavioral and contextual processes) and academic achievement.Design/methodology/approachFor the purposes of this study, an ePortfolio was designed and implemented based on SRL. The ePortfolio-based self-regulated learning approach (ePSRL) system encompasses the merits of a social networking platform and the functionalities of a learning management system. The participants were 123 university students (38 females and 85 males) at a computer science department. Students were randomly divided into two groups, the experimental and the control group.FindingsThe results of the study indicate that there is a significant increase of the means across SRL processes between the perceptions in the experimental and the control group. The implementation of the ePSRL approach as a learning module for undergraduate students could enable learners to manage their learning processes, transform their behavior into measurable learning outcomes and foster their academic performance.Originality/valueThis paper considers the importance of SRL and ePortfolios. Also, highlights the need of providing technology enhanced training courses and interventions to undergraduate students for supporting them to thrive during their academic studies. Thus, it proposes a set of educational affordances and practical guidelines that can be used by practitioners, instructional designers and educators in higher education as well as in vocational education and training institutions.

Assessment of OB/Gyn Residents’ Knowledge of Basic Obstetric Sonography and Psychomotor Skills Posttraining on a Computer-Based Simulator

2021 ◽  
pp. 875647932110520
Author(s):  
Sundus H. Mohammad ◽  
Carolyn M. Sommerich ◽  
Angela N. Butwin ◽  
Kevin D. Evans
Keyword(s):  
Statistical Analysis ◽  
Confidence Level ◽  
Obstetrics And Gynecology ◽  
High Fidelity ◽  
Psychomotor Skills ◽  
Knowledge And Skills ◽  
Novice Learners ◽  
Significant Difference ◽  
Computer Based ◽  
Individualized Training

Objective: This study sought to evaluate how a high-fidelity computer-based sonography simulator (FCBSS) can be used in training obstetrics and gynecology residents and evaluate efficacy of high-fidelity CBSS in enhancing resident’s sonographic knowledge, psychomotor skills, and level of confidence in performing sonographic fetal assessments. Materials and Methods: Eleven postgraduate year 1 residents (PGY1s) and ten PGY2s were assessed on sonographic performance by measuring psychomotor skills and evaluating the accuracy of the sonographic images. PGY2s received traditional sonography training while PGY1s received three individualized training sessions on a high-fidelity CBSS. At the conclusion, all residents received feedback and completed a survey to establish their current confidence level in performing and interpreting sonograms. Results: PGY2s scored a median of 33/66 points on the assessment, while PGY1s scored a median of 64/66 points. Statistical analysis performed from motion analysis metrics between cohorts revealed a statistically significant difference, with PGY1s demonstrating higher psychomotor skills. Interquartile ranges of PGY1s’ scores were smaller than PGY2s’, revealing consistency in knowledge and skills among the PGY1 cohort. Conclusion: Findings suggests that high-fidelity CBSS can be used effectively in training residents. It also demonstrates that implementation of formalized sonography training, using a high-fidelity CBSS, can be achieved and potentially expedite and enhance the learning of novice learners.

Progress toward the Validation of Alternative Tests

1997 ◽  
Vol 25 (1) ◽  
pp. 33-43 ◽  
Author(s):  
Michael Balls ◽  
Julia H. Fentem
Keyword(s):  
Validation Studies ◽  
Alternative Methods ◽  
Validation Process ◽  
Regulatory Testing ◽  
Protocol Optimisation ◽  
Test Materials ◽  
Practical Validation

ECVAM's role in the practical validation of replacement alternative methods for use in regulatory testing is reviewed, including an outline of the criteria which have been used in determining ECVAM's priorities. Some of the difficulties which have arisen in validation studies are discussed, and solutions to these are proposed, with particular emphasis on ensuring that methods are sufficiently well-developed to enter the validation process, and on the ECVAM prevalidation scheme for encouraging protocol optimisation and the prior assessment of interlaboratory transferability. Comments are made on problems encountered in selecting test materials backed by adequate in vivo data and in undertaking appropriate in vivo/in vitro comparisons.

scholarly journals Pendampingan dalam pengembangan media pembelajaran sebagai salah satu upaya untuk memperoleh sertifikasi bagi guru-guru SMK 1 Watampone

2021 ◽  
Vol 1 (1) ◽  
pp. 34-41
Author(s):  
Dian Riani Said ◽  
Andi Trisnowali ms ◽  
Andi Srimularahmah ◽  
Aisyah Nursyam
Keyword(s):  
Community Service ◽  
Teacher Certification ◽  
Training Method ◽  
Instructional Media ◽  
Certification Program ◽  
Work Process ◽  
Knowledge And Skills ◽  
Computer Based Learning ◽  
Lecture Method ◽  
Computer Based

Community Service Activities in the form of assistance in the development of learning media aim to provide knowledge and skills in developing learning media that meet the requirements for certification for teachers. The ability to develop instructional media is expected to accelerate and facilitate the acquisition of in-service teacher certification. The target audience in this PPM activity is the 26 teacher of SMK 1 Watampone. Assistance in the development of instructional media is carried out by means of lectures, demonstration and exercises accompanied by question and answers. The Lecture method is used to explain the introductory concepts of professional teachers and teacher certification and the theory of instructional media. The demonstration method is used to show a work process, namely the stages of developing computer-based learning media, while the training method is to practice making media that meets the requirements of the teacher certification program. While the question and answer method is to give participants the opportunity to consult in overcoming obstacles in the development of learning media. The benefits that participants can get from activities include being able to compile and develop computer-based learning media according to the training subject being taught.

Technology Infused Service Learning

2010 ◽  
pp. 107-122
Author(s):  
Janet Holland
Keyword(s):  
Service Learning ◽  
Learning Opportunities ◽  
Optimal Time ◽  
Academic Learning ◽  
Knowledge And Skills ◽  
Technology Knowledge ◽  
Positive Difference ◽  
Computer Based ◽  
The One ◽  
The Impact

It seems like everyone is so busy today, it is easy to miss opportunities to reach out and make a positive difference. Though we are all experiencing the impact of tight economic times there is one lesson we are learning internationally: by putting our minds and actions towards mutual goals we all can benefit. What better way to live, learn, and work together than to share our knowledge and skills to improve our communities, both the one we live in immediately, and the one we thrive in globally. When we leave behind a legacy, will it be one of teaching service to our students to improve both academic learning and making valuable contributions to our communities for generations to follow? With the prevalence of computer-based technologies and the desire of youth to be digitally connected, it is an optimal time to share technology knowledge and skills for service learning opportunities.

Challenges Experienced by Lecturers About Instructional Practices on Agricultural Programmes in TVET Colleges

2021 ◽  
pp. 49-73
Author(s):  
Ramongwane Daniel Sephokgole ◽  
Sylvia Manto Ramaligela
Keyword(s):  
Instructional Practices ◽  
Content Knowledge ◽  
Teaching Style ◽  
Vocational Education And Training ◽  
Research Approach ◽  
Structured Interviews ◽  
Personal Traits ◽  
Knowledge And Skills ◽  
Agricultural Resources

The acquisition of knowledge and skills largely depends on the availability of resources and equipment to practice agricultural programmes. Providing quality of knowledge and skills is challenging for lecturers offering agricultural programmes in technical and vocational education and training (TVET) colleges. Therefore, practicing agriculture using appropriate resources and equipment have a crucial role to play in ensuring that lecturers are able to practice agricultural programmes in TVET colleges. The considered challenge is that lecturers are unable to practice agricultural programmes due to a lack of agricultural resources and equipment. The qualitative research approach applied in this chapter was through semi-structured interviews used to collect data of 15 individual agriculture TVET lecturers. The study was analyzed using Mitzel's theoretical framework, and presage variables were used as a lens to understand the challenges experienced by lecturers about instructional practices on agricultural programmes. Content knowledge and skill, teaching skill, teaching style, and personal traits and those themes were used as categories to present the lecturer's interview. The key finding was that although most of the lecturers were able to integrate content knowledge and practical skill and has good personality traits, they were unable to show their teaching skills and teaching style due to a lack of resources and equipment. The authors conclude that a lack of resources and equipment derail the practice of agricultural programmes in TVET colleges.

Sign in / Sign up

Export Citation Format

Share Document