Skill Assessment-Tools/Analytics Tools: Die time2know® Performance Solution der IBT® SERVER-Produktfamilie

2005 ◽  
pp. 257-266
Author(s):  
Beate Bruns ◽  
Susann Smith
Author(s):  
Moh. Noer ◽  
Ali Maksum ◽  
Anung Priambodo

This research aims to develop instruments for assessing lower and upper service engineering skills in volleyball games for 6th-grade students in elementary schools. This research uses research and development methods, with the following development steps: (1) information gathering in the field, (2) analyze the information collected, (3) developing initial products, (4) expert validation and revision, (5) small-scale trials and revisions, (6) large-scale trials and revisions, (7) manufacturing of final products. The subject of this research is 6th-grade students of elementary students. Data analysis for the validity test was carried out with CVR (content validity ratio) and reliability using Alpha Cronbach. This research resulted in a handbook of instrument assessment tools for service techniques of lower and upper service in volleyball games for 6th-grade elementary school students, which contained instructions for use, student assignments sheets, assessment guidelines, assessment rubrics, and scoring tables, which have high validity. (1) And under service reliability initial attitude: r = 0.975, implementation: r = 0.961, follow-up motion: r = 0, 955. Upper Service for initial attitude: r = 0.961, implementation: r = 0.974, follow-up motion: r = 0.989.


2017 ◽  
Vol 58 (5-6) ◽  
pp. 246-262 ◽  
Author(s):  
René H. Tolba ◽  
Zoltán Czigány ◽  
Suzanne Osorio Lujan ◽  
Mihai Oltean ◽  
Michael Axelsson ◽  
...  

Background: Expectations towards surgeons in modern surgical practice are extremely high with minimal complication rates and maximal patient safety as paramount objectives. Both of these aims are highly dependent on individual technical skills that require sustained, focused, and efficient training outside the clinical environment. At the same time, there is an increasing moral and ethical pressure to reduce the use of animals in research and training, which has fundamentally changed the practice of microsurgical training and research. Various animal models were introduced and widely used during the mid-20th century, the pioneering era of experimental microsurgery. Since then, high numbers of ex vivo training concepts and quality control measures have been proposed, all aiming to reduce the number of animals without compromising quality and outcome of training. Summary: Numerous microsurgical training courses are available worldwide, but there is no general agreement concerning the standardization of microsurgical training. The major aim of this literature review and recommendation is to give an overview of various aspects of microsurgical training. We introduce here the findings of a previous survey-based analysis of microsurgical courses within our network. Basic principles behind microsurgical training (3Rs, good laboratory practice, 3Cs), considerations around various microsurgical training models, as well as several skill assessment tools are discussed. Recommendations are formulated following intense discussions within the European Society for Surgical Research (ESSR) and the International Society for Experimental Microsurgery (ISEM), based on scientific literature as well as on several decades of experience in the field of experimental (micro)surgery and preclinical research, represented by the contributing authors. Key Messages: Although ex vivo models are crucial for the replacement and reduction of live animal use, living animals are still indispensable at every level of training which aims at more than just a basic introduction to microsurgical techniques. Modern, competency-based microsurgical training is multi-level, implementing different objective assessment tools as outcome measures. A clear consensus on fundamental principles of microsurgical training and more active international collaboration for the sake of standardization are urgently needed.


Author(s):  
Jun Chen ◽  
Xiaozan Wang ◽  
Zhanjia Zhang ◽  
Weiyun Chen

This study aimed to test the validity and reliability of the Physical Education (PE) Metric Assessment Rubrics for assessing 4th-grade students’ manipulative skill competency and examine how well they demonstrated manipulative skill competency. Participants were 4th-grade students at six elementary schools in China. A total of 535 4th-grade students were assessed their soccer skills and 819 4th-grade students were assessed their basketball skills using the PE-Metric Assessment Rubrics. The results found that the soccer and basketball skill assessments had a high degree of internal consistency. And the results showed that the soccer and basketball skill assessment rubrics had a good factor structure. The students’ mean score in soccer and basketball skills assessment was lower than the Overall Competent Level. Further, the t-test indicated that soccer and basketball skill assessments had a significant difference in the mean score of Overall Competent Level between the boys and the girls. The PE-Metric Assessment Rubrics were valid and reliable assessment tools for assessing the manipulative skill competency in soccer and basketball skills among 4th-grade students in China. This study suggested that Chinese elementary school students need to improve basic manipulative skill competency in soccer and basketball skills.


2019 ◽  
Vol 52 (02) ◽  
pp. 216-221
Author(s):  
Sheeja Rajan ◽  
Ranjith Sathyan ◽  
L. S. Sreelesh ◽  
Anu Anto Kallerey ◽  
Aarathy Antharjanam ◽  
...  

AbstractMicrosurgical skill acquisition is an integral component of training in plastic surgery. Current microsurgical training is based on the subjective Halstedian model. An ideal microsurgery assessment tool should be able to deconstruct all the subskills of microsurgery and assess them objectively and reliably. For our study, to analyze the feasibility, reliability, and validity of microsurgery skill assessment, a video-based objective structured assessment of technical skill tool was chosen. Two blinded experts evaluated 40 videos of six residents performing microsurgical anastomosis for arteriovenous fistula surgery. The generic Reznick's global rating score (GRS) and University of Western Ontario microsurgical skills acquisition/assessment (UWOMSA) instrument were used as checklists. Correlation coefficients of 0.75 to 0.80 (UWOMSA) and 0.71 to 0.77 (GRS) for interrater and intrarater reliability showed that the assessment tools were reliable. Convergent validity of the UWOMSA tool with the prevalidated GRS tool showed good agreement. The mean improvement of scores with years of residency was measured with analysis of variance. Both UWOMSA (p-value: 0.034) and GRS (p-value: 0.037) demonstrated significant improvement in scores from postgraduate year 1 (PGY1) to PGY2 and a less marked improvement from PGY2 to PGY3. We conclude that objective assessment of microsurgical skills in an actual clinical setting is feasible. Tools like UWOMSA are valid and reliable for microsurgery assessment and provide feedback to chart progression of learning. Acceptance and validation of such objective assessments will help to improve training and bring uniformity to microsurgery education.


2020 ◽  
Vol In Press (In Press) ◽  
Author(s):  
Peigham Heidarpoor ◽  
Shahram Yazdani ◽  
Leila Sadati

Context: The operating room is a unique environment in which learning happens through interactions with others and facing complex situations. The results of studies show that non-technical skills play a key role in successful technical performance in critical situations. Therefore, the identification and assessment of them are very valuable. This review study was performed to identify and critique non-technical skill assessment tools for surgical team members. Evidence Acquisition: The Carnwell and Daly critical review method was used for the study design. Articles and documents were searched in databases of PubMed, Google Scholar, Scopus, and ScienceDirect from 1999 to 2019. Results: This literature review yielded 13 assessment tools of non-technical skills in the operating room, including ANTS, AS-NTS, N-ANTS, ANTS-AP for the anesthesia team, OTAS, Oxford NOTEHS, Oxford NOTECHS II, and Revised NOTECHS for the surgical team, SPINTS for scrub nurses, and OSANTS, NOTSS, SDM-RS, and SLI for surgeons. Conclusions: Since the development of the tools depends entirely on the context and task analysis of any member of the surgical team, all countries must customize the available tools and develop similar tools for other members of surgical teams.


Author(s):  
Tora Rydtun Haug ◽  
Mai-Britt Worm Ørntoft ◽  
Danilo Miskovic ◽  
Lene Hjerrild Iversen ◽  
Søren Paaske Johnsen ◽  
...  

Abstract Background In laparoscopic colorectal surgery, higher technical skills have been associated with improved patient outcome. With the growing interest in laparoscopic techniques, pressure on surgeons and certifying bodies is mounting to ensure that operative procedures are performed safely and efficiently. The aim of the present review was to comprehensively identify tools for skill assessment in laparoscopic colon surgery and to assess their validity as reported in the literature. Methods A systematic search was conducted in EMBASE and PubMed/MEDLINE in May 2021 to identify studies examining technical skills assessment tools in laparoscopic colon surgery. Available information on validity evidence (content, response process, internal structure, relation to other variables, and consequences) was evaluated for all included tools. Results Fourteen assessment tools were identified, of which most were procedure-specific and video-based. Most tools reported moderate validity evidence. Commonly not reported were rater training, assessment correlation with variables other than training level, and validity reproducibility and reliability in external educational settings. Conclusion The results of this review show that several tools are available for evaluation of laparoscopic colon cancer surgery, but few authors present substantial validity for tool development and use. As we move towards the implementation of new techniques in laparoscopic colon surgery, it is imperative to establish validity before surgical skill assessment tools can be applied to new procedures and settings. Therefore, future studies ought to examine different aspects of tool validity, especially correlation with other variables, such as patient morbidity and pathological reports, which impact patient survival.


2020 ◽  
Vol 08 (10) ◽  
pp. E1522-E1529
Author(s):  
Eckart Frimberger ◽  
Peter Klare ◽  
Bernhard Haller ◽  
Mayada Elnegouly ◽  
Monther Bajbouj ◽  
...  

Abstract Background and study aims Colonoscopic polypectomy is an essential endoscopic skill. The simulators available for training are limited and based on raw porcine colons. Animal intestines are inconvenient and offer limited advantages for polypectomy training. These limitations are avoided by two novel mechanical simulators — the magnetic system based simulator (MSPS) and the simulator for polypectomy with high frequency current (HFPS) — described here. They are equipped to demonstrate self-repair of polyps after making a cut and hybrid polyps. The aim of this study was to describe and establish face, content, and construct validity of the two simulators and to assess their perceived utility as training and assessment tools. Methods Ten novice, seven intermediate, and 10 advanced endoscopists participated in this study. Each one performed two polypectomies in MSPS and then one polypectomy and polyp retrieval in HFPS. The median times were compared among the three groups to preliminarily assess construct validity as a primary outcome. To establish face validity, the novices and intermediates completed a questionnaire about the credibility of each simulator after finishing the tasks. For content validity, the experts completed a questionnaire grading different aspects of the simulators’ realism and their usefulness for training. Results All 27 participants completed the modules. Median times needed to complete the tasks in both simulators differed significantly between the participants with different levels of experience (P < 0.05). Both MSPS and HFPS received favorable scores regarding face and content validity. No technical problems were encountered. Conclusion This study provides preliminary validation for MSPS and HFPS as useful training tools in a preclinical setting as well as during colonoscopy training. Moreover, we demonstrated the construct validity of both simulators, which confirms their use as a skill assessment tool during a colonoscopy training program.


Sign in / Sign up

Export Citation Format

Share Document