Seven keys to unlock the four levels of evaluation

2006 ◽  
Vol 45 (7) ◽  
pp. 5-8 ◽  
Author(s):  
Donald L. Kirkpatrick
2016 ◽  
Vol 30 (3) ◽  
pp. 390-407 ◽  
Author(s):  
Cheryl Throgmorton ◽  
Trey Mitchell ◽  
Tom Morley ◽  
Marijo Snyder

Purpose – With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach – The authors applied the theoretical framework of Kirkpatrick’s four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings – The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications – While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders’ partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value – Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.


2020 ◽  
Vol 73 (suppl 6) ◽  
Author(s):  
Ádria Marcela Vieira Ferreira ◽  
Leidiane Minervina Moraes de Sabino ◽  
Lilia Jannet Saldarriaga Sandoval ◽  
Francisca Elisangela Teixeira Lima ◽  
Mariana Cavalcante Martins ◽  
...  

ABSTRACT Objectives: to verify the effectiveness of a regional nutrition training program for nurses based on four levels of assessment: response, learning, behavior, and conclusions. Methods: this was a longitudinal, almost experimental before and after type of study, carried out in 2014 with eight nurses and 62 mothers attended in the Primary Health Care Units of the rural area of Ceará, Brazil, in a training program using educational technology on regional food. Results: the evaluations showed a positive reaction from the nurses; a very good post-test average (92.3%); a change in nurses’ behavior, verified by 30 educational activities after training; and satisfactory results, verified by improvement in knowledge, attitude and practice of the mothers about regional food and food safety after participating in the educational interventions carried out by the trained nurses. Conclusions: the training program was considered effective, showing positive results in the four levels of evaluation.


2005 ◽  
Vol 33 (4) ◽  
pp. 399-419 ◽  
Author(s):  
Annette C. Sherry ◽  
Andrea Bartlett

Two groups of education majors—23 undergraduates and 14 educational technology graduate students—provided perspectives about their electronic portfolios. Two investigators independently directed them, evaluating the process from students' perspectives, including holistic evaluations by departmental faculty. Survey data were framed within Kirkpatrick's Levels of Evaluation with worth expressed on four levels as attitudes, learning, planned job usage, and potential organization impact. Despite different technological capabilities and limited similarities in implementing the process, both groups primarily viewed electronic portfolios as worthwhile overall, being largely positive on three levels. Systemizing the process is suggested. Technological ability, overall, was not a major factor.


2014 ◽  
Vol 23 (4) ◽  
pp. 173-186 ◽  
Author(s):  
Deborah Hinson ◽  
Aaron J. Goldsmith ◽  
Joseph Murray

This article addresses the unique roles of social work and speech-language pathologists (SLPs) in end-of-life and hospice care settings. The four levels of hospice care are explained. Suggested social work and SLP interventions for end-of-life nutrition and approaches to patient communication are offered. Case studies are used to illustrate the specialized roles that social work and SLP have in end-of-life care settings.


2007 ◽  
Vol 12 (6) ◽  
pp. 5-8 ◽  
Author(s):  
J. Mark Melhorn

Abstract Medical evidence is drawn from observation, is multifactorial, and relies on the laws of probability rather than a single cause, but, in law, finding causation between a wrongful act and harm is essential to the attribution of legal responsibility. These different perspectives often result in dissatisfaction for litigants, uncertainty for judges, and friction between health care and legal professionals. Carpal tunnel syndrome (CTS) provides an example: Popular notions suggest that CTS results from occupational arm or hand use, but medical factors range from congenital or acquired anatomic structure, age, sex, and body mass index, and perhaps also involving hormonal disorders, diabetes, pregnancy, and others. The law separately considers two separate components of causation: cause in fact (a cause-and-effect relationship exists) and proximate or legal cause (two events are so closely related that liability can be attached to the first event). Workers’ compensation systems are a genuine, no-fault form of insurance, and evaluators should be aware of the relevant thresholds and legal definitions for the jurisdiction in which they provide an opinion. The AMA Guides to the Evaluation of Permanent Impairment contains a large number of specific references and outlines the methodology to evaluate CTS, including both occupational and nonoccupational risk factors and assigning one of four levels of evidence that supports the conclusion.


Author(s):  
Ammar Hameed Madi ◽  
Jawad A. Kamal Al-Shibani

This study was conducted to investigate the effect of bacterial bio-fertilization A. chroococcum and P. putide and four levels of compost (0, 1, 2, 3) tons.h-1 on the leaves content of N.P.K elements. The experiment was carried out in one of the greenhouses of the College of Agriculture - University of Al-Qadisiyah during fall season 2018-2019. It designed in accordance with the Randomized Complete Block Design (RCBD) with three replicates in sandy loam soil. The means of treatments were compared with the least significant difference (LSD) at (5)% probability level. The results present that the treatments of A. chroococcum, P. putide and compost at (3) tons.kg-1 significantly increases the leaves content of K.P.K compared to all other treatments in the flowering stage (4.970, 0.5000, and 4.930) mg.kg-1, respectively. This treatment was followed by the effect of the treatment of A. chroococcum and compost at (3) tons.kg-1, which increases the values of all traits except the leaf content of (P). Bio-fertilizer with P. putide + A. chroococcum significantly increases the leaves' content of P.


2015 ◽  
Vol 4 (2) ◽  
pp. 50-55
Author(s):  
Sandra J Nendissa ◽  
Rachel Breemer ◽  
Nikholaus Melamas

This objectives of this research were both to study and determine the best level of concentration of yeast Saccharomyces cereviseae and period of fermentation on the quality of tomi-tomi vinegar (Flacourtia inermis). A completely randomized experimental design with two factors of treatment was applied in this research. The first factor was concentration of yeast S. cereviseae having four levels of tretament, i.e.: without the addition of yeast 0.5, 1 and 1.5 g yeast. The second factor was period fermentation with 1, 2, 3, 4, and 5 weeks. The result indicated that the concentration of yeast S. cereviseae 1.5 g and period fermentation 5 week produced a good tomi-tomi vinegar with total acids 51.22%, total dissolved solids 8.35, total sugar 8.07% and pH 5.40.


2015 ◽  
Vol 4 (2) ◽  
pp. 41-44
Author(s):  
Priscillia Picauly ◽  
Gilian Tetelepta

Instant porridge is sereal-based food that can be combined with fruits so it will contain better nutrition. To improve the nutrition value of instant porridge then substitute of one kind of banana originally from Maluku is Tongka langit banana. A good quality of instant porridge has a high nutrition and a best physical property. This research aims to characterize of the physical properties instant porridge that are substituted by Tongka langit banana flour and the rice flour. The design that is applied is completely randomized design with four levels of treatment in comparing the substitution between Tongka langit banana flour and the rice flour as follow 20%, 40%, 60% and 80%. According to the result of this research, the physical characteristic of instant porridge that are substituted by Tongka langit banana flour are bulk density (0.84-0.89 g/mL), water absorption index (3.49-4.05%), and water solubility index (0.02-0.04%).


Sign in / Sign up

Export Citation Format

Share Document