The Kirkpatrick model for training evaluation: bibliometric analysis after 60 years (1959–2020)

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Aljawharah Alsalamah ◽  
Carol Callinan
Keyword(s):  
Bibliometric Analysis ◽  
High Performance ◽  
Medical Training ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Content Type ◽  
Need To Evaluate ◽  
Kirkpatrick Model ◽  
Training Activities ◽  
Kirkpatrick’S Model

Purpose A number of studies on Kirkpatrick’s four-level training evaluation model have been published, since its inception in 1959, either investigating it or applying it to evaluate the training process. The purpose of this bibliometric analysis is to reconsider the model, its utility and its effectiveness in meeting the need to evaluate training activities and to explain why the model is still worth using even though other later models are available. Design/methodology/approach This study adopts a “5Ws+1H” model (why, when, who, where, what and how); however, “when” and “how” are merged in the methodology. A total of 416 articles related to Kirkpatrick’s model published between 1959 and July 2020 were retrieved using Scopus. Findings The Kirkpatrick model continues to be useful, appropriate and applicable in a variety of contexts. It is adaptable to many training environments and achieves high performance in evaluating training. The overview of publications on the Kirkpatrick model shows that research using the model is an active and growing area. The model is used primarily in the evaluation of medical training, followed by computer science, business and social sciences. Originality/value This paper presents a comprehensive bibliometric analysis to reconsider the model, its utility, its effectiveness in meeting the need to evaluate training activities, its importance in the field measured by the growth in studies on the model and its applications in various settings and contexts.

scholarly journals MODEL EVALUASI KIRIKPATRICK DAN APLIKASINYA DALAM PELAKSANAAN PELATIHAN (LEVEL REAKSI DAN PEMBELAJARAN) DI PUSAT PENDIDIKAN DAN PELATIHAN PERUM JAKARTA

2015 ◽  
Vol 6 (1) ◽  
pp. 376
Author(s):  
Hania Aminah
Keyword(s):  
Content Validity ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Training Center ◽  
Post Test ◽  
Kirkpatrick Model ◽  
The Difference ◽  
Kirkpatrick’S Model ◽  
And Training

MODEL EVALUASI KIRIKPATRICK DAN APLIKASINYADALAM PELAKSANAAN PELATIHAN (LEVEL REAKSI DAN PEMBELAJARAN)DI PUSAT PENDIDIKAN DAN PELATIHAN PERUM JAKARTAHania AminahFakultas Ekonomi, Universitas Negeri JakartaEmail: [email protected] order to avoid the inefficiency of the training, the training should be measured. Theresearch aim to determine the effectiveness of information and training through theimplementation of the evaluation model is to implement two levels which consist of reactionsand learning levels, using Kirkpatrick’s model. This research was conducted at the Learningand Training Center of Central Jakarta, with a sample of all participants of training. Datacollection using a questionnaire that has been tested by using content validity, whereas testsuse SPSS.The results showed that the reaction of trainees are satisfied with the implementation of thetraining that was conducted and the results are good and improving learning are assessedfrom the pre-test and post-test. The resulting increase in the difference was significant, butwhen viewed from the aspect of knowledge, understanding and application, the result of thedifference increased, but not significantly.Keywords: Training, Evaluation, Kirkpatrick Model, Employees

Training evaluation: an analysis of the stakeholders' evaluation needs

2011 ◽  
Vol 35 (4) ◽  
pp. 385-410 ◽  
Author(s):  
Marco Guerci ◽  
Marco Vinante
Keyword(s):  
Training Program ◽  
Latent Variables ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Content Type ◽  
Stakeholder Groups ◽  
European Social Fund ◽  
Social Fund ◽  
Multi Stakeholder ◽  
Depth Interviews

PurposeIn recent years, the literature on program evaluation has examined multi‐stakeholder evaluation, but training evaluation models and practices have not generally taken this problem into account. The aim of this paper is to fill this gap.Design/methodology/approachThis study identifies intersections between methodologies and approaches of participatory evaluation, and techniques and evaluation tools typically used for training. The study focuses on understanding the evaluation needs of the stakeholder groups typically involved in training programs. A training program financed by the European Social Fund in Italy is studied, using both qualitative and quantitative methodologies (in‐depth interviews and survey research).FindingsThe findings are as follows: first, identification of evaluation dimensions not taken into account in the return on investment training evaluation model of training evaluation, but which are important for satisfying stakeholders' evaluation needs; second, identification of convergences/divergences between stakeholder groups' evaluation needs; and third, identification of latent variables and convergences/divergences in the attribution of importance to them among stakeholders groups.Research limitations/implicationsThe main limitations of the research are the following: first, the analysis was based on a single training program; second, the study focused only on the pre‐conditions for designing a stakeholder‐based evaluation plan; and third, the analysis considered the attribution of importance by the stakeholders without considering the development of consistent and reliable indicators.Practical implicationsThese results suggest that different stakeholder groups have different evaluation needs and, in operational terms are aware of the convergence and divergence between those needs.Originality/valueThe results of the research are useful in identifying: first, the evaluation elements that all stakeholder groups consider important; second, evaluation elements considered important by one or more stakeholder groups, but not by all of them; and third, latent variables which orient stakeholders groups in training evaluation.

Impact of continuing education programs (CEPs) on LIS professionals in academic libraries in Mumbai, India

2017 ◽  
Vol 38 (2/3) ◽  
pp. 117-130 ◽  
Author(s):  
Madhura Deodhar ◽  
Sushama Powdwal
Keyword(s):  
Continuing Education ◽  
Academic Libraries ◽  
Training Evaluation ◽  
Library Science ◽  
Academic Librarians ◽  
Survey Method ◽  
Education Programs ◽  
Content Type ◽  
Kirkpatrick Model ◽  
The Impact

Purpose The purpose of this paper is to report the research findings of an evaluation of the impact of continuing education programs (CEPs) on library information science (LIS) professionals of academic libraries in Mumbai, India. The paper also introduces Donald Kirkpatrick model of training evaluation for Library Science research in the area of program evaluation. Design/methodology/approach The impact of CEPs was evaluated using Donald Kirkpatrick model of training evaluation using survey method. The impact was evaluated at four levels; reaction, learning, behavior and results. The population of the present study included 344 LIS professionals working at colleges libraries affiliated to University of Mumbai and Shreemati Nathibai Damodar Thackersey (SNDT) Women’s University in Mumbai, India. The data collected through questionnaire were supplemented by five specimen interviews of heads of institutions of the academic librarians who had attended more than five CEPs in five years, 2009-2013. Findings The findings of the study revealed that professionals were satisfied with CEP attendance; keen on gaining more knowledge and transferring the acquired knowledge and skills at their workplaces and interested in implementing the learning to achieve results. The reasons given by academic librarians on not implementing the learning in the library indicated that there were hindrances like lack of management support, lack of technical expertise, inadequate staff in the library, poor IT Infrastructure, etc. in transferring the learning at work. Research limitations/implications The study was based on self-perceptions of respondents. The limitation of self-perception was eliminated to some extent by supplementing qualitative data wherever required. CEPs included conferences, seminars, workshops, refresher courses, orientation programs and online courses. Pre-test and post-test recommended by the Kirkpatrick model could not be conducted as the researcher has not adopted experimental design. The data of feedback from the organizers and content of the CEPs attended by respondents were not analyzed in the study. Practical implications The paper describes the implementation of Kirkpatrick model to evaluate the CEPs, which can be used by the organizers or institutions to evaluate the impact of CEPs in future. This will help them to improve upon the contents of CEPs making them more relevant and effective. Social implications Evaluation of CEPs will be useful to ensure the effectiveness of CEPs and performance of LIS professionals. Originality/value This paper reports an original research initiative undertaken to evaluate the impact of CEPs attended by LIS professionals of Indian academic libraries in Mumbai, India. It fills the gap in LIS research. The application of Donald Kirkpatrick model of Training evaluation is also valuable for LIS research.

Evaluation of training programs in Russian manufacturing companies

2017 ◽  
Vol 41 (2) ◽  
pp. 119-143 ◽  
Author(s):  
Dmitry Kucherov ◽  
Daria Manokhina
Keyword(s):  
Training Program ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Evaluation Process ◽  
Manufacturing Companies ◽  
Evaluation Tools ◽  
Online Questionnaire ◽  
Content Type ◽  
Manufacturing Enterprises ◽  
Employee Groups

Purpose This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels in Russian manufacturing companies. Design/methodology/approach The HR professionals from 24 Russian manufacturing companies completed the author’s online questionnaire. Findings The results revealed that the respondents perceived training evaluation as highly important, but their satisfaction level toward existing evaluation was low. The most significant training evaluation goal was recognized as raising the efficiency of training process and the most widely used training evaluation model was Kirkpatrick’s, with focus on the reaction level. It was confirmed that training evaluation tools used in Russian manufacturing enterprises differed among the employee groups and different levels of training evaluation depended on duration and cost of the training program. Originality/value This is the first study which focuses on current training evaluation processes and gaps in Russian manufacturing companies. The recommendations proposed by the authors could be used by an HR team to improve training evaluation depending on employee group involved in training, duration and costs of the training program.

scholarly journals Associative Effects between Forages and Concentrates on In Vitro Fermentation of Working Equine Diets

Animals ◽  
2021 ◽  
Vol 11 (8) ◽  
pp. 2212
Author(s):  
Mónica Gandarillas ◽  
Juan Pablo Keim ◽  
Elisa María Gapp
Keyword(s):  
High Performance ◽  
Volatile Fatty Acid ◽  
Animal Species ◽  
Nutritive Value ◽  
Gas Production ◽  
In Vitro Fermentation ◽  
In Vitro Gas Production ◽  
Production Experiment ◽  
Need To Evaluate

Background: Horses are hindgut fermenters, and it is therefore important to determine the postgastric nutritive value of their feedstuffs and diets. Moreover, it has been demonstrated in other animal species that the fermentation of diets results in different values than those expected from pure ingredients. Therefore, the general objective of this work is to evaluate the gas production (GP) and volatile fatty acid (VFA) concentration, as well as the associative effects, of mixtures of different forages and concentrated foods, which are representative of the traditional diets of high-performance horses. Methods: An in vitro gas production experiment was conducted to assess the fermentation of two forages and three concentrates that are typical in horse diets. The combination of 70% of forage and 30% concentrates was also assessed to determine potential associative effects. Results: Concentrates and grains produced higher GP and VFA than forages when evaluated alone. When experimental diets were incubated, GP parameters and VFA concentrations of forage–concentrate mixtures had unexpected differences from the values expected from the fermentation of pure ingredients, suggesting the occurrence of associative effects. Conclusions: Our results indicate that there is a need to evaluate the fermentation of diets, rather than predicting from the values of pure ingredients.

scholarly journals Rough diamonds in emerging markets: legacy, competitiveness, and sustained high performance

2019 ◽  
Vol 26 (3) ◽  
pp. 363-386
Author(s):  
Seung Ho Park ◽  
Gerardo R. Ungson
Keyword(s):  
Human Capital ◽  
Emerging Markets ◽  
High Performance ◽  
Core Competencies ◽  
Market Potential ◽  
Government Support ◽  
Screening Tests ◽  
Institutional Voids ◽  
Content Type ◽  
Over Time

Purpose The purpose of this paper is to uncover the underlying drivers of sustained high performing companies based on a field study of 127 companies in Brazilian, Russian, Indian and Chinese (BRIC) and Association of Southeast Asian Nations (ASEAN) emerging markets. Understanding these companies provides a complementary way of appraising the growth, development and transformation of emerging markets. The authors synthesize the findings in an overarching framework that covers six strategies for building and sustaining legacy that leads to the succession of intergenerational wealth over time: overcoming institutional voids, inclusive markets, deepening localization, nurturing government support, building core competencies and harnessing human capital. The authors relate these strategies to different levels of development using Prahalad and Hart’s BOP framework. Design/methodology/approach This study examines the underlying drivers of sustained high-performance companies based on field studies from an initial set of 105,260 BRIC companies and close to 500 companies in ASEAN. The methods employed four screening tests to arrive at a selection of the highest-performing firms: 70 firms in the BRIC nations and 58 firms from ASEAN. Following the selection, the authors constructed cases using primary interviews and secondary data, with the assistance of Ernst & Young and with academic colleagues in Manila. These studies were originally conducted in two separate time periods and reported accordingly. This paper synthesizes the findings of these two studies to arrive at an extended integrative framework. Findings From the cases, the authors examine six strategies for building and sustaining legacy that lead to high performance over time: overcoming institutional voids, creating inclusive markets, deepening localization, nurturing government support, building core competencies and harnessing human capital. To address the evolving state of institutional voids in these countries, the authors employ similar methods to hypothesize the placement of these strategies in the context of the world economic pyramid, initially formulated as the “bottom of the pyramid” framework. Originality/value This paper synthesizes and extends the authors’ previous works by proposing the concept of legacy to describe the emergence and succession of local exemplary firms in emerging markets. This study aims to complement extant measures of nation-growth based primarily on GDP. The paper also extends the literature on institutional voids in shifting the focus from the mix of voids to their evolving state. Altogether, the paper provides a complementary narrative on assessing the market potential of emerging markets by adopting several categories of performance.

Mitigation of road traffic crash hazard in Pakistan

2014 ◽  
Vol 23 (5) ◽  
pp. 567-585
Author(s):  
Muhammad Masood Rafi ◽  
Ashar Hashmat Lodi ◽  
Muhammad Arsalan Effendi
Keyword(s):  
Road Traffic ◽  
Evaluation Model ◽  
Road Traffic Crash ◽  
Potential Hazard ◽  
Suggested Model ◽  
Male Population ◽  
Content Type ◽  
The Road ◽  
On The Road ◽  
The City

Purpose – Road traffic crashes (RTCs) result in creating significant social and economic hazard for affectees, their families and society. The purpose of this paper is to present studies which were conducted to study the patterns of RTCs in Karachi which is a metropolitan city of Pakistan. The studies were conducted on one of the busiest roads in the city named as Shara-e-Faisal. The influence and contribution of different factors in RTCs has been studied and hazardous road sections of Shara-e-Faisal have been identified. Based on the data analysis, an evaluation model has been suggested to reduce the hazard of RTCs on Shara-e-Faisal. The objective of the presented studies is to increase the present level of safety of road travel by reducing crashes on Shara-e-Faisal. Design/methodology/approach – Existing data of RTCs in Karachi have been analysed for the presented studies. For this purpose, Shara-e-Faisal was divided in sections of 1 km length to study the vehicle crash pattern. Location surveys were conducted to record physical conditions of this road. A cluster analysis was carried out to identify hazardous sections of the road. An evaluation model has been suggested in the end to reduce the hazard of RTCs by identifying hazardous road sections of Shara-e-Faisal. Findings – The analysis of the data revealed that the crashes were higher over weekend and on Monday. Male population, particularly young people, and motorcycle riders were the largest affectees of RTCs. In general, more daytime crashes were recorded as compared to nighttime crashes. The crashes in the mid block of the road and those involving rear-end collisions were higher. The hazardous road locations were related to poor road conditions. Statistical analysis indicated that alternate routes were required to reduce the RTC hazard on Shara-e-Faisal. Research limitations/implications – The paper is a small, but an original, contribution to identify a potential hazard which is faced by the community in the city. This is the first attempt (to the best of authors’ knowledge) to address the issue of RTCs in Karachi from an engineering view point. Practical implications – The suggested model can be employed by the authorities as a guideline to mitigate the hazard of road crashes in the country. Originality/value – The paper provides valuable information on the road traffic incidents, their pattern and contributing factors in one of the largest metropolis of Pakistan. The suggested model can become helpful in reducing RTCs in Pakistan.

Sustainable supply chain management

2015 ◽  
Vol 115 (3) ◽  
pp. 436-461 ◽  
Author(s):  
MingLang Tseng ◽  
Ming Lim ◽  
Wai Peng Wong
Keyword(s):  
Supply Chain ◽  
Supply Chain Management ◽  
Balanced Scorecard ◽  
Evaluation Model ◽  
Corporate Sustainability ◽  
Sustainable Supply Chain ◽  
Chain Management ◽  
Content Type ◽  
Sustainable Supply Chain Management ◽  
Fuzzy Delphi

Purpose – Assessing a measure of sustainable supply chain management (SSCM) performance is currently a key challenge. The literature on SSCM is very limited and performance measures need to have a systematic framework. The recently developed balanced scorecard (BSC) is a measurement system that requires a balanced set of financial and non-financial measures. The purpose of this paper is to evaluate the SSCM performance based on four aspects i.e. sustainability, internal operations, learning and growth, and stakeholder. Design/methodology/approach – This paper developed a BSC hierarchical network for SSCM in a close-loop hierarchical structure. A generalized quantitative evaluation model based on the Fuzzy Delphi Method (FDM) and Analytical Network Process (ANP) were then used to consider both the interdependence among measures and the fuzziness of subjective measures in SSCM. Findings – The results of this study indicate that the top-ranking aspect to consider is that of stakeholders, and the top five criteria are green design, corporate sustainability, strategic planning for environmental management, supplier cost-saving initiatives and market share. Originality/value – The main contributions of this study are twofold. First, this paper provides valuable support for supply chain stakeholders regarding the nature of network hierarchical relations with qualitative and quantitative scales. Second, this paper improves practical performance and enhances management effectiveness for SSCM.

scholarly journals In VitroActivities of Daptomycin-, Vancomycin-, and Teicoplanin-Loaded Polymethylmethacrylate against Methicillin-Susceptible, Methicillin-Resistant, and Vancomycin-Intermediate Strains of Staphylococcus aureus

2011 ◽  
Vol 55 (12) ◽  
pp. 5480-5484 ◽  
Author(s):  
Yuhan Chang ◽  
Wen-Chien Chen ◽  
Pang-Hsin Hsieh ◽  
Dave W. Chen ◽  
Mel S. Lee ◽  
...  
Keyword(s):  
Staphylococcus Aureus ◽  
High Performance ◽  
Low Dose ◽  
Antibacterial Activities ◽  
High Dose ◽  
Bone Cements ◽  
Antibacterial Effects ◽  
Methicillin Resistant ◽  
Content Type

ABSTRACTThe objective of this study was to evaluate the antibacterial effects of polymethylmethacrylate (PMMA) bone cements loaded with daptomycin, vancomycin, and teicoplanin against methicillin-susceptibleStaphylococcus aureus(MSSA), methicillin-resistantStaphylococcus aureus(MRSA), and vancomycin-intermediateStaphylococcus aureus(VISA) strains. Standardized cement specimens made from 40 g PMMA loaded with 1 g (low-dose), 4 g (middle-dose) or 8 g (high-dose) antibiotics were tested for elution characteristics and antibacterial activities. The patterns of release of antibiotics from the cement specimens were evaluated usingin vitrobroth elution assay with high-performance liquid chromatography. The activities of broth elution fluid against differentStaphylococcus aureusstrains (MSSA, MRSA, and VISA) were then determined. The antibacterial activities of all the tested antibiotics were maintained after being mixed with PMMA. The cements loaded with higher dosages of antibiotics showed longer elution periods. Regardless of the antibiotic loading dose, the teicoplanin-loaded cements showed better elution efficacy and provided longer inhibitory periods against MSSA, MRSA, and VISA than cements loaded with the same dose of vancomycin or daptomycin. Regarding the choice of antibiotics for cement loading in the treatment ofStaphylococcus aureusinfection, teicoplanin was superior in terms of antibacterial effects.

Sign in / Sign up

Export Citation Format

Share Document