Evaluation of training programs in Russian manufacturing companies

2017 ◽  
Vol 41 (2) ◽  
pp. 119-143 ◽  
Author(s):  
Dmitry Kucherov ◽  
Daria Manokhina
Keyword(s):  
Training Program ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Evaluation Process ◽  
Manufacturing Companies ◽  
Evaluation Tools ◽  
Online Questionnaire ◽  
Content Type ◽  
Manufacturing Enterprises ◽  
Employee Groups

Purpose This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels in Russian manufacturing companies. Design/methodology/approach The HR professionals from 24 Russian manufacturing companies completed the author’s online questionnaire. Findings The results revealed that the respondents perceived training evaluation as highly important, but their satisfaction level toward existing evaluation was low. The most significant training evaluation goal was recognized as raising the efficiency of training process and the most widely used training evaluation model was Kirkpatrick’s, with focus on the reaction level. It was confirmed that training evaluation tools used in Russian manufacturing enterprises differed among the employee groups and different levels of training evaluation depended on duration and cost of the training program. Originality/value This is the first study which focuses on current training evaluation processes and gaps in Russian manufacturing companies. The recommendations proposed by the authors could be used by an HR team to improve training evaluation depending on employee group involved in training, duration and costs of the training program.

Training evaluation: an analysis of the stakeholders' evaluation needs

2011 ◽  
Vol 35 (4) ◽  
pp. 385-410 ◽  
Author(s):  
Marco Guerci ◽  
Marco Vinante
Keyword(s):  
Training Program ◽  
Latent Variables ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Content Type ◽  
Stakeholder Groups ◽  
European Social Fund ◽  
Social Fund ◽  
Multi Stakeholder ◽  
Depth Interviews

PurposeIn recent years, the literature on program evaluation has examined multi‐stakeholder evaluation, but training evaluation models and practices have not generally taken this problem into account. The aim of this paper is to fill this gap.Design/methodology/approachThis study identifies intersections between methodologies and approaches of participatory evaluation, and techniques and evaluation tools typically used for training. The study focuses on understanding the evaluation needs of the stakeholder groups typically involved in training programs. A training program financed by the European Social Fund in Italy is studied, using both qualitative and quantitative methodologies (in‐depth interviews and survey research).FindingsThe findings are as follows: first, identification of evaluation dimensions not taken into account in the return on investment training evaluation model of training evaluation, but which are important for satisfying stakeholders' evaluation needs; second, identification of convergences/divergences between stakeholder groups' evaluation needs; and third, identification of latent variables and convergences/divergences in the attribution of importance to them among stakeholders groups.Research limitations/implicationsThe main limitations of the research are the following: first, the analysis was based on a single training program; second, the study focused only on the pre‐conditions for designing a stakeholder‐based evaluation plan; and third, the analysis considered the attribution of importance by the stakeholders without considering the development of consistent and reliable indicators.Practical implicationsThese results suggest that different stakeholder groups have different evaluation needs and, in operational terms are aware of the convergence and divergence between those needs.Originality/valueThe results of the research are useful in identifying: first, the evaluation elements that all stakeholder groups consider important; second, evaluation elements considered important by one or more stakeholder groups, but not by all of them; and third, latent variables which orient stakeholders groups in training evaluation.

The Kirkpatrick model for training evaluation: bibliometric analysis after 60 years (1959–2020)

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Aljawharah Alsalamah ◽  
Carol Callinan
Keyword(s):  
Bibliometric Analysis ◽  
High Performance ◽  
Medical Training ◽  
Evaluation Model ◽  
Training Evaluation ◽  
Content Type ◽  
Need To Evaluate ◽  
Kirkpatrick Model ◽  
Training Activities ◽  
Kirkpatrick’S Model

Purpose A number of studies on Kirkpatrick’s four-level training evaluation model have been published, since its inception in 1959, either investigating it or applying it to evaluate the training process. The purpose of this bibliometric analysis is to reconsider the model, its utility and its effectiveness in meeting the need to evaluate training activities and to explain why the model is still worth using even though other later models are available. Design/methodology/approach This study adopts a “5Ws+1H” model (why, when, who, where, what and how); however, “when” and “how” are merged in the methodology. A total of 416 articles related to Kirkpatrick’s model published between 1959 and July 2020 were retrieved using Scopus. Findings The Kirkpatrick model continues to be useful, appropriate and applicable in a variety of contexts. It is adaptable to many training environments and achieves high performance in evaluating training. The overview of publications on the Kirkpatrick model shows that research using the model is an active and growing area. The model is used primarily in the evaluation of medical training, followed by computer science, business and social sciences. Originality/value This paper presents a comprehensive bibliometric analysis to reconsider the model, its utility, its effectiveness in meeting the need to evaluate training activities, its importance in the field measured by the growth in studies on the model and its applications in various settings and contexts.

A new supplier performance evaluation model

Kybernetes ◽  
2010 ◽  
Vol 39 (1) ◽  
pp. 37-54 ◽  
Author(s):  
He‐Yau Kang ◽  
Amy H.I. Lee
Keyword(s):  
Performance Evaluation ◽  
Integrated Circuit ◽  
Evaluation Model ◽  
Pairwise Comparison ◽  
Evaluation Process ◽  
Supplier Evaluation ◽  
Content Type ◽  
Supplier Performance ◽  
Performance Evaluation Model ◽  
Proposed Model

PurposeMost industries have become increasingly competitive nowadays, and a good supply chain relationship is essential for a company to survive and to acquire reasonable profit. Therefore, supplier selection is very important. The purpose of this paper is to propose a novel model for evaluating the performance of suppliers.Design/methodology/approachA supplier performance evaluation model based on analytic hierarchy process (AHP) and data envelopment analysis (DEA) is constructed. DEA is applied first to evaluate quantitative factors, and the results are transformed into pairwise comparison values for AHP analysis. Qualitative factors are also evaluated through AHP analysis, and a final ranking of suppliers can be obtained by combining the quantitative and qualitative results.FindingsThe proposed model can be applied to evaluate and select the most appropriate integrated circuit packaging company for outsourcing. With the incorporation of experts' opinions and the consideration of qualitative and quantitative factors, the model can provide a both subjective and objective supplier performance ranking.Practical implicationsThe proposed model can be tailored and applied to supplier evaluation and selection in other industries.Originality/valueAlthough many models are available for supplier evaluation, this paper considers both the subjective and objective performance characteristics simultaneously in the evaluation process.

scholarly journals Foresight evaluation: lessons from project management

foresight ◽  
2014 ◽  
Vol 16 (1) ◽  
pp. 75-91 ◽  
Author(s):  
Ekaterina A. Makarova ◽  
Anna Sokolova
Keyword(s):  
Project Management ◽  
Design Methodology ◽  
Quantitative Methods ◽  
Evaluation Model ◽  
Methodological Approach ◽  
Evaluation Process ◽  
Project Evaluation ◽  
Evaluation Framework ◽  
Content Type ◽  
Evaluation Procedures

Purpose – The aim of this paper is to identify ways for improvement of the foresight evaluation framework on the basis of analysis and systematisation of accumulated experience in the field of project management. Design/methodology/approach – The paper is based on a detailed literature review devoted to an evaluation of foresight and traditional projects. The approaches to project evaluation in the field of project management were investigated, and the main steps of traditional project evaluation process were determined. The most commonly applied steps of foresight evaluation were identified by the analysis of recent foresight evaluation projects. The comparison of evaluation frameworks for foresight projects and traditional projects allows to provide recommendations for foresight evaluation framework improvement. Findings – The paper identifies several lessons for foresight evaluation from project management. The elements which can enrich foresight evaluation framework are the following: the development of an evaluation model; the extensive use of quantitative methods; the elaboration of evaluation scales; the inclusion of economic indicators into evaluation; and the provision of more openness and transparency for evaluation results. Originality/value – Given the importance of foresight evaluation procedures and the lack of a commonly applied methodological approach, the value of this paper consists in identifying a foresight evaluation framework and enriching it with elements of project management.

Six Sigma learning evaluation model using Bloom’s Taxonomy

2018 ◽  
Vol 9 (1) ◽  
pp. 156-174 ◽  
Author(s):  
Gabriela Fonseca Amorim ◽  
Pedro Paulo Balestrassi ◽  
Rapinder Sawhney ◽  
Mariângela de Oliveira-Abans ◽  
Diogo Leonardo Ferreira da Silva
Keyword(s):  
Six Sigma ◽  
Conceptual Knowledge ◽  
Evaluation Model ◽  
Evaluation Process ◽  
Bloom's Taxonomy ◽  
Content Type ◽  
Learning Evaluation ◽  
Bloom’S Taxonomy ◽  
Innovative Learning ◽  
Training Quality

Purpose This paper aims to propose a learning evaluation model for Green Belts and Black Belts at the training level. A question bank has been developed on the basis of Bloom’s learning classification and applied to a group of employees who were being trained in Six Sigma (SS). Their results were then used to decide on the students’ approval and to guide the instructor’s plan of teaching for the next classes. Design/methodology/approach An action research has been conducted to develop a question bank of 310 questions based on the revised Bloom’s Taxonomy, to implement the evaluation model, and to apply it during the SS training. Findings The evaluation model has been designed so that the students do not proceed unless they have acquired the conceptual knowledge at each step of the DMAIC (Define, Measure, Analyze, Improve and Control) roadmap. At the end of the evaluation process, the students’ results have been analyzed. The number of mistakes in all stages of DMAIC was equal, implying that the training was uniform the entire roadmap. However, the opposite happened in each of the Bloom’s Taxonomy levels, showing that some skills need to be better stimulated by the instructor than others. Research limitations/implications The learning evaluation model proposed in this paper has been applied to a group of 70 employees who were being trained in SS at a Brazilian aircraft manufacturer. The data have been analyzed using Microsoft Excel® and Minitab® 17 Statistical Software. Originality/value Despite the abundance of courses offering the SS Green Belt and Black Belt certifications, there is no standard evaluation to ensure the training quality. Thus, this paper proposes an innovative learning evaluation model.

scholarly journals E-university delivery model: handling the evaluation process

2019 ◽  
Vol 25 (7) ◽  
pp. 1633-1646 ◽  
Author(s):  
Rasha Ismail ◽  
Fadi Safieddine ◽  
Ashraf Jaradat
Keyword(s):  
Business Models ◽  
Evaluation Process ◽  
Evaluation Tools ◽  
Content Type ◽  
Online Evaluation ◽  
Brick And Mortar ◽  
Online Distance Learning ◽  
Online Distance ◽  
The Impact

Purpose The setting up of e-university has been slow-going. Much of e-university slow progress has been attributed to poor business models, branding, disruptive technologies, lack of organisational structure that accommodates such challenges, and failure to integrate a blended approach. One of the stumbling blocks, among many, is the handling of evaluation process. E-university models do not provide much automation compared to the original brick-and-mortar classroom model of delivery. The underlining technologies may not have been supportive; however, the conditions are changing, and more evaluation tools are becoming available for academics. The paper aims to discuss these issues. Design/methodology/approach This paper identifies the extent of current online evaluation processes. In this process, the team reviews the case study of a UK E-University using Adobe Connect learning model that mirrors much of the physical processes as well as online exams and evaluation tools. Using the Riva model, the paper compares the physical with the online evaluation processes for e-universities to identify differences in these processes to evaluate the benefits of e-learning. As a result, the models can help us to identify the processes where improvements can take place for automating the process and evaluate the impact of this change. Findings The paper concludes that this process can be significantly shortened and provide a fairer outcome but there remain some challenges for e-university processes to overcome. Originality/value This paper examines the vital quality assurance processes in academia as more universities move towards process automation, blended or e-university business models. Using the case study of Arden University online distance learning, the paper demonstrates, through modelling and analysis that the process of online automation of the evaluation process is achieved with significant efficiency.

Training evaluation levels and ROI: the case of a small logistics company

2014 ◽  
Vol 38 (9) ◽  
pp. 845-870 ◽  
Author(s):  
Carla Curado ◽  
Susana Martins Teixeira
Keyword(s):  
Training Program ◽  
Training Programs ◽  
Training Evaluation ◽  
Individual Performance ◽  
Accounting Data ◽  
Content Type ◽  
Evaluation Practices ◽  
Logistics Company ◽  
Four Levels

Purpose – This study’s purpose is to contribute to literature on training evaluation following Kirkpatrick’s four-levels model and estimating each training program’s return on investment (ROI) using evidence from a small firm. Design/methodology/approach – This case study uses data collected at a logistics company based upon training output indicators like training program evaluation data; individual performance evaluation reports; information on attained objectives; service and productivity levels; quality audit reports; and accounting data. Findings – Results show that all the training programs addressed report evaluation procedures at the four different levels (reactions, learning, behavior and results). ROI for each training program was estimated based upon costs and benefits associated to each program. The two training programs presenting above-average returns address work quality and conditions. The program addressing corporate social responsibility issues produced below-average results. Research limitations/implications – Limitations to this study may result from collecting data in a single moment in time and using data from a single organization, excluding generalization and extrapolation of results. Practical implications – This case study should inspire managers in small and medium enterprises (SME) to implement training evaluation practices and ROI estimation. Having the ROI estimation available allows better management of the training budget, as ROI’s presentation is an argument to assign value and progress. Originality/value – The originality of this study regards the way it reports training evaluation practices at the four levels established by Kirkpatrick’s framework (2005) and complements it with ROI estimation regarding five training courses run at a Portuguese SME logistics firm.

Impediments to CSR assurance in an emerging economy

2014 ◽  
Vol 29 (3) ◽  
pp. 253-267 ◽  
Author(s):  
Faizah Darus ◽  
Yussri Sawani ◽  
Mustaffa Mohamed Zain ◽  
Tamoi Janggu
Keyword(s):  
Customer Relations ◽  
Developed Countries ◽  
Emerging Economy ◽  
Subjective Norms ◽  
Third Party ◽  
Corporate Communications ◽  
Manufacturing Companies ◽  
Online Questionnaire ◽  
Content Type ◽  
Regulatory Authorities

Purpose – This study explores the factors that impede the growth of the voluntary adoption of independent corporate social responsibilities assurance (CSRA) practices among manufacturing companies in Malaysia. Despite the argument that independent CSRA appraisals would improve the credibility of information disclosed, the majority of CSR reports in Malaysia are still not independently assured. The aim of this study is to understand the factors that impede CSRA practices among public-listed manufacturing companies in Malaysia. The theory of reasoned action was used to underpin arguments on the reluctance of managers to undertake CSRA. Design/methodology/approach – Online questionnaire surveys were employed to obtain respondents' perceptions on the factors that hinder CSRA practices. The target respondents comprised of CSR managers, corporate communications executives and customer relations personnel. Findings – This study provides evidence that the behavioural reluctance of managers to undertake CSRA was due to their attitudes and subjective norms towards independence assurance. The subjective norms due to the risk towards corporate reputation and the exposure to public scrutiny were the main factors that impede CSRA practices among manufacturing companies in Malaysia. The managers' attitude towards cost, data management systems and the uncertainty of the merits of CSRA were also compelling factors that hinder independent CSRA. These factors seemed to override incentives to provide credible information to stakeholders. Research limitations/implications – The findings of the study are limited to the perceptions of CSR managers, corporate communications executives and customer relations personnel responsible for CSR activities of the manufacturing industries in Malaysia. The results of the study suggest that further initiatives or pressure from stakeholders or regulatory authorities may be needed to convince the companies of the benefits of undertaking third-party assurance practices as such actions would provide a platform for the companies to enhance the credibility of their CSR reporting. Practical implications – The findings gleaned from this study would be of interest to the relevant corporate bodies and regulatory authorities with a view to formulating strategies to improve CSRA practices among organisations in Malaysia. Originality/value – The findings from the study offer initial insights into the impediments to CSRA practices in an emerging economy. It adds substantially to the existing literature that focuses mainly on CSRA practices in developed countries.

scholarly journals Evaluating the quality of the learning outcome in healthcare sector

2015 ◽  
Vol 27 (8) ◽  
pp. 611-626 ◽  
Author(s):  
Sara Cervai ◽  
Federica Polo
Keyword(s):  
Learning Outcomes ◽  
Healthcare Service ◽  
Evaluation Model ◽  
Evaluation Process ◽  
Healthcare Sector ◽  
Quality Model ◽  
Social Implication ◽  
Content Type ◽  
Continuous Improvement Process

Purpose – This paper aims to present the Expero4care model. Considering the growing need for a training evaluation model that does not simply fix processes, the Expero4care model represents the first attempt of a “quality model” dedicated to the learning outcomes of healthcare trainings. Design/Methodology/Approach – Created as development of the Expero model (Cervai et al., 2013), the Expero4care model has been tailored for workplace learning in the healthcare sector and tested in six organizations across Europe. The model has been validated through the review of an international team of experts and its approval as QualiCert standard. Findings – Expero4care allows the evaluation of the quality of learning outcomes focusing on competences, impact in the workplace, transferability, participation and credits. The evaluation process involves different categories of stakeholders (learners, trainers, colleagues, managers, internal or external bodies that can benefit the training’s results, i.e. final users of the service, such as patients and citizens), and it is based on a systematic data collection and comparison among expectations and perceptions. The implementation of the Expero4care model gives the opportunity to start a continuous improvement process of the trainings in the healthcare service. Research limitations/implications – Expero4care has been tested in both university courses and organizational trainings dedicated to professionals in the healthcare sector. The initial sample is not wide enough to cover all the countries and the types of trainings, so a larger implementation is needed to validate its appropriateness. Social Implication – Expero4care is the first model created specifically for organizations providing training in the healthcare sector. The implementation of the Expero4care model – adaptable to different kind of organizations and trainings – means that it is possible to highlight the value of the training considering its impact on the workplace and on the citizens. Originality/value – As the most commonly used tools to assess the quality of trainings consist of questionnaires submitted to participants at the end of the training and considering that quality models have not been utilized to analyse learning outcomes in healthcare, Expero4care represents the first quality model dedicated to training in healthcare service.

Technology push and demand pull practices for achieving sustainable development in manufacturing industries

2018 ◽  
Vol 29 (2) ◽  
pp. 240-272 ◽  
Author(s):  
Anuj Singla ◽  
Inderpreet Singh Ahuja ◽  
APS Sethi
Keyword(s):  
Sustainable Development ◽  
Large Scale ◽  
Corporate Strategy ◽  
Global Market ◽  
Manufacturing Industries ◽  
Manufacturing Companies ◽  
Content Type ◽  
Development Indicators ◽  
Manufacturing Enterprises ◽  
Demand Pull

Purpose The purpose of this paper is to evaluate the significance of various technology push (TP) and demand pull (DP) practices substantial for achieving sustainable development in Indian manufacturing industries. The research crucially examines the effectiveness of TP-DP practices in manufacturing companies. Design/methodology/approach An extensive survey of 92 companies in India has been executed to identify improvements made by TP-DP practices, to achieve sustainable development in manufacturing industries. The companies in the survey include medium- and large-scale manufacturing enterprises. The correlations between various TP-DP practices and sustainable development parameters are evaluated and validated using various numerical methods and tools. Findings The focus of the paper is on the distinguishable contributions made by TP-DP practices like innovative capability, research and development, corporate strategy, export orientation, stringent implementation of government regulations, transforming capabilities, unionized labor and customer attributes toward achieving sustainable development in manufacturing industries. The inter-relationships between different TP-DP practices with sustainable development parameters are evaluated to effectively manage the goals and objectives of industries related to sustainability and growth. However, it is also acknowledged that manufacturing firms need to work more actively on managing certain practices of TP-DP. Research limitations/implications In the present investigation, contributions made by TP-DP practices are evaluated to accomplish sustainable development in Indian manufacturing industries. Hence, the results obtained may need some modifications before applying to other countries. Moreover, issue-wise independent modeling can also be performed to assess the importance of TP-DP practices under specific orientations. Practical implications The research gives priority to enhancement in the planning among various TP-DP practices and sustainable development indicators in the industries, to impart TP-DP as important practices to meet the challenges of competent markets worldwide. Social implications It has been exhibited from the observations that adequate TP-DP practices can efficiently contribute toward recognition of sustainable development to compete in the highly progressive global market. The results of various inter-relationships among TP-DP practices and sustainable development parameters represent the effectiveness of TP-DP practices for accomplishment of social as well as organizational objectives. Originality/value The investigation shows that TP-DP practices are significant initiatives employed by the manufacturing industries for performance improvement and sustainable development. The paper peeks into the research to find out TP-DP issues that need to be assessed efficiently by companies to avail the benefits of sustainable development to meet the challenges posed by international markets.

Sign in / Sign up

Export Citation Format

Share Document