scholarly journals Exploring what motivates evaluation capacity building in early learning services: “What are the children getting out of this?”

2021 ◽  
Vol 7 ◽  
pp. 71-95
Author(s):  
Elena F. Moretti

This article describes a research project focused on evaluation capacity building and internal evaluation practice, in a small sample of early learning services in Aotearoa New Zealand. Poor evaluation practice in this context has persisted for several decades, and capacity building attempts have had limited impact. Multiple methods were used to gather data on factors and conditions that motivated successful evaluation capacity building and internal evaluation practice in five unusually high-performing early learning services. The early learning sector context is described and discussed in relation to existing research on evaluation capacity building in organisations. This is followed by a brief overview of the research methodology for this study, with the majority of the article devoted to findings and areas for future exploration and research. Quotes from the research participants are used to illustrate their views, and the views of the wider early learning sector, on evaluation matters. Findings suggest that motivation is hindered by a widespread view of internal evaluation as overly demanding and minimally valuable. In addition, some features of the Aotearoa New Zealand early learning context mean that accountability factors are not effective motivators for evaluation capacity building. Early learning service staff are more motivated to engage in evaluation by factors and conditions related to their understandings of personal capability, guidance and support strategies, and the alignment of internal evaluation processes to positive children’s outcomes. The strength of agreement within the limited sample size and scope of this study, particularly considering the variation in early learning service contexts of the research participants, supports the validity of the findings. Understandings of evaluation capacity building motivators in this context will contribute to discussions related to organisation evaluation, internal evaluation, social-sector evaluation, and evaluation capacity building.

2017 ◽  
Vol 5 (1) ◽  
Author(s):  
Candice Morkel ◽  
Mokgophana Ramasobana

Background: The growing demand for evidence to support policy decisions, guide resource allocation and demonstrate results has elevated the need for expertise in monitoring and evaluation (M&E). Despite the mushrooming of short courses in M&E, their impact on improving the capacity to meet the demand has not been adequately and comprehensively measured or evaluated. The purpose of this article was to highlight the need for improving the measurement of evaluation capacity building (ECB) to better understand what works in building M&E capacity in Africa.Objectives: This article provides important insights into the need for empirical and rigorous measurement of ECB interventions and their role in strengthening evaluation practice.Method: The study was primarily a desktop review of existing literature, corroborated by a survey of a few senior representatives of organisations responsible for capacity building across the African continent.Results: The review found that there remains little empirical evidence that indicates whether ECB processes, activities and outcomes are ultimately effective. There is also very little empirical evidence that helps to interpret how change happens, and how this may shape ECB efforts. Training is acknowledged as only one element of ECB, and there is a need for a multi-pronged approach to ECB.Conclusion: Much more empirical and rigorous research is needed to build a clear understanding of what conditions are needed in ECB in Africa to strengthen evaluation practice. This article is useful for guiding further research into measuring the effect of ECB, as well as implementing more effective models of ECB towards strengthening evaluation practice in Africa.


2016 ◽  
Vol 38 (3) ◽  
pp. 393-404 ◽  
Author(s):  
Lara Hilton ◽  
Salvatore Libretto

The need for evaluation capacity building (ECB) in military psychological health is apparent in light of the proliferation of newly developed, yet untested programs coupled with the lack of internal evaluation expertise. This study addresses these deficiencies by utilizing Preskill and Boyle’s multidisciplinary ECB model within a post-traumatic stress disorder treatment program. This model outlines a theoretical framework, offers practical strategies, and emphasizes both context and culture, which are paramount in military health-care settings. This study found that the model provides a highly applicable ECB framework that includes ways to identify ECB objectives, tailor activities, and understand outcomes. While there was high utilization of ECB activities by program staff, there was misaligned evaluative thinking, which ultimately truncated sustainable evaluation practice. Based on this research, evaluators can better understand how to provide an ECB intervention in a complex cultural and political environment and assess its effectiveness.


2016 ◽  
pp. daw088 ◽  
Author(s):  
Roanna Lobo ◽  
Gemma Crawford ◽  
Jonathan Hallett ◽  
Sue Laing ◽  
Donna B Mak ◽  
...  

2005 ◽  
Vol 5 (2) ◽  
pp. 41-47 ◽  
Author(s):  
Diana Beere

Evaluation capacity-building entails not only developing the expertise needed to undertake robust and useful evaluations; it also involves creating and sustaining a market for that expertise by promoting an organisational culture in which evaluation is a routine part of ‘the way we do things around here’. A challenge for evaluators is to contribute to evaluation capacity-building while also fulfilling their key responsibilities to undertake evaluations. A key strategy is to focus on both discerning value and adding value for clients/commissioners of evaluations. This paper takes as examples two related internal evaluation projects conducted for the Queensland Police Service that have added value for the client and, in doing so, have helped to promote and sustain an evaluation culture within the organisation. It describes key elements of these evaluations that contributed to evaluation capacity-building. The paper highlights the key role that evaluators themselves, especially internal evaluators, can take in evaluation capacity-building, and proposes that internal evaluators can, and should, integrate evaluation capacity-building into their routine program evaluation work.


2012 ◽  
Vol 23 (2A) ◽  
pp. 33-48 ◽  
Author(s):  
Tabia Henry Akintobi ◽  
Ellen M. Yancey ◽  
Pamela Daniels ◽  
Robert M. Mayberry ◽  
DeBran Jacobs ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document