scholarly journals Narrative Assessment: A new approach to evaluation of advocacy for development

Evaluation ◽  
2018 ◽  
Vol 24 (4) ◽  
pp. 400-418 ◽  
Author(s):  
Margit van Wessel

This article proposes an approach to monitoring and evaluating advocacy that integrates theory of change and storytelling. This approach, called Narrative Assessment, addresses the feasibility of objectivity and evidence in the complex context of advocacy and proposes an evaluation methodology rooted in alternative conceptualizations of rigour and of evaluator roles. The approach centres on practical judgment and the construction and examination of stories through interaction between advocates and monitoring and evaluation specialists. The article discusses how Narrative Assessment can be useful in the evaluation of advocacy in terms of (1) monitoring and evaluation specialists’ orientation toward programmes; (2) the interpretation of outcomes; (3) the assessment of outcome relevance; (4) reflection and learning and (5) the communication of programme results. The approach builds on lessons drawn from evaluation of eight advocacy programmes in international development.

2020 ◽  
Vol 8 (1) ◽  
pp. 1-11
Author(s):  
M Kholis Hamdy

Abstract. This article is a brief study of the advantages and disadvantages of Theory of Change (ToC) and the Logical Framework (Log Frame) based on literature; a comparative approach. The later has a long historical stand in the development practices while the former was formed as supposed to answer the shortcomings of the Log Frame. By comparing both strengths and weaknesses, the finding argues that ToC is strongly considered to have a more certain degree of advantages rather than the M&E in view of development agencies especially NGOs in the practice of monitoring and evaluation of development practices. M&E, in particular, gave birth to ToC in pursue of answering the Log Frame’s current shortcoming. ToC has gained positive stand in the realm of international development by addressing at least three main features: participation, flexibility and the dynamic of development deliverance and accountability.  Abstrak. Artikel ini adalah studi singkat tentang kelebihan dan kekurangan dari Theory of Change (ToC) dan Logical Framework (Log Frame) berdasarkan literatur; pendekatan komparatif. Yang kedua memiliki pendirian historis yang panjang dalam praktik pembangunan, sementara yang pertama dibentuk untuk menjawab kekurangan Log Frame. Dengan membandingkan kekuatan dan kelemahan, temuan ini berpendapat bahwa ToC secara kuat dianggap memiliki tingkat keuntungan yang lebih pasti daripada M&E dalam pandangan lembaga pembangunan terutama LSM dalam praktik pemantauan dan evaluasi praktik pembangunan. Monitoring & Evaluation secara khusus melahirkan ToC dalam rangka menjawab kekurangan Log Frame saat ini. ToC telah mendapatkan posisi positif di bidang pembangunan internasional dengan mengatasi setidaknya tiga fitur utama: partisipasi, fleksibilitas dan dinamika pembebasan dan akuntabilitas pembangunan.  


2019 ◽  
Vol 33 (3) ◽  
Author(s):  
Gordon Freer ◽  
Sebastian Lemire

There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application. Drawing on lessons from a recent theory-based evaluation, this article argues that fully integrating the program theory of change within the program logframe provides for a stronger and more holistic understanding of program progress.


Author(s):  
Mary Kay Gugerty ◽  
Dean Karlan

A theory of change can build consensus on a program’s vision and guide the development of a right-fit monitoring and evaluation system. This case examines how the Uganda-based youth empowerment NGO Educate! used the theory of change process to clearly define its intended impact and decide how to measure it. After analyzing the process Educate! used to develop its theory of change, readers will be able to discuss the value of gathering internal perspectives and conducting field research to develop a theory of change. Readers will also assess how successive iterations of the theory of change provide clarity on program design and objectives and determine whether the final theory of change is sufficient to design a monitoring and evaluation plan that adheres to CART principles.


2016 ◽  
Vol 3 ◽  
pp. 5035 ◽  
Author(s):  
Kai Matturi ◽  
Chris Pain

Over the last number of decades there has been a tendency within the international development sector to privilege the management of projects in a siloed manner. This translates to projects managed in a narrow way according to pre-defined parameters of say the education or health sectors. As a project manager you are held accountable for delivering education or health outputs. A shift in donor funding to focus on development projects that are considered easy to administer partly explains this siloed approach to project management within the development sector. However, there is a gradual kick back against the siloed project management approach. Instead we are seeing a return to an integrated managerial approach.An integrated managerial approach involves bringing together various technical specialists to work on common objectives in a coordinated and collaborative manner. A growing number of development actors such as Concern Worldwide are embracing this ‘new approach’. For Concern Worldwide integrated projects are interventions which address multiple needs through coordination across a variety of sectors and with the participation of all relevant stakeholders to achieve common goals. Integrated projects are about sector projects working together with the same target group in the same area in a coordinated manner. This paper reflects on Concern’s experience and evidence to date with integration drawing on the agency’s work in Zambia. The Realigning Agriculture to Improve Nutrition project in Zambia highlights the practical challenges and lessons of managing an integrated project.   


2019 ◽  
Vol 7 (1) ◽  
Author(s):  
Daniel O. Chachu

Background: The quest for an appropriate monitoring and evaluation (M&E) design that delivers accountability, supports management and facilitates learning is one that many organisations grapple with. Over the years, experiences in project and/or programme development and delivery led the International Programme for the Elimination of Child Labour of the International Labour Organization (ILO-IPEC) to consolidate M&E efforts towards the development of a comprehensive monitoring and evaluation strategy.Objectives: The aim of this article is to present lessons from the design and implementation of a theory of change-driven comprehensive monitoring and evaluation strategy in a child labour project rolled out in Ghana and Côte d’Ivoire. The 5-year project was implemented during 2011–2015 by ILO-IPEC with support from the United States Department of Labour (USDOL).Methods: This article critically analyses project documents (including evaluations) and captures the reflections and experiences of key project staff involved in the project.Results: Timeless lessons are distilled, along with key phases of the project cycle. Critical markers include the importance of stakeholders’ involvement in the design and development of a M&E strategy as a pre-requisite for buy-in and uptake. We find capacity building not just as a box to be ticked but an iterative process to improve knowledge, transfer skills and support learning. In addition to paying attention to technical elements, the soft issues of patience, flexibility and simplicity are discussed as invaluable ingredients for realising M&E goals.Conclusion: While not exhaustive, it is hoped that these lessons would contribute to a minimum set of guidelines for improving M&E practice within projects and programmes.


2021 ◽  
Author(s):  
Eleanor Gordon ◽  
Briony Jones

The experiences and marginalisation of international organisation employees with caring responsibilities has a direct negative impact on the type of security and justice being built in conflict-affected environments. This is in large part because international organisations fail to respond to the needs of those with caring responsibilities, which leads to their early departure from the field, and negatively affects their work while in post. In this toolkit we describe this problem, the exacerbating factors, and challenges to overcoming it. We offer a theory of change demonstrating how caring for carers can both improve the working conditions of employees of international organisations as well as the effectiveness, inclusivity and responsiveness of peace and justice interventions. This is important because it raises awareness among employers in the sector of the severity of the problem and its consequences. We also offer a guide for employers for how to take the caring responsibilities of their employees into account when developing human resource policies and practices, designing working conditions and planning interventions. Finally, we underscore the importance of conducting research on the gendered impacts of the marginalisation of employees with caring responsibilities, not least because of the breadth and depth of resultant individual, organisational and sectoral harms. In this regard, we also draw attention to the way in which gender stereotypes and gender biases not only inform and undermine peacebuilding efforts, but also permeate research in this field. Our toolkit is aimed at international organisation employees, employers and human resources personnel, as well as students and scholars of peacebuilding and international development. We see these communities of knowledge and action as overlapping, with insights to be brought to bear as well as challenges to be overcome in this area. The content of the toolkit is equally relevant across these knowledge communities as well as between different specialisms and disciplines. Peacebuilding and development draw in experts from economics, politics, anthropology, sociology and law, to name but a few. The authors of this toolkit have come together from gender studies, political science, and development studies to develop a theory of change informed by interdisciplinary insights. We hope, therefore, that this toolkit will be useful to an inclusive and interdisciplinary set of knowledge communities. Our core argument - that caring for carers benefits the individual, the sectors, and the intended beneficiaries of interventions - is relevant for students, researchers, policy makers and practitioners alike.


2020 ◽  
pp. 030631272095083
Author(s):  
Timothy McLellan

Demands for research to generate impact, along with proliferating institutional regimes for evaluating impact, are a ubiquitous aspect of contemporary scientific practice. Based on participant observation at an agro-environmental research institute in southwest China, this article explores three iterations of a tool for planning and evaluating impactful science called ‘theory of change’ (TOC). Despite their ostensible common grounding in TOC, I show how an impact scientist’s framework, a donor’s monitoring and evaluation regime, and a communication consultant’s branding strategy each suggest very different normative structures for scientific practice. These structures entail: particular horizons towards which scientific research is to be practiced, precise points in time at which the future effects of research are to be anticipated, and specific assumptions about how scientists’ agency should play out across time. Taking the peculiar sensibilities of TOC as a comparative framework, I illuminate IFF scientists’ implicit imaginations of how contemporary science does and should generate effects in the world.


2019 ◽  
Vol 12 (2) ◽  
pp. 595-625
Author(s):  
Elizabeth Bakibinga-Gaswaga

Abstract Africa and the developing world have been the theatre of countless rules of law assistance projects since the end of World War II, with mixed results. While the reasons for the mixed results vary from project to project and from country to country, this paper seeks to address the limitations that arise right from project inception, reviews the cycle of project management from problem construction to monitoring and evaluation, taking into account the core and secondary aspects of project management such as scope, budget, quality, schedule, as well as stakeholder engagement, communication, risk management and performance management. With a focus on the attainment of the Sustainable Development Goals of Agenda 2030, the paper addresses the following aspects: identify challenges of past approaches of major development partners and interrogate the current shift in paradigm by the World Bank, United Nations and the United Kingdom’s Department for International Development (DfID). It will consider lessons from complexity and other methodologies, theories of change, theoretical frameworks, and the Problem Driven Iterative Adaptation (PDIA) model as tools for doing development differently. The paper concludes with recommendations on improving the effectiveness of rule of law programmes, including a better approach to project design that makes allowance for results based programming, ease of adaptation, reflective learning through after action reviews and lessons learned from military science’s doctrines and practices in the management of complex operations. The paper also recommends, back and forth iteration and better stakeholder engagement, including at the lowest level of governance (local contextualization), to increase effectiveness of rule of law and change in mind-sets especially donor and development partner ideology.


2017 ◽  
Vol 39 (2) ◽  
pp. 221-236 ◽  
Author(s):  
Bodille Arensman ◽  
Cornelie van Waegeningh ◽  
Margit van Wessel

Theory of change (ToC) is currently the approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC’s focus on cause–effect logic and intended outcomes does not do justice to the recursive nature of complex interventions such as advocacy. Supported by our work as evaluators, and specifically our case study of an advocacy program on child rights, we illustrate how advocacy evolves through recursive interactions, with outcomes that are emergent rather than predictable. We propose putting “practices of change” at the center by emphasizing human interactions, using the analytical lenses of strategies as practice and recursiveness. This provides room for emergent outcomes and implies a different use of ToC. In this article, we make a clear distinction between theoretical reality models and the real world of practices.


Sign in / Sign up

Export Citation Format

Share Document