scholarly journals Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi

2018 ◽  
Vol 3 ◽  
pp. 8 ◽  
Author(s):  
Kate Gooding ◽  
Regina Makwinja ◽  
Deborah Nyirenda ◽  
Robin Vincent ◽  
Rodrick Sambakunsi
Keyword(s):  
Community Engagement ◽  
Information Needs ◽  
Monitoring And Evaluation ◽  
Evaluation Framework ◽  
Theory Of Change ◽  
Design Data ◽  
Intermediate Outcomes ◽  
Evaluation Staff ◽  
Research Organisations ◽  
Theories Of Change

Background: Evaluation of community and public engagement in research is important to deepen understanding of how engagement works and to enhance its effectiveness. Theories of change have been recommended for evaluating community engagement, for their ability to make explicit intended outcomes and understandings of how engagement activities contribute to these outcomes. However, there are few documented examples of using theories of change for evaluation of engagement. This article reports experience of using theories of change to develop a framework for evaluating community engagement in research at a clinical research organisation in Malawi. We describe the steps used to develop theories of change, and the way theories of change were used to design data collection plans. Based on our experience, we reflect on the advantages and challenges of the theory of change approach. Methods: The theories of change and evaluation framework were developed through a series of workshops and meetings between engagement practitioners, monitoring and evaluation staff, and researchers. We first identified goals for engagement, then used ‘so that’ chains to clarify pathways and intermediate outcomes between engagement activities and goals. Further meetings were held to refine initial theories of change, identify priority information needs, and define feasible evaluation methods. Results: The theory of change approach had several benefits. In particular, it helped to construct an evaluation framework focused on relevant outcomes and not just activities. The process of reflecting on intended goals and pathways also helped staff to review the design of engagement activities. Challenges included practical considerations around time to consider evaluation plans among practitioners (a challenge for evaluation more generally regardless of method), and more fundamental difficulties related to identifying feasible and agreed outcomes. Conclusions: These experiences from Malawi provide lessons for other research organisations considering use of theories of change to support evaluation of community engagement.

scholarly journals Theory of Change in Digital Behavior Change Interventions (Dbcis) And Community-Based Change Initiatives – A General Framework

2021 ◽  
Vol 21 ◽  
pp. 554-569
Author(s):  
Dana Rad ◽  
Gavril Rad
Keyword(s):  
Behavior Change ◽  
Psychological Intervention ◽  
Theory Of Change ◽  
Community Based ◽  
Change Initiatives ◽  
Complex Situation ◽  
Behavior Change Interventions ◽  
Intermediate Outcomes ◽  
A Chain ◽  
Theories Of Change

A theory of change is a purposeful model of how an initiative, such as a policy, a strategy, a program, a project or an intervention contributes through a chain of early and intermediate outcomes to the intended result. Theories of change help navigate the complexity of social change. Digital behavior change interventions (DBCIs) and Community-based change initiatives represent complex designable systems. The goal of the DCBI is to provide an effective theoretical framework for behavioral change to practitioners that offer different forms of psychological intervention based on scientifically validated practices. Applying theory of change when designing digital individual and community interventions for optimizing digital wellbeing helps practitioners to achieve results in practice, as this strategic approach is generally considered an evidence-based framework. Theory of change is useful to guide the strategic thinking and action, as most of DCBI/ Community-based change initiatives research endeavors are active in a complex situation, often unplanned events happening. Conclusions and implications are discussed.

THEORIES OF CHANGE IN THE PROCESS OF RURAL TRANSFORMATION: A REFINED WAY FORWARD

2020 ◽  
Vol 8 (7) ◽  
pp. 279-297
Author(s):  
V. Rengarajan ◽  
K. Sivasubramaniyan
Keyword(s):  
Process Monitoring ◽  
Social Science Research ◽  
Monitoring And Evaluation ◽  
Science Research ◽  
Theory Of Change ◽  
Refined Theory ◽  
Evaluation Tool ◽  
Public Authorities ◽  
Theories Of Change ◽  
The Impact

Theory of change has been a useful evaluation tool for social science research. The interest in its use has been notable in recent years amongst international aid organisations and public authorities who make huge investment in social oriented intervention with more focus on the challenges related to gender empowerment and poverty cure in rural area. Logically, the achievement of intended change (impact) matters. In this context, the emerging question is: 'How are we getting a candid profile of change after the project implementation? The sources of data for analysis are taken from evaluation reports of Programme Evaluation Organisation, Planning Commission, Government of India.   Among the convolutions, found in the theory of change the important one is that the monitoring system does not extend beyond output level in the causal path revealing only impaired impact confining to the physical achievement vs target. This apart, there is no process monitoring of implementation and mid-course corrections. The paper suggests a slew of critical constituents for the refined theory of change which include: (a) process monitoring; (b) result based monitoring and evaluation (c) transparent outcome and the impact; and (d) human behaviour.

Development Trajectories and Complex Systems–Informed Theories of Change

2020 ◽  
pp. 109821402094778
Author(s):  
Aaron Eduardo Zazueta ◽  
Thuy Thu Le ◽  
Nima Bahramalian
Keyword(s):  
Complex Adaptive Systems ◽  
Adaptive Systems ◽  
Theory Of Change ◽  
Design Data ◽  
Data Collection And Analysis ◽  
Complex Adaptive ◽  
Development Trajectory ◽  
Theories Of Change ◽  
Visualization Techniques ◽  
Development Trajectories

This article presents an approach to use complex adaptive systems thinking to construct a theory of change to plan and evaluate transformational interventions. The article draws on the concepts of domains, scales, agents, and emergence to build a model of the system targeted by the intervention, to identify the chains of causality driving the system, and to identify the most influential enabling conditions affecting the system's development trajectory. Using the case study of the Indonesia SMART-Fish project, the article illustrates how to use such a theory of change to understand how a program interacts with the phenomena and how to assess the extent to which a program contributes to a development trajectory consistent with the intended long term transformational objectives. The article also illustrates how to use network analysis tools and simple data visualization techniques in ways that engage stakeholders in evaluation design, data collection and analysis.

scholarly journals Can’t See the Wood For the Logframe: Integrating Logframes and Theories of Change in Development Evaluation

2019 ◽  
Vol 33 (3) ◽  
Author(s):  
Gordon Freer ◽  
Sebastian Lemire
Keyword(s):  
International Development ◽  
Monitoring And Evaluation ◽  
Theory Of Change ◽  
Recent Theory ◽  
Practical Application ◽  
Fully Integrated ◽  
Holistic Understanding ◽  
Development Evaluation ◽  
Theories Of Change ◽  
Development And Management

There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application. Drawing on lessons from a recent theory-based evaluation, this article argues that fully integrating the program theory of change within the program logframe provides for a stronger and more holistic understanding of program progress.

scholarly journals Theory of change: Drama and arts-based community engagement for malaria research and elimination in Cambodia

2021 ◽  
Vol 6 ◽  
pp. 46
Author(s):  
Mom Ean ◽  
Nou Sanann ◽  
James J. Callery ◽  
Christopher Pell ◽  
Thomas J. Peto ◽  
...  
Keyword(s):  
Young People ◽  
Health Knowledge ◽  
National Malaria Control Programme ◽  
Monitoring And Evaluation ◽  
Control Programme ◽  
Theory Of Change ◽  
Malaria Control Programme ◽  
Local Health ◽  
Malaria Research ◽  
Theories Of Change

Background: Across the Greater Mekong Sub-region, malaria persists in isolated communities along international borders. Arts and drama have been used to reach to communities in Cambodia to engage them in malaria research, prevention and control. The “Village Drama Against Malaria” (VDAM) project was conducted in north eastern and western Cambodia: Stung Treng; Battambang and Pailin provinces during 2016 to 2019.  In total, VDAM reached 55 rural villages, 2,378 student participants and 43,502 audience members. Methods: This article presents the results of two stakeholder-led evaluation workshops in which participants collaboratively developed theories of change to better understand the potential and actual impact of arts and drama-based activities on malaria in these communities. The workshops had a particular focus on identifying areas for monitoring and evaluation so that impact can be measured. Workshop participants included village malaria workers, community leaders, professional and student drama performers, and representatives from the local health authorities and the national malaria control programme. Results: Five broad areas were identified as relevant for monitoring and evaluation: logistical and practical challenges; embeddedness and reach of engagement; health knowledge and confidence of young people; effectiveness of communications; impact on malaria. These areas align well with the monitoring and evaluation conducted to date and point to additional opportunities for data collection. Conclusions: The findings from these workshops will inform future engagement strategies, for example, we may engage a smaller number of young people but over a longer period and more in-depth.

scholarly journals Theory of change: Drama and arts-based community engagement for malaria research and elimination in Cambodia

2021 ◽  
Vol 6 ◽  
pp. 46
Author(s):  
Mom Ean ◽  
Nou Sanann ◽  
James J. Callery ◽  
Christopher Pell ◽  
Thomas J. Peto ◽  
...  
Keyword(s):  
Young People ◽  
Health Knowledge ◽  
National Malaria Control Programme ◽  
Monitoring And Evaluation ◽  
Control Programme ◽  
Theory Of Change ◽  
Malaria Control Programme ◽  
Local Health ◽  
Malaria Research ◽  
Theories Of Change

Background: Across the Greater Mekong Sub-region, malaria persists in isolated communities along international borders. Arts and drama have been used to reach to communities in Cambodia to engage them in malaria research, prevention and control. The “Village Drama Against Malaria” (VDAM) project was conducted in north eastern and western Cambodia: Stung Treng; Battambang and Pailin provinces during 2016 to 2019.  In total, VDAM reached 55 rural villages, 2,378 student participants and 43,502 audience members. Methods: This article presents the results of two stakeholder-led evaluation workshops in which participants collaboratively developed theories of change to better understand the potential and actual impact of arts and drama-based activities on malaria in these communities. The workshops had a particular focus on identifying areas for monitoring and evaluation so that impact can be measured. Workshop participants included village malaria workers, community leaders, professional and student drama performers, and representatives from the local health authorities and the national malaria control programme. Results: Five broad areas were identified as relevant for monitoring and evaluation: logistical and practical challenges; embeddedness and reach of engagement; health knowledge and confidence of young people; community-level malaria outcomes; impact on malaria. These areas align well with the monitoring and evaluation conducted to date and point to additional opportunities for data collection. Conclusions: The findings from these workshops will inform future engagement strategies, for example, we may engage a smaller number of young people but over a longer period and more in-depth.

Educate! Developing a Theory of Change for “Changemakers”

2018 ◽  
Author(s):  
Mary Kay Gugerty ◽  
Dean Karlan
Keyword(s):  
Change Process ◽  
Evaluation System ◽  
Program Design ◽  
Field Research ◽  
Monitoring And Evaluation ◽  
Theory Of Change ◽  
Youth Empowerment ◽  
Evaluation Plan ◽  
Final Theory

A theory of change can build consensus on a program’s vision and guide the development of a right-fit monitoring and evaluation system. This case examines how the Uganda-based youth empowerment NGO Educate! used the theory of change process to clearly define its intended impact and decide how to measure it. After analyzing the process Educate! used to develop its theory of change, readers will be able to discuss the value of gathering internal perspectives and conducting field research to develop a theory of change. Readers will also assess how successive iterations of the theory of change provide clarity on program design and objectives and determine whether the final theory of change is sufficient to design a monitoring and evaluation plan that adheres to CART principles.

scholarly journals Bringing Older Adults to the Table: Opportunities for Consumer Engagement in Planning and Policy Making

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 102-102
Author(s):  
Alice Prendergast ◽  
Kristi Fuller
Keyword(s):  
Data Collection ◽  
Community Engagement ◽  
Community Involvement ◽  
Social Connectedness ◽  
Planning Process ◽  
The United States ◽  
Lessons Learned ◽  
Service Planning ◽  
Community Members ◽  
Design Data

Abstract Efforts to include community voice in health policy and service planning are gaining recognition and support in the United States. Findings suggest community involvement can contribute to a better understanding of systems and factors that impact health, and, subsequently, more effective and sustainable policy and program design. Additionally, engagement can increase community buy-in, and community members can gain a greater awareness of services; increased confidence navigating systems; feelings of social connectedness; and capacity to advocate around issues through participation. Despite these findings, the extent to which community members are engaged in planning and decision-making varies considerably. Researchers from Georgia State University conducted a review of state plans on aging using the Person-Centered Outcomes Research Initiative (PCORI) Engagement Principles and the Health Research & Educational Trust’s Community and Patient Engagement Spectrum as frameworks to assess evidence of community engagement. The frameworks recognize engagement throughout the planning process, including design, data collection and interpretation, and dissemination. The review revealed that few planning processes described significant engagement, but rather met the minimal requirements established by federal policy. Federal guidance on community-informed planning practices is sparse, as are resources to support states in adopting these processes. To address this gap, the research team drew on the frameworks and other promising practices to design two community engagement projects, both in partnership with Georgia’s Division of Aging Services. Methods for participant engagement, data collection, interpretation and application of results, and lessons learned through both projects will be discussed, as well as potential implications.

Frameworks for evaluating law and justice development assistance: Lessons from Australia’s involvement in PNG

2021 ◽  
pp. 1037969X2110219
Author(s):  
Adrian Guy
Keyword(s):  
Papua New Guinea ◽  
Development Assistance ◽  
Development Program ◽  
Monitoring And Evaluation ◽  
Evaluation Framework ◽  
Constructivist Approach ◽  
Assistance Programs ◽  
Effectiveness Model ◽  
Law And Justice ◽  
Ideal Framework

For over 20 years Australia has provided assistance to Papua New Guinea in the development of their law and justice sector. The Justice Services and Stability for Development program is the most recent of such law and justice development assistance programs. Much like its predecessors, while it made some achievements, efforts have ultimately underperformed due to an inadequate and donor-centric monitoring and evaluation framework. It is contended that although an ideal monitoring and evaluation framework will not guarantee development results, it is a prerequisite. This ideal framework adopts the learning-effectiveness model and constructivist approach, relies on mechanisms such as self-reporting and qualitative research tested against context-centric indicators and is necessarily staged in its rollout design.

Sign in / Sign up

Export Citation Format

Share Document