Evaluation and the Theory of Change

2018 ◽  
pp. 173-186
Author(s):  
Helen Cahill
Keyword(s):  
Theory Of Change

Articulating a strategic approach to face complexity in design projects

2019 ◽  
Vol 2 (1) ◽  
Author(s):  
Luca SIMEONE ◽  
David DRABBLE ◽  
Giorgia IACOPINI ◽  
Kirsten VAN DAM ◽  
Nicola MORELLI ◽  
...  
Keyword(s):  
Complexity Theory ◽  
Wicked Problems ◽  
Theory Of Change ◽  
Strategic Action ◽  
Community Initiatives ◽  
Uncertain Environment ◽  
Strategic Approach ◽  
Design Projects

In today’s world of global wicked problems, constraints and imperatives imposed by an external and uncertain environment render strategic action a quite complex endeavour. Since the 1990s, within community initiatives and philanthropic projects, the construct of Theory of Change has been used to address such complexity. Theory of Change can be defined as the systematic and cumulative study of the links between the activities, outcomes, and context of an intervention. The area of focus for this paper is to explore whether Theory of Change can support more strategic approaches in design. In particular, the paper examines how Theory of Change was applied to DESIGNSCAPES - a project oriented, among other things, toward offering a supporting service for all those city actors interested in using design to develop urban innovation initiatives that tackle complex issues of broad concern.

Useful Theory of Change Models

2015 ◽  
Vol 30 (2) ◽  
pp. 119-142 ◽  
Author(s):  
John Mayne
Keyword(s):  
Theory Of Change ◽  
Change Models

Educate! Developing a Theory of Change for “Changemakers”

2018 ◽  
Author(s):  
Mary Kay Gugerty ◽  
Dean Karlan
Keyword(s):  
Change Process ◽  
Evaluation System ◽  
Program Design ◽  
Field Research ◽  
Monitoring And Evaluation ◽  
Theory Of Change ◽  
Youth Empowerment ◽  
Evaluation Plan ◽  
Final Theory

A theory of change can build consensus on a program’s vision and guide the development of a right-fit monitoring and evaluation system. This case examines how the Uganda-based youth empowerment NGO Educate! used the theory of change process to clearly define its intended impact and decide how to measure it. After analyzing the process Educate! used to develop its theory of change, readers will be able to discuss the value of gathering internal perspectives and conducting field research to develop a theory of change. Readers will also assess how successive iterations of the theory of change provide clarity on program design and objectives and determine whether the final theory of change is sufficient to design a monitoring and evaluation plan that adheres to CART principles.

scholarly journals Identifying pathways for large-scale implementation of a school-based mental health programme in the Eastern Mediterranean Region: a theory-driven approach

2020 ◽  
Vol 35 (Supplement_2) ◽  
pp. ii112-ii123 ◽  
Author(s):  
Olakunle Alonge ◽  
Anna Chiumento ◽  
Hesham M Hamoda ◽  
Eman Gaber ◽  
Zill-e- Huma ◽  
...  
Keyword(s):  
Mental Health ◽  
Mediterranean Region ◽  
Large Scale ◽  
Eastern Mediterranean ◽  
Eastern Mediterranean Region ◽  
Theory Of Change ◽  
Programme Implementation ◽  
School Based ◽  
Mental Health Programme ◽  
Health Programme

Abstract Globally there is a substantial burden of mental health problems among children and adolescents. Task-shifting/task-sharing mental health services to non-specialists, e.g. teachers in school settings, provide a unique opportunity for the implementation of mental health interventions at scale in low- and middle-income countries (LMICs). There is scant information to guide the large-scale implementation of school-based mental health programme in LMICs. This article describes pathways for large-scale implementation of a School Mental Health Program (SMHP) in the Eastern Mediterranean Region (EMR). A collaborative learning group (CLG) comprising stakeholders involved in implementing the SMHP including policymakers, programme managers and researchers from EMR countries was established. Participants in the CLG applied the theory of change (ToC) methodology to identify sets of preconditions, assumptions and hypothesized pathways for improving the mental health outcomes of school-aged children in public schools through implementation of the SMHP. The proposed pathways were then validated through multiple regional and national ToC workshops held between January 2017 and September 2019, as the SMHP was being rolled out in three EMR countries: Egypt, Pakistan and Iran. Preconditions, strategies and programmatic/contextual adaptations that apply across these three countries were drawn from qualitative narrative summaries of programme implementation processes and facilitated discussions during biannual CLG meetings. The ToC for large-scale implementation of the SMHP in the EMR suggests that identifying national champions, formulating dedicated cross-sectoral (including the health and education sector) implementation teams, sustained policy advocacy and stakeholders engagement across multiple levels, and effective co-ordination among education and health systems especially at the local level are among the critical factors for large-scale programme implementation. The pathways described in this paper are useful for facilitating effective implementation of the SMHP at scale and provide a theory-based framework for evaluating the SMHP and similar programmes in the EMR and other LMICs.

scholarly journals A Review of the Community Health Club Literature Describing Water, Sanitation, and Hygiene Outcomes

2021 ◽  
Vol 18 (4) ◽  
pp. 1880
Author(s):  
Jason Rosenfeld ◽  
Ruth Berggren ◽  
Leah Frerichs
Keyword(s):  
Social Capital ◽  
Collective Action ◽  
Community Health ◽  
Theory Of Change ◽  
Health Promotion Program ◽  
Review Of The Literature ◽  
Middle Income ◽  
Health Club ◽  
Qualitative Evidence ◽  
Sanitation And Hygiene

The Community Health Club (CHC) model is a community-based health promotion program that utilizes water, sanitation, and hygiene (WASH) education as the first stage of a longitudinal development process. Although the CHC model has been implemented in fourteen countries over 20 years, this is the first review of the literature describing the model’s outcomes and impact. We conducted a review of the literature that provided quantitative or qualitative evidence of CHC interventions focused on WASH in low- and middle-income countries. We identified 25 articles that met our inclusion criteria. We found six major outcomes: WASH behaviors and knowledge, social capital, collective action, health, and cost or cost-effectiveness. The most consistent evidence was associated with WASH behaviors and knowledge, with significant effects on defecation practices, hand washing behaviors, and WASH knowledge. We also found qualitative evidence of impact on social capital and collective action. CHCs catalyze favorable changes in WASH behaviors and knowledge, yielding outcomes commensurate with other WASH promotion strategies. This review provides insights into the model’s theory of change, helping identify areas for further investigation. The CHC model’s holistic focus and emphasis on individual and collective change offer promising potential to address multiple health and development determinants.

scholarly journals Achieving Social and Ecological Outcomes in Collaborative Environmental Governance: Good Examples from Swedish Moose Management

2021 ◽  
Vol 13 (4) ◽  
pp. 2329
Author(s):  
Sabrina Dressel ◽  
Annelie Sjölander-Lindqvist ◽  
Maria Johansson ◽  
Göran Ericsson ◽  
Camilla Sandström
Keyword(s):  
Social Learning ◽  
Environmental Governance ◽  
Collaborative Governance ◽  
Theory Of Change ◽  
Ecological Context ◽  
Discretionary Power ◽  
Structured Interviews ◽  
Resource Governance ◽  
Social Ecological ◽  
The Social

Collaborative governance approaches have been suggested as strategies to handle wicked environmental problems. Evaluations have found promising examples of effective natural resource governance, but also highlighted the importance of social-ecological context and institutional design. The aim of this study was to identify factors that contribute to the achievement of social and ecological sustainability within Swedish moose (Alces alces) management. In 2012, a multi-level collaborative governance regime was implemented to decrease conflicts among stakeholders. We carried out semi-structured interviews with six ‘good examples’ (i.e., Moose Management Groups that showed positive social and ecological outcomes). We found that ‘good examples’ collectively identified existing knowledge gaps and management challenges and used their discretionary power to develop procedural arrangements that are adapted to the social-ecological context, their theory of change, and attributes of local actors. This contributed to the creation of bridging social capital and principled engagement across governance levels. Thus, our results indicate the existence of higher-order social learning as well as a positive feedback from within-level collaboration dynamics to between-level collaboration. Furthermore, our study illustrates the importance of institutional flexibility to utilize the existing knowledge across stakeholder groups and to allow for adaptations based on the social learning process.

scholarly journals Improving nursing documentation for surgical patients in a referral hospital in Freetown, Sierra Leone: protocol for assessing feasibility of a pilot multifaceted quality improvement hybrid type project

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Nataliya Brima ◽  
Nick Sevdalis ◽  
K. Daoh ◽  
B. Deen ◽  
T. B. Kamara ◽  
...  
Keyword(s):  
Quality Improvement ◽  
Quality Of Care ◽  
Sierra Leone ◽  
Referral Hospital ◽  
Audit And Feedback ◽  
Health System Strengthening ◽  
Theory Of Change ◽  
Improve Quality ◽  
Nursing Documentation

Abstract Background There is an urgent need to improve quality of care to reduce avoidable mortality and morbidity from surgical diseases in low- and middle-income countries. Currently, there is a lack of knowledge about how evidence-based health system strengthening interventions can be implemented effectively to improve quality of care in these settings. To address this gap, we have developed a multifaceted quality improvement intervention to improve nursing documentation in a low-income country hospital setting. The aim of this pilot project is to test the intervention within the surgical department of a national referral hospital in Freetown, Sierra Leone. Methods This project was co-developed and co-designed by in-country stakeholders and UK-based researchers, after a multiple-methodology assessment of needs (qualitative, quantitative), guided by a participatory ‘Theory of Change’ process. It has a mixed-method, quasi-experimental evaluation design underpinned by implementation and improvement science theoretical approaches. It consists of three distinct phases—(1) pre-implementation(project set up and review of hospital relevant policies and forms), (2) intervention implementation (awareness drive, training package, audit and feedback), and (3) evaluation of (a) the feasibility of delivering the intervention and capturing implementation and process outcomes, (b) the impact of implementation strategies on the adoption, integration, and uptake of the intervention using implementation outcomes, (c) the intervention’s effectiveness For improving nursing in this pilot setting. Discussion We seek to test whether it is possible to deliver and assess a set of theory-driven interventions to improve the quality of nursing documentation using quality improvement and implementation science methods and frameworks in a single facility in Sierra Leone. The results of this study will inform the design of a large-scale effectiveness-implementation study for improving nursing documentation practices for patients throughout hospitals in Sierra Leone. Trial registration Protocol version number 6, date: 24.12.2020, recruitment is planned to begin: January 2021, recruitment will be completed: December 2021.

scholarly journals Effectiveness–implementation hybrid type 2 study evaluating an intervention to support ‘information work’ in dementia care: an implementation study protocol

BMJ Open ◽  
2020 ◽  
Vol 10 (12) ◽  
pp. e038397
Author(s):  
Chiara De Poli ◽  
Jan R Oyebode ◽  
Christopher Binns ◽  
Richard Glover ◽  
Mara Airoldi
Keyword(s):  
Service Providers ◽  
Unmet Need ◽  
Theory Of Change ◽  
Family Carers ◽  
Long Term Conditions ◽  
Local Service ◽  
Hybrid Type ◽  
North East ◽  
People With Dementia

IntroductionPatients with long-term conditions consistently report a lack of information around services and support available to them. This unmet need for information is significant among people with dementia and family carers. A quality improvement intervention is being carried out to tackle this issue as part of a co-creation initiative in the North East of England (UK). The intervention consists of the dissemination (via the local Community Mental Health Services for Older People) of a leaflet about services available to people with dementia and their family carers in the study site. This protocol is reported in accordance with the Standards for Reporting Implementation Studies.Methods and analysisThis effectiveness–implementation hybrid type 2 study aims at understanding (1) the unfolding and outcomes of the implementation strategy, (2) the outcomes of the intervention (for people with dementia and family carers, staff implementing the intervention and local service providers) and (3) the contribution of co-creation to the design and implementation of the intervention and its outcomes. The prospective theory of change of the intervention articulated by local stakeholders is used as a reference framework against which to assess the implementation and outcomes of the intervention. Evaluation data will be collected through in-depth interviews with people with dementia and family carers receiving the intervention, staff implementing the intervention and managers from local service providers. Referral data from local service providers will be collected to triangulate the interview data. A focus group with key stakeholders will support the sense-making of findings. The realist configuration of mechanism–context–outcome, operationalised using an information behaviour model, will inform data analysis and interpretation.Ethics and disseminationEthical and research governance approvals have been obtained from the West Midlands—South Birmingham Research Ethics Committee. The results of the study will be submitted for publication in peer-reviewed journals and disseminated through conferences.

Sign in / Sign up

Export Citation Format

Share Document