scholarly journals Five ways to get a grip on the drawbacks of logic models in program evaluation

2021 ◽  
Author(s):  
Betty Onyura ◽  
Hollie Mullins ◽  
Deena Hamza
Keyword(s):  
Program Evaluation ◽  
Stakeholder Engagement ◽  
Evaluation Studies ◽  
Project Planning ◽  
Relative Simplicity ◽  
Logic Models ◽  
Evaluation Project ◽  
Evaluation Work ◽  
Visual Illustrations

Logic models are perhaps the most widely used tools in program evaluation work. They provide reasonably straightforward, visual illustrations of plausible links between program activities and outcomes. Consequently, they are employed frequently in stakeholder engagement, communication, and evaluation project planning. However, their relative simplicity comes with multiple drawbacks that can compromise the integrity of evaluation studies. In this Black Ice article, we outline key considerations and provide practical strategies that can help those engaged in evaluation work to identify and mitigate the limitations of logic models.  

Theoretical and Methodological Problems of a 10-Year Follow-Up Program Evaluation Study

2002 ◽  
Vol 18 (3) ◽  
pp. 229-241 ◽  
Author(s):  
Kurt A. Heller ◽  
Ralph Reimann
Keyword(s):  
Program Evaluation ◽  
Evaluation Studies ◽  
Evaluation Study ◽  
Control Groups ◽  
Cross Sectional ◽  
Long Term Study ◽  
Partial Inclusion ◽  
Methodological Problems

Summary In this paper, conceptual and methodological problems of school program evaluation are discussed. The data were collected in conjunction with a 10 year cross-sectional/longitudinal investigation with partial inclusion of control groups. The experiences and conclusions resulting from this long-term study are revealing not only from the vantage point of the scientific evaluation of new scholastic models, but are also valuable for program evaluation studies in general, particularly in the field of gifted education.

scholarly journals Program Evaluation Through the Use of Logic Models

2021 ◽  
Author(s):  
Antonio J. Carrion ◽  
Jovan D. Miles ◽  
Michael D. Thompson ◽  
Briana Journee ◽  
Eboni Nelson
Keyword(s):  
Program Evaluation ◽  
Logic Models

scholarly journals Evaluating Youth Programs: An Overview of Practitioner Led Evaluations

2010 ◽  
Vol 5 (1) ◽  
pp. 112-117
Author(s):  
Mat D. Duerden ◽  
Peter A. Witt
Keyword(s):  
Program Evaluation ◽  
Youth Programs ◽  
Positive Development ◽  
Positive Outcomes ◽  
Program Logic ◽  
Evaluation Strategy ◽  
Logic Models ◽  
Different Types ◽  
Key Issues

Youth programs are prime contexts for the intentional facilitation of positive development. However, not all youth programs achieve positive outcomes equally. In order to promote the identification and dissemination of the characteristics and processes of effective youth programs, increased focus needs to be given to program evaluation. This article briefly reviews the main tenets of evaluation science in order to provide practitioners a roadmap for conducting their own evaluations. This includes an overview of different types of evaluations and key issues to consider when constructing an evaluation strategy such as targeting outcomes and developing program logic models.

Evaluation Capacity-building: A Tale of Value-adding

2005 ◽  
Vol 5 (2) ◽  
pp. 41-47 ◽  
Author(s):  
Diana Beere
Keyword(s):  
Program Evaluation ◽  
Capacity Building ◽  
Organisational Culture ◽  
Added Value ◽  
Evaluation Capacity Building ◽  
Evaluation Capacity ◽  
Police Service ◽  
Internal Evaluators ◽  
Integrate Evaluation ◽  
Evaluation Work

Evaluation capacity-building entails not only developing the expertise needed to undertake robust and useful evaluations; it also involves creating and sustaining a market for that expertise by promoting an organisational culture in which evaluation is a routine part of ‘the way we do things around here’. A challenge for evaluators is to contribute to evaluation capacity-building while also fulfilling their key responsibilities to undertake evaluations. A key strategy is to focus on both discerning value and adding value for clients/commissioners of evaluations. This paper takes as examples two related internal evaluation projects conducted for the Queensland Police Service that have added value for the client and, in doing so, have helped to promote and sustain an evaluation culture within the organisation. It describes key elements of these evaluations that contributed to evaluation capacity-building. The paper highlights the key role that evaluators themselves, especially internal evaluators, can take in evaluation capacity-building, and proposes that internal evaluators can, and should, integrate evaluation capacity-building into their routine program evaluation work.

How to Make Program Evaluation Work for You

1992 ◽  
Vol 2 (4) ◽  
pp. 52-71 ◽  
Author(s):  
Stephen Forer
Keyword(s):  
Program Evaluation ◽  
Evaluation Work

scholarly journals LATER-ADULTHOOD TRAUMA REENGAGEMENT IN VIETNAM VETERANS WITH PTSD: FINDINGS FROM A PROGRAM EVALUATION PROJECT

2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S663-S663
Author(s):  
Kelly A O Malley ◽  
Patricia M Bamonti ◽  
Kirsten Graham ◽  
Ronald Smith ◽  
Jacqueline Gurevitch ◽  
...  
Keyword(s):  
Mental Health ◽  
Program Evaluation ◽  
Vietnam Veterans ◽  
Military Service ◽  
Meaning Making ◽  
Additional Treatment ◽  
Health Clinic ◽  
Post Intervention ◽  
And Coping ◽  
Evaluation Project

Abstract As Veterans age, they may experience an emergence or exacerbation of stress symptomatology. Later-Adulthood Trauma Reengagement (LATR) is an intervention that provides psychoeducation on the LATR process, teaches mindfulness and coping, facilitates trauma re-integration, and fosters meaning-making in late life. This program evaluation project evaluated the LATR group offered in the Geriatric Mental Health Clinic at VA Boston. Twenty-one Vietnam Veterans with PTSD symptomatology were referred to the group between 2017-2018. Fifteen completed the 10-week group, and 12 completed pre- and post-intervention assessments and offered feedback. At the conclusion of the group, Veterans reported a decrease in depressive and PTSD symptoms. Of the 4 Veterans who endorsed suicidal ideation at the start of the group, 3 reported a decrease post-group. Veterans endorsed slightly more positive appraisals of their military service. Veterans reported that the group offered support, connection, and a sense of belonging with other Veterans, helped increase coping, and increased insight into thoughts, feelings, and behaviors. A suggested improvement to the group was to offer more sessions. Eleven Veterans sought continued mental health services following the group; three newly sought trauma-focused interventions. Four Veterans reported that their trauma-related symptoms were resolved and declined referral. Veterans found the LATR group helpful as evidenced by reduction in symptoms and responses to open-ended questions. A small number sought additional trauma-focused treatment; others reported that their symptoms were resolved and did not require additional treatment. Findings support the continued offering of the LATR group within this clinical setting.

scholarly journals Comparing and Contrasting a Program versus System Approach to Evaluation: The Example of a Cardiac Care System

2020 ◽  
Vol 35 (2) ◽  
Author(s):  
Ralph Renger ◽  
Jirina Foltysova ◽  
Jessica Renger ◽  
Stewart I. Donaldson ◽  
Gary Hart ◽  
...  
Keyword(s):  
Program Evaluation ◽  
Systems Thinking ◽  
System Approach ◽  
Case Illustration ◽  
System Evaluation ◽  
Cardiac Care ◽  
Evaluation Theory ◽  
Program Logic ◽  
Logic Models ◽  
Versus System

This paper focuses on the application of systems thinking concepts to evaluate systems.  The terms systems and systems thinking concepts are first defined.  The use of systems thinking concepts in program and system evaluation are then highlighted.  It is noted that while there are methods available to assist evaluation practitioners in applying systems thinking concepts to program evaluation, there is a need for similar guidance in applying systems thinking concepts to evaluating systems.  System Evaluation Theory (SET) is then reviewed as one evaluation theory designed to apply systems thinking concepts to evaluating systems. A case illustration is presented to help teach practitioners how to apply SET’s three steps.  The discussion focuses on comparing the differences between evaluation questions answered by applying systems thinking concepts versus those using program logic models.

Sign in / Sign up

Export Citation Format

Share Document