scholarly journals Exploring influences on evaluation practice: a case study of a national physical activity programme

2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Judith F. Fynn ◽  
Wendy Hardeman ◽  
Karen Milton ◽  
Andy Jones
Keyword(s):  
Public Health ◽  
Physical Activity ◽  
Good Practice ◽  
Evaluation Framework ◽  
Structured Interviews ◽  
Multiple Sources ◽  
Framework Analysis ◽  
Evaluation Practice ◽  
Organisational Structures

Abstract Background Interventions to improve physical activity behaviour are a core part of public health policy and practice. It is essential that we evaluate these interventions and use the evidence to inform decisions to improve population health. Evaluation of ‘real-world’ interventions provide an opportunity to generate practice-relevant evidence, however these interventions are difficult to evaluate. Various guidelines have been developed to facilitate evaluation, but evidence about their effectiveness in practice is limited. To explore influences on evaluation practice in an applied context, we conducted a case study of Sport England’s ‘Get Healthy Get Active’ (GHGA) programme. This was a national programme that funded 33 projects that were delivered and evaluated across England. The programme was chosen as it was designed to generate evidence on the role of sport in increasing physical activity and improving health. The study aimed to explore and appraise whether strategies intended to facilitate project evaluation, including funder requirements to use a standardised evaluation framework and specific data collection methods, were effective in generating evidence that enabled the programme to meet its aims. Methods We applied a collective case study design involving 35 semi-structured interviews, and documentary analysis of multiple sources of evidence from 23 physical activity projects funded by GHGA. We applied thematic and framework analysis. We developed a logic model and mapped actual outcomes against intended outcomes. A narrative synthesis is provided. We discuss implications for the effective commissioning and evaluation of public health interventions. Results We identified five main themes of influences on evaluation practices that can act as barriers and facilitators to good practice: programme and project design; evaluation design; partnerships; resources; and organisational structures and systems. These influences are context-specific and operate through a complex set of interactions. Conclusion Developing a better understanding of how influences on evaluation practice can act as facilitators or barriers is vital to help close current gaps in the evidence-based practice cycle. Critically, organisational structures and systems are needed to facilitate collaborative decision making; integration of projects and evaluation across partners organisations; transfer of knowldege and insights between stakeholders; and more rapid feedback and dissemination.

Context and Culture in Evaluation: A Case Study of Evaluation Anthropology

2017 ◽  
Vol 17 (1) ◽  
pp. 30-38
Author(s):  
Elise Howard
Keyword(s):  
School Readiness ◽  
Cultural Difference ◽  
English Language ◽  
Evaluation Framework ◽  
Cultural Bias ◽  
Culturally Appropriate ◽  
Evaluation Practice ◽  
Cultural Aspects ◽  
Poverty And Inequality

Designing programs to address poverty and inequality for Australian Aboriginal communities over recent decades has proved problematic. There is a need for greater consideration of different cultural perspectives. A culturally appropriate evaluation framework can provide a range of strategies to embrace cultural difference. Evaluation anthropology, one of many culturally appropriate approaches, emphasises understanding of socio-cultural environments and contexts, and reflective practice to draw attention to cultural bias. This paper will define evaluation anthropology and then reflect on its usefulness in establishing an evaluation framework for a preliteracy program located in a remote Aboriginal community in Australia. The aims of the program are to improve school readiness through developing preliteracy (English language) skills in children aged 0-3 years. Developing an evaluation framework for the program required an approach that accounted for the socio-cultural aspects of literacy development. The lessons from this case study demonstrate the need for place-specific theory to inform program design and evaluation practice.

scholarly journals Using RE-AIM to examine the potential public health impact of an integrated collaborative care intervention for weight and depression management in primary care: Results from the RAINBOW trial

PLoS ONE ◽  
2021 ◽  
Vol 16 (3) ◽  
pp. e0248339
Author(s):  
Megan A. Lewis ◽  
Laura K. Wagner ◽  
Lisa G. Rosas ◽  
Nan Lv ◽  
Elizabeth M. Venditti ◽  
...  
Keyword(s):  
Public Health ◽  
Primary Care ◽  
Collaborative Care ◽  
Health Impact ◽  
Public Health Impact ◽  
Integrative Approach ◽  
Structured Interviews ◽  
Framework Analysis ◽  
Care Intervention ◽  
The Impact

Background An integrated collaborative care intervention was used to treat primary care patients with comorbid obesity and depression in a randomized clinical trial. To increase wider uptake and dissemination, information is needed on translational potential. Methods The trial collected longitudinal, qualitative data at baseline, 6 months (end of intensive treatment), 12 months (end of maintenance treatment), and 24 months (end of follow-up). Semi-structured interviews (n = 142) were conducted with 54 out of 409 randomly selected trial participants and 37 other stakeholders, such as recruitment staff, intervention staff, and clinicians. Using a Framework Analysis approach, we examined themes across time and stakeholder groups according to the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. Results At baseline, participants and other stakeholders reported being skeptical of the collaborative care approach related to some RE-AIM dimensions. However, over time they indicated greater confidence regarding the potential for future public health impact. They also provided information on barriers and actionable information to enhance program reach, effectiveness, adoption, implementation, and maintenance. Conclusions RE-AIM provided a useful framework for understanding how to increase the impact of a collaborative and integrative approach for treating comorbid obesity and depression. It also demonstrates the utility of using the framework as a planning tool early in the evidence-generation pipeline.

Physical activity experiences of youth with visual impairments: An Alaskan perspective

2017 ◽  
Vol 35 (2) ◽  
pp. 103-112 ◽  
Author(s):  
Justin A Haegele ◽  
Amanda Yessick ◽  
T Nicole Kirk
Keyword(s):  
Physical Activity ◽  
Qualitative Methodology ◽  
Visual Impairments ◽  
Study Data ◽  
Structured Interviews ◽  
Convenience Sample ◽  
Case Study Design ◽  
Exploratory Case Study ◽  
Analytic Process

The purpose of this study was to explore the physical activity experiences of youth with visual impairments living in Alaska. This study utilized a descriptive-qualitative methodology using an exploratory case study design. A convenience sample of four (one female, three males; aged 12–18 years) Alaskan youths with visual impairments participated in this study. Data included semi-structured interviews, reflective interview notes, and observational notes. Data were transcribed verbatim, and thematic development was undertaken inductively using a three-step analytic process. Based on the analysis, two interrelated themes emerged from the data: (a) “I don’t really participate in sports other than at camp”: preferences for unstructured activities and (b) “my sister’s willing to do anything”: familial impact on physical activity. Results of this study can help inform future efforts to promote physical activity engagement among youth with visual impairments, particularly those living in geographic areas similar to Alaska.

Participant Perceptions of Character Concepts in a Physical Activity–Based Positive Youth Development Program

2016 ◽  
Vol 38 (5) ◽  
pp. 481-492 ◽  
Author(s):  
Shaina Riciputi ◽  
Meghan H. McDonough ◽  
Sarah Ullrich-French
Keyword(s):  
Physical Activity ◽  
Youth Development ◽  
Positive Youth Development ◽  
Low Income ◽  
Character Development ◽  
Development Program ◽  
Structured Interviews ◽  
Low Income Families ◽  
The Impact

Physical activity–based positive youth development (PYD) programs often aim to foster character development. This study examined youth perspectives of character development curricula and the impact these activities have on their lives within and beyond the program. This case study examined youth from low-income families in a physical activity–based summer PYD program that integrated one character concept (respect, caring, responsibility, trust) in each of 4 weeks. Participants (N = 24) included a cross section of age, gender, ethnicity, and past program experience. Semi-structured interviews were analyzed using inductive thematic analysis and constant comparative methods. Thirteen themes were grouped in four categories: building highquality reciprocal relationships; intrapersonal improvement; moral reasoning and understanding; and rejection, resistance, and compliance. The findings provide participant-centered guidance for understanding youth personal and social development through physical activity in ways that are meaningful to participants, which is particularly needed for youth in low-income communities with limited youth programming.

Agency as the achievement of reform ownership

2019 ◽  
Vol 18 (2) ◽  
pp. 249-262
Author(s):  
Lauren Godfrey ◽  
Carol Booth Olson
Keyword(s):  
Student Learning ◽  
Teacher Expertise ◽  
Teacher Professionalism ◽  
Structured Interviews ◽  
Multiple Sources ◽  
Content Type ◽  
Study Approach ◽  
Advance Student ◽  
Current Reform

Purpose The purpose of this study is to explore how, through the cultivation of reform ownership in the professional development (PD) program, the Pathway Project, agency was achieved for the development of teacher professionalism and teacher expertise in the cases of Mrs. Cruz and Mrs. Keyes. This, in turn, provided opportunities to advance student learning. Design/methodology/approach Multiple sources of data (focused classroom observations, semi-structured interviews and collected artifacts) were analyzed through a case study approach to understand the processes by which an agentic context materialized for these two teachers. Findings The authors identified the following three stages in the cultivation of reform ownership in the cases of Mrs. Cruz and Mrs. Keyes: emerging; developing; and deepening. Each of these stages proved critical to the achievement of agency for the development of teacher professionalism, teacher expertise and student learning. Originality/value The cases of Mrs. Cruz and Mrs. Keyes offer a renewed vision of the ways in which teachers can achieve agency in the current reform environment. Given the proliferation of reform efforts within today’s educational landscape, their cases suggest that PD developers take seriously the responsibility of cultivating reform ownership for the achievement of agency and deep and lasting change.

The Lifestyles of Affluent Young People Ages 9 to 15 Years: A Case Study

2007 ◽  
Vol 4 (4) ◽  
pp. 460-469 ◽  
Author(s):  
Mike Sleap ◽  
Barbara Elliott ◽  
Martha Paisi ◽  
Helen Reed
Keyword(s):  
Public Health ◽  
Physical Activity ◽  
Young People ◽  
Physical Activities ◽  
Moderate Intensity ◽  
Activity Levels ◽  
Future Health ◽  
Lifestyle Activity ◽  
Physical Activity Levels

Background:There are concerns about the future health of young people due to inactive lifestyles. However, evidence about their physical activity levels is not extensive, especially with regard to affluent young people. This study aimed to investigate whether young people from affluent backgrounds met public health recommendations for physical activity.Methods:Diary accounts of lifestyle activity were collected from 219 students ages 9 to 15 y attending a fee-paying school in England.Results:Pupils spent an average of 121 min per day participating in physical activities of at least moderate intensity, considerably more than public health recommendations of 60 min per day. However, almost a quarter of these young people engaged in less than 60 min of physical activity per day of at least moderate intensity.Conclusions:The picture to emerge was one of a balance between sedentary pursuits like television and homework and physical activities such as sport and active play.

scholarly journals The evolution of an asset-based community led alcohol harm intervention in the North West England

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
P A Cook ◽  
C Ure ◽  
S C Hargreaves ◽  
E Burns ◽  
M Coffey ◽  
...  
Keyword(s):  
Public Health ◽  
Community Development ◽  
Social Deprivation ◽  
New Technology ◽  
Descriptive Analysis ◽  
Lessons Learned ◽  
Framework Analysis ◽  
North West ◽  
Asset Based Community Development

Abstract Background Communities in Charge of Alcohol (CICA) is an Asset Based Community Development (ABCD) place-based approach to reducing alcohol harm. Local volunteers, from areas with multiple indicators of deprivation, train to become accredited 'Alcohol Health Champions' (AHCs). AHCs, supported by a local co-ordinator, provide brief opportunistic advice at an individual level and mobilise action on alcohol availability through influencing licensing decisions at a community level. CICA is the first programme we are aware of globally that has attempted to build local AHC capacity. Here we explore lessons learned from four case study areas (of the original ten) that persisted with the intervention for more than 12 months. Methods A case study approach to investigate the context, acceptability, facilitators and barriers to maintaining CICA. Descriptive analysis of ongoing recruitment of champions, numbers of training events and activity of champions (as reported by area coordinators). Framework analysis of interviews with AHCs and stakeholders. Results CICA has increased public health capacity by training 123 AHCs in its first year. The four areas that continued with CICA have trained a further 34. The different approaches in the four areas include: embedding champions in wider health champion/volunteering projects; innovative use of new technology (portable fibroscan); expansion into different geographical areas. AHCs and coordinators report significant social value from participation in CICA. Conclusions The likelihood of embedding CICA into a local area's activities appeared to be dependent on the energy and enthusiasm of the local area's co-ordinator, and may be dependent on that individual remaining in post. ABCD programmes may be more likely to be sustainable if capacity building is supported. CICA might be more sustainable if it was embedded in a wider programme of ABCD, since health issues are interrelated and AHCs often wish to broaden their portfolio. Key messages A volunteer alcohol health champions programme increased public health capacity in areas of social deprivation by utilising the assets (skills) of local people. Embedding a community alcohol health champions programme in a wider programme of asset based community development is more sustainable and allows champions to broaden their volunteering portfolio.

scholarly journals Experiences of staff providing specialist palliative care during COVID-19: A multiple qualitative case study.

2021 ◽  
Author(s):  
Andy Bradshaw ◽  
Lesley Dunleavy ◽  
Ian Garner ◽  
Nancy Preston ◽  
Sabrina Bajwah ◽  
...  
Keyword(s):  
Palliative Care ◽  
Moral Distress ◽  
Death And Dying ◽  
Well Being ◽  
Study Data ◽  
Care Staff ◽  
Specialist Palliative Care ◽  
Structured Interviews ◽  
Framework Analysis

Objectives: To explore the experiences of, and impact on, staff working in palliative care during the COVID-19 pandemic. Design: Qualitative multiple case study using semi-structured interviews between November 2020 and April 2021 as part of the CovPall study. Data were analysed using thematic framework analysis. Setting: Organisations providing specialist palliative services in any setting. Participants: Staff working in specialist palliative care, purposefully sampled by the criteria of role, care setting and COVID-19 experience. Main outcome measures: Experiences of working in palliative care during the COVID-19 pandemic. Results: Five cases and 24 participants were recruited (n=12 nurses, 4 clinical managers, 4 doctors, 2 senior managers, 1 healthcare assistant, 1 allied healthcare professional). Central themes demonstrate how infection control constraints prohibited and diluted participants ability to provide care that reflected their core values, resulting in experiences of moral distress. Despite organisational, team, and individual support strategies, continually managing these constraints led to a crescendo effect in which the impacts of moral distress accumulated over time, sometimes leading to burnout. Solidarity with colleagues and making a valued contribution provided moral comfort for some. Conclusions: This study provides a unique insight into why and how healthcare staff have experienced moral distress during the pandemic, and how organisations have responded. Despite their experience of dealing with death and dying, the mental health and well-being of palliative care staff was affected by the pandemic. Organisational, structural, and policy changes are urgently required to mitigate and manage these impacts.

PP31 Data awareness for sending help (DASH): policy opportunities & challenges

2019 ◽  
Vol 36 (1) ◽  
pp. e12.2-e12
Author(s):  
Archie Drake ◽  
Alex Pollitt ◽  
Leanne Smith ◽  
Elizabeth Sklar
Keyword(s):  
Public Health ◽  
Policy Development ◽  
Research Question ◽  
Data Sources ◽  
Primary Data ◽  
Structured Interviews ◽  
Framework Analysis ◽  
Ambulance Dispatch ◽  
Wide Range ◽  
Potential Impact

BackgroundThe DASH project is a collaboration between King’s College London and the London Ambulance Service (LAS). Its goal is to explore the potential impact of integrating new and emerging data sources and technologies on emergency response, using technical and policy approaches in tandem. Computer science and public health both emphasise dynamic systems thinking in which elements should be connected to others, e.g. ‘data linkage’, ‘health in all policies’. EMS research has started to demonstrate the value of connecting LAS information systems to transport and environmental as well as emergency department data. Policy research question: what are the opportunities and challenges for EMS, wider healthcare providers and the public in the integration of new and emergent data sources and technologies in ambulance dispatch?MethodsMixed Methods study, including literature review, framework analysis, stakeholder and process mapping, open policy development and interviews. Primary data collection (thematic analysis) entails approximately: 15 semi-structured interviews with LAS staff and 60 unstructured interviews with a variety of stakeholders. Secondary data analysis of LAS incident and response datasets over calendar year 2016 with other publicly available administrative data.ResultsA wide range of new and emergent data sources have a potential impact on ambulance dispatch decision-making. The opportunities extend beyond the operational level into tactical and strategic dimensions. But the challenges are significant across a range of perspectives, impeding efforts to realise the benefits in practice. The study suggests a prioritisation of new and emergent data sources and technologies for LAS based on a utility/feasibility matrix which is presented to provoke discussion.ConclusionsMore effective, dynamic ‘data aware’ dispatch systems are likely to improve patient outcomes. Ambulance services can usefully raise awareness to seek the necessary data and support – simultaneously furthering health system integration and wider public health goals. See https://dash.kcl.ac.uk/reports/ for project outputs.

Sign in / Sign up

Export Citation Format

Share Document