scholarly journals Rapid Evaluations of Innovations: A Scoping Review

Author(s):  
Gill Norman ◽  
Thomas Mason ◽  
Jo Dumville ◽  
Peter Bower ◽  
Paul Wilson ◽  
...  

Abstract BackgroundThere is increasing demand for more rapid evaluation of innovation in health and social care, to support timely decision-making about service redesign. These pressures have increased during the COVID-19 pandemic. Making evaluations more rapid raises challenges in terms of ensuring rigour and the effective use of resources, but assessment of rapid evaluation methodologies has been lacking. MethodsWe conducted a scoping review to map the developing field of methods of rapid evaluation of innovation in health and social care, to describe the existing literature, categorise different approaches to rapid evaluation, and identify knowledge gaps. We searched multiple databases and websites of key organisations. We prioritised studies with relevance to the context of the NHS in England. We extracted information to enable us to classify and map existing studies on key characteristics. We undertook a narrative synthesis to identify the evidence and the gaps; focussing on the different approaches to conducting rapid evaluation in primary research. ResultsWe identified 14069 records from our searches of which 352 explored rapid evaluations of innovations, methods for rapid evaluation or rapid evaluation of implementation. Our scoping review identified four main approaches used for rapid evaluation: (1) Use of a methodology designed specifically for rapid evaluation;(2) Increasing rapidity by doing less or using a less time-intensive methodology;(3) Use of alternative technologies and/or data to increase the speed of an existing evaluation method; (4) Adaptation of part of a non-rapid evaluation DiscussionThis scoping review identified a lack of clarity about ‘rapid evaluation’ but identified some useful preliminary categories. There is very little comparative research on the impact of using rapid rather than standard evaluation. There is a need for clarity and consistency in terms of what constitutes rapid evaluation, the development of specific methodologies for making evaluation more rapid, and assessment of the advantages and disadvantages of rapid methodology in terms of rigour, cost and impact.

2007 ◽  
Vol 191 (S50) ◽  
pp. s37-s41 ◽  
Author(s):  
Tom Burns

BackgroundPeople with schizophrenia comprise the majority of patients with severe mental illness recruited to recent mental health service studies of new teams (e.g. assertive outreach, crisis resolution). Reduction in hospitalisation has been the most consistent outcome measure in these studies, but results are inconsistentAimsTo understand inconsistency of results from studies using hospitalisation as an outcome measureMethodThe advantages and disadvantages of hospitalisation are explored, including the ways in which it is recorded. Regional variation in outcomes and the impact of control services are reviewedResultsHospitalisation has face validity as an outcome but translates poorly between differing healthcare contexts. These variations can be exploited positively to distinguish potentially effective ingredients in community care (outreach, combined health and social care, team structure) from redundant componentsConclusionsHospitalisation is a good proxy outcome measure in schizophrenia care in randomised controlled trials, but the dangers of extrapolating to new contexts require care


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
M. P. Pomey ◽  
M. de Guise ◽  
M. Desforges ◽  
K. Bouchard ◽  
C. Vialaron ◽  
...  

Abstract Background Quebec is one of the Canadian provinces with the highest rates of cancer incidence and prevalence. A study by the Rossy Cancer Network (RCN) of McGill university assessed six aspects of the patient experience among cancer patients and found that emotional support is the aspect most lacking. To improve this support, trained patient advisors (PAs) can be included as full-fledged members of the healthcare team, given that PA can rely on their knowledge with experiencing the disease and from using health and social care services to accompany cancer patients, they could help to round out the health and social care services offer in oncology. However, the feasibility of integrating PAs in clinical oncology teams has not been studied. In this multisite study, we will explore how to integrate PAs in clinical oncology teams and, under what conditions this can be successfully done. We aim to better understand effects of this PA intervention on patients, on the PAs themselves, the health and social care team, the administrators, and on the organization of services and to identify associated ethical and legal issues. Methods/design We will conduct six mixed methods longitudinal case studies. Qualitative data will be used to study the integration of the PAs into clinical oncology teams and to identify the factors that are facilitators and inhibitors of the process, the associated ethical and legal issues, and the challenges that the PAs experience. Quantitative data will be used to assess effects on patients, PAs and team members, if any, of the PA intervention. The results will be used to support oncology programs in the integration of PAs into their healthcare teams and to design a future randomized pragmatic trial to evaluate the impact of PAs as full-fledged members of clinical oncology teams on cancer patients’ experience of emotional support throughout their care trajectory. Discussion This study will be the first to integrate PAs as full-fledged members of the clinical oncology team and to assess possible clinical and organizational level effects. Given the unique role of PAs, this study will complement the body of research on peer support and patient navigation. An additional innovative aspect of this study will be consideration of the ethical and legal issues at stake and how to address them in the health care organizations.


BMJ Open ◽  
2021 ◽  
Vol 11 (1) ◽  
pp. e039939
Author(s):  
Sahdia Parveen ◽  
Sarah Jane Smith ◽  
Cara Sass ◽  
Jan R Oyebode ◽  
Andrea Capstick ◽  
...  

ObjectivesThe aim of this study was to establish the impact of dementia education and training on the knowledge, attitudes and confidence of health and social care staff. The study also aimed to identify the most effective features (content and pedagogical) of dementia education and training.DesignCross-sectional survey study. Data collection occurred in 2017.SettingsHealth and social care staff in the UK including acute care, mental health community care trusts, primary care and care homes.ParticipantsAll health and social care staff who had completed dementia education and training meeting the minimal standards as set by Health Education England, within the past 5 years were invited to participate in an online survey. A total of 668 health and social care staff provided informed consent and completed an online survey, and responses from 553 participants were included in this study. The majority of the respondents were of white British ethnicity (94.4%) and identified as women (88.4%).OutcomesKnowledge, attitude and confidence of health and social care staff.ResultsHierarchical multiple regression analysis was conducted. Staff characteristics, education and training content variables and pedagogical factors were found to account for 29% of variance in staff confidence (F=4.13, p<0.001), 22% of variance in attitude (knowledge) (F=3.80, p<001), 18% of the variance in staff knowledge (F=2.77, p<0.01) and 14% of variance in staff comfort (attitude) (F=2.11, p<0.01).ConclusionThe results suggest that dementia education and training has limited impact on health and social care staff learning outcomes. While training content variables were important when attempting to improve staff knowledge, more consideration should be given to pedagogical factors when training is aiming to improve staff attitude and confidence.


2016 ◽  
Vol 22 (4) ◽  
pp. 263-268 ◽  
Author(s):  
Jennifer Perry ◽  
Fiona L. Mason

SummaryThe health and social care landscape in the UK is changing, and there is now, more than ever, a real need for doctors to embrace leadership and management. Evidence shows that medical leadership is associated with better outcomes for patients. Psychiatrists are particularly well suited to such roles, given the interpersonal skills and self-awareness that they develop in their training. In this article, we examine the role of the psychiatrist in leading at a patient, team and organisational level and the impact this has. We also discuss different leadership and management styles.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Karen Louise Bester ◽  
Anne McGlade ◽  
Eithne Darragh

Purpose “Co-production” is a process in health and social care wherein service users and practitioners work in partnership. Recovery colleges (RCs) are educational establishments offering mental health education; a cornerstone feature is that courses are designed and delivered in parity by both mental health practitioners and “peers” – people with lived experience of mental illness. This paper aims to consider, through the identification of key themes, whether co-production within RCs is operating successfully. Design/methodology/approach The paper is a systematic review of qualitative literature. Relevant concept groups were systematically searched using three bibliographic databases: Medline, Social Care Online and Scopus. Articles were quality appraised and then synthesised through inductive thematic analysis and emergent trends identified. Findings Synthesis identified three key themes relating to the impact of co-production in RCs: practitioner attitudes, power dynamics between practitioners and service users, and RCs’ relationships with their host organisations. As a result of RC engagement, traditional practitioner/patient hierarchies were found to be eroding. Practitioners felt they were more person-centred. RCs can model good co-productive practices to their host organisations. The review concluded, with some caveats, that RC co-production was of high fidelity. Originality/value RC research is growing, but the body of evidence remains relatively small. Most of what exists examine the impact of RCs on individuals’ overall recovery and mental health; there is a limited empirical investigation into whether their flagship feature of parity between peers and practitioners is genuine.


2018 ◽  
Vol 28 (5) ◽  
pp. 481-488 ◽  
Author(s):  
A. Crowther ◽  
A. Taylor ◽  
R. Toney ◽  
S. Meddings ◽  
T. Whale ◽  
...  

AbstractAimsRecovery Colleges are opening internationally. The evaluation focus has been on outcomes for Recovery College students who use mental health services. However, benefits may also arise for: staff who attend or co-deliver courses; the mental health and social care service hosting the Recovery College; and wider society. A theory-based change model characterising how Recovery Colleges impact at these higher levels is needed for formal evaluation of their impact, and to inform future Recovery College development. The aim of this study was to develop a stratified theory identifying candidate mechanisms of action and outcomes (impact) for Recovery Colleges at staff, services and societal levels.MethodsInductive thematic analysis of 44 publications identified in a systematised review was supplemented by collaborative analysis involving a lived experience advisory panel to develop a preliminary theoretical framework. This was refined through semi-structured interviews with 33 Recovery College stakeholders (service user students, peer/non-peer trainers, managers, community partners, clinicians) in three sites in England.ResultsCandidate mechanisms of action and outcomes were identified at staff, services and societal levels. At the staff level, experiencing new relationships may change attitudes and associated professional practice. Identified outcomes for staff included: experiencing and valuing co-production; changed perceptions of service users; and increased passion and job motivation. At the services level, Recovery Colleges often develop somewhat separately from their host system, reducing the reach of the college into the host organisation but allowing development of an alternative culture giving experiential learning opportunities to staff around co-production and the role of a peer workforce. At the societal level, partnering with community-based agencies gave other members of the public opportunities for learning alongside people with mental health problems and enabled community agencies to work with people they might not have otherwise. Recovery Colleges also gave opportunities to beneficially impact on community attitudes.ConclusionsThis study is the first to characterise the mechanisms of action and impact of Recovery Colleges on mental health staff, mental health and social care services, and wider society. The findings suggest that a certain distance is needed in the relationship between the Recovery College and its host organisation if a genuine cultural alternative is to be created. Different strategies are needed depending on what level of impact is intended, and this study can inform decision-making about mechanisms to prioritise. Future research into Recovery Colleges should include contextual evaluation of these higher level impacts, and investigate effectiveness and harms.


BMJ Open ◽  
2018 ◽  
Vol 8 (7) ◽  
pp. e023464 ◽  
Author(s):  
Marica Cassarino ◽  
Katie Robinson ◽  
Rosie Quinn ◽  
Breda Naddy ◽  
Andrew O’Regan ◽  
...  

IntroductionFinding cost-effective strategies to improve patient care in the emergency department (ED) is an increasing imperative given growing numbers of ED attendees. Encouraging evidence indicates that interdisciplinary teams including health and social care professionals (HSCPs) enhance patient care across a variety of healthcare settings. However, to date no systematic reviews of the effectiveness of early assessment and/or interventions carried by such teams in the ED exist. This systematic review aims to explore the impact of early assessment and/or intervention carried out by interdisciplinary teams including HSCPs in the ED on the quality, safety and cost-effectiveness of care, and to define the content of the assessment and/or intervention offered by HSCPs.Methods and analysisUsing the Preferred Reporting Items for Systematic Reviews and Meta-Analyses standardised guidelines, we will conduct a systematic review of randomised controlled trials (RCTs), non-RCTs, controlled before–after studies, interrupted time series and repeated measures studies that report the impact of early assessment and/or intervention provided to adults aged 18+ by interdisciplinary teams including HSCPs in the ED. Searches will be carried in Cumulative Index of Nursing and Allied Health Literature, Embase, Cochrane Library and MEDLINE from inception to March 2018. We will also hand-search the reference lists of relevant studies. Following a two-step screening process, two independent reviewers will extract data on the type of population, intervention, comparison, outcomes and study design. The quality of the studies will be appraised using the Cochrane Risk of Bias Tool. The findings will be synthesised in a narrative summary, and a meta-analysis will be conducted where appropriate.Ethics and disseminationEthical approval will not be sought since it is not required for systematic reviews. The results of this review will be disseminated through publication in a peer-review journal and presented at relevant conferences.Trial registration numberCRD42018091794.


10.2196/31668 ◽  
2021 ◽  
Vol 23 (12) ◽  
pp. e31668
Author(s):  
Janna Nadav ◽  
Anu-Marja Kaihlanen ◽  
Sari Kujala ◽  
Elina Laukka ◽  
Pirjo Hilama ◽  
...  

Background Although the COVID-19 pandemic has significantly boosted the implementation of digital services worldwide, it has become increasingly important to understand how these solutions are integrated into professionals’ routine work. Professionals who are using the services are key influencers in the success of implementations. To ensure successful implementations, it is important to understand the multiprofessional perspective, especially because implementations are likely to increase even more. Objective The aim of this study is to examine health and social care professionals’ experiences of digital service implementations and to identify factors that support successful implementations and should be considered in the future to ensure that the services are integrated into professionals’ routine work. Methods A qualitative approach was used, in which 8 focus group interviews were conducted with 30 health and social care professionals from 4 different health centers in Finland. Data were analyzed using qualitative content analysis. The resulting categories were organized under the components of normalization process theory. Results Our results suggested 14 practices that should be considered when implementing new digital services into routine work. To get professionals to understand and make sense of the new service, (1) the communication related to the implementation should be comprehensive and continuous and (2) the implementation process should be consistent. (3) A justification for the service being implemented should also be given. The best way to engage the professionals with the service is (4) to give them opportunities to influence and (5) to make sure that they have a positive attitude toward the service. To enact the new service into professionals’ routine work, it is important that (6) the organization take a supportive approach by providing support from several easy and efficient sources. The professionals should also have (7) enough time to become familiar with the service, and they should have (8) enough know-how about the service. The training should be (9) targeted individually according to skills and work tasks, and (10) it should be diverse. The impact of the implementation on the professionals’ work should be evaluated. The service (11) should be easy to use, and (12) usage monitoring should happen. An opportunity (13) to give feedback on the service should also be offered. Moreover, (14) the service should support professionals’ work tasks. Conclusions We introduce 14 practices for organizations and service providers on how to ensure sustainable implementation of new digital services and the smooth integration into routine work. It is important to pay more attention to comprehensive and continuing communication. Organizations should conduct a competence assessment before training in order to ensure proper alignment. Follow-ups to the implementation process should be performed to guarantee sustainability of the service. Our findings from a forerunner country of digitalization can be useful for countries that are beginning their service digitalization or further developing their digital services.


BJPsych Open ◽  
2021 ◽  
Vol 7 (S1) ◽  
pp. S337-S337
Author(s):  
Rajan Nathan ◽  
Stephen Callaghan ◽  
Kelly Walker ◽  
Angela Mason ◽  
Rosemarie Whittington

AimsThe aim was to examine the reasons for advice requests by carers of people who live with dementia (PLWD) that attend the Me2u dementia day centre in order to identify key explanatory themes. We hypothesised that requests were related mainly to coordinating care and clinical issues due to limited post-diagnostic support (PDS) in our area.BackgroundThe Me2u dementia day centre (Merseyside) cares for PLWD and also supports carers. As part of the service, a 24-hour advice line is included for PLWD and their carers who attend the centre. Locally, there is limited PDS and most carers navigate the health and social care system alone mirroring the findings by the National Collaborating Centre for Mental Health (NCCMH).MethodWe undertook a retrospective evaluation of 244 advice calls, from 64 carers, between 01/06/2019 and 31/12/2019. We analysed time of call, type of advice, type of dementia, age and whether the advice was for the PLWD or for the carer.ResultOf the 244 calls, the most common time to call was between 09.00 - 14.00 (n = 168; (68.8%) peak 09.00 - 10.00 (n = 38). Average age of the person about whom the advice was sought was 79.08 years. 91.4% of the advice calls related to PLWD (most common dementia Alzheimer's) and 8.6% to the carer only. The mean number of calls per person was 3.8 (range 1–24).Advice data were grouped into 9 broad themes namely, related to symptoms/behaviour (32.79%, n = 80), request for Me2u to coordinate care (20.08%, n = 49), general advice (14.75%, n = 36), personal care (9.42%, n = 23), carer only advice (8.60%, n = 21), social issues (6.14%, n = 15), social care (4.50%, n = 11), safeguarding (2.46%, n = 6), non-health and social care issue (1.23%, n = 3).ConclusionReasons for limited/poor PDS given by the NCCMH are; absence of named coordinators of care, over-reliance on families and carers to manage and facilitate appointments, poor recognition and management of comorbidities. This data show that 52.87% of calls were for clinical advice and coordination of care reflecting NCCMH findings. The interventions post-call reduced the impact on providers of urgent care.These findings provide support for the provision of a [24-hour] advice line as a routine part of post-diagnostic support services, especially in areas that have limited or poor PDS. Commissioners of PDS services in areas that have limited or poor PDS should make this a priority to prevent unplanned admissions to hospital and carer breakdown.


Sign in / Sign up

Export Citation Format

Share Document