scholarly journals A review of the quantitative effectiveness evidence synthesis methods used in public health intervention guidelines

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Ellesha A. Smith ◽  
Nicola J. Cooper ◽  
Alex J. Sutton ◽  
Keith R. Abrams ◽  
Stephanie J. Hubbard

Abstract Background The complexity of public health interventions create challenges in evaluating their effectiveness. There have been huge advancements in quantitative evidence synthesis methods development (including meta-analysis) for dealing with heterogeneity of intervention effects, inappropriate ‘lumping’ of interventions, adjusting for different populations and outcomes and the inclusion of various study types. Growing awareness of the importance of using all available evidence has led to the publication of guidance documents for implementing methods to improve decision making by answering policy relevant questions. Methods The first part of this paper reviews the methods used to synthesise quantitative effectiveness evidence in public health guidelines by the National Institute for Health and Care Excellence (NICE) that had been published or updated since the previous review in 2012 until the 19th August 2019.The second part of this paper provides an update of the statistical methods and explains how they address issues related to evaluating effectiveness evidence of public health interventions. Results The proportion of NICE public health guidelines that used a meta-analysis as part of the synthesis of effectiveness evidence has increased since the previous review in 2012 from 23% (9 out of 39) to 31% (14 out of 45). The proportion of NICE guidelines that synthesised the evidence using only a narrative review decreased from 74% (29 out of 39) to 60% (27 out of 45).An application in the prevention of accidents in children at home illustrated how the choice of synthesis methods can enable more informed decision making by defining and estimating the effectiveness of more distinct interventions, including combinations of intervention components, and identifying subgroups in which interventions are most effective. Conclusions Despite methodology development and the publication of guidance documents to address issues in public health intervention evaluation since the original review, NICE public health guidelines are not making full use of meta-analysis and other tools that would provide decision makers with fuller information with which to develop policy. There is an evident need to facilitate the translation of the synthesis methods into a public health context and encourage the use of methods to improve decision making.

2020 ◽  
Vol 36 (suppl 2) ◽  
Author(s):  
Paula Mendes Luz ◽  
Paulo Nadanovsky ◽  
Julie Leask

Abstract: Immunization, the most successful public health intervention to date, can only be effective if eligible individuals or their legal representatives have access to vaccines and subsequently comply with their use. Under-vaccination stems from multiple causes: access, affordability, awareness, acceptance and activation. In this paper, we focus on acceptance and, specifically, on factors pertaining to individual or parental compliance, specifically the psychology of judgment and decision making. We describe how heuristics and cognitive biases - a facet of thoughts and feelings - affect vaccination decision making. Additionally, we address when and how social processes play a role and how attitudes towards vaccines might reflect a more general underlying attitude or ideology. The understanding of how decision making, with regards to vaccines occurs, and the role played by heuristics and cognitive biases can help inform more appropriate public health interventions.


2022 ◽  
Author(s):  
Molly Wells ◽  
Sylwia Bujkiewicz ◽  
Stephanie J Hubbard

Abstract BackgroundIn the appraisal of clinical interventions, complex evidence synthesis methods, such as network meta-analysis (NMA), are commonly used to investigate the effectiveness of multiple interventions in a single analysis. The results from a NMA can inform clinical guidelines directly or be used as inputs into a decision-analytic model assessing the cost-effectiveness of the interventions. However, there is hesitancy in using complex evidence synthesis methods when evaluating public health interventions. This is due to significant heterogeneity across studies investigating such interventions and concerns about their quality. Threshold analysis has been developed to help assess and quantify the robustness of recommendations made based on results obtained from NMAs to potential limitations of the data. Developed in the context of clinical guidelines, the method may prove useful also in the context of public health interventions. In this paper, we illustrate the use of the method in the study investigating the effectiveness of interventions aiming to increase the uptake of poison prevention behaviours in homes with children aged 0-5.MethodsRandom effects NMA was carried out to assess the effectiveness of several interventions for increasing the uptake of poison prevention behaviours, focusing on the safe storage of other household products outcome. Threshold analysis was then applied to the NMA to assess the robustness of the intervention recommendations made based on the NMA.Results15 studies assessing seven interventions were included in the NMA. The results of the NMA indicated that complex intervention, including Education, Free/low-cost equipment, Fitting equipment and Home safety inspection, was the most effective intervention at promoting poison prevention behaviours. However, the threshold analyses highlighted that this intervention recommendation was not robust.Conclusions In our case study, threshold analysis allowed us to demonstrate that the intervention recommendation for promoting poison prevention behaviours was not robust to changes in the evidence due to potential bias. Therefore, caution should be taken when considering such interventions in practice. We have illustrated the potential benefit of threshold analysis and, therefore, encourage the use of the method in practice as a sensitivity analysis for NMA of public health interventions.


2020 ◽  
Author(s):  
Jia Li ◽  
Patrizio Mazzone ◽  
Lisa WM Leung ◽  
Weiqian Lin ◽  
Giuseppe D’Angelo ◽  
...  

ABSTRACTAimsTo chart the effect of the COVID-19 pandemic on the activity of interventional electrophysiology services in affected regions.MethodsWe reviewed the electrophysiology laboratory records in 3 affected cities: Wenzhou in China, Milan in Italy and London, United Kingdom. We interviewed electrophysiologists in each centre to gather information on the impact of the pandemic on working patterns and on the health of staff members.ResultsThere was a striking decline in interventional electrophysiology activity in each of the centres. The decline occurred within a week of the recognition of widespread community transmission of the virus in each region and shows a striking correlation with the national figures for new diagnoses of COVID-19 in each case. During the period of restriction, work-flow dropped to <5% of normal, consisting of emergency cases only. In 2 of 3 centres, electrophysiologists were redeployed to perform emergency work outside electrophysiology. Among the centres studied, only Wenzhou has seen a recovery from the restrictions in activity. Following an intense nationwide program of public health interventions, local transmission of COVID-19 ceased to be detectable after February 18th allowing the electrophysiology service to resume with a strict testing regime for all patients.ConclusionInterventional electrophysiology is vulnerable to closure in times of great social difficulty including the COVID-19 pandemic. Intense public health intervention can permit suppression of local disease transmission allowing resumption of some normal activity.CONDENSED ABSTRACTCOVID-19 has affected every aspect of life worldwide. In the electrophysiology labs of Wenzhou, Milan and London, activity was suspended as the disease took hold. Only Wenzhou has resumed normal services, facilitated by a monumental nationwide program of public health interventions and supported by stringent testing protocols.WHAT’S NEWWe describe the impact of the COVID-19 pandemic on interventional electrophysiology units in 3 cities: Wenzhou, Milan and London.In all cases, the routine work of the electrophysiology was virtually suspended within a week of the recognition of widespread virus transmission in the area.During the period of restricted activity imposed by the pandemic, centres have dealt with a small number of emergency ablations only, a balanced mix of atrial, ventricular and junctional arrhythmias.In 2 of the 3 centres, electrophysiologists were redeployed to perform other medical duties including in COVID-19 wards.COVID-19 infection occurred in medical and nursaing staff in 2 of the 3 centres.Only in the cases of Wenzhou, China, has a resumption of normal activity been possible; this follows intensive public health intervention and is protected by stringent testing.FUNDINGNoneETHICAL APPROVALNone required from the Research Ethics Committee (REC) London according to the type of study. Institutional ethical approval obtained at the centres of: St. George’s Hospital NHS Foundation Trust, London, UK; Local Health Authority Ethical Approval was obtained in: The Second Affiliated Hospital and Yuying Children’s Hospital of Wenzhou Medical University in Wenzhou, PR China and San Raffaele in Milan, Italy.CONSENTInformed consent was obtained from all participants/interviewees who took part in this study.


Author(s):  
Zixin Hu ◽  
Qiyang Ge ◽  
Shudi Li ◽  
Li Jin ◽  
Momiao Xiong

As COVID-19 evolves rapidly, the issues the governments of affected countries facing are whether and when to take public health interventions and what levels of strictness of these interventions should be, as well as when the COVID-19 spread reaches the stopping point after interventions are taken. To help governments with policy-making, we developed modified auto-encoders (MAE) method to forecast spread trajectory of Covid-19 of countries affected, under different levels and timing of intervention strategies. Our analysis showed public health interventions should be executed as soon as possible. Delaying intervention 4 weeks after March 8, 2020 would cause the maximum number of cumulative cases of death increase from 7,174 to 133,608 and the ending points of the epidemic postponed from Jun 25 to Aug 22.


2017 ◽  
Vol 76 (5) ◽  
pp. 595-608 ◽  
Author(s):  
Calum F Leask ◽  
Marlene Sandlund ◽  
Dawn A Skelton ◽  
Sebastien FM Chastin

Objective: The increasing health care costs associated with an ageing population and chronic disease burden are largely attributable to modifiable lifestyle factors that are complex and vary between individuals and settings. Traditional approaches to promoting healthy lifestyles have so far had limited success. Recently, co-creating public health interventions with end-users has been advocated to provide more effective and sustainable solutions. The aim of this study was to document and evaluate the co-creation of a public health intervention to reduce sedentary behaviour in older adults. Design: Community-dwelling older adults ( N = 11, mean age = 74 years) and academic researchers attended 10 interactive co-creation workshops together. Setting: Workshops took place on university campus and the co-creators completed fieldwork tasks outside the workshops. Method: Workshops were informed by the Participatory and Appreciative Action and Reflection methodology. Data were collected using field notes, video recording and worksheet tasks. Analysis was conducted using a qualitative content analysis approach. Results: The co-creators developed a tailored intervention delivered through a mode congruent with older adults’ lives. Key elements of the intervention included (1) education on sedentary behaviour, (2) resources to interrupt sedentary behaviour, (3) self-monitoring, (4) action planning and (5) evaluating the benefits of interrupting sedentary behaviour. Conclusion: Co-creation is a feasible approach to develop public health interventions; however, it is limited by the lack of a systematic framework to guide the process. Future work should aim to develop principles and recommendations to ensure co-creation can be conducted in a more scientific and reproducible way. The effectiveness and scalability of the intervention should be assessed.


2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
K Southby ◽  
S Rushworth ◽  
J South ◽  
S Coan ◽  
J Woodward ◽  
...  

Abstract Background Despite growing interest in understanding complex systems and public health interventions, research methodologies that take account of system-wide action are relatively underdeveloped. Community-based participatory research (CBPR) is steered and conducted by people with lived experience of the issues being researched. This paper explores the value of CBPR in complex public health intervention evaluations. The 'Local People' and 'Local Conversations' programmes use a community empowerment approach in 50 communities across the UK experiencing social disadvantage to increase social connections and collective control, improve health and wellbeing, and reduce inequalities (linked to SDG 3 and 11). Methods Evaluation of the programmes followed a mixed-methods design, including qualitative case studies, longitudinal survey, process appraisal, and CBPR. Residents from 10 communities across the programmes each undertook 2 rounds of CBPR. These projects resulted in written reports, which were analysed thematically alongside other data sources. Results There was some variation in the scope and design of the 20 completed CBPR projects. Whilst projects did not generally extend beyond the scope of the overall evaluation, peer research provided information from residents that were inaccessible to other data collection streams. Gathering community (lay) knowledge improved understanding of local priorities and actions within the programmes. However, the utility of CBPR was less consistent for community-researchers and local communities, often failing to support project development. Some community-researchers felt unprepared for the activity despite support from the academic team. Conclusions Conducted appropriately, CBPR can elicit data that would be less accessible through externally led research. This study highlights the value of CBPR in complex programme evaluations, enabling a deeper understanding of social context in which interventions occur. Key messages CBPR complements more traditional research methodologies in complex public health evaluation designs. CBPR can enable a deeper understanding of social processes necessary for the success of complex public health interventions that might be beyond the scope of other methodologies.


2020 ◽  
Author(s):  
Robin Qiu

<p>This is a short article, focusing on promoting more study on SEIR modeling by leveraging rich data and machine learning. We believe that this is extremely critical as many regions at the country or state/provincial levels have been struggling with their public health intervention policies on fighting the COVID-19 pandemic. Some recent published papers on mitigation measures show promising SEIR modeling results, which could shred the light for other policymakers at different community levels. We present our perspective on this research direction. Hopefully, we can stimulate more studies and help the world win this “war” against the invisible enemy “coronavirus” sooner rather than later. </p>


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Sam McCrabb ◽  
Kaitlin Mooney ◽  
Benjamin Elton ◽  
Alice Grady ◽  
Sze Lin Yoong ◽  
...  

Abstract Background Optimisation processes have the potential to rapidly improve the impact of health interventions. Optimisation can be defined as a deliberate, iterative and data-driven process to improve a health intervention and/or its implementation to meet stakeholder-defined public health impacts within resource constraints. This study aimed to identify frameworks used to optimise the impact of health interventions and/or their implementation, and characterise the key concepts, steps or processes of identified frameworks. Methods A scoping review of MEDLINE, CINAL, PsycINFO, and ProQuest Nursing & Allied Health Source databases was undertaken. Two reviewers independently coded the key concepts, steps or processes involved in each frameworks, and identified if it was a framework aimed to optimise interventions or their implementation. Two review authors then identified the common steps across included frameworks. Results Twenty optimisation frameworks were identified. Eight frameworks were for optimising interventions, 11 for optimising implementation and one covered both intervention and implementation optimisation. The mean number of steps within the frameworks was six (range 3–9). Almost half (n = 8) could be classified as both linear and cyclic frameworks, indicating that some steps may occur multiple times in a single framework. Two meta-frameworks are proposed, one for intervention optimisation and one for implementation strategy optimisation. Steps for intervention optimisation are: Problem identification; Preparation; Theoretical/Literature base; Pilot/Feasibility testing; Optimisation; Evaluation; and Long-term implementation. Steps for implementation strategy optimisation are: Problem identification; Collaborate; Plan/design; Pilot; Do/change; Study/evaluate/check; Act; Sustain/endure; and Disseminate/extend. Conclusions This review provides a useful summary of the common steps followed to optimise a public health intervention or its implementation according to established frameworks. Further opportunities to study and/or validate such frameworks and their impact on improving outcomes exist.


Sign in / Sign up

Export Citation Format

Share Document