scholarly journals Problems with evidence assessment in COVID-19 health policy impact evaluation: a systematic review of study design and evidence strength

BMJ Open ◽  
2022 ◽  
Vol 12 (1) ◽  
pp. e053820
Author(s):  
Noah A Haber ◽  
Emma Clarke-Deelder ◽  
Avi Feller ◽  
Emily R Smith ◽  
Joshua A. Salomon ◽  
...  
Keyword(s):  
Health Policy ◽  
Study Design ◽  
Impact Evaluation ◽  
Evaluation Studies ◽  
Policy Impact ◽  
Cross Sectional ◽  
Policy Makers ◽  
Evidence Strength ◽  
Quantitative Impact ◽  
The Impact

IntroductionAssessing the impact of COVID-19 policy is critical for informing future policies. However, there are concerns about the overall strength of COVID-19 impact evaluation studies given the circumstances for evaluation and concerns about the publication environment.MethodsWe included studies that were primarily designed to estimate the quantitative impact of one or more implemented COVID-19 policies on direct SARS-CoV-2 and COVID-19 outcomes. After searching PubMed for peer-reviewed articles published on 26 November 2020 or earlier and screening, all studies were reviewed by three reviewers first independently and then to consensus. The review tool was based on previously developed and released review guidance for COVID-19 policy impact evaluation.ResultsAfter 102 articles were identified as potentially meeting inclusion criteria, we identified 36 published articles that evaluated the quantitative impact of COVID-19 policies on direct COVID-19 outcomes. Nine studies were set aside because the study design was considered inappropriate for COVID-19 policy impact evaluation (n=8 pre/post; n=1 cross-sectional), and 27 articles were given a full consensus assessment. 20/27 met criteria for graphical display of data, 5/27 for functional form, 19/27 for timing between policy implementation and impact, and only 3/27 for concurrent changes to the outcomes. Only 4/27 were rated as overall appropriate. Including the 9 studies set aside, reviewers found that only four of the 36 identified published and peer-reviewed health policy impact evaluation studies passed a set of key design checks for identifying the causal impact of policies on COVID-19 outcomes.DiscussionThe reviewed literature directly evaluating the impact of COVID-19 policies largely failed to meet key design criteria for inference of sufficient rigour to be actionable by policy-makers. More reliable evidence review is needed to both identify and produce policy-actionable evidence, alongside the recognition that actionable evidence is often unlikely to be feasible.

scholarly journals Problems with Evidence Assessment in COVID-19 Health Policy Impact Evaluation (PEACHPIE): A systematic review of evidence strength

2021 ◽  
Author(s):  
Noah A. Haber ◽  
Emma Clarke-Deelder ◽  
Avi Feller ◽  
Emily R. Smith ◽  
Joshua Salomon ◽  
...  
Keyword(s):  
Health Policy ◽  
Impact Evaluation ◽  
Evaluation Method ◽  
Functional Form ◽  
Evaluation Studies ◽  
Policy Impact ◽  
Graphical Display ◽  
Evidence Strength ◽  
Quantitative Impact ◽  
The Impact

AbstractIntroductionAssessing the impact of COVID-19 policy is critical for informing future policies. However, there are concerns about the overall strength of COVID-19 impact evaluation studies given the circumstances for evaluation and concerns about the publication environment. This study systematically reviewed the strength of evidence in the published COVID-19 policy impact evaluation literature.MethodsWe included studies that were primarily designed to estimate the quantitative impact of one or more implemented COVID-19 policies on direct SARS-CoV-2 and COVID-19 outcomes. After searching PubMed for peer-reviewed articles published on November 26 or earlier and screening, all studies were reviewed by three reviewers first independently and then to consensus. The review tool was based on previously developed and release review guidance for COVID-19 policy impact evaluation, assessing what impact evaluation method was used, graphical display of outcomes data, functional form for the outcomes, timing between policy and impact, concurrent changes to the outcomes, and an overall rating.ResultsAfter 102 articles were identified as potentially meeting inclusion criteria, we identified 36 published articles that evaluated the quantitative impact of COVID-19 policies on direct COVID-19 outcomes. The majority (n=23/36) of studies in our sample examined the impact of stay-at-home requirements. Nine studies were set aside because the study design was considered inappropriate for COVID-19 policy impact evaluation (n=8 pre/post; n=1 cross-section), and 27 articles were given a full consensus assessment. 20/27 met criteria for graphical display of data, 5/27 for functional form, 19/27 for timing between policy implementation and impact, and only 3/27 for concurrent changes to the outcomes. Only 1/27 studies passed all of the above checks, and 4/27 were rated as overall appropriate. Including the 9 studies set aside, reviewers found that only four of the 36 identified published and peer-reviewed health policy impact evaluation studies passed a set of key design checks for identifying the causal impact of policies on COVID-19 outcomes.DiscussionThe reviewed literature directly evaluating the impact of COVID-19 policies largely failed to meet key design criteria for useful inference. This was largely driven by the circumstances under which policies were passed making it difficult to attribute changes in COVID-19 outcomes to particular policies. More reliable evidence review is needed to both identify and produce policy-actionable evidence, alongside the recognition that actionable evidence is often unlikely to be feasible.

The Impact of the Public Expenditure Cuts Policy on the Labor Market in Vietnam

2012 ◽  
pp. 22-46
Author(s):  
Huong Nguyen Thi Lan ◽  
Toan Pham Ngoc
Keyword(s):  
Labor Market ◽  
Computable General Equilibrium ◽  
Impact Evaluation ◽  
Public Expenditure ◽  
Computable General Equilibrium Model ◽  
Living Standard ◽  
Input Output ◽  
Policy Makers ◽  
The Public ◽  
The Impact

The purpose of this study is to evaluate the impact of public expenditure cuts on employment and income to support policies for the development of the labor mar- ket. Impact evaluation is of interest for policy makers as well as researchers. This paper presents a method – that is based on a Computable General Equilibrium model – to analyse the impact of the public expenditure cuts policy on employment and income in industries and occupations in Vietnam using macro data, the Input output table, 2006, 2008 and the 2010 Vietnam Household Living Standard Survey.

Measuring the globalization of health services: a possible index of openness of country health sectors to trade

2006 ◽  
Vol 1 (4) ◽  
pp. 323-342 ◽  
Author(s):  
RICHARD SMITH
Keyword(s):  
Health Policy ◽  
Health Services ◽  
Health Sector ◽  
Specific Aspect ◽  
Policy Makers ◽  
Significant Aspect ◽  
National Economies ◽  
The Impact

Globalization is a key challenge facing health policy-makers. A significant aspect of this is trade in health services. However, little is currently known about how trade in health services will affect the health of populations and national economies. A key determinant of the impact of trade in health services will be the general economic and trade context of the country concerned. One specific aspect of this is the ‘openness’ of a country’s health sector to trade; yet there is little, if anything, currently known about the most appropriate methods to assess openness of the health sector.

scholarly journals Quantitative methods used to evaluate impact of health promotion interventions to prevent HIV infections: a methodological systematic review protocol

2021 ◽  
Author(s):  
Andrainolo Ravalihasy ◽  
Lidia Kardas-Sloma ◽  
Yazdan Yazdanpanah ◽  
Valéry Ridde
Keyword(s):  
Systematic Review ◽  
Health Promotion ◽  
Impact Evaluation ◽  
Quantitative Methods ◽  
Evaluation Studies ◽  
Complex Interventions ◽  
Hiv Infections ◽  
Combination Prevention ◽  
Health Promotion Interventions ◽  
The Impact

Abstract Background Combination prevention is currently considered the best approach to combat HIV epidemic. It is based upon the combination of structural, behavioral and biomedical interventions. Such interventions are frequently implemented in a health promoting manner due to their aims, the approach that was adopted and their complexity. The impact evaluation of these interventions often relies on methods inherited from the biomedical field. However, these methods have limitations and should be adapted to be relevant for these complex interventions. This systematic review aims to map the evidence-based methods used to quantify the impact of these interventions and analyze how these methods are implemented. Methods Three databases (Web of Science, Scopus, PubMed) will be used to identify impact evaluation studies of health promotion interventions that aimed at reducing the incidence or prevalence of HIV infection. Only studies based on quantitative design assessing intervention impact on HIV prevalence or incidence will be included. Two reviewers will independently screen studies based on titles and abstracts and then on the full text. The information about study characteristics will be extracted to understand the context in which the interventions are implemented. The information specific to quantitative methods of impact evaluation will be extracted using items from the Mixed Methods Appraisal Tool (MMAT), the guidelines for reporting Statistical Analyses and Methods in the Published Literature (SAMPL) and the guidelines for Strengthening The Reporting of Empirical Simulation Studies (STRESS). This review will be conducted according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement. Discussion The impact evaluation of HIV prevention interventions is a matter of substantial importance given the growing need for evidence of the effectiveness of these interventions whereas they are increasingly complex. These evaluations allow to identify the most effective strategies to be implemented to fight the epidemic. It is therefore relevant to map the methods to better implement them and adapt them according to the type of intervention to be evaluated. Systematic review registration: PROSPERO CRD42020210825

scholarly journals P–759 The impact of the COVID–19 pandemic on women seeking fertility treatment in Germany: the patient´s perspective

2021 ◽  
Vol 36 (Supplement_1) ◽  
Author(s):  
S Wedner-Ross ◽  
F Vo. Versen-Höynck
Keyword(s):  
Study Design ◽  
Online Survey ◽  
Fertility Treatment ◽  
Unborn Child ◽  
Negative Effects ◽  
Cross Sectional ◽  
Professional Societies ◽  
Fertility Treatments ◽  
The Impact

Abstract Study question This cross-sectional survey sought the views of women seeking fertility treatment on the impact of the COVID–19 pandemic on their fertility treatment and attitudes. Summary answer Most respondents worried the recommendations to postpone treatment would reduce their chances of pregnancy and were concerned about negative effects of SARS-Cov–2 infections on pregnancy. What is known already In spring 2020, the recommendations of ESHRE and German professional societies to postpone fertility treatments resulted in limited or closed services from mid-March to early May in many clinics. Previous studies reported that postponing fertility clinic appointments causes psychological distress, with most patients saying they would have preferred to continue treatment. While no similar studies are available from Germany, where COVID–19 incidence was relatively low, concerns of the patients about possible consequences of a treatment delay and a SARS-CoV–2 infection on fertility and pregnancy remain unknown. Study design, size, duration This cross-sectional, anonymous, online questionnaire was completed in June-December 2020 by 249 women attending fertility clinics across Germany. The women were recruited using leaflets, directly by study personnel either in person or by telephone, or via online support group forums for fertility patients. Participants/materials, setting, methods All women seeking treatment in fertility clinics were eligible to participate. The online survey covered questions about the patient’s quality of life, their opinions about the professional societies’ recommendations and their effects as well as any concerns about infection with SARS-CoV–2. Statistical analysis was conducted using SPSS Version 27. Main results and the role of chance Three-quarters of participants disagreed with the pausing of fertility treatments. Women who participated from October-December 2020, when the incidence rate was high, were as likely to disagree as participants that participated from June-September 2020 (73% vs 79%, p = 0.3). Nearly all participants (95%) were concerned that treatment delays would reduce their chances of pregnancy. 72 participants (29%) had their appointments cancelled. Nearly all (97%) reported being upset by this, with 40 (56%) reporting that they were extremely or very disappointed about the cancellation. Women coming for follow-up appointments and women who had to wait 10 weeks or longer were more likely to be upset by the postponement or cancellation of their appointment (p = 0.016 and p = 0.012, respectively). Nearly all (97%) of the participants were worried about possible negative effects a SARS-CoV–2 infection might have related to their fertility, pregnancy or unborn child. Sixty-one percent stated they were very or moderately concerned about the negative influence the infection might have on the womańs own health during pregnancy and 60% were very to moderately concerned about potential negative effects for the unborn child. However, only 26% reported they were very or moderately concerned about the potential negative effects of an infection on fertility. Limitations, reasons for caution The main limitations of this study are the possibility of selection bias as people with strong opinions are more likely to have participated and the lack of information on non-responders due to the study design. Also, the Covid–19 pandemic is evolving continuously meaning that participantś opinions may vary over time. Wider implications of the findings: Postponement of treatments increased distress among patients and should be avoided when possible. If unavoidable, follow-up patients should be prioritised for treatment and the length of postponement should be minimised. Fertility clinics must provide information about the current state of knowledge of SARS-Cov–2 infections in pregnancies and options for immunization. Trial registration number Not applicable

Predicting entrepreneurial motivation among university students: The role of entrepreneurship education

2016 ◽  
Vol 58 (7/8) ◽  
Author(s):  
Minoo Farhangmehr ◽  
Paulo Gonçalves ◽  
Maria Sarmento
Keyword(s):  
University Students ◽  
Knowledge Base ◽  
Design Methodology ◽  
Qualitative Interviews ◽  
Entrepreneurship Education ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Policy Makers ◽  
Entrepreneurial Motivation ◽  
The Impact

Purpose This research aims to better understand the main drivers of entrepreneurial motivation among university students and to determine whether entrepreneurship education has a moderating effect on improving the impact of knowledge base and entrepreneurship competencies on entrepreneurial motivation. Design/methodology/approach This study uses a mixed-method approach that combines qualitative interviews and a cross-sectional survey of a sample of 465 university students. Findings The study reveals that entrepreneurship competencies are a predictor of entrepreneurship motivation but that knowledge base is not. Additionally, entrepreneurship education does not improve the motivation of university students to become entrepreneurs. These findings suggest that, to increase entrepreneurial motivation, pedagogy should emphasize the development of students’ entrepreneurial psychological and social skills by covering in particular the emotional dimension and critical thinking. Originality/value This research contributes to the literature on entrepreneurship education and provides strategic recommendations for university managers and education-policy makers.

Task-shifting in Mental Health Services: Extent, Impact and Challenges in Ghana

2017 ◽  
Vol 41 (S1) ◽  
pp. S618-S618
Author(s):  
V. Agyapong
Keyword(s):  
Mental Health ◽  
Health Policy ◽  
Health Workers ◽  
Continuing Professional Development ◽  
Task Shifting ◽  
Mental Health Workers ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
The Impact

AimTo examine the role and scope of practice of community mental health workers (CMHWs) as well as the impact and challenges associated with of work of CMHWs within Ghana's mental health delivery system.MethodsA cross sectional survey of 11 psychiatrists, 29 health policy directors and 164 CMHWs as well as key informant interviews with 3 CMHWs, 5 psychiatrists and 2 health policy directors and three focus group discussions with 21 CMHWs. Results of quantitative data were analysed with SPSS version 20 whilst the results from qualitative data were analysed manually through thematic analysis.ResultsIn addition to duties prescribed in their job descriptions, all the CMHWs identified several jobs that they routinely perform including jobs reserved for higher level cadres such as medication prescribing for which most of the CMHWs have no training. Some CMHWs reported they had considered leaving the mental health profession because of the stigma, risk, lack of opportunities for continuing professional development and career progression as well as poor remuneration. Almost all the stakeholders believed CMHWs in Ghana receive adequate training for the role they are expected to play although many identify some gaps in the training of these mental health workers for the expanded roles they actually play. All the stakeholders expressed concerns about the quality of the care provided by CMHWs.ConclusionThe study highlights several important issues, which facilitate or hinder effective task-shifting arrangements from psychiatrists to CMHWs and impact on the quality of care provided by the latter.Disclosure of interestThe author has not supplied his/her declaration of competing interest.

scholarly journals The Subjective Wellbeing of Healthcare Staff and their Patients

2020 ◽  
Author(s):  
Ivo Vlaev ◽  
Henry A Lee ◽  
Paul Dolan ◽  
Ara Darzi
Keyword(s):  
Health Policy ◽  
Subjective Wellbeing ◽  
Empirical Work ◽  
Healthcare Setting ◽  
Data Sets ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
New Perspective ◽  
The Impact ◽  
The Way

Abstract Subjective wellbeing (SWB) is a broad category of phenomena that includes people’s emotional responses, domain satisfactions (e.g., health or work), and global judgements of life satisfaction. Measures of SWB offer a means to gauge the impact of events in the lives of individuals. This article examines for the first time the ways in which measures of SWB can be used within a healthcare setting, which brings a new perspective to the way that SWB is considered and applied in determining health policy. The research uses methods for SWB data collection developed through innovative empirical work. The study is a cross sectional survey of the adult inpatient population of an NHS hospital and the nurses caring for the patients, which was undertaken at two time points: summer and winter. This work on the SWB of the staff and inpatients of an acute NHS hospital generated new data sets in clinical populations. The SWB of patients was shown to be significantly affected by severe levels of EQ5D states. When considering the data on a ward-by-ward basis, it was shown that nurses health and job satisfaction were important determinants of patient SWB. We discuss the implications of this research and explain how, when and where SWB measures, when used in healthcare, can be used in health policy. We offer a novel perspective that ensures a greater focus is placed on the way that patients experience health interventions when developing health policy.

scholarly journals FAKTOR-FAKTOR YANG MEMENGARUHI KEPATUHAN PENERAPAN KAWASAN TANPA ROKOK PADA RESTORAN DI KABUPATEN TABANAN: ANALISA REGRESI LOGISTIK

2021 ◽  
Vol 8 (2) ◽  
pp. 254
Author(s):  
Putu Melda Kuswandari ◽  
Ni Made Dian Kurniasari ◽  
Putu Ayu Swandewi Astuti
Keyword(s):  
Response Rate ◽  
Smoking Ban ◽  
Rate Data ◽  
Cross Sectional ◽  
Policy Makers ◽  
Cross Sectional Design ◽  
Response Rate Data ◽  
The Impact ◽  
Restaurant Owners ◽  
Free Area

ABSTRAK Kabupaten Tabanan memberlakukan peraturan kawasan tanpa rokok pada restoran, namun dalam penerapannya masih rendah. Penelitian ini bertujuan untuk mengetahui faktor-faktor yang memengaruhi kepatuhan penerapan KTR oleh pengelola dengan memerhatikan larangan merokok total pada restoran di Kabupaten Tabanan. Penelitian ini merupakan penelitian analitik kuantitatif dengan rancangan crossectional. Sampel penelitian yaitu pengelola restoran yang berada di Kabupaten Tabanan. Besar sampel menggunakan total sampling dengan jumlah 110 restoran, dengan jumlah yang berpartisipasi 87 restoran (79% response rate). Data dianalisis dengan menggunakan regresi logistik. Hasil penelitian menunjukkan bahwa kepatuhan restoran dalam menerapkan larangan merokok total sebesar 26,44%. Faktor yang memengaruhi kepatuhan penerapan KTR yaitu umur pengelola (OR=3,45; 95% CI: 1,10-10,84), pengetahuan pengelola (OR=3,56; 95% CI: 0,96-13,16), sikap pengelola (OR=2,45; 95% CI: 0,72-8,30), serta persepsi dampak bisnis pengelola (OR=4,62; 95% CI: 1,12-19,07) berpeluang meningkatkan kepatuhan KTR. Kepatuhan pengelola restoran di Kabupaten Tabanan terhadap penerapan larangan merokok total relatif rendah. Masih banyak terdapat indikator yang belum terpenuhi dalam implementasi kepatuhan restoran. Perlu adanya dukungan berbagai sektor dalam meningkatkan kepatuhan seperti pengelola, pengunjung, maupun pemerintah sebagai pembuat kebijakan. Kata Kunci: rokok, kepatuhan, KTR, restoran.  ABSTRACT Tabanan regency applied smoke-free by law (SFL) in restaurant but the implementation was still low. This study aimed to determine the factors that influence the compliance of the implementation of smoke-free area by restaurant owners through looking complete smoking ban restaurant in Tabanan Regency. This was a quantitative analytic study with a cross-sectional design. The study samples were restaurant owners/managers in Tabanan Regency. The number of sampling on this study was set by respondent’s rate respond (79% response rate). Data was analyzed using logistic regression. The results showed that the compliance of restaurant manager to total smoking ban was low (26.44%). The factors that influence compliance SFL such as the age of the manager (OR=3.45; 95% CI: 1.10-10.84), the manager's knowledge (OR=3.56; 95% CI: 0.96-13.16), the manager’s attitude (OR=2.45; 95% CI: 0.72-8.30), as well as the perception of the impact of the manager's business (OR=4.62; 95% CI:1.12-19.07) has significantly association with compliance. The compliance of restaurant managers in Tabanan Regency on the implementation of total smoking ban was relatively low. There are still many indicators that have not been fulfilled. There needs concrete support to improving the compliance such as managers, customers, and government as policy makers. Key Words: cigarrete, compliance, smoke-free area, restaurant.

Sign in / Sign up

Export Citation Format

Share Document