An Evidence-Based Review and Meta-Analysis of Active Supervision

Active supervision—defined as circulating, scanning, interacting with students, and reinforcing demonstrations of expected academic and social behaviors by a teacher or other staff member—is often considered a component of safe and secure schools. Yet, the evidence base supporting the effectiveness of active supervision has not been synthesized or evaluated for its quality. Therefore, we conducted an evidence-based review and meta-analysis of empirical research evaluating the effects of active supervision in schools. We identified 12 research studies evaluating active supervision, assessed the quality of each study, and calculated effect sizes for student behaviors, including disruptive behavior. Results from the four studies meeting data requirements for estimating standardized mean difference effect sizes suggest that, on average, active supervision reduced problem behavior by almost 2.0 standard deviation units. Only four studies met the What Works Clearinghouse (WWC) design standards and the results of those were mixed, thus not meeting the WWC evidence-based criteria. Limitations and recommendations for future research are discussed.

Download Full-text

Quality of Research Design Moderates Effects of Grade Retention on Achievement: A Meta-Analytic, Multilevel Analysis

Educational Evaluation and Policy Analysis ◽

10.3102/0162373709352239 ◽

2009 ◽

Vol 31 (4) ◽

pp. 480-499 ◽

Cited By ~ 65

Author(s):

Chiharu S. Allen ◽

Qi Chen ◽

Victor L. Willson ◽

Jan N. Hughes

Keyword(s):

Grade Retention ◽

Negative Impact ◽

Meta Analysis ◽

Median Number ◽

Effect Sizes ◽

Future Research ◽

Negative Effects ◽

Design Quality ◽

Individual Level

The present meta-analysis examines the effect of grade retention on academic outcomes and investigates systemic sources of variability in effect sizes. Using multilevel modeling (MLM), the authors investigate characteristics of 207 effect sizes across 22 studies published between 1990 and 2007 at two levels: the study (between) and individual (within) levels. Design quality is a study-level variable. Individual-level variables are median grade retained and median number of years postretention. Quality of design is associated with less negative effects. Years postretention is negatively associated with retention effects, and this effect is stronger for studies using grade comparisons versus age comparisons. The results challenge the widely held view that retention has a negative impact on achievement. Suggestions for future research are discussed.

Download Full-text

The Impact of Malocclusion/Orthodontic Treatment Need on the Quality of Life

The Angle Orthodontist ◽

10.2319/042108-224.1 ◽

2009 ◽

Vol 79 (3) ◽

pp. 585-591 ◽

Cited By ~ 101

Author(s):

Zhijian Liu ◽

Colman McGrath ◽

Urban Hägg

Keyword(s):

Quality Of Life ◽

Orthodontic Treatment ◽

Meta Analysis ◽

Current Evidence ◽

Future Research ◽

Evidence Based ◽

Treatment Need ◽

Methodologic Quality ◽

The Impact

Abstract Objective: To assess the current evidence of the relationship between malocclusion/orthodontic treatment need and quality of life (QoL). Materials and Methods: Four electronic databases were searched for articles concerning the impact of malocclusion/orthodontic treatment need on QoL published between January 1960 and December 2007. Electronic searches were supplemented by manual searches and reference linkages. Eligible literature was reviewed and assessed by methodologic quality as well as by analytic results. Results: From 143 reviewed articles, 23 met the inclusion criteria and used standardized health-related QoL (HRQoL) and orthodontic assessment measures. The majority of studies (18/23) were conducted among child/adolescent populations. Seventeen of the papers were categorized as level 1 or 2 evidence based on the criteria of the Oxford Centre for Evidence-Based Medicine. An observed association between HRQoL and malocclusion/orthodontic treatment need was generally detected irrespective of how they were assessed. However, the strength of the association could be described as modest at best. Key findings and future research considerations are described in the review. Conclusions: Findings of this review suggest that there is an association (albeit modest) between malocclusion/orthodontic treatment need and QoL. There is a need for further studies of their relationship, particularly studies that employ standardized assessment methods so that outcomes are uniform and thus amenable to meta-analysis.

Download Full-text

Evidence-Based Healthcare: The Importance of Effective Interprofessional Working for High Quality Veterinary Services, a UK Example

Veterinary Evidence ◽

10.18849/ve.v1i4.54 ◽

2016 ◽

Vol 1 (4) ◽

Cited By ~ 1

Author(s):

Tierney Kinnison ◽

Stephen A May

Keyword(s):

Service Delivery ◽

Evidence Base ◽

Patient Treatment ◽

Future Research ◽

Evidence Based ◽

Veterinary Services ◽

Interprofessional Working ◽

Evidence Based Healthcare ◽

The Uk

Objective: To highlight the importance of evidence-based research, not only for the consideration of clinical diseases and individual patient treatment, but also for investigating complex healthcare systems, as demonstrated through a focus on veterinary interprofessional working.Background:Evidence-Based Veterinary Medicine (EBVM) was developed due to concerns over inconsistent approaches to therapy being delivered by individuals. However, a focus purely on diagnosis and treatment will miss other potential causes of substandard care including the holistic system. Veterinary services are provided by interprofessional teams; research on these teams is growing.Evidentiary value:This paper outlines results from four articles, written by the current authors, which are unique in their focus on interprofessional practice teams in the UK. Through mixed methods, the articles demonstrate an evidence base of the effects of interprofessional working on the quality of service delivery.Results:The articles explored demonstrate facilitators and challenges of the practice system on interprofessional working and the outcomes, including errors. The results encourage consideration of interprofessional relationships and activities in veterinary organisations. Interprofessional working is an example of one area which can affect the quality of veterinary services.Conclusion: The papers presented on veterinary interprofessional working are an example of the opportunities for future research on various topics within evidence-based healthcare.Application:The results are pertinent to members of veterinary teams seeking to improve their service delivery, to educators looking to enhance their students’ understanding of interprofessional working, and to researchers, who will hopefully be encouraged to consider evidence-based healthcare more holistically. <img src="https://www.veterinaryevidence.org/rcvskmod/icons/oa-icon.jpg" alt="Open Access" /> <img src="https://www.veterinaryevidence.org/rcvskmod/icons/pr-icon.jpg" alt="Peer Reviewed" />

Download Full-text

REGISTERING AND REPORTING SYSTEMATIC REVIEWS

Central Asian Journal of Medical Hypotheses and Ethics ◽

10.47316/cajmhe.2020.1.2.03 ◽

2021 ◽

Vol 1 (2) ◽

pp. 122-126

Author(s):

Pallavi Patro ◽

Durga Prasanna Misra

Keyword(s):

Systematic Reviews ◽

Observational Studies ◽

Meta Analysis ◽

Future Research ◽

Evidence Based ◽

Extensive Literature ◽

Literature Searches ◽

Review Question ◽

Based Medicine

Systematic reviews are considered as the highest rung in the ladder of evidence-based medicine. They are bound by a pre-defined structure and requirement for extensive literature searches, when compared with the more liberal format of narrative reviews. Systematic review protocols should ideally be pre-registered to avoid duplication or redundancy. After defining clear review question(s), thorough literature searches form the basis of systematic reviews. Presentation of results should be qualitative or quantitative (meta-analysis) if the data is homogenous enough to permit pooling across multiple studies. Quality of individual studies by Cochrane risk of bias 2 tool for interventional studies and other suitable scales for observational studies, as well as appropriate assessment of publication bias are recommended. Certainty of outcomes should be assessed by the GRADE profiler. Finally, systematic reviews should conclude with recommendations for future research, based on their findings.

Download Full-text

Meta-analysis provides evidence-based effect sizes for a cancer-specific quality-of-life questionnaire, the FACT-G

Journal of Clinical Epidemiology ◽

10.1016/j.jclinepi.2009.05.001 ◽

2010 ◽

Vol 63 (3) ◽

pp. 270-281 ◽

Cited By ~ 25

Author(s):

Madeleine T. King ◽

Martin R. Stockler ◽

David F. Cella ◽

David Osoba ◽

David T. Eton ◽

...

Keyword(s):

Quality Of Life ◽

Meta Analysis ◽

Effect Sizes ◽

Evidence Based ◽

Life Questionnaire ◽

Quality Of Life Questionnaire

Download Full-text

Critical appraisal and meta-analysis of biological variation studies on glycosylated albumin, glucose and HbA1c

Advances in Laboratory Medicine / Avances en Medicina de Laboratorio ◽

10.1515/almed-2020-0029 ◽

2020 ◽

Vol 1 (3) ◽

Author(s):

Carmen Ricós ◽

Pilar Fernández-Calle ◽

Elisabet Gonzalez-Lao ◽

Margarida Simón ◽

Jorge Díaz-Garzón ◽

...

Keyword(s):

Healthy Subjects ◽

Critical Appraisal ◽

Meta Analysis ◽

Biological Variation ◽

Evidence Based ◽

Literature Searches ◽

Variation Data ◽

Global Estimates ◽

Systematic Literature Searches

AbstractObjectivesNumerous biological variation (BV) studies have been performed over the years, but the quality of these studies vary. The objectives of this study were to perform a systematic review and critical appraisal of BV studies on glycosylated albumin and to deliver updated BV estimates for glucose and HbA1c, including recently published high-quality studies such as the European Biological Variation study (EuBIVAS).MethodsSystematic literature searches were performed to identify BV studies. Nine publications not included in a previous review were identified; four for glycosylated albumin, three for glucose, and three for HbA1c. Relevant studies were appraised by the Biological Variation Data Critical Appraisal Checklist (BIVAC). Global BV estimates were derived by meta-analysis of BIVAC-compliant studies in healthy subjects with similar study design.ResultsOne study received BIVAC grade A, 2B, and 6C. In most cases, the C-grade was associated with deficiencies in statistical analysis. BV estimates for glycosylated albumin were: CVI=1.4% (1.2–2.1) and CVG=5.7% (4.7–10.6), whereas estimates for HbA1c, CVI=1.2% (0.3–2.5), CVG=5.4% (3.3–7.3), and glucose, CVI=5.0% (4.1–12.0), CVG=8.1% (2.7–10.8) did not differ from previously published global estimates.ConclusionsThe critical appraisal and rating of BV studies according to their methodological quality, followed by a meta-analysis, generate robust, and reliable BV estimates. This study delivers updated and evidence-based BV estimates for glycosylated albumin, glucose and HbA1c.

Download Full-text

Updated systematic review and meta-analysis of studies examining the relationship between reported racism and health and well-being for children and youth: a protocol

BMJ Open ◽

10.1136/bmjopen-2020-043722 ◽

2021 ◽

Vol 11 (6) ◽

pp. e043722

Author(s):

Naomi Priest ◽

Kate Doery ◽

Mandy Truong ◽

Shuaijun Guo ◽

Ryan Perry ◽

...

Keyword(s):

Systematic Review ◽

Health Outcomes ◽

Research Policy ◽

Meta Analysis ◽

Well Being ◽

Children And Youth ◽

Effect Sizes ◽

Future Research ◽

Critical Determinant ◽

Health And Well Being

IntroductionRacism is a critical determinant of health and health inequities for children and youth. This protocol aims to update the first systematic review conducted by Priest et al (2013), including a meta-analysis of findings. Based on previous empirical data, it is anticipated that child and youth health will be negatively impacted by racism. Findings from this review will provide updated evidence of effect sizes across outcomes and identify moderators and mediators of relationships between racism and health.Methods and analysisThis systematic review and meta-analysis will include studies that examine associations between experiences of racism and racial discrimination with health outcomes of children and youth aged 0–24 years. Exposure measures include self-reported or proxy reported systemic, interpersonal and intrapersonal racism. Outcome measures include general health and well-being, physical health, mental health, biological markers, healthcare utilisation and health behaviours. A comprehensive search of studies from the earliest time available to October 2020 will be conducted. A random effects meta-analysis will examine the average effect of racism on a range of health outcomes. Study-level moderation will test the difference in effect sizes with regard to various sample and exposure characteristics. This review has been registered with the International Prospective Register of Systematic Reviews.Ethics and disseminationThis review will provide evidence for future research within the field and help to support policy and practice development. Results will be widely disseminated to both academic and non-academic audiences through peer-review publications, community summaries and presentations to research, policy, practice and community audiences.PROSPERO registration numberCRD42020184055.

Download Full-text

Macro-level Criminological Perspectives and School Delinquency: A Meta-analysis

Youth & Society ◽

10.1177/0044118x211022387 ◽

2021 ◽

pp. 0044118X2110223

Author(s):

Natasha Pusch

Keyword(s):

Social Cohesion ◽

Meta Analysis ◽

School Level ◽

Effect Sizes ◽

Macro Level ◽

Future Research ◽

Concentrated Disadvantage ◽

Individual Level ◽

School Differences ◽

Academic Implications

School delinquency in public elementary, middle, and high schools has decreased in recent years, but is still a major issue that has negative mental health and academic implications for adolescents. Although research has focused on both individual-level and school-level explanations of school delinquency, it is not yet clear which macro-level criminological perspectives best explains it. Using 656 effect sizes nested within 75 studies and 30 unique datasets, this study addresses two questions using meta-analytic methods: Which macro-level criminological perspectives explain between-school differences in delinquency? Are effect sizes invariant across samples and research design? Results indicate that only concentrated disadvantage and social cohesion are significantly related to school delinquency. With the exception of concentrated disadvantage, effects are homogenous. This suggests that some school-level explanations are useful and future research should not exclude these factors. Practical implications suggest that improving social cohesion in schools may be more effective at preventing violence than target-hardening efforts.

Download Full-text

Effectiveness of Digital Health Interventions on Unintentional Injury, Violence, and Suicide: Meta-Analysis

Trauma Violence & Abuse ◽

10.1177/1524838020967346 ◽

2020 ◽

pp. 152483802096734

Author(s):

Mengtong Chen ◽

Ko Ling Chan

Keyword(s):

Interpersonal Violence ◽

Care Delivery ◽

Digital Health ◽

Meta Analysis ◽

Random Effect ◽

Unintentional Injury ◽

Health Interventions ◽

Effect Sizes ◽

Future Research ◽

Face To Face

Digital technologies are increasingly used in health-care delivery and are being introduced into work to prevent unintentional injury, violence, and suicide to reduce mortality. To understand the potential of digital health interventions (DHIs) to prevent and reduce these problems, we conduct a meta-analysis and provide an overview of their effectiveness and characteristics related to the effects. We searched electronic databases and reference lists of relevant reviews to identify randomized controlled trials (RCTs) published in or before March 2020 evaluating DHIs on injury, violence, or suicide reduction. Based on the 34 RCT studies included in the meta-analysis, the overall random effect size was 0.21, and the effect sizes for reducing suicidal ideation, interpersonal violence, and unintentional injury were 0.17, 0.24, and 0.31, respectively, which can be regarded as comparable to the effect sizes of traditional face-to-face interventions. However, there was considerable heterogeneity between the studies. In conclusion, DHIs have great potential to reduce unintentional injury, violence, and suicide. Future research should explore DHIs’ successful components to facilitate future implementation and wider access.

Download Full-text

The quality of research exploring in-session measures of CBT competence: a systematic review

Behavioural and Cognitive Psychotherapy ◽

10.1017/s1352465821000242 ◽

2021 ◽

pp. 1-17

Author(s):

Kathryn Rayson ◽

Louise Waddington ◽

Dougal Julian Hare

Keyword(s):

English Language ◽

Research Training ◽

Evidence Base ◽

Small Sample ◽

Measurement Properties ◽

Future Research ◽

Sample Sizes ◽

Fidelity Assessment ◽

Quality Of Research

Abstract Background: Cognitive behavioural therapy (CBT) is in high demand due to its strong evidence base and cost effectiveness. To ensure CBT is delivered as intended in research, training and practice, fidelity assessment is needed. Fidelity is commonly measured by assessors rating treatment sessions, using CBT competence scales (CCSs). Aims: The current review assessed the quality of the literature examining the measurement properties of CCSs and makes recommendations for future research, training and practice. Method: Medline, PsychINFO, Scopus and Web of Science databases were systematically searched to identify relevant peer-reviewed, English language studies from 1980 onwards. Relevant studies were those that were primarily examining the measurement properties of CCSs used to assess adult 1:1 CBT treatment sessions. The quality of studies was assessed using a novel tool created for this study, following which a narrative synthesis is presented. Results: Ten studies met inclusion criteria, most of which were assessed as being ‘fair’ methodological quality, primarily due to small sample sizes. Construct validity and responsiveness definitions were applied inconsistently in the studies, leading to confusion over what was being measured. Conclusions: Although CCSs are widely used, we need to pay careful attention to the quality of research exploring their measurement properties. Consistent definitions of measurement properties, consensus about adequate sample sizes and improved reporting of individual properties are required to ensure the quality of future research.

Download Full-text