Reviewing and Benchmarking Adventure Therapy Outcomes: Applications of Meta-Analysis

2003 ◽  
Vol 25 (3) ◽  
pp. 316-321 ◽  
Author(s):  
James T. Neill
Keyword(s):  
Outdoor Education ◽  
Program Effectiveness ◽  
Meta Analysis ◽  
Adventure Therapy ◽  
Therapy Outcomes ◽  
Program Outcomes ◽  
School Settings ◽  
Therapy Program ◽  
Psychological Training ◽  
Meta Analyses

This article summarizes evidence from meta-analyses of outdoor education, psychotherapy, and education which can he used to help determine the relative efficacy of adventure therapy programs. The major outdoor education meta-analysis by Hattie, Marsh, Neill, and Richards (1997) cites an effect size of .34 for immediate program effectiveness. Meta-analytic studies of innovative education programs in school settings report similar effects (Hattie et al., Hattie, 1992, 1993), while psychological training meta-analyses report slightly higher effects (Lipsey & Wilson, 1993), and meta-analyses of psychotherapy effectiveness find stronger effects (Casey St Berman, 1985; Smith, Glass, & Miller, 1980). This article derives outcome benchmarks for adventure therapy program outcomes taken from existing outdoor education, psychological, and educational meta-analyses, and recommends that the benchmarks be used in adventure therapy research and evaluation to allow for more accurate assessments of program's effectiveness. The suggested benchmarks should be used only as guides, and should be refined in future by meta-analyses of adventure therapy outcomes.

Volunteer Programs Supporting People With Dementia/Delirium in Hospital: Systematic Review and Meta-Analysis

2020 ◽  
Author(s):  
Elizabeth Pritchard ◽  
Sze-Ee Soh ◽  
Renata Morello ◽  
Danielle Berkovic ◽  
Annaliese Blair ◽  
...  
Keyword(s):  
Length Of Stay ◽  
Rate Ratio ◽  
Program Effectiveness ◽  
Meta Analysis ◽  
Risk Of Bias ◽  
Narrative Synthesis ◽  
Program Outcomes ◽  
Volunteer Program ◽  
People With Dementia ◽  
Volunteer Programs

Abstract Background and Objectives Volunteer-delivered programs to assist people with dementia and/or delirium in-hospital can provide person-centered one-on-one support in addition to usual care. These programs could mitigate hospital resource demands; however, their effectiveness is unknown. This review evaluated literature of volunteer programs in acute hospital settings for people living with dementia and/or delirium. Research Design and Methods Four databases were searched. Studies that reported patient or program outcomes were included (i.e., delirium incidence, length of stay, number of falls, satisfaction). Risk of bias was completed. Meta-analysis was performed where 2 or more studies measured the same outcome. Narrative synthesis was performed on the qualitative results. Results Eleven studies were included in the review, with varied design, participant groups and outcomes measured. Risk of bias averaged 71%. Volunteer-delivered programs addressed delirium risk factors, for example, hydration/nutrition, mobility, use of sensory aids. Eight patients and 6 program outcomes were captured, but only 3 patient outcomes could be pooled. Meta-analyses demonstrated a reduction in delirium incidence (rate ratio = 0.65; 95% confidence interval [CI] 0.47, 0.90) but no reduction in length of stay (mean difference −1.09; 95% CI −0.58, 2.77) or number of falls (rate ratio = 0.67; 95% CI 0.19, 2.35). Narrative synthesis identified benefits to patients (e.g., less loneliness), volunteers (sense of meaning), and staff (timesaving, safety). Discussion and Implications Volunteer-delivered programs for inpatients with dementia and/or delirium may provide benefits for patients, volunteers, and staff. However, studies conducted with more robust designs are required to determine overall effectiveness on program outcomes. Further high-quality research appropriate for this vulnerable population is required to identify volunteer program effectiveness.

A Meta-Analysis of Adventure Therapy Outcomes and Moderators

2013 ◽  
Vol 6 (1) ◽  
pp. 28-53 ◽  
Author(s):  
Daniel J. Bowen ◽  
James T. Neill
Keyword(s):  
Effect Size ◽  
Meta Analysis ◽  
Adventure Therapy ◽  
Therapy Outcomes ◽  
Short Term ◽  
Analytic Review ◽  
Comparison Groups ◽  
The 1960S ◽  
Therapy Studies

This study reports on a meta-analytic review of 197 studies of adventure therapy participant outcomes (2,908 effect sizes, 206 unique samples). The short-term effect size for adventure therapy was moderate (g = .47) and larger than for alternative (.14) and no treatment (.08) comparison groups. There was little change during the lead-up (.09) and follow- up periods (.03) for adventure therapy, indicating long-term maintenance of the short-term gains. The short-term adventure therapy outcomes were significant for seven out of the eight outcome categories, with the strongest effects for clinical and self-concept measures, and the smallest effects for spirituality/morality. The only significant moderator of outcomes was a positive relationship with participant age. There was also evidence that adventure therapy studies have reported larger effects over time since the 1960s. Publication bias analyses indicated that the study may slightly underestimate true effects. Overall, the findings provide the most robust meta-analysis of the effects of adventure therapy to date. Thus, an effect size of approximately .5 is suggested as a benchmark for adventure therapy programs, although this should be adjusted according to the age group.

Managing Countertransference

2019 ◽  
pp. 522-548
Author(s):  
Jeffrey A. Hayes ◽  
Charles J. Gelso ◽  
D. Martin Kivlighan ◽  
Simon B. Goldberg
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Psychotherapy Outcome ◽  
Psychotherapy Outcomes ◽  
Therapy Outcomes ◽  
Management Factors ◽  
Definition Of ◽  
Meta Analyses

This chapter reviews the history and definition of countertransference, as well as empirical research on countertransference, its management, and the relation of both to psychotherapy outcome. Three meta-analyses are presented, as well as studies that illustrate findings from the meta-analyses. The first meta-analysis indicated that countertransference reactions are related inversely and modestly to psychotherapy outcomes (r = –.16, d = –.33, k = 14 studies, N = 973). A second meta-analysis supported the notion that countertransference management factors attenuate countertransference reactions (r = –.27, d = –.55, k = 13 studies, N = 1,065). The final meta-analysis revealed that successful countertransference management is related to better therapy outcomes (r = .39, d = .84, k = 9 studies, N = 392 participants). The authors conclude by summarizing the limitations of the research base, noting diversity considerations, and highlighting the therapeutic practices predicated on research.

The Effectiveness of Educational Interventions on Traditional Bullying and Cyberbullying Among Adolescents: A Systematic Review and Meta-Analysis

2020 ◽  
pp. 152483802093386
Author(s):  
Esperanza Debby Ng ◽  
Joelle Yan Xin Chua ◽  
Shefaly Shorey
Keyword(s):  
Systematic Review ◽  
Program Effectiveness ◽  
Meta Analysis ◽  
Random Effect ◽  
Random Effect Model ◽  
Educational Interventions ◽  
Traditional Bullying ◽  
Mean Differences ◽  
Bullying Interventions ◽  
Meta Analyses

In consideration of the adverse societal, physical, and psychological impacts of bullying on a child’s development and future, many studies have developed anti-bullying programs and educational interventions to curb bullying occurrences. Therefore, this systematic review aimed to examine the effectiveness of such educational interventions at reducing the frequencies of traditional bullying or cyberbullying and cybervictimization among adolescents. A comprehensive search was conducted using PubMed, Embase, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, Google Scholar, and ProQuest Dissertations and Theses. Only quantitative studies that reported the effects of educational interventions on reducing the frequencies of traditional bullying or cyberbullying victimization and perpetration were included. Seventeen studies ( N total = 35,694 adolescents, Rangechild age = 10–18 years) were finalized, and meta-analyses were conducted using a random effect model. Overall, the existing educational interventions had very small to small effect sizes on traditional bullying and cyberbullying perpetration (traditional: standardized mean differences [SMD] = −.30 and cyber: SMD = −.16) and victimization (traditional: SMD = −18 and cyber: SMD = −.13) among adolescents. Type of intervention (i.e., whole school–based or classroom-based), program duration, and presence of parental involvement did not moderate program effectiveness, but cyberbullying programs were more effective when delivered by technology-savvy content experts compared to teachers. Since existing educational interventions were marginally effective in reducing bullying frequencies, further research is needed to identify key moderators that enhance educational programs or develop alternative forms of anti-bullying interventions.

scholarly journals Resilience Programs for Children and Adolescents: A Systematic Review and Meta-Analysis

2021 ◽  
Vol 12 ◽  
Author(s):  
Tatiana Matheus Pinto ◽  
Paulo Guirro Laurence ◽  
Cristiane Rufino Macedo ◽  
Elizeu Coutinho Macedo
Keyword(s):  
Systematic Review ◽  
Program Effectiveness ◽  
Meta Analysis ◽  
Controlled Trials ◽  
Childhood And Adolescence ◽  
Cochrane Central Register ◽  
Clinical Trial Registration ◽  
Treatment As Usual ◽  
Meta Analyses

Resilience may be defined as the ability to recover and adapt to adverse situations. Given that resilience involves cognitive and behavioral aspects, it could be promoted based on strategies that favor them, especially during childhood and adolescence. As a result, several resilience-focused programs have been developed and studied. This systematic review of Randomized Controlled Trials (RCTs) aimed to assess resilience-focused programs for children (<12 years old) and adolescents (12–22 years old) compared to active (treatment as usual, other program modalities, and educational curriculum at school) or inactive (waiting list, no treatment) control groups. We performed a systematic review of meta-analyses of RCTs. The following databases were searched: Cochrane Central Register of Controlled Trials (CENTRAL), PubMed, Embase, and PsycINFO. Two authors independently selected the studies, extracted the data, and assessed the studies’ risk of bias. Meta-analyses of random effects were conducted to calculate the standard mean differences (SMD) and 95% confidence interval (CI) of program effectiveness. Of the 17 RCTs that met the inclusion criteria, 13 provided sufficient data to assess the effectiveness of the programs after their implementation. Meta-analyses indicated overall effectiveness of the programs in promoting resilience (SMD = 0.48, 95% CI [0.15, 0.81], p = 0.0077). The subgroup analysis indicated effectiveness only among adolescents’ resilience (SMD = 0.48, 95% CI [0.08, 0.88], p = 0.02). The follow-up analysis also indicated evidence of continuation of results within a period of up to 6 months up (SMD = 0.12, 95% CI [−0.44, 0.69], p = 0.02). These results indicated the effectiveness of promoting resilience, especially in adolescents, and its continuation in follow-up analyses. These findings are promising in the field of resilience programs; however, further studies are necessary to analyze the different possible characteristics of programs and their results.Clinical Trial Registration: [https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020179874], [CRD42020179874].

A Meta-Analysis of Interviews and Cognitive Ability

2013 ◽  
Vol 12 (4) ◽  
pp. 157-169 ◽  
Author(s):  
Philip L. Roth ◽  
Allen I. Huffcutt
Keyword(s):  
Cognitive Ability ◽  
Meta Analysis ◽  
Incremental Validity ◽  
Employment Interviews ◽  
Moderator Analysis ◽  
The Future ◽  
Research Questions ◽  
Meta Analyses ◽  
The Relationship

The topic of what interviews measure has received a great deal of attention over the years. One line of research has investigated the relationship between interviews and the construct of cognitive ability. A previous meta-analysis reported an overall corrected correlation of .40 ( Huffcutt, Roth, & McDaniel, 1996 ). A more recent meta-analysis reported a noticeably lower corrected correlation of .27 ( Berry, Sackett, & Landers, 2007 ). After reviewing both meta-analyses, it appears that the two studies posed different research questions. Further, there were a number of coding judgments in Berry et al. that merit review, and there was no moderator analysis for educational versus employment interviews. As a result, we reanalyzed the work by Berry et al. and found a corrected correlation of .42 for employment interviews (.15 higher than Berry et al., a 56% increase). Further, educational interviews were associated with a corrected correlation of .21, supporting their influence as a moderator. We suggest a better estimate of the correlation between employment interviews and cognitive ability is .42, and this takes us “back to the future” in that the better overall estimate of the employment interviews – cognitive ability relationship is roughly .40. This difference has implications for what is being measured by interviews and their incremental validity.

Power-Enhanced Funnel Plots for Meta-Analysis

2020 ◽  
Vol 228 (1) ◽  
pp. 43-49 ◽  
Author(s):  
Michael Kossmeier ◽  
Ulrich S. Tran ◽  
Martin Voracek
Keyword(s):  
Statistical Power ◽  
Meta Analysis ◽  
Relevant Information ◽  
Selective Reporting ◽  
Graphical Display ◽  
Funnel Plot ◽  
Evidential Value ◽  
Graphical Displays ◽  
Funnel Plots ◽  
Meta Analyses

Abstract. Currently, dedicated graphical displays to depict study-level statistical power in the context of meta-analysis are unavailable. Here, we introduce the sunset (power-enhanced) funnel plot to visualize this relevant information for assessing the credibility, or evidential value, of a set of studies. The sunset funnel plot highlights the statistical power of primary studies to detect an underlying true effect of interest in the well-known funnel display with color-coded power regions and a second power axis. This graphical display allows meta-analysts to incorporate power considerations into classic funnel plot assessments of small-study effects. Nominally significant, but low-powered, studies might be seen as less credible and as more likely being affected by selective reporting. We exemplify the application of the sunset funnel plot with two published meta-analyses from medicine and psychology. Software to create this variation of the funnel plot is provided via a tailored R function. In conclusion, the sunset (power-enhanced) funnel plot is a novel and useful graphical display to critically examine and to present study-level power in the context of meta-analysis.

Which Data to Meta-Analyze, and How?

2019 ◽  
Vol 227 (1) ◽  
pp. 64-82 ◽  
Author(s):  
Martin Voracek ◽  
Michael Kossmeier ◽  
Ulrich S. Tran
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Curve Analysis ◽  
Research Progress ◽  
Primary Data ◽  
Statistical Procedures ◽  
Graphical Displays ◽  
Primary Data Analysis ◽  
Meta Analyses ◽  
Data Analytic

Abstract. Which data to analyze, and how, are fundamental questions of all empirical research. As there are always numerous flexibilities in data-analytic decisions (a “garden of forking paths”), this poses perennial problems to all empirical research. Specification-curve analysis and multiverse analysis have recently been proposed as solutions to these issues. Building on the structural analogies between primary data analysis and meta-analysis, we transform and adapt these approaches to the meta-analytic level, in tandem with combinatorial meta-analysis. We explain the rationale of this idea, suggest descriptive and inferential statistical procedures, as well as graphical displays, provide code for meta-analytic practitioners to generate and use these, and present a fully worked real example from digit ratio (2D:4D) research, totaling 1,592 meta-analytic specifications. Specification-curve and multiverse meta-analysis holds promise to resolve conflicting meta-analyses, contested evidence, controversial empirical literatures, and polarized research, and to mitigate the associated detrimental effects of these phenomena on research progress.

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Laser Influence on Dental Sensitivity Compared to Other Light Sources Used During In-office Dental Bleaching: Systematic Review and Meta-analysis

2020 ◽  
Vol 45 (6) ◽  
pp. 589-597
Author(s):  
BGS Casado ◽  
EP Pellizzer ◽  
JR Souto Maior ◽  
CAA Lemos ◽  
BCE Vasconcelos ◽  
...  
Keyword(s):  
Randomized Clinical Trials ◽  
Color Change ◽  
Meta Analysis ◽  
Present Review ◽  
Cochrane Library ◽  
Light Sources ◽  
Eligibility Criteria ◽  
Tooth Color ◽  
Significant Difference ◽  
Meta Analyses

Clinical Relevance The use of laser light during bleaching will not reduce the incidence or severity of sensitivity and will not increase the degree of color change compared with nonlaser light sources. SUMMARY Objective: To evaluate whether the use of laser during in-office bleaching promotes a reduction in dental sensitivity after bleaching compared with other light sources. Methods: The present review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and is registered with PROSPERO (CDR42018096591). Searches were conducted in the PubMed/Medline, Web of Science, and Cochrane Library databases for relevant articles published up to August 2018. Only randomized clinical trials among adults that compared the use of laser during in-office whitening and other light sources were considered eligible. Results: After analysis of the texts retrieved during the database search, six articles met the eligibility criteria and were selected for the present review. For the outcome dental sensitivity, no significant difference was found favoring any type of light either for intensity (mean difference [MD]: −1.60; confidence interval [CI]: −3.42 to 0.22; p=0.09) or incidence (MD: 1.00; CI: 0.755 to 1.33; p=1.00). Regarding change in tooth color, no significant differences were found between the use of the laser and other light sources (MD: −2.22; CI: −6.36 to 1.93; p=0.29). Conclusions: Within the limitations of the present study, laser exerts no influence on tooth sensitivity compared with other light sources when used during in-office bleaching. The included studies demonstrated that laser use during in-office bleaching may have no influence on tooth color change.

Sign in / Sign up

Export Citation Format

Share Document