scholarly journals Complementary Meta-Analytic Methods for the Quantitative Review of Research: 1. A Theoretical Overview

2013 ◽  
Vol 4 (2) ◽  
pp. 21
Author(s):  
Aurelio José Figueredo ◽  
Candace Jasmine Black ◽  
Anne Grete Scott
Keyword(s):  
Meta Analysis ◽  
Effect Sizes ◽  
Quantitative Review ◽  
Analytic Methods ◽  
Meta Analyses ◽  
The Relationship ◽  
Theoretical Overview

Contents Meta-Analysis is a procedure designed to quantitatively analyze the methodological characteristics in studies sampled in conventional meta-analyses to assess the relationship between methodologies and outcomes. This article presents the rationale and procedures for conducting a Contents Meta-Analysis in conjunction with conventional Effects Meta-analysis. We provide an overview of the pertinent limitations of conventional meta-analysis from methodological and meta-scientific standpoint. We then introduce novel terminology distinguishing different kinds of complementary meta-analyses that address many of the problems previously identified for conventional meta-analyses. We would also like to direct readers to the second paper in this series (Figueredo, Black, & Scott, this issue), which demonstrates the utility of Contents Meta-Analysis with an empirical example and present findings regarding the generalizability of the effect sizes estimated. DOI:10.2458/azu_jmmss_v4i2_figueredo2

scholarly journals Complementary Meta-Analytic Methods for the Quantitative Review of Research: 1. A Theoretical Overview

2013 ◽  
Vol 4 (2) ◽  
pp. 21 ◽  
Author(s):  
Aurelio José Figueredo ◽  
Candace Jasmine Black ◽  
Anne Grete Scott
Keyword(s):  
Meta Analysis ◽  
Effect Sizes ◽  
Quantitative Review ◽  
Analytic Methods ◽  
Meta Analyses ◽  
The Relationship ◽  
Theoretical Overview

Contents Meta-Analysis is a procedure designed to quantitatively analyze the methodological characteristics in studies sampled in conventional meta-analyses to assess the relationship between methodologies and outcomes. This article presents the rationale and procedures for conducting a Contents Meta-Analysis in conjunction with conventional Effects Meta-analysis. We provide an overview of the pertinent limitations of conventional meta-analysis from methodological and meta-scientific standpoint. We then introduce novel terminology distinguishing different kinds of complementary meta-analyses that address many of the problems previously identified for conventional meta-analyses. We would also like to direct readers to the second paper in this series (Figueredo, Black, & Scott, this issue), which demonstrates the utility of Contents Meta-Analysis with an empirical example and present findings regarding the generalizability of the effect sizes estimated. DOI:10.2458/azu_jmmss_v4i2_figueredo2

scholarly journals Adolescent Sport Participation and Symptoms of Anxiety and Depression: A Systematic Review and Meta-Analysis

2020 ◽  
Vol 42 (3) ◽  
pp. 201-218
Author(s):  
Michael J. Panza ◽  
Scott Graupensperger ◽  
Jennifer P. Agans ◽  
Isabelle Doré ◽  
Stewart A. Vella ◽  
...  
Keyword(s):  
Systematic Review ◽  
Sport Participation ◽  
Causal Effect ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Anxiety And Depression ◽  
Organized Sport ◽  
Protective Environment ◽  
Meta Analyses ◽  
The Relationship

Sport may protect against symptoms of mental disorders that are increasingly prevalent among adolescents. This systematic review explores the relationship between adolescent organized sport participation and self-reported symptoms of anxiety and depression. From 9,955 records screened, 29 unique articles were selected that included 61 effect sizes and 122,056 participants. Effects were clustered into four categories based on the operationalization of sport involvement: absence or presence of involvement, frequency of involvement, volume of involvement, and duration of participation. Results from the random-effects meta-analyses indicated that symptoms of anxiety and depression were significantly lower among sport-involved adolescents than in those not involved in sport, although this effect size was small in magnitude. Meta-regression was used to identify how age and sex explained heterogeneity in effects. Although these results do not signify a causal effect, they do support theorizing that sport participation during adolescence may be a protective environment against anxiety and depressive symptoms.

scholarly journals Examining Psychological Science through Systematic Meta-Method Analysis: A Call for Research

2019 ◽  
Author(s):  
Malte Elson
Keyword(s):  
Data Collection ◽  
Meta Analysis ◽  
Research Synthesis ◽  
Effect Sizes ◽  
Psychological Science ◽  
Meta Analyses ◽  
The Relationship ◽  
Method Analysis

Research synthesis is based on the assumption that when the same association between constructs is observed repeatedly in a field, the relationship is probably real, even if its exact magnitude can be debated. Yet this probability is not only a function of recurring results, but also of the quality and consistency in the empirical procedures that produced those results and that any meta-analysis necessarily inherits. Standardized protocols in data collection, analysis, and interpretation are important empirical properties, and a healthy sign of a discipline's maturity.This manuscript proposes that meta-analyses as typically applied in psychology benefit from complementing their aggregates of observed effect sizes by systematically examining the standardization of methodology that deterministically produced them. Potential units of analyses are described and two examples are offered to illustrate the benefits of such efforts. Ideally, this synergetic approach emphasizes the role of methods in advancing theory by improving the quality of meta-analytic inferences.

Linking attachment to empathy in childhood and adolescence: A multilevel meta-analysis

2021 ◽  
pp. 026540752110310
Author(s):  
Song Li ◽  
Guangming Ran ◽  
Xu Chen
Keyword(s):  
Resource Sharing ◽  
Literature Search ◽  
Social Bonds ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Childhood And Adolescence ◽  
Secure Attachment ◽  
Avoidant Attachment ◽  
Meta Analyses ◽  
The Relationship

From promoting cooperation and resource sharing to forming and maintaining harmonious social bonds, empathy plays a key role in everyday life. However, despite the theoretical relevance of attachment to empathy, questions remain about the strength of the association between these two variables in childhood and adolescence. Thus, a series of multilevel meta-analyses were conducted to determine the strength of the relationship between each of the attachment patterns and empathy, and to test potential moderators altering this relationship in individuals aged 0 to 18 years. In total, 159 effect sizes from 50 studies, assessing 66 independent samples, including 29,653 young people, were retrieved by a systematic literature search. The results revealed that secure attachment was positively correlated with empathy, ambivalent attachment was not associated with empathy, and avoidant attachment was negatively related to empathy. In addition, the multivariate analysis showed that the dimension of empathy moderated the relationship between secure attachment and empathy. In sum, the findings of the current study were crucial for understanding the association between attachment and empathy in childhood and adolescence.

scholarly journals The longitudinal and concurrent relationship between caregiver sensitivity and preschool attachment: A systematic review and meta-analysis

PLoS ONE ◽  
2021 ◽  
Vol 16 (1) ◽  
pp. e0245061
Author(s):  
Monica C. O’Neill ◽  
Shaylea Badovinac ◽  
Rebecca Pillai Riddell ◽  
Jean-François Bureau ◽  
Carla Rumeo ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Classification Systems ◽  
Effect Sizes ◽  
Medium Effect ◽  
Future Directions ◽  
Longitudinal Association ◽  
Registration Number ◽  
Meta Analyses ◽  
The Relationship

The present study aimed to systematically review and meta-analyze the concurrent and longitudinal relationship between caregiver sensitivity and preschool attachment measured using the Main and Cassidy (1988) and Cassidy and Marvin (1992) attachment classification systems. This review was pre-registered with the International Prospective Register of Systematic Reviews (PROSPERO; Registration Number CRD42017073417) and completed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The present review identified 36 studies made up of 21 samples (N = 3, 847) examining the relationship between caregiver sensitivity and preschool attachment. Eight primary meta-analyses were conducted separately according to the proximity of the assessment of sensitivity to attachment (i.e., concurrent versus longitudinal), operationalization of caregiver sensitivity (i.e., unidimensional versus multidimensional) and attachment categorizations (i.e., secure-insecure versus organized-disorganized). Overall, the meta-analyses revealed higher levels of caregiver sensitivity among caregivers with secure and organized preschoolers, relative to insecure and disorganized preschoolers, respectively. Medium effect sizes (g = .46 to .59) were found for both longitudinal and concurrent associations between caregiver sensitivity and preschool attachment when a unidimensional measure of caregiver sensitivity was employed, compared to small to medium effect sizes (g = .34 to .49) when a multidimensional measure of caregiver sensitivity was employed. Child age at attachment measurement was a significant moderator of the longitudinal association between unidimensional caregiver sensitivity and preschool attachment. Future directions for the literature and clinical implications are discussed.

scholarly journals Examining Psychological Science through Systematic Meta-Method Analysis: A Call for Research

2019 ◽  
Author(s):  
Malte Elson
Keyword(s):  
Data Collection ◽  
Meta Analysis ◽  
Research Synthesis ◽  
Effect Sizes ◽  
Psychological Science ◽  
Meta Analyses ◽  
The Relationship ◽  
Method Analysis

Research synthesis is based on the assumption that when the same association between constructs is observed repeatedly in a field, the relationship is probably real, even if its exact magnitude can be debated. Yet this probability is not only a function of recurring results, but also of the quality and consistency in the empirical procedures that produced those results and that any meta-analysis necessarily inherits. Standardized protocols in data collection, analysis, and interpretation are important empirical properties, and a healthy sign of a discipline's maturity.This manuscript proposes that meta-analyses as typically applied in psychology benefit from complementing their aggregates of observed effect sizes by systematically examining the standardization of methodology that deterministically produced them. Potential units of analyses are described and two examples are offered to illustrate the benefits of such efforts. Ideally, this synergetic approach emphasizes the role of methods in advancing theory by improving the quality of meta-analytic inferences.

A Meta-Analysis of Interviews and Cognitive Ability

2013 ◽  
Vol 12 (4) ◽  
pp. 157-169 ◽  
Author(s):  
Philip L. Roth ◽  
Allen I. Huffcutt
Keyword(s):  
Cognitive Ability ◽  
Meta Analysis ◽  
Incremental Validity ◽  
Employment Interviews ◽  
Moderator Analysis ◽  
The Future ◽  
Research Questions ◽  
Meta Analyses ◽  
The Relationship

The topic of what interviews measure has received a great deal of attention over the years. One line of research has investigated the relationship between interviews and the construct of cognitive ability. A previous meta-analysis reported an overall corrected correlation of .40 ( Huffcutt, Roth, & McDaniel, 1996 ). A more recent meta-analysis reported a noticeably lower corrected correlation of .27 ( Berry, Sackett, & Landers, 2007 ). After reviewing both meta-analyses, it appears that the two studies posed different research questions. Further, there were a number of coding judgments in Berry et al. that merit review, and there was no moderator analysis for educational versus employment interviews. As a result, we reanalyzed the work by Berry et al. and found a corrected correlation of .42 for employment interviews (.15 higher than Berry et al., a 56% increase). Further, educational interviews were associated with a corrected correlation of .21, supporting their influence as a moderator. We suggest a better estimate of the correlation between employment interviews and cognitive ability is .42, and this takes us “back to the future” in that the better overall estimate of the employment interviews – cognitive ability relationship is roughly .40. This difference has implications for what is being measured by interviews and their incremental validity.

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

Career Adaptability and Career Decision Self-Efficacy: Meta-Analysis

2021 ◽  
pp. 089484532110124
Author(s):  
Graham B. Stead ◽  
Lindsey M. LaVeck ◽  
Sandra M. Hurtado Rúa
Keyword(s):  
Self Efficacy ◽  
Total Population ◽  
Meta Analysis ◽  
Career Decision ◽  
Decision Making Process ◽  
Career Adaptability ◽  
Efficacy Measures ◽  
Meta Analyses ◽  
Career Research ◽  
The Relationship

The relationship between career adaptability and career decision self-efficacy was examined due to its importance for clients in the career development and career decision-making process. Multivariate meta-analyses using 18 studies with a total population of 6,339 participants were employed. Moderator variables important to this relationship were country of participants, mean age, and career adaptability measures. Estimated correlations between career adaptability subscales and career decision self-efficacy measures ranged from .36 to .44. Findings are discussed in relation to career research and counseling.

Sign in / Sign up

Export Citation Format

Share Document