Making the Invisible Visible: Guidelines for the Coding Process in Meta-Analyses

2021 ◽  
pp. 109442812110463
Author(s):  
Jessica Villiger ◽  
Simone A. Schweiger ◽  
Artur Baldauf
Keyword(s):  
Decision Making ◽  
Meta Analysis ◽  
Reliability And Validity ◽  
Quality Standards ◽  
Research Community ◽  
Future Research ◽  
Research Communities ◽  
Meta Analyses ◽  
The Invisible

This article contributes to the practice of coding in meta-analyses by offering direction and advice for experienced and novice meta-analysts on the “how” of coding. The coding process, the invisible architecture of any meta-analysis, has received comparably little attention in methodological resources, leaving the research community with insufficient guidance on “how” it should be rigorously planned (i.e., cohere with the research objective), conducted (i.e., make reliable and valid coding decisions), and reported (i.e., in a sufficiently transparent manner for readers to comprehend the authors’ decision-making). A lack of rigor in these areas can lead to erroneous results, which is problematic for entire research communities who build their future knowledge upon meta-analyses. Along four steps, the guidelines presented here elucidate “how” the coding process can be performed in a coherent, efficient, and credible manner that enables connectivity with future research, thereby enhancing the reliability and validity of meta-analytic findings. Our recommendations also support editors and reviewers in advising authors on how to improve the rigor of their coding and ultimately establish higher quality standards in meta-analytic research.

The Student Risk Screening Scale: A Reliability and Validity Generalization Meta-Analysis

2017 ◽  
Vol 26 (3) ◽  
pp. 143-155 ◽  
Author(s):  
Stephen P. Kilgus ◽  
Katie Eklund ◽  
Daniel M. Maggin ◽  
Crystal N. Taylor ◽  
Amanda N. Allen
Keyword(s):  
Internal Consistency ◽  
Externalizing Behavior ◽  
Meta Analysis ◽  
Reliability And Validity ◽  
Future Research ◽  
Risk Screening ◽  
Validity Generalization ◽  
Meta Analyses ◽  
Student Risk ◽  
Screening Scale

The purpose of this study was to conduct reliability and validity generalization meta-analyses of evidence regarding the Student Risk Screening Scale (SRSS), a universal screener for externalizing behavior problems. A systematic review of the literature resulted in the identification of 17 studies inclusive of evidence regarding SRSS score (a) internal consistency reliability (i.e., alpha coefficients), and/or (b) criterion-related validity (e.g., correlations between the SRSS and various outcomes). Multilevel meta-analyses indicated that across studies, SRSS scores were associated with adequate internal consistency (α = .83). Analyses further suggested the SRSS was a valid indicator of both social and behavioral outcomes ( r = .52) and academic outcomes ( r = .42). Follow-up analyses suggested that in accordance with theory-driven expectations, the SRSS was a stronger indicator of externalizing problems and broad behavior outcomes relative to alternative outcomes (e.g., internalizing problems). Limitations and directions for future research are discussed, including recommendations for the collection of additional SRSS diagnostic accuracy evidence.

scholarly journals Effectiveness of probiotics in irritable bowel syndrome: methodological quality of meta-analyses and systematic reviews

2019 ◽  
Vol 6 (2) ◽  
pp. 115-121 ◽  
Author(s):  
Yuan Jia ◽  
Li-Min Guo ◽  
Si-Yuan Yang ◽  
Qian Wu ◽  
Fan-Jie Meng
Keyword(s):  
Irritable Bowel Syndrome ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Meta Analysis ◽  
Quality Standards ◽  
Systematic Evaluation ◽  
Future Research ◽  
Irritable Bowel ◽  
Meta Analyses

Abstract Objective This study assessed the methodological quality of systematic reviews/meta-analysis of the effectiveness of probiotics against irritable bowel syndrome (IBS) using the accepted methodological quality assessment scale AMSTAR and explored the factors that influenced the quality of methodology. It was designed to provide a reference for future research and systematic reviews/metaanalysis. Methods The methodological quality of existing systematic reviews/meta-analysis was evaluated using the AMSTAR scale. Influencing factors of methodological quality were statistically analyzed using RevMan 5.3 software. The included systematic reviews/metaanalysis must include the following characteristics: (1) methods using systematic evaluation/meta-analysis, (2) probiotic intervention, and (3) language limitation to Chinese and English. Results The AMSTAR score was 5–9 (7.42 ± 1.22), and the quality is above average. The factors affecting the methodological quality are the number of authors and whether they cooperate with the institution. Conclusions Studies have shown that current systematic reviews/meta-analysis of the effectiveness of probiotics on IBS does not fully comply with methodological quality standards, and therefore the methodological quality of research in this area needs to be strengthened. To better clarify how probiotics affect IBS, future systematic reviews and meta-analyses should not only follow methodological quality standards but also include more effective outcome measures, and they should focus more on the discussion of research results. We look forward to the development of higher-quality randomized controlled trials in the future.

scholarly journals AI-Enabled Sensing and Decision-Making for IoT Systems

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Hao Qinxia ◽  
Shah Nazir ◽  
Ma Li ◽  
Habib Ullah ◽  
Wang Lianlian ◽  
...  
Keyword(s):  
Decision Making ◽  
Real Life ◽  
Research Community ◽  
Smart Sensors ◽  
Future Research ◽  
New Paradigm ◽  
Exclusion Criteria ◽  
Intelligent Devices ◽  
Research Questions

The influential stage of Internet of Things (IoT) has reformed all fields of life in general but specifically with the emergence of artificial intelligence (AI) has drawn the attention of researchers into a new paradigm of life standard. This revolution has been accepted around the globe for making life easier with the use of intelligent devices such as smart sensors, actuators, and many other devices. AI-enabled devices are more intelligent and capable of doing a specific task which saves a lot of resources and time. Different approaches are available in the existing literature to tackle diverse issues of real life based on AI and IoT systems. The role of decision-making has its own importance in the AI-enabled and IoT systems. In-depth knowledge of the existing literature is dire need of the research community to summarize the literature in effective way by which practitioners and researchers can benefit from the prevailing proofs and suggest new solutions for solving a particular problem of AI-enabled sensing and decision-making for the IoT system. To facilitate research community, the proposed study presents a systematic literature review of the existing literature, organizes the evidences in a systematic way, and then analyzes it for future research. The study reported the literature of the last 5 years based on the research questions, inclusion and exclusion criteria, and quality assessment of the selected study. Finally, derivations are drawn from the included paper for future research.

scholarly journals Comparing Bayesian Posterior Passing with Meta-analysis

2020 ◽  
Author(s):  
Joshua Pritsker
Keyword(s):  
Publication Bias ◽  
Fixed Effects ◽  
Meta Analysis ◽  
Future Research ◽  
Meta Analyses

Brand, von der Post, Ounsley, and Morgan (2019) introduced Bayesian posterior passing as an alternative to traditional meta-analyses. In this commentary I relate their procedure to traditional meta-analysis, showing that posterior passing is equivalent to fixed effects meta-analysis. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. Additionally, practical limitations of posterior passing and the role that it can play in future research are discussed.

scholarly journals Obsessive healthy eating and orthorexic eating tendencies in sport and exercise contexts: A systematic review and meta-analysis

2021 ◽  
Author(s):  
Jana Strahler ◽  
Hanna Wachten ◽  
Anett Mueller-Alcazar
Keyword(s):  
Systematic Review ◽  
Gender Differences ◽  
Healthy Eating ◽  
Meta Analysis ◽  
Group Analysis ◽  
Future Research ◽  
Exercise Behaviors ◽  
Sport And Exercise ◽  
Underlying Mechanisms ◽  
Meta Analyses

AbstractBackgroundOrthorexia Nervosa (ON) and exercise addiction (ExAdd) are two phenomena believed to overlap. We conducted a meta-analysis exploring the link between ON and (addictive) exercise behaviors.MethodsA systematic review of major databases and gray literature was carried out for studies reporting on ON and (addictive) exercise behaviors. Random effects meta-analyses were undertaken calculating correlations between ON and (addictive) exercise behaviors. A sub-group analysis investigated gender differences.ResultsTwenty-five studies with 10,134 participants (mean age = 25.21; 56.4% female) were included. Analyses showed a small overall correlation between ON and exercise (21 studies, r = 0.12, 95% CI |0.06–0.18|) and a medium overall correlation between ON and ExAdd (7 studies, r = 0.29, 95% CI |0.13–0.45|). Gender differences were negligible.ConclusionsOrthorexic eating correlated slightly and moderately with exercise and ExAdd, respectively, expressing some unique and shared variance of these behaviors. While this does not suggest ON and addictive exercising to be independent, it does not indicate substantial comorbidity. Future research should focus on clinical relevance, underlying mechanisms, vulnerability, and risk factors.

Internet Use and Psychological Well-Being

2012 ◽  
pp. 302-314 ◽  
Author(s):  
Chiungjung Huang
Keyword(s):  
Social Networking ◽  
Social Networking Sites ◽  
Internet Use ◽  
Meta Analysis ◽  
Well Being ◽  
Social Networking Site ◽  
Future Research ◽  
Psychological Well Being ◽  
Site Use ◽  
Meta Analyses

The direction of the correlation between Internet use and psychological well-being is debatable. The displacement hypothesis indicates the correlation is negative, as Internet use for communication replaces face-to face-interaction. Conversely, the augmentation hypothesis suggests that the correlation is positive because Internet use for communication complements existing social interaction. While previous empirical findings about the relationship between Internet use and psychological well-being have been diverse, two previous meta-analyses and the present meta-analysis about the use of social networking sites and psychological well-being supported neither position, and found no relationship between Internet use and psychological well-being. Investigation of causal predominance between Internet use and psychological well-being, increased attention to measurement problems of social networking site use and older adults, and consideration of effects of indicators and moderators should be addressed in future research.

Is hospitalization a risk factor for cognitive decline in older age adults?

2020 ◽  
pp. 1-18
Author(s):  
Lucia Chinnappa-Quinn ◽  
Steve Robert Makkar ◽  
Michael Bennett ◽  
Ben C. P. Lam ◽  
Jessica W. Lo ◽  
...  
Keyword(s):  
Cognitive Decline ◽  
Meta Analysis ◽  
Severity Of Illness ◽  
The Elderly ◽  
Preliminary Evidence ◽  
Older Age ◽  
Future Research ◽  
Cognitive Changes ◽  
Newcastle Ottawa Scale ◽  
Meta Analyses

ABSTRACT Objectives: Many studies document cognitive decline following specific types of acute illness hospitalizations (AIH) such as surgery, critical care, or those complicated by delirium. However, cognitive decline may be a complication following all types of AIH. This systematic review will summarize longitudinal observational studies documenting cognitive changes following AIH in the majority admitted population and conduct meta-analysis (MA) to assess the quantitative effect of AIH on post-hospitalization cognitive decline (PHCD). Methods: We followed Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. Selection criteria were defined to identify studies of older age adults exposed to AIH with cognitive measures. 6566 titles were screened. 46 reports were reviewed qualitatively, of which seven contributed data to the MA. Risk of bias was assessed using the Newcastle–Ottawa Scale. Results: The qualitative review suggested increased cognitive decline following AIH, but several reports were particularly vulnerable to bias. Domain-specific outcomes following AIH included declines in memory and processing speed. Increasing age and the severity of illness were the most consistent risk factors for PHCD. PHCD was supported by MA of seven eligible studies with 41,453 participants (Cohen’s d = −0.25, 95% CI [−0.02, −0.49] I2 35%). Conclusions: There is preliminary evidence that AIH exposure accelerates or triggers cognitive decline in the elderly patient. PHCD reported in specific contexts could be subsets of a larger phenomenon and caused by overlapping mechanisms. Future research must clarify the trajectory, clinical significance, and etiology of PHCD: a priority in the face of an aging population with increasing rates of both cognitive impairment and hospitalization.

Institutional Logics

2017 ◽  
Author(s):  
Heather A. Haveman ◽  
Gillian Gualtieri
Keyword(s):  
United States ◽  
Empirical Work ◽  
Reliability And Validity ◽  
The United States ◽  
Institutional Logics ◽  
Theoretical Development ◽  
Future Research ◽  
Social Phenomena ◽  
Empirical Measures ◽  
Meta Analyses

Research on institutional logics surveys systems of cultural elements (values, beliefs, and normative expectations) by which people, groups, and organizations make sense of and evaluate their everyday activities, and organize those activities in time and space. Although there were scattered mentions of this concept before 1990, this literature really began with the 1991 publication of a theory piece by Roger Friedland and Robert Alford. Since that time, it has become a large and diverse area of organizational research. Several books and thousands of papers and book chapters have been published on this topic, addressing institutional logics in sites as different as climate change proceedings of the United Nations, local banks in the United States, and business groups in Taiwan. Several intellectual precursors to institutional logics provide a detailed explanation of the concept and the theory surrounding it. These literatures developed over time within the broader framework of theory and empirical work in sociology, political science, and anthropology. Papers published in ten major sociology and management journals in the United States and Europe (between 1990 and 2015) provide analysis and help to identify trends in theoretical development and empirical findings. Evaluting these trends suggest three gentle corrections and potentially useful extensions to the literature help to guide future research: (1) limiting the definition of institutional logic to cultural-cognitive phenomena, rather than including material phenomena; (2) recognizing both “cold” (purely rational) cognition and “hot” (emotion-laden) cognition; and (3) developing and testing a theory (or multiple related theories), meaning a logically interconnected set of propositions concerning a delimited set of social phenomena, derived from assumptions about essential facts (axioms), that details causal mechanisms and yields empirically testable (falsifiable) hypotheses, by being more consistent about how we use concepts in theoretical statements; assessing the reliability and validity of our empirical measures; and conducting meta-analyses of the many inductive studies that have been published, to develop deductive theories.

TBLT implementation and evaluation: A meta-analysis

2017 ◽  
Vol 23 (5) ◽  
pp. 603-632 ◽  
Author(s):  
Lara Bryfonski ◽  
Todd H. McKay
Keyword(s):  
Meta Analysis ◽  
Future Research ◽  
Language Program ◽  
Language Programs ◽  
Language Classrooms ◽  
L2 Development ◽  
Meta Analyses ◽  
Traditional Grammar ◽  
Authentic Language ◽  
Main Effects

Task-based language teaching (TBLT) is an empirically investigated pedagogy that has garnered attention from language programs across the globe. TBLT provides an alternative to traditional grammar translation or present-practice-produce pedagogies by emphasizing interaction during authentic tasks. Despite several previous meta-analyses investigating the effect of individual tasks or short-term task-based treatments on second language (L2) development, no studies to date have synthesized the effects of long-term implementation of TBLT in authentic language classrooms. The present study uses meta-analytic techniques to investigate the effectiveness of TBLT programs on L2 learning. Findings based on a sample of 52 studies revealed an overall positive and strong effect ( d = 0.93) for TBLT implementation on a variety of learning outcomes. The study further examined a range of programmatic and methodological features that moderated these main-effects (program region, institution type, needs analysis, and cycles of implementation). Additionally, synthesizing across both quantitative and qualitative data, results also showed positive stakeholder perceptions towards TBLT programs. The study concludes with implications for the domain of TBLT implementation, language program evaluation, and future research in this domain.

scholarly journals A SYSTEMATIC REVIEW AND META-ANALYSIS OF AGE-RELATED DIFFERENCES IN TRUST

2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S477-S477
Author(s):  
Phoebe E Bailey ◽  
Tarren Leon
Keyword(s):  
Systematic Review ◽  
Older Adults ◽  
Young Adults ◽  
Meta Analysis ◽  
Self Report ◽  
Future Research ◽  
Age Group ◽  
Age Related ◽  
Meta Analyses ◽  
Effect Of Age

Abstract This systematic review and meta-analysis quantifies the magnitude and breadth of age-related differences in trust. Thirty-eight independent data sets met criteria for inclusion. Overall, there was a moderate effect of age group on trust (g = 0.22), whereby older adults were more trusting than young adults. Three additional meta-analyses assessed age-related differences in trust in response to varying degrees of trustworthiness. This revealed that older adults were more trusting than young adults in response to neutral (g = 0.31) and negative (g = 0.33), but not positive (g = 0.15), indicators of trustworthiness. The effect of age group on trust in response to positive and neutral cues was moderated by type of trust (financial vs. non-financial) and type of responding (self-report vs. behavioral). Older adults were more trusting than young adults in response to positive and neutral indicators of trustworthiness when trust was expressed non-financially, but not financially. There was also an age-related increase in self-reported, but not behavioral, trust in response to neutral cues. Older adults were more trusting than young adults in response to negative indicators of trustworthiness regardless of the type of trust or type of responding. The reliability of information about trustworthiness (superficial vs. genuine cues) did not moderate any effects of age on trust. Implications of these findings and directions for future research are discussed.

Sign in / Sign up

Export Citation Format

Share Document