Effect sizes and research directions of peer assessments: From an integrated perspective of meta-analysis and co-citation network

2021 ◽  
pp. 104123
Author(s):  
Ching-Yi Chang ◽  
De-Chih Lee ◽  
Kai-Yu Tang ◽  
Gwo-Jen Hwang
Keyword(s):  
Meta Analysis ◽  
Citation Network ◽  
Effect Sizes ◽  
Research Directions

scholarly journals The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews

2021 ◽  
Author(s):  
Piers Steel ◽  
Sjoerd Beugelsdijk ◽  
Herman Aguinis
Keyword(s):  
Meta Analysis ◽  
Effect Sizes ◽  
Future Research ◽  
Research Directions ◽  
Outlier Identification ◽  
Business Studies ◽  
Award Winning ◽  
Future Research Directions ◽  
Meta Analyses ◽  
Highly Cited

AbstractMeta-analyses summarize a field’s research base and are therefore highly influential. Despite their value, the standards for an excellent meta-analysis, one that is potentially award-winning, have changed in the last decade. Each step of a meta-analysis is now more formalized, from the identification of relevant articles to coding, moderator analysis, and reporting of results. What was exemplary a decade ago can be somewhat dated today. Using the award-winning meta-analysis by Stahl et al. (Unraveling the effects of cultural diversity in teams: A meta-analysis of research on multicultural work groups. Journal of International Business Studies, 41(4):690–709, 2010) as an exemplar, we adopted a multi-disciplinary approach (e.g., management, psychology, health sciences) to summarize the anatomy (i.e., fundamental components) of a modern meta-analysis, focusing on: (1) data collection (i.e., literature search and screening, coding), (2) data preparation (i.e., treatment of multiple effect sizes, outlier identification and management, publication bias), (3) data analysis (i.e., average effect sizes, heterogeneity of effect sizes, moderator search), and (4) reporting (i.e., transparency and reproducibility, future research directions). In addition, we provide guidelines and a decision-making tree for when even foundational and highly cited meta-analyses should be updated. Based on the latest evidence, we summarize what journal editors and reviewers should expect, authors should provide, and readers (i.e., other researchers, practitioners, and policymakers) should consider about meta-analytic reviews.

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

Effectiveness of psychological interventions to improve emotion regulation in youth - a meta-analysis

2019 ◽  
Author(s):  
Bettina Moltrecht ◽  
Jessica Deighton ◽  
Praveetha Patalay ◽  
Julian Childs
Keyword(s):  
Emotion Regulation ◽  
Emotion Dysregulation ◽  
Psychological Intervention ◽  
Meta Analysis ◽  
Age Groups ◽  
Effect Sizes ◽  
What Works ◽  
Large Heterogeneity ◽  
Larger Sample

Background: Research investigating the role of emotion regulation (ER) in the development and treatment of psychopathology has increased in recent years. Evidence suggests that an increased focus on ER in treatment can improve existing interventions. Most ER research has neglected young people, therefore the present meta-analysis summarizes the evidence for existing psychosocial intervention and their effectiveness to improve ER in youth. Methods: A systematic review and meta-analysis was conducted according to the PRISMA guidelines. Twenty-one randomized-control-trials (RCTs) assessed changes in ER following a psychological intervention in youth exhibiting various psychopathological symptoms.Results: We found moderate effect sizes for current interventions to decrease emotion dysregulation in youth (g=-.46) and small effect sizes to improve emotion regulation (g=0.36). Significant differences between studies including intervention components, ER measures and populations studied resulted in large heterogeneity. Conclusion: This is the first meta-analysis that summarizes the effectiveness for existing interventions to improve ER in youth. The results suggest that interventions can enhance ER in youth, and that these improvements correlate with improvements in psychopathology. More RCTs including larger sample sizes, different age groups and psychopathologies are needed to increase our understanding of what works for who and when.

A Meta-Analysis of the Facial Feedback Literature: Effects of Facial Feedback on Emotional Experience Are Small and Variable

2017 ◽  
Author(s):  
Nicholas Alvaro Coles ◽  
Jeff T. Larsen ◽  
Heather Lench
Keyword(s):  
Publication Bias ◽  
Emotional Experience ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Detection Methods ◽  
Feedback Effects ◽  
Facial Feedback ◽  
Facial Movements ◽  
Facial Feedback Hypothesis ◽  
Variance Estimates

The facial feedback hypothesis suggests that an individual’s experience of emotion is influenced by feedback from their facial movements. To evaluate the cumulative evidence for this hypothesis, we conducted a meta-analysis on 286 effect sizes derived from 138 studies that manipulated facial feedback and collected emotion self-reports. Using random effects meta-regression with robust variance estimates, we found that the overall effect of facial feedback was significant, but small. Results also indicated that feedback effects are stronger in some circumstances than others. We examined 12 potential moderators, and three were associated with differences in effect sizes. 1. Type of emotional outcome: Facial feedback influenced emotional experience (e.g., reported amusement) and, to a greater degree, affective judgments of a stimulus (e.g., the objective funniness of a cartoon). Three publication bias detection methods did not reveal evidence of publication bias in studies examining the effects of facial feedback on emotional experience, but all three methods revealed evidence of publication bias in studies examining affective judgments. 2. Presence of emotional stimuli: Facial feedback effects on emotional experience were larger in the absence of emotionally evocative stimuli (e.g., cartoons). 3. Type of stimuli: When participants were presented with emotionally evocative stimuli, facial feedback effects were larger in the presence of some types of stimuli (e.g., emotional sentences) than others (e.g., pictures). The available evidence supports the facial feedback hypothesis’ central claim that facial feedback influences emotional experience, although these effects tend to be small and heterogeneous.

A Review of Minimum Quantity Lubrication (MQL) based on Bibliometry

2020 ◽  
Vol 13 ◽  
Author(s):  
Gaurav Gaurav ◽  
Abhay Sharma ◽  
G S Dangayach ◽  
M L Meena
Keyword(s):  
Descriptive Analysis ◽  
Minimum Quantity Lubrication ◽  
Citation Network ◽  
Machining Process ◽  
Cutting Fluid ◽  
Future Research ◽  
Research Directions ◽  
Minimum Quantity ◽  
Research Areas ◽  
Future Research Directions

Background: Minimum quantity lubrication (MQL) is one of the most promising machining techniques that can yield a reduction in consumption of cutting fluid more than 90 % while ensuring the surface quality and tool life. The significance of the MQL in machining makes it imperative to consolidate and analyse the current direction and status of research in MQL. Objective: This study aims to assess global research publication trends and hot topics in the field of MQL among machining process. The bibliometric and descriptive analysis are the tools that the investigation aims to use for the data analysis of related literature collected from Scopus databases. Methods: Various performance parameters are extracted, such as document types and languages of publication, annual scientific production, total documents, total citations, and citations per article. The top 20 of the most relevant and productive sources, authors, affiliations, countries, word cloud, and word dynamics are assessed. The graphical visualisation of the bibliometric data is presented in terms of bibliographic coupling, citation, and co-citation network. Results: The investigation reveals that the International Journal of Machine Tools and Manufacture (2611 citations, 31 hindex) is the most productive journal that publishes on MQL. The most productive institution is the University of Michigan (32 publications), the most cited country is Germany (1879 citations), and the most productive country in MQL is China (124 publications). The study shows that ‘Cryogenic Machining’, ‘Sustainable Machining’, ‘Sustainability’, ‘Nanofluid’ and ‘Titanium alloy’ are the most recent keywords and indications of the hot topics and future research directions in the MQL field. Conclusion: The analysis finds that MQL is progressing in publications and the emerging with issues that are strongly associated with the research. This study is expected to help the researchers to find the most current research areas through the author’s keywords and future research directions in MQL and thereby expand their research interests.

scholarly journals Medicine storage, wastage, and associated determinants among urban households: a systematic review and meta-analysis of household surveys

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Adineh Jafarzadeh ◽  
Alireza Mahboub-Ahari ◽  
Moslem Najafi ◽  
Mahmood Yousefi ◽  
Koustuv Dalal
Keyword(s):  
Systematic Review ◽  
Meta Analysis ◽  
Supply And Demand ◽  
Random Effect ◽  
Effect Sizes ◽  
Household Surveys ◽  
Affective Factors ◽  
Urban Households ◽  
Medical Needs ◽  
Geographical Regions

Abstract Background Irrational household storage of medicines is a world-wide problem, which triggers medicine wastage as well as its associated harms. This study aimed to include all available evidences from literature to perform a focused examination of the prevalence and factors associated with medicine storage and wastage among urban households. This systematic review and meta-analysis mapped the existing literature on the burden, outcomes, and affective socio-economic factors of medicine storage among urban households. In addition, this study estimated pooled effect sizes for storage and wastage rates. Methods Household surveys evaluating modality, size, costs, and affective factors of medicines storage at home were searched in PubMed, EMBASE, OVID, SCOPUS, ProQuest, and Google scholar databases in 2019. Random effect meta-analysis and subgroup analysis were used to pool effect sizes for medicine storage and wastage prevalence among different geographical regions. Results From the 2604 initial records, 20 studies were selected for systematic review and 16 articles were selected for meta-analysis. An overall pooled-prevalence of medicine storage and real wastage rate was 77 and 15%, respectively. In this regard, some significant differences were observed between geographical regions. Southwest Asia region had the highest storage and wastage rates. The most common classes of medicines found in households belonged to the Infective agents for systemic (17.4%) and the Nervous system (16.4%). Moreover, income, education, age, the presence of chronic illness, female gender, and insurance coverage were found to be associated with higher home storage. The most commonly used method of disposal was throwing them in the garbage. Conclusions Factors beyond medical needs were also found to be associated with medicine storage, which urges effective strategies in the supply and demand side of the medicine consumption chain. The first necessary step to mitigate home storage is establishing an adequate legislation and strict enforcement of regulations on dispensing, prescription, and marketing of medicines. Patient’s pressure on excessive prescription, irrational storage, and use of medicines deserve efficient community-centered programs, in order to increase awareness on these issues. So, hazardous consequences of inappropriate disposal should be mitigated by different take back programs, particularly in low and middle income countries.

Sign in / Sign up

Export Citation Format

Share Document