scholarly journals Moderators of relative confidence calibration: A meta-analysis of the across-subject relationship between confidence and accuracy

2021 ◽  
Author(s):  
Sunny Jin ◽  
Paul Verhaeghen ◽  
Dobromir Rahnev
Keyword(s):  
Statistical Power ◽  
Meta Analysis ◽  
Witness Testimony ◽  
High Stakes ◽  
Confidence Judgments ◽  
Relative Consistency ◽  
Average Accuracy ◽  
Average Confidence ◽  
Confidence Calibration ◽  
The Relationship

If one friend confidently tells us to buy product A while another friend thinks that product B is better but is not confident, we may go with the advice of our confident friend. Should we? The relationship between people’s confidence and accuracy has been of great interest in many fields, especially in the context of high-stakes situations like eye-witness testimony, but there is still little consensus about how much we should trust someone’s overall level of confidence. Here we examine the across-subject relationship between average accuracy and average confidence in 214 unique datasets from the Confidence Database. This approach allows us to empirically address this issue with unprecedented statistical power and check for the presence of various moderators. We find that the across-subject correlation between average accuracy and average confidence in this sample is R = .22. Importantly, this relationship is much stronger for memory than for perception tasks, as well as for confidence scales with fewer points. These results show that we should take one’s confidence seriously (and perhaps buy product A) and suggest several factors that moderate the relative consistency of how people make confidence judgments.

scholarly journals Tissue Infiltrating Immune Cells as Prognostic Biomarkers in Endometrial Cancer: A Meta-Analysis

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Fang Guo ◽  
Yishan Dong ◽  
Qingqing Tan ◽  
Jing Kong ◽  
Bin Yu
Keyword(s):  
Endometrial Cancer ◽  
T Cell ◽  
Cell Density ◽  
Immune Cells ◽  
Statistical Power ◽  
Meta Analysis ◽  
Disease Free Survival ◽  
Free Survival ◽  
Gynecology And Obstetrics ◽  
The Relationship

Background. The association between tumour-infiltrating immune cells and the prognosis of endometrial cancer (EC) is controversial due to the smaller sample sizes and limited statistical power of the extant studies. We carried out a meta-analysis of the relationship between tumour-infiltrating immune cells and EC survival outcomes. Methods. A literature search in multiple databases was carried out up to December 2019. Pooled hazard ratio (HRs) and 95% confidence intervals (CIs) were calculated by the Z-test to assess the association between infiltrating immune cells and overall survival (OS), progression-free survival (PFS), relapse-free survival (RFS), disease-specific survival (DSS), and disease-free survival (DFS). A subgroup analysis was performed based on the localisation of immune cells in tumour parenchyma or stroma, immune markers, and the International Federation of Gynecology and Obstetrics stage. Heterogeneity and publication bias between studies were evaluated by Cochran’s Q-test and Egger regression test, respectively. Results. Seventeen studies were included in the analysis. The pooled HR of OS, PFS, DSS, and DFS indicated that a high CD8+ T cell density was associated with a favorable prognosis in EC patients. A significant relationship was found between a high density of CD45RO+ T cells and a favorable OS in EC patients, but the FoxP3+ T cell density was not associated with either OS or RFS. A high TAM density was associated with a worse PFS. However, a sensitivity analysis indicated that the findings of PFS and DSS in CD8+ T cell and PFS in TAM were not robust results. Conclusion. This is the first meta-analysis of the relationship between tumour-infiltrating immune cells and the prognosis of EC. High CD8+ and CD45RO+ T cell densities in tumours were associated with favorable outcomes in EC patients.

scholarly journals The Relationship between Family Violence and Self-Control in Adolescence: A Multi-Level Meta-Analysis

2018 ◽  
Vol 15 (11) ◽  
pp. 2468 ◽  
Author(s):  
Yayouk Willems ◽  
Jian-Bin Li ◽  
Anne Hendriks ◽  
Meike Bartels ◽  
Catrin Finkenauer
Keyword(s):  
Family Violence ◽  
Statistical Power ◽  
Meta Analysis ◽  
Time Lag ◽  
Self Control ◽  
Effect Sizes ◽  
Future Research ◽  
Multi Level ◽  
Low Self Control ◽  
The Relationship

Theoretical studies propose an association between family violence and low self-control in adolescence; however, empirical findings of this association are inconclusive. The aim of the present research was to systematically summarize available findings on the relation between family violence and self-control across adolescence. We included 28 studies with 143 effect sizes, representing more than 25,000 participants of eight countries from early to late adolescence. Applying a three-level meta-analysis, taking dependency between effect sizes into account while retaining statistical power, we examined the magnitude and direction of the overall effect size. Additionally, we investigated whether theoretical moderators (e.g., age, gender, country), and methodological moderators (e.g., time lag between family violence and self-control, informant) influenced the magnitude of the association between family violence and self-control. Our results revealed that family violence and self-control have a small to moderate significant negative association (r = −0.191). This association did not vary across gender, country, and informants. The strength of the association, however, decreased with age and in longitudinal studies. This finding provides evidence that researchers and clinicians may expect low self-control in the wake of family violence, especially in early adolescence. Recommendations for future research in the area are discussed.

scholarly journals Meta-Analysis in Plant Pathology: Synthesizing Research Results

2004 ◽  
Vol 94 (9) ◽  
pp. 1013-1017 ◽  
Author(s):  
M. S. Rosenberg ◽  
K. A. Garrett ◽  
Z. Su ◽  
R. L. Bowden
Keyword(s):  
Disease Severity ◽  
Statistical Power ◽  
Meta Analysis ◽  
Geographic Region ◽  
Test Results ◽  
Research Results ◽  
Wheat Diseases ◽  
Statistical Effect ◽  
The Difference ◽  
The Relationship

Meta-analysis is a set of statistical procedures for synthesizing research results from a number of different studies. An estimate of a statistical effect, such as the difference in disease severity for plants with or without a management treatment, is collected from each study along with a measure of the variance of the estimate of the effect. Combining results from different studies will generally result in increased statistical power so that it is easier to detect small effects. Combining results from different studies may also make it possible to compare the size of the effect as a function of other predictor variables such as geographic region or pathogen species. We present a review of the basic methodology for meta-analysis. We also present an example of meta-analysis of the relationship between disease severity and yield loss for foliar wheat diseases, based on data collected from a decade of fungicide and nematicide test results.

Relationship between total plasma homocysteine and the risk of aneurysms – a meta-analysis

VASA ◽  
2020 ◽  
pp. 1-6
Author(s):  
Hanji Zhang ◽  
Dexin Yin ◽  
Yue Zhao ◽  
Yezhou Li ◽  
Dejiang Yao ◽  
...  
Keyword(s):  
Large Scale ◽  
Meta Analysis ◽  
Single Species ◽  
Total Plasma ◽  
Control Groups ◽  
Randomized Controlled ◽  
Randomized Controlled Studies ◽  
The Difference ◽  
The Relationship ◽  
Healthy Participants

Summary: Our meta-analysis focused on the relationship between homocysteine (Hcy) level and the incidence of aneurysms and looked at the relationship between smoking, hypertension and aneurysms. A systematic literature search of Pubmed, Web of Science, and Embase databases (up to March 31, 2020) resulted in the identification of 19 studies, including 2,629 aneurysm patients and 6,497 healthy participants. Combined analysis of the included studies showed that number of smoking, hypertension and hyperhomocysteinemia (HHcy) in aneurysm patients was higher than that in the control groups, and the total plasma Hcy level in aneurysm patients was also higher. These findings suggest that smoking, hypertension and HHcy may be risk factors for the development and progression of aneurysms. Although the heterogeneity of meta-analysis was significant, it was found that the heterogeneity might come from the difference between race and disease species through subgroup analysis. Large-scale randomized controlled studies of single species and single disease species are needed in the future to supplement the accuracy of the results.

A Meta-Analysis of Interviews and Cognitive Ability

2013 ◽  
Vol 12 (4) ◽  
pp. 157-169 ◽  
Author(s):  
Philip L. Roth ◽  
Allen I. Huffcutt
Keyword(s):  
Cognitive Ability ◽  
Meta Analysis ◽  
Incremental Validity ◽  
Employment Interviews ◽  
Moderator Analysis ◽  
The Future ◽  
Research Questions ◽  
Meta Analyses ◽  
The Relationship

The topic of what interviews measure has received a great deal of attention over the years. One line of research has investigated the relationship between interviews and the construct of cognitive ability. A previous meta-analysis reported an overall corrected correlation of .40 ( Huffcutt, Roth, & McDaniel, 1996 ). A more recent meta-analysis reported a noticeably lower corrected correlation of .27 ( Berry, Sackett, & Landers, 2007 ). After reviewing both meta-analyses, it appears that the two studies posed different research questions. Further, there were a number of coding judgments in Berry et al. that merit review, and there was no moderator analysis for educational versus employment interviews. As a result, we reanalyzed the work by Berry et al. and found a corrected correlation of .42 for employment interviews (.15 higher than Berry et al., a 56% increase). Further, educational interviews were associated with a corrected correlation of .21, supporting their influence as a moderator. We suggest a better estimate of the correlation between employment interviews and cognitive ability is .42, and this takes us “back to the future” in that the better overall estimate of the employment interviews – cognitive ability relationship is roughly .40. This difference has implications for what is being measured by interviews and their incremental validity.

Power-Enhanced Funnel Plots for Meta-Analysis

2020 ◽  
Vol 228 (1) ◽  
pp. 43-49 ◽  
Author(s):  
Michael Kossmeier ◽  
Ulrich S. Tran ◽  
Martin Voracek
Keyword(s):  
Statistical Power ◽  
Meta Analysis ◽  
Relevant Information ◽  
Selective Reporting ◽  
Graphical Display ◽  
Funnel Plot ◽  
Evidential Value ◽  
Graphical Displays ◽  
Funnel Plots ◽  
Meta Analyses

Abstract. Currently, dedicated graphical displays to depict study-level statistical power in the context of meta-analysis are unavailable. Here, we introduce the sunset (power-enhanced) funnel plot to visualize this relevant information for assessing the credibility, or evidential value, of a set of studies. The sunset funnel plot highlights the statistical power of primary studies to detect an underlying true effect of interest in the well-known funnel display with color-coded power regions and a second power axis. This graphical display allows meta-analysts to incorporate power considerations into classic funnel plot assessments of small-study effects. Nominally significant, but low-powered, studies might be seen as less credible and as more likely being affected by selective reporting. We exemplify the application of the sunset funnel plot with two published meta-analyses from medicine and psychology. Software to create this variation of the funnel plot is provided via a tailored R function. In conclusion, the sunset (power-enhanced) funnel plot is a novel and useful graphical display to critically examine and to present study-level power in the context of meta-analysis.

Replication of the Superstition and Performance Study by

2014 ◽  
Vol 45 (3) ◽  
pp. 239-245 ◽  
Author(s):  
Robert J. Calin-Jageman ◽  
Tracy L. Caldwell
Keyword(s):  
Task Difficulty ◽  
Statistical Power ◽  
Meta Analysis ◽  
A Priori ◽  
Significant Heterogeneity ◽  
Performance Study ◽  
Improve Performance ◽  
Research Designs ◽  
Series Of Experiments ◽  
And Performance

A recent series of experiments suggests that fostering superstitions can substantially improve performance on a variety of motor and cognitive tasks ( Damisch, Stoberock, & Mussweiler, 2010 ). We conducted two high-powered and precise replications of one of these experiments, examining if telling participants they had a lucky golf ball could improve their performance on a 10-shot golf task relative to controls. We found that the effect of superstition on performance is elusive: Participants told they had a lucky ball performed almost identically to controls. Our failure to replicate the target study was not due to lack of impact, lack of statistical power, differences in task difficulty, nor differences in participant belief in luck. A meta-analysis indicates significant heterogeneity in the effect of superstition on performance. This could be due to an unknown moderator, but no effect was observed among the studies with the strongest research designs (e.g., high power, a priori sampling plan).

The Relationship Between Immorality and Cleansing

2018 ◽  
Vol 49 (5) ◽  
pp. 303-309 ◽  
Author(s):  
Jedidiah Siev ◽  
Shelby E. Zuckerman ◽  
Joseph J. Siev
Keyword(s):  
Effect Size ◽  
Meta Analysis ◽  
Weighted Mean ◽  
The Relationship

Abstract. In a widely publicized set of studies, participants who were primed to consider unethical events preferred cleansing products more than did those primed with ethical events ( Zhong & Liljenquist, 2006 ). This tendency to respond to moral threat with physical cleansing is known as the Macbeth Effect. Several subsequent efforts, however, did not replicate this relationship. The present manuscript reports the results of a meta-analysis of 15 studies testing this relationship. The weighted mean effect size was small across all studies (g = 0.17, 95% CI [0.04, 0.31]), and nonsignificant across studies conducted in independent laboratories (g = 0.07, 95% CI [−0.04, 0.19]). We conclude that there is little evidence for an overall Macbeth Effect; however, there may be a Macbeth Effect under certain conditions.

Sign in / Sign up

Export Citation Format

Share Document