scholarly journals Analytic and bootstrap confidence intervals for the common-language effect size estimate

Methodology ◽  
2021 ◽  
Vol 17 (1) ◽  
pp. 1-21
Author(s):  
Johnson Ching-Hong Li ◽  
Virginia Man Chung Tze

Evaluating how an effect-size estimate performs between two continuous variables based on the common-language effect size (CLES) has received increasing attention. While Blomqvist (1950; https://doi.org/10.1214/aoms/1177729754) developed a parametric estimator (q') for the CLES, there has been limited progress in further refining CLES. This study: a) extends Blomqvist’s work by providing a mathematical foundation for Bp (a non-parametric version of CLES) and an analytic approach for estimating its standard error; and b) evaluates the performance of the analytic and bootstrap confidence intervals (CIs) for Bp. The simulation shows that the bootstrap bias-corrected-and-accelerated interval (BCaI) has the best protected Type 1 error rate with a slight compromise in Power, whereas the analytic-t CI has the highest overall Power but with a Type 1 error slightly larger than the nominal value. This study also uses a real-world data-set to demonstrate the applicability of the CLES in measuring the relationship between age and sexual compulsivity.

2021 ◽  
pp. 152483802110216
Author(s):  
Brooke N. Lombardi ◽  
Todd M. Jensen ◽  
Anna B. Parisi ◽  
Melissa Jenkins ◽  
Sarah E. Bledsoe

Background: The association between a lifetime history of sexual victimization and the well-being of women during the perinatal period has received increasing attention. However, research investigating this relationship has yet to be systematically reviewed or quantitatively synthesized. Aim: This systematic review and meta-analysis aims to calculate the pooled effect size estimate of the statistical association between a lifetime history of sexual victimization and perinatal depression (PND). Method: Four bibliographic databases were systematically searched, and reference harvesting was conducted to identify peer-reviewed articles that empirically examined associations between a lifetime history of sexual victimization and PND. A random effects model was used to ascertain an overall pooled effect size estimate in the form of an odds ratio and corresponding 95% confidence intervals (CIs). Subgroup analyses were also conducted to assess whether particular study features and sample characteristic (e.g., race and ethnicity) influenced the magnitude of effect size estimates. Results: This review included 36 studies, with 45 effect size estimates available for meta-analysis. Women with a lifetime history of sexual victimization had 51% greater odds of experiencing PND relative to women with no history of sexual victimization ( OR = 1.51, 95% CI [1.35, 1.67]). Effect size estimates varied considerably according to the PND instrument used in each study and the racial/ethnic composition of each sample. Conclusion: Findings provide compelling evidence for an association between a lifetime history of sexual victimization and PND. Future research should focus on screening practices and interventions that identify and support survivors of sexual victimization perinatally.


2001 ◽  
Vol 31 (4) ◽  
pp. 48-54 ◽  
Author(s):  
Anneke C. Grobler ◽  
Adelene A. Grobler ◽  
Karel G.F. Esterhuyse

This study was conducted to identify predictors of mathematics achievement among grade 9 learners of a random sample of five township schools. A series of regression analyses were performed for boys and girls separately to obtain Cohen's (1992) effect size estimate (uniquely explained criterion variance expressed as a proportion of unexplained criterion variance) for various predictor variables. Cognitive predictors were verbal and non-verbal General Scholastic Aptitude Test scores. Non-cognitive variables included the hierarchical levels of self-concept: Global (Rosenberg Self-Esteem Scale), and academic and mathematics self-concept (relevant scales of Brookover, Erickson and Joiner). Socio-economic predictors included home-related variables (parental education, parental occupation, family size) and school-related factors (class size, teacher's qualification, teacher's experience). Gender differences favouring boys were found. Non-verbal and verbal scholastic aptitude and teacher's general training correlated significantly with mathematics achievement for boys and girls, with nonverbal scholastic aptitude showing the highest correlation and effect size estimate for girls and teacher's general training occupying this position for boys. Teacher's mathematics training and class size showed correlations in excess of 0.35 for boys but not for girls. The negative corrrelation obtained for teacher's general training suggested that learners whose teachers held a three-year teaching diploma performed better in mathematics than did learners whose teachers held a degree and a teacher's diploma.


2014 ◽  
Vol 26 (2) ◽  
pp. 633-660
Author(s):  
Rahim Moineddin ◽  
Christopher Meaney ◽  
Eva Grunfeld

Composite endpoints are commonplace in biomedical research. The complex nature of many health conditions and medical interventions demand that composite endpoints be employed. Different approaches exist for the analysis of composite endpoints. A Monte Carlo simulation study was employed to assess the statistical properties of various regression methods for analyzing binary composite endpoints. We also applied these methods to data from the BETTER trial which employed a binary composite endpoint. We demonstrated that type 1 error rates are poor for the Negative Binomial regression model and the logistic generalized linear mixed model (GLMM). Bias was minimal and power was highest in the binomial logistic regression model, the linear regression model, the Poisson (corrected for over-dispersion) regression model and the common effect logistic generalized estimating equation (GEE) model. Convergence was poor in the distinct effect GEE models, the logistic GLMM and some of the zero-one inflated beta regression models. Considering the BETTER trial data, the distinct effect GEE model struggled with convergence and the collapsed composite method estimated an effect, which was greatly attenuated compared to other models. All remaining models suggested an intervention effect of similar magnitude. In our simulation study, the binomial logistic regression model (corrected for possible over/under-dispersion), the linear regression model, the Poisson regression model (corrected for over-dispersion) and the common effect logistic GEE model appeared to be unbiased, with good type 1 error rates, power and convergence properties.


2004 ◽  
Vol 16 (4) ◽  
pp. 389-396
Author(s):  
John T. Chibnall

Background: At the request of the Editor of International Psychogeriatrics, a statistical audit of all papers published in the journal during 2003 was undertaken by the statistical advisor to International Psychogeriatrics.Method: Only research papers using inferential statistical techniques were assessed and only the statistical elements of these papers were evaluated. The following issues were addressed: did the authors report a power calculation or address power issues? Did the authors report an appropriate effect size indicator? When multiple univariate statistical tests were used was a correction for type 1 error employed? Did authors demonstrate the adequacy of the data analyzed for the statistical tests employed? Were sufficient details reported to enable an evaluation of the statistical analyses and reported results?Results: Twenty papers published during 2003 were suitable for analysis. None addressed power issues. About half reported an effect size indicator and about half adjusted the statistical analysis for the effects of multiple univariate statistical comparisons. Few demonstrated the adequacy of the data being analyzed and few provided sufficient detail to evaluate the statistical analyses and reported results. Most papers used the right statistic in the right way.Conclusion: The statistical quality of articles published in International Psychogeriatrics could be improved by attention to a few relatively fundamental issues.


2019 ◽  
Author(s):  
Faye Terese Nitschke ◽  
Blake M McKimmie ◽  
Eric John Vanman

Rape cases have a disproportionately high attrition rate and low conviction rate compared to other criminal offenses. Evaluations of a rape complainant’s credibility often determine whether a case progresses through the criminal justice system. Even though emotional demeanor is not related to witness honesty or accuracy, distressed rape complainants are perceived to be more credible than complainants who present with controlled affect. To understand the extent and robustness of the influence of emotional demeanor on credibility judgments of female adult rape complainants, we conducted a systematic review, meta-analysis and p-curve analysis of the experimental simulated decision-making literature on the influence of complainant emotional demeanor on complainant credibility. The meta-analysis included 20 studies with participants who were criminal justice professionals (e.g., police officers and judges), community members, and mock jurors (N = 3128). Results suggest that distressed demeanor significantly increased perceptions of complainant credibility, with a small to moderate effect size estimate. Importantly, the results of p-curve analysis suggest that reporting bias is not a likely explanation for the effect of emotional demeanor on rape complainant credibility. Sample type (whether perceivers were criminal justice professionals or prospective jurors) and stimulus modality (whether perceivers read about or watched the complainant recount the alleged rape) were not found to moderate the effect size estimate. These results suggest that effective methods of reducing reliance on emotional demeanor to make credibility judgments about rape complainants should be investigated to make credibility assessments fairer and more accurate.


Sign in / Sign up

Export Citation Format

Share Document