Combining survival and toxicity effect sizes from clinical trials into an interpretable, quality-adjusted survival effect size estimate of treatment efficacy.

2014 ◽  
Vol 32 (15_suppl) ◽  
pp. 6630-6630 ◽  
Author(s):  
Jeff A. Sloan ◽  
Brittny Major ◽  
Paul J. Novotny ◽  
Axel Grothey ◽  
Randolph Marks ◽  
...  
2021 ◽  
pp. 152483802110216
Author(s):  
Brooke N. Lombardi ◽  
Todd M. Jensen ◽  
Anna B. Parisi ◽  
Melissa Jenkins ◽  
Sarah E. Bledsoe

Background: The association between a lifetime history of sexual victimization and the well-being of women during the perinatal period has received increasing attention. However, research investigating this relationship has yet to be systematically reviewed or quantitatively synthesized. Aim: This systematic review and meta-analysis aims to calculate the pooled effect size estimate of the statistical association between a lifetime history of sexual victimization and perinatal depression (PND). Method: Four bibliographic databases were systematically searched, and reference harvesting was conducted to identify peer-reviewed articles that empirically examined associations between a lifetime history of sexual victimization and PND. A random effects model was used to ascertain an overall pooled effect size estimate in the form of an odds ratio and corresponding 95% confidence intervals (CIs). Subgroup analyses were also conducted to assess whether particular study features and sample characteristic (e.g., race and ethnicity) influenced the magnitude of effect size estimates. Results: This review included 36 studies, with 45 effect size estimates available for meta-analysis. Women with a lifetime history of sexual victimization had 51% greater odds of experiencing PND relative to women with no history of sexual victimization ( OR = 1.51, 95% CI [1.35, 1.67]). Effect size estimates varied considerably according to the PND instrument used in each study and the racial/ethnic composition of each sample. Conclusion: Findings provide compelling evidence for an association between a lifetime history of sexual victimization and PND. Future research should focus on screening practices and interventions that identify and support survivors of sexual victimization perinatally.


2020 ◽  
Vol 29 ◽  
Author(s):  
Nickolas D. Frost ◽  
Thomas W. Baskin ◽  
Bruce E. Wampold

Abstract Aims The purpose of this review is to examine the replication attempts of psychotherapy clinical trials for depression and anxiety. We focus specifically on replications of trials that exhibit large differences between psychotherapies. The replicability of these trials is especially important for meta-analysis, where the inclusion of false-positive trials can lead to erroneous conclusions about treatment efficacy. Methods Standard replication criteria were developed to distinguish direct from conceptual replication methodologies. Next, an exhaustive literature search was conducted for published meta-analyses of psychotherapy comparisons. Trials that exhibited large effects (d > 0.8) were culled from these meta-analyses. For each trial, a cited replication was conducted to determine if the trial had been subsequently replicated by either ‘direct’ or ‘conceptual’ methods. Finally, a broader search was conducted to examine the extent of replication efforts in the psychotherapy literature overall. Results In the meta-analytic search, a total of N = 10 meta-analyses met the inclusion criteria. From these meta-analyses, N = 12 distinct trials exhibited large effect sizes. The meta-analyses containing more than two large effect trials reported evidence for treatment superiority. A cited replication search yielded no direct replication attempts (N = 0) for the trials with large effects, and N = 4 conceptual replication attempts of average or above average quality. However, of these four attempts, only two partially corroborated the results from their original trial. Conclusion Meta-analytic reviews are influenced by trials with large effects, and it is not uncommon for these reviews to contain several such trials. Since we find no evidence that trials with such large effects are directly replicable, treatment superiority conclusions from these reviews are highly questionable. To enhance the quality of clinical science, the development of authoritative replication criteria for clinical trials is needed. Moreover, quality benchmarks should be considered before trials are included in a meta-analysis, or replications are attempted.


Methodology ◽  
2021 ◽  
Vol 17 (1) ◽  
pp. 1-21
Author(s):  
Johnson Ching-Hong Li ◽  
Virginia Man Chung Tze

Evaluating how an effect-size estimate performs between two continuous variables based on the common-language effect size (CLES) has received increasing attention. While Blomqvist (1950; https://doi.org/10.1214/aoms/1177729754) developed a parametric estimator (q') for the CLES, there has been limited progress in further refining CLES. This study: a) extends Blomqvist’s work by providing a mathematical foundation for Bp (a non-parametric version of CLES) and an analytic approach for estimating its standard error; and b) evaluates the performance of the analytic and bootstrap confidence intervals (CIs) for Bp. The simulation shows that the bootstrap bias-corrected-and-accelerated interval (BCaI) has the best protected Type 1 error rate with a slight compromise in Power, whereas the analytic-t CI has the highest overall Power but with a Type 1 error slightly larger than the nominal value. This study also uses a real-world data-set to demonstrate the applicability of the CLES in measuring the relationship between age and sexual compulsivity.


2018 ◽  
Vol 7 (4) ◽  
pp. 137-146
Author(s):  
Brittny T. Major- Elechi ◽  
Paul J. Novotny ◽  
Jasvinder A. Singh ◽  
James A. Bonner ◽  
Amylou C. Dueck ◽  
...  

2001 ◽  
Vol 31 (4) ◽  
pp. 48-54 ◽  
Author(s):  
Anneke C. Grobler ◽  
Adelene A. Grobler ◽  
Karel G.F. Esterhuyse

This study was conducted to identify predictors of mathematics achievement among grade 9 learners of a random sample of five township schools. A series of regression analyses were performed for boys and girls separately to obtain Cohen's (1992) effect size estimate (uniquely explained criterion variance expressed as a proportion of unexplained criterion variance) for various predictor variables. Cognitive predictors were verbal and non-verbal General Scholastic Aptitude Test scores. Non-cognitive variables included the hierarchical levels of self-concept: Global (Rosenberg Self-Esteem Scale), and academic and mathematics self-concept (relevant scales of Brookover, Erickson and Joiner). Socio-economic predictors included home-related variables (parental education, parental occupation, family size) and school-related factors (class size, teacher's qualification, teacher's experience). Gender differences favouring boys were found. Non-verbal and verbal scholastic aptitude and teacher's general training correlated significantly with mathematics achievement for boys and girls, with nonverbal scholastic aptitude showing the highest correlation and effect size estimate for girls and teacher's general training occupying this position for boys. Teacher's mathematics training and class size showed correlations in excess of 0.35 for boys but not for girls. The negative corrrelation obtained for teacher's general training suggested that learners whose teachers held a three-year teaching diploma performed better in mathematics than did learners whose teachers held a degree and a teacher's diploma.


2021 ◽  
Author(s):  
Ymkje Anna de Vries ◽  
Robert A Schoevers ◽  
Julian Higgins ◽  
Marcus Munafo ◽  
Jojanneke Bastiaansen

Background: Previous research has suggested that statistical power is suboptimal in many biomedical disciplines, but it is unclear whether power is better in trials for particular interventions, disorders, or outcome types. We therefore performed a detailed examination of power in trials of psychotherapy, pharmacotherapy, and complementary and alternative medicine (CAM) for mood, anxiety, and psychotic disorders. Methods: We extracted data from the Cochrane Database of Systematic Reviews (Mental Health). We focused on continuous efficacy outcomes and estimated power to detect standardized effect sizes (SMD=0.20-0.80, primary effect size SMD=0.40) and the meta-analytic effect size (ESMA). We performed meta-regression to estimate the influence of including underpowered studies in meta-analyses. Results: We included 216 reviews with 8809 meta-analyses and 36540 studies. Statistical power for continuous efficacy outcomes was very low across intervention and disorder types (overall median [IQR] power for SMD=0.40: 0.33 [0.19-0.54]; for ESMA: 0.15 [0.07-0.44]), only reaching conventionally acceptable levels (80%) for SMD=0.80. Median power to detect the ESMA was higher in TAU/waitlist-controlled (0.54-0.66) or placebo-controlled (0.15-0.40) trials than in trials comparing active treatments (0.07-0.10). Meta-regression indicated that adequately-powered studies produced smaller effect sizes than underpowered studies (B=-0.06, p=0.008). Conclusions: Power to detect both fixed and meta-analytic effect sizes in clinical trials in psychiatry was low across all interventions and disorders examined. As underpowered studies produced larger effect sizes than adequately-powered studies, these results confirm the need to increase sample sizes and to reduce reporting bias against studies reporting null results to improve the reliability of the published literature.


2019 ◽  
Author(s):  
Faye Terese Nitschke ◽  
Blake M McKimmie ◽  
Eric John Vanman

Rape cases have a disproportionately high attrition rate and low conviction rate compared to other criminal offenses. Evaluations of a rape complainant’s credibility often determine whether a case progresses through the criminal justice system. Even though emotional demeanor is not related to witness honesty or accuracy, distressed rape complainants are perceived to be more credible than complainants who present with controlled affect. To understand the extent and robustness of the influence of emotional demeanor on credibility judgments of female adult rape complainants, we conducted a systematic review, meta-analysis and p-curve analysis of the experimental simulated decision-making literature on the influence of complainant emotional demeanor on complainant credibility. The meta-analysis included 20 studies with participants who were criminal justice professionals (e.g., police officers and judges), community members, and mock jurors (N = 3128). Results suggest that distressed demeanor significantly increased perceptions of complainant credibility, with a small to moderate effect size estimate. Importantly, the results of p-curve analysis suggest that reporting bias is not a likely explanation for the effect of emotional demeanor on rape complainant credibility. Sample type (whether perceivers were criminal justice professionals or prospective jurors) and stimulus modality (whether perceivers read about or watched the complainant recount the alleged rape) were not found to moderate the effect size estimate. These results suggest that effective methods of reducing reliance on emotional demeanor to make credibility judgments about rape complainants should be investigated to make credibility assessments fairer and more accurate.


Sign in / Sign up

Export Citation Format

Share Document