scholarly journals Stage 1 Registered Report: The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: five years later

2021 ◽  
Author(s):  
Ingrid Boedker ◽  
David Giofrè ◽  
Geoff Cumming ◽  
Patrizio Tressoldi

The changes in statistical practices and reporting have been documented by Giofrè et al. (2017), who investigated ten statistical and open practices in two high ranking journals (Psychological Science [PS] and Journal of Experimental Psychology, General [JEPG]): Null hypothesis significance testing; confidence or credible intervals; meta-analysis of the results of multiple experiments; confidence intervals interpretation; effect size interpretation; sample size determination; sample size stopping rule; data availability; materials availability; preregistered design and analysis plan.The investigation was based on an analysis of all papers published in these journals between 2013 and the 2015.The aim of the present study is to follow up changes in both PS and the JEPG in subsequent years, from 2016 to 2020 adding code availability as further open practice.

2020 ◽  
Vol 40 (7) ◽  
Author(s):  
Guanghai Wu ◽  
Mei Xue ◽  
Yongjie Zhao ◽  
Youkui Han ◽  
Shuai Zhang ◽  
...  

Abstract Epidemiological studies have suggested inconclusive associations between 25-hydroxyvitamin D (25(OH)D) and survival in patients with colorectal cancer (CRC). The aim of the present study was to quantitatively assess these associations. PubMed, EMBASE, and Web of Science databases were systematically searched for eligible studies. Subgroup analyses based on study geographic location, publication year, length of follow-up time, sample size, and stage were conducted to explore the potential sources of heterogeneity. Dose–response relationships and pooled hazard ratios (HR) for overall and CRC-specific survival comparing the highest versus the lowest categories of circulating 25(OH)D concentrations were assessed. Overall, 17 original studies with a total of 17,770 CRC patients were included. Pooled HR (95% confidence intervals) comparing highest versus lowest categories were 0.64 (0.55–0.72) and 0.65 (0.56–0.73) for overall and CRC-specific survival, respectively. Studies conducted in the U.S.A., with median follow-up time ≥ 8 years, larger sample size, and including stage I-III patients showed a more prominent association between 25(OH)D concentrations and overall survival. The dose–response analysis showed that the risk of all-cause mortality was reduced by 7% (HR = 0.93; 95% CI: 0.90, 0.95), and the risk of CRC-specific mortality was reduced by 12% (HR = 0.88; 95% CI: 0.84, 0.93) for each 20 nmol/l increment of 25(OH)D concentration. This meta-analysis provides evidences that a higher 25(OH)D concentration is associated with lower overall mortality and CRC-specific mortality.


2020 ◽  
Vol 2020 ◽  
pp. 1-12 ◽  
Author(s):  
Zhuyu Li ◽  
Yunjiu Cheng ◽  
Dongyu Wang ◽  
Haitian Chen ◽  
Hanqing Chen ◽  
...  

Objective. The reported incidence of type 2 diabetes mellitus (T2DM) after gestational diabetes (GDM) varies widely. The purpose of this meta-analysis was to define the incidence rate of T2DM among women with a history of GDM and to examine what might modulate the rate. Research Design and Methods. We searched PubMed and Embase for terms related to T2DM after GDM up to January 2019. Large cohort studies with sample size ≥300 and follow-up duration of at least one year were included. Data from selected studies were extracted, and meta-analysis was performed using the random-effects model. Subgroups analyses were based on the sample size of gestational diabetes, geographic region, maternal age, body-mass index, diagnostic criteria, and duration of follow-up. Results. Twenty-eight studies involving 170,139 women with GDM and 34,627 incident cases of T2DM were identified. The pooled incidence of T2DM after GDM was 26.20 (95% CI, 23.31 to 29.10) per 1000 person-years. Women from Asia and those with older age and higher body mass index seem to experience higher risk of developing T2DM. The incidence rate of T2DM was lowest when applying IADPSG (7.16 per 1000 person-years) to diagnose GDM. The risk of developing T2DM after GDM increased linearly with the duration of follow-up. The increments per year of follow-up were estimated at 9.6‰. The estimated risks for T2DM were 19.72% at 10 years, 29.36% at 20 years, 39.00% at 30 years, 48.64% at 40 years, and 58.27% at 50 years, respectively. Conclusions. The findings of very high incidence of T2DM after GDM add an important insight into the trajectory of the development of T2DM in the long-term postpartum periods, which could provide evidence for consultant and might motivate more women with GDM to screen for T2DM. This trial is registered with PROSPERO identifier CRD42019128980.


Author(s):  
Ahmad A. Mirza ◽  
Hatim Y. Shawli ◽  
Talal A. Alandejani ◽  
Sattam M. Aljuaid ◽  
Mahmoud Alreefi ◽  
...  

Abstract Objective Chronic rhinosinusitis (CRS) negatively affects quality of life (QoL), and balloon catheter sinuplasty (BCS) has shown good outcomes in adult patients. However, there has not been much research on the effects of BCS on pediatric patients. The objective of this review is to systematically assess the literature for studies demonstrating the effectiveness and safety of BCS in pediatric CRS patients. Data sources PubMed, Embase and Cochrane Library. Study selection We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis recommendations (PRISMA) to conduct our study. Observational- and interventional-based studies reporting efficacy and/or side effects of BCS among pediatric populations were included. Efficacy was evaluated by clinically reliable measures including Sino-Nasal 5 (SN-5) QoL scale. Antibiotic usage and revision surgery were also evaluated. Data extraction Articles were screened, and data were obtained. Study design, sample size and demographics, treated sinuses, criteria of inclusion, adjunct procedure(s), follow-up time, and outcomes measured were reported. Main findings Out of 112 articles identified, 10 articles were included: two interventional controlled trials and eight observational studies. All studies evaluating QoL by SN-5 showed a remarkable reduction in SN-5 score postoperatively. Improvement in the computed tomography (CT) and endoscopic findings for up to 1 year after operation was reported. Furthermore, the majority of patinets treated with BCS did not recieve any course of sinusitis-indicated antibiotics during long-term follow-up, and they had low surgical revision rates. Minor side effects were reported, most commonly synechia. Conclusion Available evidence suggests that BCS is safe and effective for the treatment of CRS in pediatric patients. Future randomized controlled studies with large sample size are warranted. Such studies can further determine the efficacy of BCS in managing children with CRS.


Stroke ◽  
2021 ◽  
Vol 52 (2) ◽  
pp. 748-760
Author(s):  
Renerus J. Stolwyk ◽  
Tijana Mihaljcic ◽  
Dana K. Wong ◽  
Jodie E. Chapman ◽  
Jeffrey M. Rogers

This systematic review and meta-analysis aimed to investigate whether cognition is associated with activity and participation outcomes in adult stroke survivors. Five databases were systematically searched for studies investigating the relationship between general- and domain-specific cognition and longer-term (>3 months) basic activities of daily living (ADL), instrumental ADLs, and participation outcomes. Eligibility for inclusion, data extraction, and study quality was evaluated by 2 reviewers using a standardized protocol. Effect sizes ( r ) were estimated using a random-effects model. Sixty-two publications were retained for review, comprising 7817 stroke survivors (median age 63.57 years, range:18–96 years). Median length of follow-up was 12 months (range: 3 months–11 years). Cognition (all domains combined) demonstrated a significant medium association with all 3 functional outcomes combined, r =0.37 (95% CI, 0.33–0.41), P <0.001. Moderator analyses revealed these effects persisted regardless of study quality, order in which outcomes were collected (sequential versus concurrent), age, sample size, or follow-up period. Small to medium associations were also identified between each individual cognitive domain and the separate ADL, instrumental ADL, and participation outcomes. In conclusion, poststroke cognitive impairment is associated with early and enduring activity limitations and participation restrictions, and the association is robust to study design factors, such as sample size, participant age, follow-up period, or study quality. Cognitive assessment early poststroke is recommended to facilitate early detection of disability, prediction of functional outcomes, and to inform tailored rehabilitation therapies.


2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Sitong Lin ◽  
Yushan Guo

As the scale and depth of artificial intelligence network models continue to increase, their accuracy in albumin recognition tasks has increased rapidly. However, today’s small medical datasets are the main reason for the poor recognition of artificial intelligence techniques in this area. The sample size in this article is based on the data analysis and research on urine albumin detection of diabetes in the EI database. It is assumed that the observation group has at least 20 mg UAER difference from the control group, and the standard deviation of the UAER change from baseline to 12 weeks is 30 mg. Therefore, the sample size of the two groups is 77 cases. Assuming that the rate of loss to follow-up during the follow-up period is 20%, at least 92 patients are needed. The final enrollment in this study is 100 patients. Studies have shown that DR is used as an indicator to diagnose NDRD, and its OR value is as high as 28.198, indicating that non-DR can be used as an indicator to distinguish DN from NDRD. The meta-analysis found that DR has a sensitivity of 0.65 and a specificity of 0.75 in distinguishing DN from NDRD in patients with type 2 diabetes, and it is emphasized that PDR is highly specific in the diagnosis of DN. Using a meta-analysis to systematically analyze 45 studies, it was found that the sensitivity of DR to diagnose DN was 0.67, the specificity was 0.78, and the specificity of PDR to predict DN was 0.99, indicating that DR is a good indicator for predicting DN, and the team’s latest research has also verified this point of view. They have established a new model for diagnosing DN. In addition to including traditional proteinuria, glycosylated hemoglobin, FR, blood pressure, and other indicators into the diagnostic model, it will also include the presence or absence of DR. The final external verification accuracy rate of this model is 0.875.


Blood ◽  
2015 ◽  
Vol 126 (23) ◽  
pp. 2103-2103 ◽  
Author(s):  
Kai Ruggeri ◽  
Áine Maguire ◽  
Susanne Schmitz ◽  
Elisa Haller ◽  
Cathal Walsh ◽  
...  

Abstract Introduction: Recently introduced treatments have improved survival outcomes in relapsed or refractory multiple myeloma (rrMM), with positive outlooks from ongoing trials. However, evidence on relative effectiveness to inform best practice is lacking due to the paucity of head-to-head clinical trials. This systematic review aimed to compare all treatments in rrMM via a mixed treatment comparison (MTC), taking into account prior lines of therapy. Novel statistical techniques using a network meta-analysis (NMA) were developed to estimate relative effectiveness. Methods: A literature search was conducted August 2014 and repeated December 2014. Randomised control trials (RCTs) were included if they reported median duration of progression-free survival (PFS), overall survival (OS) or time to progression (TTP) as a primary or secondary rrMM treatment outcomes. A Bayesian NMA using non-informative prior distributions was fitted in the software application R using JAGS. Such models allow for the estimation of all pairwise comparisons within a connected network of evidence. Fixed effects were assumed, as each direct comparison in the network is informed by a maximum of two trials, which does not allow for the estimation of a heterogeneity parameter. Considerable heterogeneity was observed across studies. In particular the number of prior treatment lines among patients recruited into trials in rrMM varied markedly and was often not reported in enough detail to include this potentially important variable in the analysis. As a result, trials conducted in heavily pre-treated patient populations (3 or more prior lines of therapy) were excluded from the primary analysis. Results: A total of 24 RCTs reporting relevant outcomes for 20 different treatment regimens were identified for data extraction. It was not possible to link all 20 regimens within a single evidence network, but the majority (16) were incorporated within two networks (see figure 1). As a result, the analysis estimated all pairwise comparisons within each of the networks; it is not possible to draw conclusions for comparisons across networks. Results are presented in figure 2 for the yellow (larger) and blue networks (smaller). Three studies were excluded from the presented analysis as median PFS had not yet been reached at follow up. Median follow up across all identified studies ranged from 5.59 to 36 months. Within the yellow network, carfilzomib in combination with lenalidomide and dexamethasone was the most effective treatment, followed by lenalidomide and dexamethasone and then bortezomib. In the smaller blue evidence network, bortezomib in combination with dexamethasone and panobinostat was the most effective treatment. Discussion: Decision-making to optimise patient care, supported by clinical guidelines, requires evidence-based assessment of available treatments. In practise this is often restricted to a series of pair-wise comparisons of treatments such that drawing appropriate inferences across all available options is not possible. To our knowledge, the application of NMA and subsequent results presented here are the first of their kind in rrMM. Previous meta-analyses have been reported for individual treatments, but not for all available options. Our analysis appears broadly consistent with evidence from clinical trials for licensed treatments which are now the established standard of care in rrMM. One limitation of our analysis relates to the published evidence on prior treatment lines in rrMM patients. Fitting a meta-regression to explain heterogeneity may lead to confounding of the treatment effect given the available evidence. Patient level data would allow for a more reliable analysis of the effect of prior treatment lines on PFS. A further consideration is the level of evidence included within our analysis. NMA typically focuses on data drawn from RCTs though methods are available to allow for the inclusion of non-RCT evidence. A great deal of published evidence of this sort is available in the rrMM setting and future analytical approaches should explore how the inclusion of this evidence affects our findings. Figure 1. Reduced RCT evidence network (red links for trials which not reporting OS outcomes) Figure 1. Reduced RCT evidence network (red links for trials which not reporting OS outcomes) Figure 2. Odds ratio and 95% credible intervals for pairwise comparisons A versus B. Significant differences shaded in green. Estimates below 1 favour drug A, estimates above 1 favour drug B. Figure 2. Odds ratio and 95% credible intervals for pairwise comparisons A versus B. Significant differences shaded in green. Estimates below 1 favour drug A, estimates above 1 favour drug B. Figure 3. Figure 3. Disclosures Ruggeri: Cogentia UK: Research Funding. Maguire:Cogentia Healthcare Consulting: Research Funding. Cook:Celgene: Consultancy, Research Funding, Speakers Bureau; BMS: Consultancy; Sanofi: Consultancy, Speakers Bureau; Amgen: Consultancy, Speakers Bureau; Takeda Oncology: Consultancy, Research Funding, Speakers Bureau; Janssen: Consultancy, Research Funding, Speakers Bureau. O'Dwyer:Celgene: Honoraria, Research Funding.


Sign in / Sign up

Export Citation Format

Share Document