scholarly journals Reporting quality of randomized controlled trial abstracts

2015 ◽  
Vol 146 (9) ◽  
pp. 669-678.e1 ◽  
Author(s):  
Fang Hua ◽  
Lijia Deng ◽  
Chung How Kau ◽  
Han Jiang ◽  
Hong He ◽  
...  
Trials ◽  
2019 ◽  
Vol 20 (1) ◽  
Author(s):  
Rohan Kumar Ochani ◽  
Asim Shaikh ◽  
Naser Yamani

AbstractRandomized controlled trials are considered the gold standard in assessing treatment regimens, and since abstracts may be the only part of a paper that a physician reads, accurate reporting of data in abstracts is essential. The CONSORT checklist for abstracts was designed to standardize data reporting; however, for papers submitted to anesthesiology journals, the level of adherence to the CONSORT checklist for abstracts is unknown. Therefore, we commend Janackovic and Puljak for their efforts in determining the adherence of reports of trials in the highest-impact anesthesiology journals between 2014 and 2016. The results of their study are extremely important; however, we believe that that study had some methodological limitations, which we discuss in this manuscript.


Trials ◽  
2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Melissa L. Rethlefsen ◽  
Sara Schroter ◽  
Lex M. Bouter ◽  
David Moher ◽  
Ana Patricia Ayala ◽  
...  

Abstract Background Problems continue to exist with the reporting quality and risk of bias in search methods and strategies in systematic reviews and related review types. Peer reviewers who are not familiar with what is required to transparently and fully report a search may not be prepared to review the search components of systematic reviews, nor may they know what is likely to introduce bias into a search. Librarians and information specialists, who have expertise in searching, may offer specialized knowledge that would help improve systematic review search reporting and lessen risk of bias, but they are underutilized as methodological peer reviewers. Methods This study will evaluate the effect of adding librarians and information specialists as methodological peer reviewers on the quality of search reporting and risk of bias in systematic review searches. The study will be a pragmatic randomized controlled trial using 150 systematic review manuscripts submitted to BMJ and BMJ Open as the unit of randomization. Manuscripts that report on completed systematic reviews and related review types and have been sent for peer review are eligible. For each manuscript randomized to the intervention, a librarian/information specialist will be invited as an additional peer reviewer using standard practices for each journal. First revision manuscripts will be assessed in duplicate for reporting quality and risk of bias, using adherence to 4 items from PRISMA-S and assessors’ judgements on 4 signaling questions from ROBIS Domain 2, respectively. Identifying information from the manuscripts will be removed prior to assessment. Discussion The primary outcomes for this study are quality of reporting as indicated by differences in the proportion of adequately reported searches in first revision manuscripts between intervention and control groups and risk of bias as indicated by differences in the proportions of first revision manuscripts with high, low, and unclear bias. If the intervention demonstrates an effect on search reporting or bias, this may indicate a need for journal editors to work with librarians and information specialists as methodological peer reviewers. Trial registration Open Science Framework. Registered on June 17, 2021, at 10.17605/OSF.IO/W4CK2.


PLoS ONE ◽  
2017 ◽  
Vol 12 (11) ◽  
pp. e0187807 ◽  
Author(s):  
Seung Yeon Song ◽  
Boyeon Kim ◽  
Inhye Kim ◽  
Sungeun Kim ◽  
Minjeong Kwon ◽  
...  

2016 ◽  
Author(s):  
Peerapol Sukon ◽  
Saijai Kongpechr ◽  
Sakolwan Bubpahou ◽  
Natchaya Boonpian ◽  
Natyaon Manasrisureeyun

In publication of a controlled trial article from health science research, the abstract is an important part that readers usually read first and then decide whether to read the whole article; therefore, information provided in the abstract should be adequate. The CONSORT (consolidated standards of reporting trials) for Abstracts checklist has been developed and used as a guideline for authors to prepare their manuscripts. This checklist has also been used as a tool to evaluate published abstracts. The objectives of this study were to evaluate reporting quality of randomized controlled trial (RCT) and non-RCT abstracts from chicken research and to determine factors associated with the reporting quality. We searched PubMed for RCT and non-RCT abstracts involving chicken research published between 2006 and 2015. The included abstracts were evaluated using the modified CONSORT for Abstracts checklist. The primary outcome was a mean overall quality score (OQS), which, for each abstract, was a sum of items reported in the modified CONSORT for Abstracts checklist. In addition, some pre-specified factors were evaluated for their association with the reporting quality using simple and multiple linear regression analyses. A total of 949 abstracts (n=262 for RCT and n=687 for non-RCT abstracts) were included and evaluated. Although OQS was significantly greater in RCT than in non-RCT abstracts (mean ± SD, 6.7 ± 0.9 vs 3.3 ± 1.1; P-value<0.001), both mean scores were still less than half of the full score of 15. Only 2 items—objective and conclusions—were adequately reported (>80%) in both types of the abstracts. Items concerning trial design, participants, interventions, randomization, and number randomized were adequately reported only in the RCT abstracts. In contrast, items concerning the study as randomized in the title, clearly defined primary outcome, blinding, numbers analyzed, estimated effect size and its precision for the primary outcome, trial registration, and funding were not reported or reported less than 5% in both RCT and non-RCT abstracts. In this study, 4 factors—year of publication, number of trials reported, number of experimental groups reported, and sample size reported—were associated with OQS. That is, abstracts with higher OQS were published more recently, reported a single trial rather than multiple trials, reported number of experimental groups rather than not reported, and reported sample size rather than not reported. These factors explained about 37.5% of the variance of OQS. In conclusion, reporting quality of RCT and non-RCT abstracts from chicken research was suboptimal. Therefore, efforts especially the development of specific guidelines based on the CONSORT for Abstracts checklist should be made for reporting controlled trial abstracts from chicken research to improve the transparency, completeness, and sufficiently detailed of reporting.


2016 ◽  
Author(s):  
Peerapol Sukon ◽  
Saijai Kongpechr ◽  
Sakolwan Bubpahou ◽  
Natchaya Boonpian ◽  
Natyaon Manasrisureeyun

In publication of a controlled trial article from health science research, the abstract is an important part that readers usually read first and then decide whether to read the whole article; therefore, information provided in the abstract should be adequate. The CONSORT (consolidated standards of reporting trials) for Abstracts checklist has been developed and used as a guideline for authors to prepare their manuscripts. This checklist has also been used as a tool to evaluate published abstracts. The objectives of this study were to evaluate reporting quality of randomized controlled trial (RCT) and non-RCT abstracts from chicken research and to determine factors associated with the reporting quality. We searched PubMed for RCT and non-RCT abstracts involving chicken research published between 2006 and 2015. The included abstracts were evaluated using the modified CONSORT for Abstracts checklist. The primary outcome was a mean overall quality score (OQS), which, for each abstract, was a sum of items reported in the modified CONSORT for Abstracts checklist. In addition, some pre-specified factors were evaluated for their association with the reporting quality using simple and multiple linear regression analyses. A total of 949 abstracts (n=262 for RCT and n=687 for non-RCT abstracts) were included and evaluated. Although OQS was significantly greater in RCT than in non-RCT abstracts (mean ± SD, 6.7 ± 0.9 vs 3.3 ± 1.1; P-value<0.001), both mean scores were still less than half of the full score of 15. Only 2 items—objective and conclusions—were adequately reported (>80%) in both types of the abstracts. Items concerning trial design, participants, interventions, randomization, and number randomized were adequately reported only in the RCT abstracts. In contrast, items concerning the study as randomized in the title, clearly defined primary outcome, blinding, numbers analyzed, estimated effect size and its precision for the primary outcome, trial registration, and funding were not reported or reported less than 5% in both RCT and non-RCT abstracts. In this study, 4 factors—year of publication, number of trials reported, number of experimental groups reported, and sample size reported—were associated with OQS. That is, abstracts with higher OQS were published more recently, reported a single trial rather than multiple trials, reported number of experimental groups rather than not reported, and reported sample size rather than not reported. These factors explained about 37.5% of the variance of OQS. In conclusion, reporting quality of RCT and non-RCT abstracts from chicken research was suboptimal. Therefore, efforts especially the development of specific guidelines based on the CONSORT for Abstracts checklist should be made for reporting controlled trial abstracts from chicken research to improve the transparency, completeness, and sufficiently detailed of reporting.


Sign in / Sign up

Export Citation Format

Share Document