scholarly journals Research transparency promotion by surgical journals publishing randomised controlled trials: a survey

2019 ◽  
Author(s):  
Nicolas Lombard ◽  
Anis Gasmi ◽  
Laurent Sulpice ◽  
Karim Boudjema ◽  
Florian Naudet ◽  
...  

Abstract Objective To describe the surgical journal position statement on data-sharing policies (primary objective) and to describe the other features of their research transparency promotion.Methods Only “SURGICAL” journals with an impact factor superior to 2 (Web of Science) were eligible for the study. They were not included if there were no explicit instructions for clinical trial publication in the instructions for authors and if there were no RCT published between January 2016 and January 2019. The primary outcome was the existence of a data-sharing policy in the instructions for authors. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement” policy; a “COIs” disclosure requirement and a specific reference to reporting guidelines such as CONSORT for RCT.Results Among the 87 surgical journals eligible, 82 (94%) were included in the analysis: 67 (77%) had explicit instructions for RCT and of the remaining, 15 (17.2%) had published at least one RCT between 2016-2019. The median impact factor was 2.98 [IQR=2.48-3.77] and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR=5-20.75]. Data-sharing statement instructions (primary outcome) were ICMJE-compliant in four cases (4.88%), weaker in 45.12% (n=37) and inexistent in 50% (n=41) of the journals. As for data-sharing statements, no association was found between journal characteristics and the existence of data-sharing policies (ICMJE-compliant or weaker). A “prospective registration of clinical trials requirement” was associated with ICMJE allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines.Conclusion Research transparency promotion is still limited in surgical journals. Uniformization of journal requirements vis-à-vis ICMJE guidelines could be a first step forward for research transparency promotion in surgery.

2019 ◽  
Author(s):  
N. Lombard ◽  
A. Gasmi ◽  
L. Sulpice ◽  
K. Boudjema ◽  
F. Naudet ◽  
...  

AbstractObjectiveTo describe the surgical journal position statement on data-sharing policies (primary objective) and to describe the other features of their research transparency promotion.MethodsOnly “SURGICAL” journals with an impact factor superior to 2 (Web of Science) were eligible for the study. They were not included if there were no explicit instructions for clinical trial publication in the instructions for authors and if there were no RCT published between January 2016 and January 2019. The primary outcome was the existence of a data-sharing policy in the instructions for authors. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement” policy; a “COIs” disclosure requirement and a specific reference to reporting guidelines such as CONSORT for RCT.ResultsAmong the 87 surgical journals eligible, 82 (94%) were included in the analysis: 67 (77%) had explicit instructions for RCT and of the remaining, 15 (17.2%) had published at least one RCT between 2016-2019. The median impact factor was 2.98 [IQR=2.48-3.77] and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR=5-20.75]. Data-sharing statement instructions (primary outcome) were ICMJE-compliant in four cases (4.88%), weaker in 45.12% (n=37) and inexistent in 50% (n=41) of the journals. As for data-sharing statements, no association was found between journal characteristics and the existence of data-sharing policies (ICMJE-compliant or weaker). A “prospective registration of clinical trials requirement” was associated with ICMJE allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines.ConclusionResearch transparency promotion is still limited in surgical journals. Uniformization of journal requirements vis-à-vis ICMJE guidelines could be a first step forward for research transparency promotion in surgery.


2020 ◽  
Author(s):  
Nicolas Lombard ◽  
Anis Gasmi ◽  
Laurent Sulpice ◽  
Karim Boudjema ◽  
Florian Naudet ◽  
...  

Abstract Objective: To describe the surgical journal position statement on data-sharing policies (primary objective) and to describe the other features of their research transparency promotion. Methods: Only “SURGICAL” journals with an impact factor superior to 2 (Web of Science) were eligible for the study. They were not included if there were no explicit instructions for clinical trial publication in the official instructions for authors (OIA) and if there were no randomized controlled trial (RCT) published between 1 st January 2016 and 1 st January 2019. The primary outcome was the existence of a data-sharing policy in the instructions for authors. Data sharing policy was detailed in 3 categories, the International committee of medical journal editors (ICMJE) compliant, optional or inexistent. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement” policy; a conflict of interests (COIs) disclosure requirement and a specific reference to reporting guidelines such as CONSORT for RCT. Results: Among the 87 surgical journals eligible, 82 were included in the study: 67 (82%) had explicit instructions for RCT and of the remaining, 15 (18%) had published at least one RCT. The median impact factor was 2.98 [IQR=2.48-3.77] and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR=5-20.75]. Data-sharing statement instructions (primary outcome) was retrieved in 41 journals (50%); Data-sharing statement instructions were ICMJE compliant in four cases (4.9%), optional in 45% (n=37) and inexistent in 50% (n=41) of the journals. As for data-sharing statements, no association was found between journal characteristics and the existence of data-sharing policies (ICMJE-compliant or optional). A “prospective registration of clinical trials requirement” was associated with ICMJE allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines. Conclusion: Research transparency promotion is still limited in surgical journals. Standardisation of journal requirements according to ICMJE guidelines could be a first step forward for research transparency promotion in surgery.


2020 ◽  
Author(s):  
Nicolas Lombard ◽  
Anis Gasmi ◽  
Laurent Sulpice ◽  
Karim Boudjema ◽  
Florian Naudet ◽  
...  

Abstract Objective: To describe the surgical journal position statement on data-sharing policies (primary objective) and to describe the other features of their research transparency promotion. Methods: Only “SURGICAL” journals with an impact factor superior to 2 (Web of Science) were eligible for the study. They were not included if there were no explicit instructions for clinical trial publication in the official instructions for authors (OIA) and if there were no randomized controlled trial (RCT) published between 1st January 2016 and 31st December 2018. The primary outcome was the existence of a data-sharing policy in the instructions for authors. Data sharing policy was detailed in 3 categories, inclusion of data sharing policy mandatory, optional or not available. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement” policy; a conflict of interests (COIs) disclosure requirement and a specific reference to reporting guidelines such as CONSORT for RCT. Results: Among the 87 surgical journals eligible, 82 were included in the study: 67 (82%) had explicit instructions for RCT and of the remaining, 15 (18%) had published at least one RCT. The median impact factor was 2.98 [IQR=2.48-3.77] and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR=5-20.75]. Data-sharing statement instructions (primary outcome) was retrieved in 41 journals (50%); Data-sharing statement instructions were mandatory in four cases (4.9%), optional in 45% (n=37) and not available in 50% (n=41) of the journals. As for data-sharing statements, no association was found between journal characteristics and the existence of data-sharing policies (mandatory or optional). A “prospective registration of clinical trials requirement” was associated with ICMJE allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines. Conclusion: Research transparency promotion is still limited in surgical journals. Standardisation of journal requirements according to ICMJE guidelines could be a first step forward for research transparency promotion in surgery.


2020 ◽  
Author(s):  
Nicolas Lombard ◽  
Anis Gasmi ◽  
Laurent Sulpice ◽  
Karim Boudjema ◽  
Florian Naudet ◽  
...  

Abstract Objective: To describe surgical journals’ position statements on data-sharing policies (primary objective) and to describe key features of their research transparency promotion.Methods: Only “SURGICAL” journals with an impact factor higher than 2 (Web of Science) were eligible for the study. They were included, if there were explicit instructions for clinical trial publication in the official instructions for authors, (OIA) and or if they had published randomized controlled trial (RCT) between 1st January 2016 and 31st December 2018. The primary outcome was the existence of a data-sharing policy included in the instructions for authors. Data sharing policies were grouped into 3 categories, inclusion of data sharing policy mandatory, optional or not available. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement policy”; a conflict of interests (COIs) disclosure requirement and a specific reference to reporting guidelines, such as CONSORT for RCT. Results: Among the 87 surgical journals identified, 82 were included in the study: 67 (82%) had explicit instructions for RCT and the remaining 15 (18%) had published at least one RCT. The median impact factor was 2.98 [IQR=2.48-3.77] and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR=5-20.75]. The OIA of four journals (5%) stated that the inclusion of a data sharing statement was mandatory, optional in 45% (n=37), and not included in 50% (n=41).No association was found between journal characteristics and the existence of data-sharing policies (mandatory or optional). A “prospective registration of clinical trials requirement” was associated with International Committee of Medical Journal Editors (ICMJE) allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines. Conclusion: Research transparency promotion is still limited in surgical journals. Standardisation of journal requirements according to ICMJE guidelines could be a first step forward for research transparency promotion in surgery.


Trials ◽  
2020 ◽  
Vol 21 (1) ◽  
Author(s):  
N. Lombard ◽  
A. Gasmi ◽  
L. Sulpice ◽  
K. Boudjema ◽  
F. Naudet ◽  
...  

Abstract Objective To describe surgical journals’ position statements on data-sharing policies (primary objective) and to describe key features of their research transparency promotion. Methods Only “SURGICAL” journals with an impact factor higher than 2 (Web of Science) were eligible for the study. They were included, if there were explicit instructions for clinical trial publication in the official instructions for authors (OIA) or if they had published randomised controlled trial (RCT) between 1 January 2016 and 31 December 2018. The primary outcome was the existence of a data-sharing policy included in the instructions for authors. Data-sharing policies were grouped into 3 categories, inclusion of data-sharing policy mandatory, optional, or not available. Details on research transparency promotion were also collected, namely the existence of a “prospective registration of clinical trials requirement policy”, a conflict of interests (COIs) disclosure requirement, and a specific reference to reporting guidelines, such as CONSORT for RCT. Results Among the 87 surgical journals identified, 82 were included in the study: 67 (82%) had explicit instructions for RCT and the remaining 15 (18%) had published at least one RCT. The median impact factor was 2.98 [IQR = 2.48–3.77], and in 2016 and 2017, the journals published a median of 11.5 RCT [IQR = 5–20.75]. The OIA of four journals (5%) stated that the inclusion of a data-sharing statement was mandatory, optional in 45% (n = 37), and not included in 50% (n = 41). No association was found between journal characteristics and the existence of data-sharing policies (mandatory or optional). A “prospective registration of clinical trials requirement” was associated with International Committee of Medical Journal Editors (ICMJE) allusion or affiliation and higher impact factors. Journals with specific RCT instructions in their OIA and journals referenced on the ICMJE website more frequently mandated the use of CONSORT guidelines. Conclusion Research transparency promotion is still limited in surgical journals. Standardisation of journal requirements according to ICMJE guidelines could be a first step forward for research transparency promotion in surgery.


2020 ◽  
Vol 49 (6) ◽  
pp. 708-712
Author(s):  
John A. Kellum

<b><i>Introduction:</i></b> Reports of consensus conferences are usually valued less than reports of clinical trials even when rigorous methodology is used. However, limited data are available comparing the impact of these 2 methods of shaping clinical practice. <b><i>Objective:</i></b> Compare the publication impact of consensus conferences and clinical trials. <b><i>Methods:</i></b> Consensus publications from the Acute Disease Quality Initiative (ADQI) from 2002 through 2017 were identified and classified by subject matter. Randomized trials were identified in the same publication year and subject in journals, starting with the highest impact factor. Both publication types were matched, and total citations were determined for each using Google Scholar. A secondary analysis compared total costs for each publication type. <b><i>Results and Conclusions:</i></b> Seventeen ADQI consensus conference reports and 17 randomized trials were identified. ADQI reports received a similar number of citations per paper (median, interquartile range) compared to randomized trials (132, 54–228; vs. 159, 60–340, <i>p</i> = ns). Similarly, 10 (58.8%) ADQI reports and 10 randomized trials were cited &#x3e;100 times. On average, ADQI reports appeared in journals with lower impact factors compared to clinical trials (5.4 ± 4.6 vs. 25.4 ± 27.1; <i>p</i> &#x3c; 0.01). The median cost per citation (USD 2017) for ADQI reports was USD 606.01 compared to almost twice this figure, USD 1,182.59, for clinical trials on the same topics (<i>p</i> = 0.09). Despite being published in lower impact factor journals, consensus reports on topics in critical care nephrology, received similar citations to randomized controlled trials published the same year.


2018 ◽  
Author(s):  
Herm J Lamberink ◽  
Christiaan Vinkers ◽  
Willem M. Otte ◽  
Joeri K. Tijdink

Objective Randomised clinical trials (RCTs) are complex endeavours that demand extensive collaborative efforts from researchers, institutions, and funding partners. Undoubtedly, there is ample reason to acknowledge these efforts and to be grateful for publication of the results. However, some RCTs explicitly express gratitude in an acknowledgment section whereas other do not. We hypothesized that this would be related to author’s gender and religion, medical field, journal, and year of publication. DesignQuantitative analysis of all available full-text randomised clinical trials identified through PubMed.Methods We determined the presence of an acknowledgment section containing explicit words of gratitude in 90,163 full-text publications. The hypotheses were publicly pre-registered before study conduct. We tested the following determinants of the presence of these acknowledgment sections: gender of the first and last author, the percentage of protestant inhabitants in the country of the primary research institution, the year of publication, journal impact factor (JIF), the journal’s medical field (compared to the medical field of surgery). Explorative analyses were performed on the different determinants that were associated with received gratitude in the acknowledgement sections. Main outcome measureThe presence of an acknowledgment section with explicit words of gratitude.Results In total, 28,897 (32%) RCT publications contained an acknowledgement section with explicit words of gratitude. All hypotheses were confirmed, with a higher likelihood of an acknowledgement section with words of gratitude when the first and/or last author was female (OR 1.28 95% CI 1.24-1.31), an increased percentage of protestant inhabitants in the country of the first author’s affiliation (+ 10%; OR = 1.04 95% CI 1.04-1.05), and more recent publication (+ 1 year; OR 1.04 95% CI 1.04-1.05). The journal’s impact factor (- 1 JIF; OR = 0.99 95% CI 0.99-0.99) and RCTs published in surgical journals (OR 0.35 95% CI 0.32-0.38) were associated with a lower likelihood of RCT publications containing words of gratitude. Conclusions Acknowledgement sections with explicit words of gratefulness are more frequently present when researchers are female, from protestant countries, working in non-surgical fields, and published in lower impact factor journals, and this trend has increased over time. To foster a healthy and responsible publication culture, it is important that all individuals, institutions, and groups that have contributed to the research are acknowledged. Credit should go where credit is due, and Christmas is the most suitable period to remind us of the importance of gratitude.


2018 ◽  
Vol 9 (1) ◽  
pp. 1-2 ◽  
Author(s):  
Koen Venema

After a steady increase over recent years, last year we experienced our first drop in Impact Factor (IF): from 3.301 to 2.923. Although last year I concluded that I was pretty awful at predicting the future (Venema, 2017; and I still haven’t found a probiotic to improve that …), this result was not entirely unexpected. As a young journal (we have yet to celebrate our 10th anniversary), the IF will inevitably fluctuate a little. I keep track of the IF development over the course of the year and we are well on our way to achieving an IF of above 2 again (with still another 6 months to go until the end of June, when the new impact factors will be provided by Clarivate Analytics), which isn’t bad at all for a young journal.


Phlebologie ◽  
1998 ◽  
Vol 27 (03) ◽  
pp. 77-83
Author(s):  
A. Finzen

ZusammenfassungWissenschaftliche Leistungen leben von der Originalität ihrer Urheber. Der Ver-such, sie zu quantifizieren, erscheint als Widerspruch in sich. Um so irritierender ist der Siegeszug des sogenannten Impact Factors, eines Konstrukts des amerikanischen Institute of Scientific Information (ISI), das den Anspruch stellt, über die Häufigkeit der Zitierung von – vom ISI erfaßten – Zeitschriften das Gewicht der in diesen publizierenden Wissenschaftler zu messen. Seit naturwissenschaftliche und medizinische Forschungseinrichtungen und Fakultäten dazu übergehen, den Impact Factor zur Grundlage für die Verteilung von Forschungsgeldern und zur Guillotine für wissenschaftliche Karrieren zu machen, schickt er sich an, die internationale Wissenschaftskultur zu verändern. Deshalb ist es an der Zeit, daß die Öffentlichkeit dieses Zeitgeistphänomen zur Kenntnis nimmt und sich mit seinen Folgen auseinandersetzt.


Author(s):  
Gianfranco Pacchioni

This chapter discusses how performance is measured in science, such as through the role of citation metrics. Next, the chapter discusses the pros and cons of bibliometric indexes, and of ‘impact factor’, which was introduced by Eugene Garfield in 1955 but not widely used until twenty years later. The various ways that journals attempt to improve their impact factors, and how this will affect science, are also examined. Besides impact factor, the role played by indicators in evaluating scientists, such as the recently introduced h-index, is explored. Finally, fashions and trends in science are touched upon, illustrated with personal anecdotes from the author.


Sign in / Sign up

Export Citation Format

Share Document