scholarly journals Overinterpretation of Research Findings: Evaluation of “Spin” in Systematic Reviews of Diagnostic Accuracy Studies in High–Impact Factor Journals

2020 ◽  
Vol 66 (7) ◽  
pp. 915-924 ◽  
Author(s):  
Trevor A McGrath ◽  
Joshua C Bowdridge ◽  
Ross Prager ◽  
Robert A Frank ◽  
Lee Treanor ◽  
...  

Abstract Background To compare the frequency of “spin” in systematic reviews of diagnostic accuracy studies in high-impact journals with the frequency a previously assessed series of reviews. Methods Medline was searched from January 2010 to January 2019. Systematic reviews of diagnostic accuracy studies were included if they reported a meta-analysis and were published in a journal with an impact factor >5. Two investigators independently scored each included systematic review for positivity of conclusions and for actual and potential overinterpretation practices. Results Of 137 included systematic reviews, actual overinterpretation was present in ≥1 form in the abstract in 63 (46%) and in the full-text report in 52 (38%); 108 (79%) contained a form of potential overinterpretation. Compared with the previously assessed series (reviews published 2015–2016), reviews in this series were less likely to contain ≥1 form of actual overinterpretation in the abstract and full-text report or ≥1 form of potential overinterpretation (P < 0.001 for all comparisons). The significance of these comparisons did not persist for actual overinterpretation in sensitivity analysis in which Cochrane systematic reviews were removed. Reviews published in the Cochrane Database of Systematic Reviews were less likely to contain actual overinterpretation in the abstract or the full-text report than reviews in other high-impact journals (P < 0.001 for both comparisons). Conclusions Reviews of diagnostic accuracy studies in high-impact journals are less likely to contain overinterpretation or spin. This difference is largely due to the reviews published in the Cochrane Database of Systematic Reviews, which contain spin less often than reviews published in other high-impact journals.


2020 ◽  
Vol 10 (1) ◽  
pp. 51-61
Author(s):  
B. Niveditha ◽  
Mallinath Kumbar

The present study examines the availability and recovery of web references cited in scholarly journals selected based on their high impact factor published between 2008 and 2017. A PHP script was used to crawl the Uniform Resource Locators (URL) collected from the references. A total of 5720 articles were downloaded and 237418 references were extracted. A total of 33512 URLs were checked for their availability. Further the lexical features of URLs like file extension, path depth, character length and top-level domain was determined. The research findings indicated that out of 33512 web references, 20218 contained URLs, DOIs were found in 12799 references and 495 references contained arXiv or WOS identifier. It was found that 29760 URLs were accessible and the remaining 3752 URLs were missing. Most errors were due to HTTP 404 error code (Not found error). The study also tried to recover the inaccessible URLs through Time Travel. Almost 60.55% of inaccessible URLs were archived in various web archives. The findings of the study will be helpful to authors, publishers, and editorial staff to ensure that web references will be accessible in future.



2019 ◽  
Vol 1 (1) ◽  
pp. 1-2
Author(s):  
Mohammad Iqbal Khan

Research is indispensable for the growth and development of all disciplines, particularly medical sciences which fundamentally need continuous research and progressive innovation. Writing and reporting scientific discoveries is an important outcome of a researcher. Mostly, editors and reviewers appreciate manuscripts that are easy to read and to edit beside valuable scientific contents. Medical writings have significantly improved in past two decades resulting in increased number of medical journals and quality of reporting. Once research findings are ready to be reported, a researcher makes an educated choice, as to where to get it published. A high impact factor indicates that research findings published in journal are considered highly influential. With stirring zeal and drive, the “Journal of Shifa Tameer-e-Millat University” (JSTMU) is being launched and a dedicated team of editors, advisors and reviewers has been appointed to facilitate the researchers who wish to publish in JSTMU. 



2017 ◽  
Vol 63 (8) ◽  
pp. 1353-1362 ◽  
Author(s):  
Trevor A McGrath ◽  
Matthew D F McInnes ◽  
Nick van Es ◽  
Mariska M G Leeflang ◽  
Daniël A Korevaar ◽  
...  

Abstract BACKGROUND We wished to assess the frequency of overinterpretation in systematic reviews of diagnostic accuracy studies. METHODS MEDLINE was searched through PubMed from December 2015 to January 2016. Systematic reviews of diagnostic accuracy studies in English were included if they reported one or more metaanalyses of accuracy estimates. We built and piloted a list of 10 items that represent actual overinterpretation in the abstract and/or full-text conclusion, and a list of 9 items that represent potential overinterpretation. Two investigators independently used the items to score each included systematic review, with disagreements resolved by consensus. RESULTS We included 112 systematic reviews. The majority had a positive conclusion regarding the accuracy or clinical usefulness of the investigated test in the abstract (n = 83; 74%) and full-text (n = 83; 74%). Of the 112 reviews, 81 (72%) contained at least 1 actual form of overinterpretation in the abstract, and 77 (69%) in the full-text. This was most often a “positive conclusion, not reflecting the reported summary accuracy estimates,” in 55 (49%) abstracts and 56 (50%) full-texts and a “positive conclusion, not taking high risk of bias and/or applicability concerns into account,” in 47 abstracts (42%) and 26 full-texts (23%). Of these 112 reviews, 107 (96%) contained a form of potential overinterpretation, most frequently “nonrecommended statistical methods for metaanalysis performed” (n = 57; 51%). CONCLUSIONS Most recent systematic reviews of diagnostic accuracy studies present positive conclusions and a majority contain a form of overinterpretation. This may lead to unjustified optimism about test performance and erroneous clinical decisions and recommendations.



BMJ Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. e043665
Author(s):  
Srinivasa Rao Kundeti ◽  
Manikanda Krishnan Vaidyanathan ◽  
Bharath Shivashankar ◽  
Sankar Prasad Gorthi

IntroductionThe use of artificial intelligence (AI) to support the diagnosis of acute ischaemic stroke (AIS) could improve patient outcomes and facilitate accurate tissue and vessel assessment. However, the evidence in published AI studies is inadequate and difficult to interpret which reduces the accountability of the diagnostic results in clinical settings. This study protocol describes a rigorous systematic review of the accuracy of AI in the diagnosis of AIS and detection of large-vessel occlusions (LVOs).Methods and analysisWe will perform a systematic review and meta-analysis of the performance of AI models for diagnosing AIS and detecting LVOs. We will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses Protocols guidelines. Literature searches will be conducted in eight databases. For data screening and extraction, two reviewers will use a modified Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies checklist. We will assess the included studies using the Quality Assessment of Diagnostic Accuracy Studies guidelines. We will conduct a meta-analysis if sufficient data are available. We will use hierarchical summary receiver operating characteristic curves to estimate the summary operating points, including the pooled sensitivity and specificity, with 95% CIs, if pooling is appropriate. Furthermore, if sufficient data are available, we will use Grading of Recommendations, Assessment, Development and Evaluations profiler software to summarise the main findings of the systematic review, as a summary of results.Ethics and disseminationThere are no ethical considerations associated with this study protocol, as the systematic review focuses on the examination of secondary data. The systematic review results will be used to report on the accuracy, completeness and standard procedures of the included studies. We will disseminate our findings by publishing our analysis in a peer-reviewed journal and, if required, we will communicate with the stakeholders of the studies and bibliographic databases.PROSPERO registration numberCRD42020179652.



2020 ◽  
Vol 116 (12) ◽  
pp. e165-e168
Author(s):  
Adam M Sheikh ◽  
Heather Y Small ◽  
Charalambos Antoniades ◽  
Tomasz J Guzik


2012 ◽  
Vol 87 (5) ◽  
pp. 714-716
Author(s):  
Mariane Da Cas de Aquim Martins ◽  
Marília Gabriela Linné Netto Carneiro ◽  
Joyce Benck Utzig ◽  
Eleolina Lara Kaled Neta ◽  
Majenna Andrade Pachnicki ◽  
...  

BACKGROUND: The qualitative and quantitative scientific output of Brazilian dermatologists in journals of high impact factor is little known. OBJECTIVE: To describe the scientific output of dermatologists from Brazilian institutions in journals of high impact factor. METHODS: The five journals with the highest impact factor in dermatology were analyzed. All articles produced from Brazilian institutions between 1986 and 2010 were compiled and the following aspects were analyzed: position of Brazilian researchers in the list of authors, selected theme, experimental design, studied disease, area of interest and year of publication. RESULTS: Seventy-four articles written with the participation of Brazilian dermatologists have been identified. Upon grouping the articles in five-year periods, an important increase was observed in the Brazilian production from the year 2006 onwards. The dermatologists were placed as second authors in the majority of cases (53.66%). According to the selected theme to be studied, the majority of the articles had a laboratory focus (45.95%). The majority of the articles reported cross-sectional studies or non-controlled clinical trials (both at 17.57%), and pemphigus foliaceus was the most studied disease (29.73%). CONCLUSION: The increase in the number of publications by Brazilian dermatologists over the last years is encouraging, but it is still small in comparison to the total number of articles published in these five periodicals.



2014 ◽  
Vol 21 (4) ◽  
pp. 564 ◽  
Author(s):  
P. Tang ◽  
G.R. Pond ◽  
S. Welch ◽  
E.X. Chen


Author(s):  
Mario Pagliaro

In most world’s countries, scholarship evaluation for tenure and promotion continues to rely on conventional criteria of publications in journals of high impact factor and grant funding. Continuing to hire and promote scholars for their achievements in research and in securing research funds exposes universities at risk because students, directly and indirectly through government funds, are the main source of revenues for academic institutions, whereas talented young researchers are those who actually carry out most of the published research. Purposeful scholarship evaluation needs to include all three areas of scholarly activity: research, teaching and mentoring, and service to society. Young scholars seeking tenure and promotion benefit from the practice of open science because it provides better and more impactful results with respect to each of the three areas of scholarship.



2018 ◽  
Vol 28 (1) ◽  
Author(s):  
Ugo Carraro

Myologists working in Padua (Italy) were able to continue a half-century tradition of studies of skeletal muscles, that started with a research on fever, specifically if and how skeletal muscle contribute to it by burning bacterial toxin. Beside main publications in high-impact-factor journals by Padua myologists, I hope to convince readers (and myself) of the relevance of the editing Basic and Applied Myology (BAM), retitled from 2010 European Journal of Translational Myology (EJTM), of the institution of the Interdepartmental Research Center of Myology of the University of Padova (CIR-Myo), and of a long series of International Conferences organized in Euganei Hills and Padova, that is, the PaduaMuscleDays. The 2018Spring PaduaMuscleDays (2018SpPMD), were held in Euganei Hills and Padua (Italy), in March 14-17, and were dedicated to Giovanni Salviati. The main event of the “Giovanni Salviati Memorial”, was held in the Aula Guariento, Accademia Galileiana di Scienze, Lettere ed Arti of Padua to honor a beloved friend and excellent scientist 20 years after his premature passing. Using the words of Prof. Nicola Rizzuto, we all share his believe that Giovanni “will be remembered not only for his talent and originality as a biochemist, but also for his unassuming and humanistic personality, a rare quality in highly successful people like Giovanni. The best way to remember such a person is to gather pupils and colleagues, who shared with him the same scientific interests and ask them to discuss recent advances in their own fields, just as Giovanni have liked to do”. Since Giovanni’s friends sent many abstracts still influenced by their previous collaboration with him, all the Sessions of the 2018SpPMD reflect both to the research aims of Giovanni Salviati and the traditional topics of the PaduaMuscleDays, that is, basics and applications of physical, molecular and cellular strategies to maintain or recover functions of skeletal muscles. The translational researches summarized in the 2018SpPMD Abstracts are at the appropriate high level to attract approval of Ethical Committees, the interest of International Granting Agencies and approval for publication in top quality, international journals. The abstracts of the March 16, 2018 Padua Muscle Day are listed in this chapter III. All 2018SpPMD Abstracts are indexed at the end of the Chapter IV.



Sign in / Sign up

Export Citation Format

Share Document