Overinterpretation and misreporting of prognostic factor and biomarker studies in medical oncology.

2017 ◽  
Vol 35 (15_suppl) ◽  
pp. e14023-e14023
Author(s):  
Emmanuelle Kempf ◽  
Jennifer de Beyer ◽  
Raphael Porcher ◽  
Long Nguyen ◽  
Karel Moons ◽  
...  
Keyword(s):  
Prognostic Factor ◽  
Full Text ◽  
Data Extraction ◽  
Median Number ◽  
Impact Factors ◽  
Multivariable Model ◽  
Eligibility Criteria ◽  
Data Extraction Form ◽  
Misleading Interpretation ◽  
Insight Into

e14023 Background: To generate empirical evidence, classify and estimate the frequency of distorted presentation and overinterpretation of results in prognostic factor (PF) studies in oncology. Methods: We selected 17 oncology journals with an impact factor of 7 or more. PubMed was searched to identify primary clinical studies evaluating one or more PFs published in 2015. Each article was independently evaluated by 2 reviewers using a data extraction form that was extensively pilot-tested. We classified aspects of overinterpretation as misleading reporting, interpretation and extrapolation. Results: Our search identified 10 844 articles, 98 met eligibility criteria. The PF was assessed prospectively in 8 of 56 observational studies, and in 16 of 42 clinical trials. The median number of PFs per study was 2 (Q1-Q3, 1-5). Overall survival was used as the outcome in 77 studies. The median number of statistical analyses reported with regards to the PF effect assessment was 42.5 per study (Q1-Q3, 15.5-86.5). Thirty-three reports reported using 2 or more different multivariable models to assess the PF effect and 21 did not adjust. Misleading reporting included selective and incomplete reporting of the PF effect (n = 26 and n = 8, respectively). The conclusions focused solely on significant results in 80 reports, and in those where there was at least one NS result, 80% of studies focused their conclusions solely on the significant results. Misleading interpretation included not reporting the PF effect within a multivariable model (n = 23 and n = 54 in full-texts and abstracts, respectively). One out of 5 conclusions used linguistic spin with strong statements in both full-text and abstract. Linguistic spin of NS results was found in 28 Results sections in the full-text and in 18 abstract conclusions. The conclusions were inconsistent with the study findings in one out of five articles (both in the full-text and abstract). Discrepancies between the conclusions presented in the full-text and in the abstract were found in 18 reports. Conclusions: Our study provides insight into the level of reporting and overinterpretation of findings that were frequently inconsistent with the results in oncology journals with high impact factors.

scholarly journals Comprehensive Researcher Achievement Model (CRAM): a framework for measuring researcher achievement, impact and influence derived from a systematic literature review of metrics and models

BMJ Open ◽  
2019 ◽  
Vol 9 (3) ◽  
pp. e025320 ◽  
Author(s):  
Jeffrey Braithwaite ◽  
Jessica Herkes ◽  
Kate Churruca ◽  
Janet C Long ◽  
Chiara Pomare ◽  
...  
Keyword(s):  
Full Text ◽  
English Language ◽  
Data Extraction ◽  
Meta Analysis ◽  
Assessment Method ◽  
Assessment Model ◽  
Eligibility Criteria ◽  
Promotion And Tenure ◽  
Full Text Review ◽  
Q Statistic

ObjectivesEffective researcher assessment is key to decisions about funding allocations, promotion and tenure. We aimed to identify what is known about methods for assessing researcher achievements, leading to a new composite assessment model.DesignWe systematically reviewed the literature via the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols framework.Data sourcesAll Web of Science databases (including Core Collection, MEDLINE and BIOSIS Citation Index) to the end of 2017.Eligibility criteria(1) English language, (2) published in the last 10 years (2007–2017), (3) full text was available and (4) the article discussed an approach to the assessment of an individual researcher’s achievements.Data extraction and synthesisArticles were allocated among four pairs of reviewers for screening, with each pair randomly assigned 5% of their allocation to review concurrently against inclusion criteria. Inter-rater reliability was assessed using Cohen’s Kappa (ĸ). The ĸ statistic showed agreement ranging from moderate to almost perfect (0.4848–0.9039). Following screening, selected articles underwent full-text review and bias was assessed.ResultsFour hundred and seventy-eight articles were included in the final review. Established approaches developed prior to our inclusion period (eg, citations and outputs, h-index and journal impact factor) remained dominant in the literature and in practice. New bibliometric methods and models emerged in the last 10 years including: measures based on PageRank algorithms or ‘altmetric’ data, methods to apply peer judgement and techniques to assign values to publication quantity and quality. Each assessment method tended to prioritise certain aspects of achievement over others.ConclusionsAll metrics and models focus on an element or elements at the expense of others. A new composite design, the Comprehensive Researcher Achievement Model (CRAM), is presented, which supersedes past anachronistic models. The CRAM is modifiable to a range of applications.

scholarly journals A protocol for a scoping review of equity measurement in mental health care for children and youth

2020 ◽  
Vol 9 (1) ◽  
Author(s):  
William Gardner ◽  
Stuart G. Nicholls ◽  
Graham J. Reid ◽  
Brian Hutton ◽  
Candyce Hamel ◽  
...  
Keyword(s):  
Mental Health ◽  
Scoping Review ◽  
Full Text ◽  
Data Extraction ◽  
Open Science ◽  
Children And Youth ◽  
Eligibility Criteria ◽  
Study Selection ◽  
Study Characteristics ◽  
Two Stages

Abstract Background Mental health (MH) problems are among the most important causes of morbidity and mortality for children and youth. Problems of lack of equity in child and youth MH services (CYMHS)—including, but not limited to, problems in inaccessibility and quality of services—are widespread. Characterizing the nature of equity in CYMHS is an ongoing challenge because the field lacks a consistent approach to conceptualizing equity. We will conduct a scoping review of how equity in MH services for children and youth has been defined, operationalized, and measured. Our objectives are to discover: (1) What conceptual definitions of equity are used by observational studies of CYMHS?; (2) What service characteristics of CYMHS care do indices of equity cover?; (3) What population dimensions have been used to operationalize equity?; (4) What statistical constructs have been used in indices that measure CYMHS equity?; and (5) What were the numerical values of those indices? Methods The following databases will be searched: Medline, Embase, PsycINFO, Cochrane Controlled Register of Trials, CINAHL, EconLit, and Sociological Abstracts. Searches will be conducted from the date of inception to the end of the last full calendar year (December 2019). Studies will be included if they include an evaluation of a mental health service for children or youth (defined as those under 19 years of age) and which quantify variation in some aspect of child or youth mental health services (e.g., accessibility, volume, duration, or quality) as a function of socio-demographic and/or geographic variables. Study selection will occur over two stages. Stage one will select articles based on title and abstract using the liberal-accelerated method. Stage two will review the full texts of selected titles. Two reviewers will work independently on full-text reviewing, with each study screened twice using pre-specified eligibility criteria. One reviewer will chart study characteristics and indices to be verified by a second reviewer. Reviewers will resolve full-text screening and data extraction disagreements through discussion. Synthesis of the collected data will focus on compiling and mapping the types and characteristics of the indices used to evaluate MH services equity. Discussion The planned, systematic scoping review will survey the literature regarding how equity in MH services for children and youth has been operationalized and help inform future studies of equity in CYMHS. Systematic review registration Open Science Foundation ID SYSR-D-19-00371, https://osf.io/58srv/.

scholarly journals Primary tooth pulpectomy overfilling by different placement techniques: A systematic review and meta-analysis

2020 ◽  
Vol 14 (4) ◽  
pp. 250-261
Author(s):  
Naser Asl Aminabadi ◽  
Nahid Asl Aminabad ◽  
Zahra Jamali ◽  
Sajjad Shirazi
Keyword(s):  
Calcium Hydroxide ◽  
Clinical Studies ◽  
English Language ◽  
Data Extraction ◽  
Meta Analysis ◽  
In Vitro Studies ◽  
Primary Tooth ◽  
Eligibility Criteria ◽  
Data Extraction Form

Background. This study was conducted to investigate root canal overfilling with different material placement techniques in primary teeth. Methods. A systematic search was undertaken by searching PubMed/MEDLINE and Scopus for English language peer-reviewed articles published until February 2018 that reported primary tooth pulpectomy overfilling. Two reviewers independently screened and identified studies in terms of the selection criteria and independently collected the data using a specially designed data extraction form. The overfilling rate was the primary summary measure. The weighted pooled overfilling rates were estimated by random-effects meta-analysis. Results. Twenty clinical and four in vitro studies met the eligibility criteria. In the clinical studies, the pooled overfilling rate for zinc oxide-eugenol (ZOE) was 23.3% with a lentulo spiral mounted on a handpiece, 22.7% with a hand-held lentulo spiral, and 17% with a plugger. The pooled overfilling rate for calcium hydroxide-based materials was 16.7% with a lentulo spiral mounted on a handpiece, 14.7% with a hand-held lentulo spiral, 19.6% with a syringe, and 25.7% with a plugger. In the in vitro studies, neither individual overfilling rates nor two-by-two comparisons were subjected to meta-analysis because of an inadequate number of studies. Conclusion. The lowest overfilling rate in the clinical studies was related to plugger and handheld lentulo spiral techniques for ZOE and calcium hydroxide-based materials, respectively

scholarly journals Digital media use among older adults during the Covid-19 pandemic: a scoping review protocol

2021 ◽  
Vol 10 (12) ◽  
pp. e520101220916
Author(s):  
Juliana Cordeiro Carvalho ◽  
Gabriela Cabett Cipolli ◽  
Vanessa Alonso ◽  
Meire Cachioni
Keyword(s):  
Older Adults ◽  
Digital Media ◽  
Media Use ◽  
Longitudinal Design ◽  
Data Extraction ◽  
Empirical Studies ◽  
Letters To The Editor ◽  
Eligibility Criteria ◽  
Data Extraction Form ◽  
Review Protocol

Objective: To identify the purpose of digital media use among older adults during the Covid-19 pandemic. Methodology: The indexed literature published in English, Spanish and Portuguese will be systematically searched on 7 databases; the references of studies included will be searched manually. Two authors will independently evaluate titles, abstracts and full-texts according to eligibility criteria. A customized data extraction form will be used to chart the data extracted from the studies. For consideration, studies must be in English, Portuguese or Spanish; involve older adults aged ≥ 55 years (or mean age 60 years); assess older adults who used digital media during the Covid-19 pandemic; be empirical studies with qualitative or quantitative data, have crosssectional or longitudinal design, be letters to the Editor and editorials, and be published between the end of 2019 and 2021. Results: Results will be charted in a table and accompanied by a narrative summary.

scholarly journals A scoping review protocol to map the evidence on self-reported health and neuroticism in older adults

2021 ◽  
Vol 15 ◽  
Author(s):  
Meire Cachioni ◽  
Vanessa Alonso ◽  
Gabriela Cabett Cipolli ◽  
Ruth Caldeira de Melo ◽  
Constança Paúl
Keyword(s):  
Older Adults ◽  
Intervention Studies ◽  
Reference Lists ◽  
Data Extraction ◽  
Community Dwelling ◽  
Eligibility Criteria ◽  
Data Extraction Form ◽  
Review Protocol ◽  
Reported Health ◽  
Community Dwelling Older Adults

OBJECTIVE: To identify the evidence on self-reported health and neuroticism in older adults. METHODS: Indexed literature published in English, Spanish and Portuguese will be systematically searched and retrieved from 10 databases; reference lists from included studies will be manually searched. Two authors will independently screen titles, abstracts, and full texts against the eligibility criteria. A customized data extraction form will be used to perform data extraction of the included studies, which will be: studies written in English, Portuguese, and Spanish; studies of older adults aged 55 years or over (mean age is 60 years at least); studies of community-dwelling older adults; studies that evaluated both self-reported health and personality; studies that evaluated self-reported health and personality with validated instruments; observational, review, and intervention studies. RESULTS: The results will be presented in a tabular format, accompanied by a narrative summary.

Herbal smoking products: a systematic content analysis and mapping of the e-retail market

2021 ◽  
pp. tobaccocontrol-2020-056340
Author(s):  
Arpit Gupta ◽  
Shweta Sharda ◽  
Pothamsetty Yogitha ◽  
Sonu Goel ◽  
Ashima Goyal ◽  
...  
Keyword(s):  
Data Extraction ◽  
Age Groups ◽  
Health Benefit ◽  
Marketing Strategies ◽  
Retail Market ◽  
Health Warnings ◽  
Eligibility Criteria ◽  
Data Extraction Form ◽  
The Usa ◽  
Online Availability

ObjectiveTo assess the online availability and e-marketing strategies of herbal smoking products (HSPs).MethodologyGoogle, Yahoo and Bing were searched using relevant keywords related to HSPs. The first 50 records were retrieved and duplicates were removed. Two trained and calibrated authors screened the records according to the eligibility criteria and extracted data from each selected retail-webpage as per the pre-tested data extraction form.ResultsOut of the initial 1044 records obtained, 73 retail webpages were finally included. Most of the webpages about HSPs hailed from India followed by the USA. The results showed 24 brands with about 189 flavour variants that are readily available online to all age groups including minors, with price per pack (20 sticks) of herbal cigarettes ranging from INR (₹) 51 to 1830 (median 588). There are no regulations regarding the sale and marketing of HSPs concerning age restrictions and display of health warnings.ConclusionHSPs are readily available online at affordable prices and attractive variants for customers of all ages. The flavour appeal and the health benefit appeal is being used to target minors and young women. There is an urgent need for some regulations on the sale and e-marketing of such products that have an enormous potential to be used as a gateway to tobacco smoking.

scholarly journals Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Roland Brian Büchter ◽  
Alina Weise ◽  
Dawid Pieper
Keyword(s):  
Systematic Reviews ◽  
Data Extraction ◽  
Extraction Methods ◽  
Data Errors ◽  
Cochrane Reviews ◽  
Study Selection ◽  
Data Extraction Form ◽  
Current Sample ◽  
Automation Tools ◽  
Insight Into

Abstract Background Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. Methods We included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively. Results Of the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%). Conclusions Reporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.

Impact of surgery timing for craniosynostosis on neurodevelopmental outcomes: a systematic review

2019 ◽  
Vol 23 (4) ◽  
pp. 442-454 ◽  
Author(s):  
Rachel Mandela ◽  
Maggie Bellew ◽  
Paul Chumas ◽  
Hannah Nash
Keyword(s):  
Systematic Review ◽  
Beneficial Effect ◽  
Data Extraction ◽  
Sociodemographic Factors ◽  
Future Research ◽  
Neurodevelopmental Outcomes ◽  
Age At Surgery ◽  
Data Extraction Form ◽  
Surgery Timing ◽  
Anesthetic Exposure

OBJECTIVEThere are currently no guidelines for the optimum age for surgical treatment of craniosynostosis. This systematic review summarizes and assesses evidence on whether there is an optimal age for surgery in terms of neurodevelopmental outcomes.METHODSThe databases MEDLINE, PsycINFO, CINAHL, Embase + Embase Classic, and Web of Science were searched between October and November 2016 and searches were repeated in July 2017. According to PICO (participants, intervention, comparison, outcome) criteria, studies were included that focused on: children diagnosed with nonsyndromic craniosynostosis, aged ≤ 5 years at time of surgery; corrective surgery for nonsyndromic craniosynostosis; comparison of age-at-surgery groups; and tests of cognitive and neurodevelopmental postoperative outcomes. Studies that did not compare age-at-surgery groups (e.g., those employing a correlational design alone) were excluded. Data were double-extracted by 2 authors using a modified version of the Cochrane data extraction form.RESULTSTen studies met the specified criteria; 5 found a beneficial effect of earlier surgery, and 5 did not. No study found a beneficial effect of later surgery. No study collected data on length of anesthetic exposure and only 1 study collected data on sociodemographic factors.CONCLUSIONSIt was difficult to draw firm conclusions from the results due to multiple confounding factors. There is some inconclusive evidence that earlier surgery is beneficial for patients with sagittal synostosis. The picture is even more mixed for other subtypes. There is no evidence that later surgery is beneficial. The authors recommend that future research use agreed-upon parameters for: age-at-surgery cut-offs, follow-up times, and outcome measures.

scholarly journals Diversity in health professional education scholarship: a document analysis of international author representation in leading journals

BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e043970
Author(s):  
Brittany Buffone ◽  
Ilena Djuana ◽  
Katherine Yang ◽  
Kyle J Wilby ◽  
Maguy S El Hajj ◽  
...  
Keyword(s):  
Health Professional ◽  
Professional Education ◽  
Teaching And Learning ◽  
Western Europe ◽  
English Language ◽  
Data Extraction ◽  
Document Analysis ◽  
Original Research ◽  
Health Professional Education ◽  
Eligibility Criteria

ObjectivesThe global distribution of health professionals and associated training programmes is wide but prior study has demonstrated reported scholarship of teaching and learning arises from predominantly Western perspectives.DesignWe conducted a document analysis to examine authorship of recent publications to explore current international representation.Data sourcesThe table of contents of seven high-impact English-language health professional education journals between 2008 and 2018 was extracted from Embase.Eligibility criteriaThe journals were selected according to highest aggregate ranking across specific scientific impact indices and stating health professional education in scope; only original research and review articles from these publications were included for analysis.Data extraction and synthesisThe table of contents was extracted and eligible publications screened by independent reviewers who further characterised the geographic affiliations of the publishing research teams and study settings (if applicable).ResultsA total 12 018 titles were screened and 7793 (64.8%) articles included. Most were collaborations (7048, 90.4%) conducted by authors from single geographic regions (5851, 86%). Single-region teams were most often formed from countries in North America (56%), Northern Europe (14%) or Western Europe (10%). Overall lead authorship from Asian, African or South American regions was less than 15%, 5% and 1%, respectively. Geographic representation varied somewhat by journal, but not across time.ConclusionsDiversity in health professional education scholarship, as marked by nation of authors’ professional affiliations, remains low. Under-representation of published research outside Global North regions limits dissemination of novel ideas resulting in unidirectional flow of experiences and a concentrated worldview of teaching and learning.

scholarly journals Sleep quality in the chronic stage of concussion is associated with poorer recovery: A systematic review

2021 ◽  
Vol 5 ◽  
pp. 205970022110208
Author(s):  
Rebecca Ludwig ◽  
Eryen Nelson ◽  
Prasanna Vaduvathiriyan ◽  
Michael A Rippee ◽  
Catherine Siengsukon
Keyword(s):  
Physical Activity ◽  
Sleep Quality ◽  
Sleep Disturbances ◽  
Data Extraction ◽  
Grey Literature ◽  
Chronic Phase ◽  
Emotional Symptoms ◽  
Eligibility Criteria ◽  
Chronic Stage ◽  
Prior Review

Background Recovery from a concussion varies based on a multitude of factors. One such factor is sleep disturbances. In our prior review, it was observed that in the acute phase, sleep disturbances are predictive of poor outcomes following a concussion. The literature gap remains on how sleep in the chronic phase of recovery affects outcomes. Objective To examine the association between sleep quality during the chronic stage of concussion and post-concussion outcomes. Literature Survey: Literature searches were performed during 1 July to 1 August 2019 in selected databases along with searching grey literature. Out of the 733 results, 702 references were reviewed after duplicate removal. Methods Three reviewers independently reviewed and consented on abstracts meeting eligibility criteria ( n = 35). The full-text articles were assessed independently by two reviewers. Consensus was achieved, leaving four articles. Relevant data from each study was extracted using a standard data-extraction table. Quality appraisal was conducted to assess potential bias and the quality of articles. Results One study included children (18–60 months) and three studies included adolescents and/or adults (ranging 12–35 years). The association between sleep and cognition (two studies), physical activity (one study), and emotion symptoms (one study) was examined. Sleep quality was associated with decreased cognition and emotional symptoms, but not with meeting physical activity guidelines six months post-concussion injury. Conclusions The heterogeneity in age of participants and outcomes across studies and limited number of included studies made interpretations difficult. Future studies may consider if addressing sleep quality following concussion will improve outcomes.

Sign in / Sign up

Export Citation Format

Share Document