scholarly journals Comprehensive Researcher Achievement Model (CRAM): a framework for measuring researcher achievement, impact and influence derived from a systematic literature review of metrics and models

BMJ Open ◽  
2019 ◽  
Vol 9 (3) ◽  
pp. e025320 ◽  
Author(s):  
Jeffrey Braithwaite ◽  
Jessica Herkes ◽  
Kate Churruca ◽  
Janet C Long ◽  
Chiara Pomare ◽  
...  

ObjectivesEffective researcher assessment is key to decisions about funding allocations, promotion and tenure. We aimed to identify what is known about methods for assessing researcher achievements, leading to a new composite assessment model.DesignWe systematically reviewed the literature via the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols framework.Data sourcesAll Web of Science databases (including Core Collection, MEDLINE and BIOSIS Citation Index) to the end of 2017.Eligibility criteria(1) English language, (2) published in the last 10 years (2007–2017), (3) full text was available and (4) the article discussed an approach to the assessment of an individual researcher’s achievements.Data extraction and synthesisArticles were allocated among four pairs of reviewers for screening, with each pair randomly assigned 5% of their allocation to review concurrently against inclusion criteria. Inter-rater reliability was assessed using Cohen’s Kappa (ĸ). The ĸ statistic showed agreement ranging from moderate to almost perfect (0.4848–0.9039). Following screening, selected articles underwent full-text review and bias was assessed.ResultsFour hundred and seventy-eight articles were included in the final review. Established approaches developed prior to our inclusion period (eg, citations and outputs, h-index and journal impact factor) remained dominant in the literature and in practice. New bibliometric methods and models emerged in the last 10 years including: measures based on PageRank algorithms or ‘altmetric’ data, methods to apply peer judgement and techniques to assign values to publication quantity and quality. Each assessment method tended to prioritise certain aspects of achievement over others.ConclusionsAll metrics and models focus on an element or elements at the expense of others. A new composite design, the Comprehensive Researcher Achievement Model (CRAM), is presented, which supersedes past anachronistic models. The CRAM is modifiable to a range of applications.

Author(s):  
Mary J. Sandage ◽  
Elizabeth S. Ostwalt ◽  
Lauren H. Allison ◽  
Grace M. Cutchin ◽  
Mariah E. Morton ◽  
...  

Purpose The primary aim of this review was to identify environmental irritants known to trigger chronic cough through the life span and develop a comprehensive clinically useful irritant checklist. Method A scoping review was conducted using the Preferred Reporting Items for Systematic Review and Meta-Analysis Extension for Scoping Reviews, checklist, and explanation. English-language, full-text resources were identified through Medline, PsycINFO, SPORTDiscus, Web of Science, and ProQuest Dissertations and Theses Global. Results A total of 1,072 sources were retrieved; of these, 109 were duplicates. Titles of abstracts of 963 articles were screened, with 295 selected for full-text review. Using the exclusion and inclusion criteria listed, 236 articles were considered eligible and 214 different triggers were identified. Triggers were identified from North America, Europe, Africa, Asia, and Australia. Occupational exposures were also delineated. Conclusions A clinically useful checklist of both frequently encountered triggers and idiosyncratic or rare triggers was developed. The clinical checklist provides a unique contribution to streamline and standardize clinical assessment of irritant-induced chronic cough. The international scope of this review extends the usefulness of the clinical checklist to clinicians on most continents.


2013 ◽  
Vol 93 (4) ◽  
pp. 504-513 ◽  
Author(s):  
Hilary J. Gunn ◽  
Paul Newell ◽  
Bernhard Haas ◽  
Jonathan F. Marsden ◽  
Jennifer A. Freeman

Background Falls are a significant issue in people with multiple sclerosis (MS), with research demonstrating fall rates of more than 50%. Purpose The purpose of this study was to evaluate the risk factors associated with falling in people with MS. Data Sources Mixed search methods were used, including computer-based and manual searches. Additionally, hand searches of reference lists and conference abstracts were performed. All literature published from the source's earliest date to January 2012 was included; only full-text English-language sources (or those where a translation was available) were included. Study Selection Eligibility criteria specified articles evaluating any aspect of fall risk in adults with a confirmed MS diagnosis, where the incidence of falling as determined by prospective or retrospective participant report was included. Data Extraction Data were extracted independently by 2 reviewers using a written protocol and standardized extraction documentation. Detailed assessment of each article was independently undertaken by both reviewers, including assessment of study quality using an adaptation of the Newcastle Ottawa Scale plus extraction of key data (participant characteristics, fall incidence, and outcomes). Data Synthesis The final review comprised 8 articles with a total of 1,929 participants; 1,037 (53.75%) were classified as fallers. Eighteen different risk factors were assessed within the included studies. Meta-analysis demonstrated an increase in fall risk associated with impairments of balance and cognition, progressive MS, and use of a mobility aid. Narrative review of the qualitative articles and those factors where meta-analysis was not possible also was undertaken. Limitations Variation in assessment, analysis, and reporting methods allowed meta-analysis for only 4 factors. Conclusion There is limited evidence of the factors associated with fall risk in people with MS. Further methodologically robust studies are needed.


2020 ◽  
Vol 14 (4) ◽  
pp. 250-261
Author(s):  
Naser Asl Aminabadi ◽  
Nahid Asl Aminabad ◽  
Zahra Jamali ◽  
Sajjad Shirazi

Background. This study was conducted to investigate root canal overfilling with different material placement techniques in primary teeth. Methods. A systematic search was undertaken by searching PubMed/MEDLINE and Scopus for English language peer-reviewed articles published until February 2018 that reported primary tooth pulpectomy overfilling. Two reviewers independently screened and identified studies in terms of the selection criteria and independently collected the data using a specially designed data extraction form. The overfilling rate was the primary summary measure. The weighted pooled overfilling rates were estimated by random-effects meta-analysis. Results. Twenty clinical and four in vitro studies met the eligibility criteria. In the clinical studies, the pooled overfilling rate for zinc oxide-eugenol (ZOE) was 23.3% with a lentulo spiral mounted on a handpiece, 22.7% with a hand-held lentulo spiral, and 17% with a plugger. The pooled overfilling rate for calcium hydroxide-based materials was 16.7% with a lentulo spiral mounted on a handpiece, 14.7% with a hand-held lentulo spiral, 19.6% with a syringe, and 25.7% with a plugger. In the in vitro studies, neither individual overfilling rates nor two-by-two comparisons were subjected to meta-analysis because of an inadequate number of studies. Conclusion. The lowest overfilling rate in the clinical studies was related to plugger and handheld lentulo spiral techniques for ZOE and calcium hydroxide-based materials, respectively


BMJ Open ◽  
2019 ◽  
Vol 9 (8) ◽  
pp. e029966 ◽  
Author(s):  
Navneet Singh ◽  
Ralph Alan Huston Stewart ◽  
Jocelyne Rachelle Benatar

ObjectivesTo evaluate the importance of the frequency and duration of lifestyle interventions for achieving weight loss over ≥1 year and associations with all-cause mortality.DesignMeta-analysis of randomised trials using Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and RevMan software version 5·2 (The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen).Data sourcesMEDLINE, CENTRAL, Google and Science Direct databases alongside reference lists of appropriate articles and meta-analyses.Eligibility criteriaRandomised studies published in English-language journals from 1980 to June 2018 that assessed lifestyle compared with control interventions on weight loss and that included ≥100 subjects and reported weight change and mortality for ≥1 year.Data extraction and synthesisTwo independent reviewers extracted data and assessed risk of bias. Data were pooled using the generic inverse-variance method and expressed as mean differences (MDs) with 95% CI and OR with 95% CI as appropriate. Heterogeneity was assessed (Cochran Q statistic) and quantified (I2statistic). The Grading of Recommendations Assessment, Development, and Evaluation score was used to assess the certainty of the evidence.Results31 randomised trials with a total of 20 816 overweight or obese participants were included. 70% of participants had cardiometabolic risk factors. Body weight was lower for lifestyle intervention compared with the control at 1 year (3.63 kg, 95% CI 2.58 to 4.67) and at 3 years (2.45 kg, 95% CI 1.17 to 3.73). Weight loss at 1 year was greater in studies with >28 compared with ≤28 interventions per year (4.50 kg, 95% CI 3.03, 5.97 vs 2.38, 95% CI 0.78 to 3.98 kg, p=0.001). In all studies, there were 593 deaths (~0.3%/year). The ORs for mortality for weight loss interventions compared with the controls was 0.86 (95% CI 0.73 to 1.02), p=0.09.ConclusionIn predominantly healthy populations with risk factors, there is a dose response with number of lifestyle interventions and weight loss. Frequent and sustained interventions are needed to achieve a clinically significant 5% weight loss. There was insufficient evidence to reliably evaluate the benefits in persons with known cardiovascular disease or cancer.Trial registration numberCRD42018095067.


2020 ◽  
Author(s):  
Kurt D Shulver ◽  
Nicholas A Badcock

We report the results of a systematic review and meta-analysis investigating the relationship between perceptual anchoring and dyslexia. Our goal was to assess the direction and degree of effect between perceptual anchoring and reading ability in typical and atypical (dyslexic) readers. We performed a literature search of experiments explicitly assessing perceptual anchoring and reading ability using PsycInfo (Ovid, 1860 to 2020), MEDLINE (Ovid, 1860 to 2019), EMBASE (Ovid, 1883 to 2019), and PubMed for all available years up to June (2020). Our eligibility criteria consisted of English-language articles and, at minimum, one experimental group identified as dyslexic - either by reading assessment at the time, or by previous diagnosis. We assessed for risk of bias using an adapted version of the Newcastle-Ottawa scale. Six studies were included in this review, but only five (n = 280 participants) were included in the meta-analysis (we were unable to access the necessary data for one study).The overall effect was negative, large and statistically significant; g = -0.87, 95% CI [-1.47, 0.27]: a negative effect size indicating less perceptual anchoring in dyslexic versus non-dyslexic groups. Visual assessment of funnel plot and Egger’s test suggest minimal bias but with significant heterogeneity; Q (4) = 9.70, PI (prediction interval) [-2.32, -0.58]. The primary limitation of the current review is the small number of included studies. We discuss methodological limitations, such as limited power, and how future research may redress these concerns. The variability of effect sizes appears consistent with the inherent variability within subtypes of dyslexia. This level of dispersion seems indicative of the how we define cut-off thresholds between typical reading and dyslexia populations, but also the methodological tools we use to investigate individual performance.


BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e043970
Author(s):  
Brittany Buffone ◽  
Ilena Djuana ◽  
Katherine Yang ◽  
Kyle J Wilby ◽  
Maguy S El Hajj ◽  
...  

ObjectivesThe global distribution of health professionals and associated training programmes is wide but prior study has demonstrated reported scholarship of teaching and learning arises from predominantly Western perspectives.DesignWe conducted a document analysis to examine authorship of recent publications to explore current international representation.Data sourcesThe table of contents of seven high-impact English-language health professional education journals between 2008 and 2018 was extracted from Embase.Eligibility criteriaThe journals were selected according to highest aggregate ranking across specific scientific impact indices and stating health professional education in scope; only original research and review articles from these publications were included for analysis.Data extraction and synthesisThe table of contents was extracted and eligible publications screened by independent reviewers who further characterised the geographic affiliations of the publishing research teams and study settings (if applicable).ResultsA total 12 018 titles were screened and 7793 (64.8%) articles included. Most were collaborations (7048, 90.4%) conducted by authors from single geographic regions (5851, 86%). Single-region teams were most often formed from countries in North America (56%), Northern Europe (14%) or Western Europe (10%). Overall lead authorship from Asian, African or South American regions was less than 15%, 5% and 1%, respectively. Geographic representation varied somewhat by journal, but not across time.ConclusionsDiversity in health professional education scholarship, as marked by nation of authors’ professional affiliations, remains low. Under-representation of published research outside Global North regions limits dissemination of novel ideas resulting in unidirectional flow of experiences and a concentrated worldview of teaching and learning.


2016 ◽  
Vol 45 (6) ◽  
pp. 1447-1457 ◽  
Author(s):  
Kate A. Timmins ◽  
Richard D. Leech ◽  
Mark E. Batt ◽  
Kimberley L. Edwards

Background: Osteoarthritis (OA) is a chronic condition characterized by pain, impaired function, and reduced quality of life. A number of risk factors for knee OA have been identified, such as obesity, occupation, and injury. The association between knee OA and physical activity or particular sports such as running is less clear. Previous reviews, and the evidence that informs them, present contradictory or inconclusive findings. Purpose: This systematic review aimed to determine the association between running and the development of knee OA. Study Design: Systematic review and meta-analysis. Methods: Four electronic databases were searched, along with citations in eligible articles and reviews and the contents of recent journal issues. Two reviewers independently screened the titles and abstracts using prespecified eligibility criteria. Full-text articles were also independently assessed for eligibility. Eligible studies were those in which running or running-related sports (eg, triathlon or orienteering) were assessed as a risk factor for the onset or progression of knee OA in adults. Relevant outcomes included (1) diagnosis of knee OA, (2) radiographic markers of knee OA, (3) knee joint surgery for OA, (4) knee pain, and (5) knee-associated disability. Risk of bias was judged by use of the Newcastle-Ottawa scale. A random-effects meta-analysis was performed with case-control studies investigating arthroplasty. Results: After de-duplication, the search returned 1322 records. Of these, 153 full-text articles were assessed; 25 were eligible, describing 15 studies: 11 cohort (6 retrospective) and 4 case-control studies. Findings of studies with a diagnostic OA outcome were mixed. Some radiographic differences were observed in runners, but only at baseline within some subgroups. Meta-analysis suggested a protective effect of running against surgery due to OA: pooled odds ratio 0.46 (95% CI, 0.30-0.71). The I2 was 0% (95% CI, 0%-73%). Evidence relating to symptomatic outcomes was sparse and inconclusive. Conclusion: With this evidence, it is not possible to determine the role of running in knee OA. Moderate- to low-quality evidence suggests no association with OA diagnosis, a positive association with OA diagnosis, and a negative association with knee OA surgery. Conflicting results may reflect methodological heterogeneity. More evidence from well-designed, prospective studies is needed to clarify the contradictions.


BMJ Open ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. e044917
Author(s):  
Tao Xu ◽  
You Wang ◽  
Jinxian Yuan ◽  
Yangmei Chen ◽  
Haiyan Luo

ObjectiveContrast extravasation (CE) after endovascular therapy (EVT) is commonly present in acute ischaemic stroke (AIS) patients. Substantial uncertainties remain about the relationship between CE and the outcomes of EVT in patients with AIS. Therefore, we aimed to evaluate this association.DesignA systematic review and meta-analysis of published studies were performed.Data sourceWe systematically searched the Medline and Embase databases for relevant clinical studies. The last literature search in databases was performed in June 2020.Eligibility criteria for study selectionWe included studies exploring the associations between CE and the outcomes of EVT in patients with AIS undergoing EVT.Data extraction and synthesisTwo reviewers extracted relevant information and data from each article independently. We pooled ORs with CIs using a random-effects meta-analysis to calculate the associations between CE and outcomes of EVT. The magnitude of heterogeneity between estimates was quantified with the I2 statistic with 95% CIs.ResultsFifteen observational studies that enrolled 1897 patients were included. Patients with CE had higher risks of poor functional outcome at discharge (2.38, 95% CI 1.45 to 3.89 p=0.001; n=545) and poor functional outcome at 90 days (OR 2.16, 95% CI 1.20 to 3.90; n=1194). We found no association between CE and in-hospital mortality (OR 0.95, 95% CI 0.27 to 3.30; n=376) or 90-day mortality (OR 1.38, 95% CI 0.81 to 2.36; n=697) after EVT. Moreover, CE was associated with higher risks of post-EVT intracranial haemorrhage (ICH) (OR 6.68, 95% CI 3.51 to 12.70; n=1721) and symptomatic ICH (OR 3.26, 95% CI 1.97 to 5.40; n=1092).ConclusionsThis systematic review and meta-analysis indicates that in patients with AIS undergoing EVT, CE is associated with higher risks of unfavourable functional outcomes and ICH. Thus, we should pay more attention to CE in patients with AIS undergoing EVT.


Author(s):  
Serena Vi ◽  
Damon Pham ◽  
Yu Yian Marina Du ◽  
Himanshu Arora ◽  
Santosh Kumar Tadakamadla

Purpose: Mini-dental implants (MDIs) have been used to support and retain overdentures, providing patients with a less invasive placement procedure. Although lucrative, the use of MDIs to retain a maxillary overdenture is still not an established treatment modality. This systematic review aims to answer the question: Do mini-implant-retained maxillary overdentures provide a satisfactory treatment outcome for complete edentulism? Methods: A systematic search for relevant articles was conducted to include articles published until April 2021 in the following electronic databases: CINAHL, Cochrane, EMBASE, PubMed, and Web of Science. All empirical studies evaluating the biological, survival, or patient-reported outcomes after placing mini-implant-retained overdentures in maxilla were considered for inclusion. The risk of bias was assessed by utilizing the Joanna Briggs Institute critical appraisal checklist. Study screening and data extraction were conducted by three reviewers independently. Results: The electronic search retrieved 1276 titles after omitting duplicates. Twenty articles were considered for full-text review, of which six studies were included in this systematic review. The included studies evaluated a total of 173 participants with a mean age of 66.3 years. The overall mini-implant survival rate was 77.1% (95% CI: 64.7–89.5%) with a mean follow-up time of 1.79 years (range: 6 months to 3 years). Implant survival differed significantly when comparing complete and partial palatal coverage overdentures. Those with complete palatal coverage exhibited less bone loss overall compared to partial coverage overdentures. Participants of all studies reported an increase in the quality of life and in satisfaction after rehabilitation treatment with MDIs. Conclusions: The survival rate of mini-implants retaining an overdenture in the maxilla was observed to be lower than the values reported for traditional implants in the literature. Improvements were observed in all aspects in terms of patient satisfaction, quality of life, oromyofunction, and articulation after the treatment.


BMJ Open ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. e041680
Author(s):  
Shu-Yue Pan ◽  
Rui-Juan Cheng ◽  
Zi-Jing Xia ◽  
Qiu-Ping Zhang ◽  
Yi Liu

ObjectivesGout, characterised by hyperuricaemia with monosodium urate crystal formation and inflammation, is the most common inflammatory arthritis in adults. Recent studies have found that elevated uric acid levels are related to the occurrence of dementia. We conducted a study to investigate the association between dementia and gout or hyperuricaemia.DesignSystematic review and meta-analysis of cohort studies.Data sourcesStudies were screened from inception to 28 June 2019 by searching Medline, Embase and the Cochrane Library databases.Eligibility criteriaCohort studies comparing the risk of dementia in patients with gout and hyperuricaemia versus non-gout and non-hyperuricaemia controls were enrolled.Data extraction and analysisTwo reviewers separately selected studies and extracted data using the Medical Subject Headings without restriction on languages or countries. The adjusted HRs were pooled using the DerSimonian and Laird random effects model. Sensitivity analyses were conducted to evaluate the stability of the results. Publication bias was evaluated using Egger’s and Begg’s tests. Quality assessment was performed according to the Newcastle-Ottawa Scale.ResultsFour cohort studies that met the inclusion criteria were included in our meta-analysis. We found that gout and hyperuricaemia did not increase the risk of dementia, with a pooled HR of 0.94 (95% CI 0.69 to 1.28), but might decrease the risk of Alzheimer’s disease (AD), with a pooled HR of 0.78 (95% CI 0.64 to 0.95). There was little evidence of publication bias. Quality assessment of the included studies was high (range: 6–8 points).ConclusionsOur study shows that gout and hyperuricaemia do not increase the risk of dementia. However, gout and hyperuricaemia might have a protective effect against AD. Due to the limited number of research articles, more investigations are needed to demonstrate the potential relationship between dementia and gout or hyperuricaemia.


Sign in / Sign up

Export Citation Format

Share Document