Measuring the teamwork performance of teams in crisis situations: a systematic review of assessment tools and their measurement properties

2018 ◽  
Vol 28 (4) ◽  
pp. 327-337 ◽  
Author(s):  
Sylvain Boet ◽  
Nicole Etherington ◽  
Sarah Larrigan ◽  
Li Yin ◽  
Hira Khan ◽  
...  

BackgroundEducational interventions to improve teamwork in crisis situations have proliferated in recent years with substantial variation in teamwork measurement. This systematic review aimed to synthesise available tools and their measurement properties in order to identify the most robust tool for measuring the teamwork performance of teams in crisis situations.MethodsSearches were conducted in Embase (via OVID), PsycINFO, Cumulative Index to Nursing and Allied Health Literature, Education Resources Information Center, Medline and Medline In-Process (via OVID) (through 12 January 2017). Studies evaluating the measurement properties of teamwork assessment tools for teams in clinical or simulated crisis situations were included. Two independent reviewers screened studies based on predetermined criteria and completed data extraction. Risk of bias was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist.ResultsThe search yielded 1822 references. Twenty studies were included, representing 13 assessment tools. Tools were primarily assessed in simulated resuscitation scenarios for emergency department teams. The Team Emergency Assessment Measure (TEAM) had the most validation studies (n=5), which demonstrated three sources of validity (content, construct and concurrent) and three sources of reliability (internal consistency, inter-rater reliability and test–retest reliability). Most studies of TEAM’s measurement properties were at no risk of bias.ConclusionsA number of tools are available for assessing teamwork performance of teams in crisis situations. Although selection will ultimately depend on the user’s context, TEAM may be the most promising tool given its measurement evidence. Currently, there is a lack of tools to assess teamwork performance during intraoperative crisis situations. Additional research is needed in this regard.

BMJ Open ◽  
2019 ◽  
Vol 9 (3) ◽  
pp. e023204 ◽  
Author(s):  
Nicola Middlebrook ◽  
Alison B Rushton ◽  
Nicola R Heneghan ◽  
Deborah Falla

IntroductionPain following musculoskeletal trauma is common with poor outcomes and disability well documented. Pain is complex in nature and can include the four primary mechanisms of pain: nociceptive, neuropathic, inflammatory and central sensitisation (CS). CS can be measured in multiple ways; however, no systematic review has evaluated the measurement properties of such measures in the musculoskeletal trauma population. This systematic review aims to evaluate the measurement properties of current measures of CS in this population.Methods/analysisThis protocol is informed and reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis-P. MEDLINE, EMBASE, CINAHL, ZETOC, Web of Science, PubMed and Google Scholar as well as key journals and grey literature will be searched in two stages to (1) identify what measures are being used to assess CS in this population and (2) evaluate the measurement properties of the identified measures. Two independent reviewers will conduct the search, extract the data, assess risk of bias for included studies and assess overall quality. The Consensus-based Standards for the selection of Health Measurement Instruments Risk of Bias Checklist and a modified Grading of Recommendations, Assessment, Development and Evaluation guidelines will be used. Meta-analysis will be conducted if deemed appropriate. Alternatively, a narrative synthesis will be conducted and summarised per measurement property per outcome measure.Ethics and disseminationThis review will aid clinicians in using the most appropriate tool for assessing central sensitisation in this population and is the first step towards a more standardised approach in pain assessment. The results of this study will be submitted to a peer reviewed journal and presented at conferences.PROSPERO registrationnumberCRD42018091531.


PeerJ ◽  
2020 ◽  
Vol 8 ◽  
pp. e9459
Author(s):  
Maryam Kazemitabar ◽  
Ali Moghadamzadeh ◽  
Mojtaba Habibi ◽  
Rezvan Hakimzadeh ◽  
Danilo Garcia

Background This systematic review aimed to investigate the psychometric properties of the school health’s assessment tools in primary schools through COSMIN Risk of Bias checklist. We examined the studies that have addressed the measurement properties of school-health instruments to give a clear overview of the quality of all available tools measuring school health in primary schools. This systematic review was registered in PROPERO with the Registration ID: CRD42020158158. Method Databases of EBSCOhost, PubMed, ProQuest, Wily, PROSPERO, and OpenGrey were systematically searched without any time limitation to find all full-text English journal articles studied at least one of the COSMIN checklist measurement properties of a school-health assessment tool in primary schools. The instruments should be constructed based on a school health model. The eligible studies were assessed by COSMIN Risk of Bias checklist to report their quality of methodology for each measurement property and for the whole study by rating high, moderate or low quality. Results At the final screening just seven studies remained for review. Four studies were tool development, three of them were rated as “adequate” and the other study as “very good”; five studies examined the content validity, three of them were appraised as “very good”, and the two remaining as “inadequate”. All seven studies measured structural validity, three of them were evaluated as “very good”, three other were scored as “adequate”, and the last study as “inadequate”. All the seven studies investigated the internal consistency, five of them were assessed as “very good”, one was rated as “doubtful”, and the last one as “inadequate”. Just one study examined the cross-cultural validity and was rated as “adequate”. Finally, all seven studies measured reliability, two of them were rated as “very good” and the rest five studies were appraised as “doubtful”. All rating was based on COSMIN checklist criteria for quality of measurement properties assessment. Conclusion The number of studies addressing school health assessment tools was very low and therefore not sufficient. Hence, there is a serious need to investigate the psychometric properties of the available instruments measuring school health at primary schools. Moreover, the studies included in the present systematic review did not fulfill all the criteria of the COSMIN checklist for assessing measurement properties. We suggest that future studies consider these criteria for measuring psychometric properties and developing school health assessment tools.


BMJ Open ◽  
2020 ◽  
Vol 10 (8) ◽  
pp. e036038
Author(s):  
Sonia Lorente ◽  
Carme Viladrich ◽  
Jaume Vives ◽  
Josep-Maria Losilla

ObjectiveThis meta-review aims to discuss the methodological, research and practical applications of tools that assess the measurement properties of instruments evaluating health-related quality of life (HRQoL) that have been reported in systematic reviews.DesignMeta-review.MethodsElectronic search from January 2008 to May 2020 was carried out on PubMed, CINAHL, PsycINFO, SCOPUS, WoS, Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) database, Google Scholar and ProQuest Dissertations and Theses.ResultsA total of 246 systematic reviews were assessed. Concerning the quality of the review process, some methodological shortcomings were found, such as poor compliance with reporting or methodological guidelines. Regarding the procedures to assess the quality of measurement properties, 164 (66.6%) of reviewers applied one tool at least. Tool format and structure differed across standards or scientific traditions (ie, psychology, medicine and economics), but most assess both measurement properties and the usability of instruments. As far as the results and conclusions of systematic reviews are concerned, only 68 (27.5%) linked the intended use of the instrument to specific measurement properties (eg, evaluative use to responsiveness).ConclusionsThe reporting and methodological quality of reviews have increased over time, but there is still room for improvement regarding adherence to guidelines. The COSMIN would be the most widespread and comprehensive tool to assess both the risk of bias of primary studies, and the measurement properties of HRQoL instruments for evaluative purposes. Our analysis of other assessment tools and measurement standards can serve as a starting point for future lines of work on the COSMIN tool, such as considering a more comprehensive evaluation of feasibility, including burden and fairness; expanding its scope for measurement instruments with a different use than evaluative; and improving its assessment of the risk of bias of primary studies.PROSPERO registration numberCRD42017065232.


Author(s):  
Clare Burgon ◽  
Sarah Elizabeth Goldberg ◽  
Veronika van der Wardt ◽  
Catherine Brewin ◽  
Rowan H. Harwood

<b><i>Background:</i></b> Apathy is highly prevalent in dementia and is also seen in mild cognitive impairment and the general population. Apathy contributes to failure to undertake daily activities and can lead to health problems or crises. It is therefore important to assess apathy. However, there is currently no gold standard measure of apathy. A comprehensive systematic review of the measurement properties of apathy scales is required. <b><i>Methods:</i></b> A systematic review was registered with PROSPERO (ID: CRD42018094390). MEDLINE, Embase, PsycINFO, and CINAHL were searched for studies that aimed to develop or assess the validity or reliability of an apathy scale in participants over 65 years, living in the community. A systematic review was conducted in line with the COnsensus-based Standards for the selection of health Measurement INstruments procedure for reviewing patient-reported outcome measures. The studies’ risk of bias was assessed, and all relevant measurement properties were assessed for quality. Results were pooled and rated using a modified Grading of Recommendations Assessment, Development, and Evaluation procedure. <b><i>Results:</i></b> Fifty-seven publications regarding 18 measures and 39 variations met the eligibility criteria. The methodological quality of individual studies ranged from inadequate to very good and measurement properties ranged from insufficient to sufficient. Similarly, the overall evidence for measurement properties ranged from very low to high quality. The Apathy Evaluation Scale (AES) and Lille Apathy Rating Scale (LARS) had sufficient content validity, reliability, construct validity, and where applicable, structural validity and internal consistency. <b><i>Conclusion:</i></b> Numerous scales are available to assess apathy, with varying psychometric properties. The AES and LARS are recommended for measuring apathy in older adults and people living with dementia. The apathy dimension of the commonly used Neuropsychiatric Inventory should be limited to screening for apathy.


BMJ Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. e042325
Author(s):  
Qirong Chen ◽  
Chongmei Huang ◽  
Aimee R Castro ◽  
Siyuan Tang

IntroductionNursing research competence of nursing personnel has received much attention in recent years, as nursing has developed as both an independent academic discipline and an evidence-based practiing profession. Instruments for appraising nursing research competence are important, as they can be used to assess nursing research competence of the target population, showing changes of this variable over time and measuring the effectiveness of interventions for improving nursing research competence. There is a need to map the current state of the science of the instruments for nursing research competence, and to identify well validated and reliable instruments. This paper describes a protocol for a scoping review to identify, evaluate, compare and summarise the instruments designed to measure nursing research competence.Methods and analysisThe scoping review will be conducted following Arksey and O’Malley’s methodological framework and Levac et al’s additional recommendations for applying this framework. The scoping review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist. The protocol is registered through the Open Science Framework (https://osf.io/ksh43/). Eight English databases and two Chinese databases will be searched between 1 December 2020 and 31 December 2020 to retrieve manuscripts which include instrument(s) of nursing research competence. The literature screening and data extraction will be conducted by two researchers, independently. A third researcher will be involved when consensus is needed. The COnsensus-based Standards for the selection of health Measurement INstruments methodology will be used to evaluate the methodological quality of the included studies on measurement properties of the instruments, as well as the quality of all the instruments identified.Ethics and disseminationEthical approval is not needed. We will disseminate the findings through a conference focusing on nursing research competence and publication of the results in a peer-reviewed journal.


2020 ◽  
Author(s):  
Pasquale Sansone ◽  
Luca Gregorio Giaccari ◽  
Mario Faenza ◽  
Pasquale Di Costanzo ◽  
Sara Izzo ◽  
...  

Abstract Background: Breast surgery in the United States is common. Pain affects up to 50% of women undergoing breast surgery and can interfere with postoperative outcomes. General anesthesia is the conventional, most frequently used anaesthetic technique. Various locoregional anesthetic techniques are also used for breast surgeries. A systematic review of the use of locoregional anesthesia for postoperative pain in breast surgery is needed to clarify its role in pain management.Objectives: To systematically review literature to establish the efficacy and the safety of locoregional anesthesia used in the treatment of pain after breast surgery.Methods: Embase, MEDLINE, Google Scholar and Cochrane Central Trials Register were systematically searched in Mars 2020 for studies examining locoregional anesthesia for management of pain in adults after breast surgery. The methodological quality of the studies and their results were appraised using the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist and specific measurement properties criteria, respectively.Results: Nineteen studies evaluating locoregional anesthesia were included: 1058 patients underwent lumpectomy/mastectomy, 142 breast augmentation and 79 breast reduction. Locoregional anesthesia provides effective anesthesia and analgesia in the perioperative setting, however no statistically significant difference emerged if compared to other techniques. For mastectomy only, the use of locoregional techniques reduces pain in the first hour after the end of the surgery if compared to other procedures (p = 0.02). Other potentially beneficial effects of locoregional anesthesia include decreased need for opioids, decreased postoperative nausea and vomiting, fewer complications and increased patient satisfaction. All this improves postoperative recovery and shortens hospitalization stay. In none of these cases, locoregional anesthesia was statistically superior to other techniques.Conclusion: The results of our review showed no differences between locoregional anesthesia and other techniques in the management of breast surgery. Locoregional techniques are superior in reducing pain in the first hour after mastectomy.


2019 ◽  
Vol 8 (1) ◽  
Author(s):  
Brett Williams ◽  
Bronwyn Beovich

Abstract Background Empathy is an important characteristic to possess for healthcare professionals. It has been found to improve communication between professionals and patients and to improve clinical health outcomes. The Jefferson Scale of Empathy (JSE) was developed to measure this quality and has been used extensively, and psychometrically appraised, with a variety of cohorts and in different cultural environments. However, no study has been undertaken to systematically examine the methodological quality of studies which have assessed psychometric factors of the JSE. This systematic review will examine the quality of published papers that have reported on psychometric factors of the JSE. Methods A systematic review of studies which report on the psychometric properties of the JSE will be conducted. We will use a predefined search strategy to identify studies meeting the following eligibility criteria: original data is reported on for at least one of the psychometric measurement properties described in the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist, examines the JSE in a healthcare cohort (using the student, physician or health profession versions of the JSE), and is published from January 2001 and in the English language. Conference abstracts, editorials and grey literature will be excluded. Six electronic databases (Medline, EMBASE, PsychInfo, PubMed, Web of Science and CINAHL) will be systematically searched for articles meeting these criteria and studies will be assessed for eligibility by two review authors. The methodological quality of included papers will be examined using the COSMIN Risk of Bias checklist. Discussion A narrative description of the findings will be presented along with summary tables. Recommendations for use of the JSE with various cohorts and circumstances will be offered which may inform future research in this field. Systematic review registration PROSPERO CRD42018111412


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Pasquale Sansone ◽  
Luca Gregorio Giaccari ◽  
Mario Faenza ◽  
Pasquale Di Costanzo ◽  
Sara Izzo ◽  
...  

Abstract Background Breast surgery in the United States is common. Pain affects up to 50% of women undergoing breast surgery and can interfere with postoperative outcomes. General anesthesia is the conventional, most frequently used anaesthetic technique. Various locoregional anesthetic techniques are also used for breast surgeries. A systematic review of the use of locoregional anesthesia for postoperative pain in breast surgery is needed to clarify its role in pain management. Objectives To systematically review literature to establish the efficacy and the safety of locoregional anesthesia used in the treatment of pain after breast surgery. Methods Embase, MEDLINE, Google Scholar and Cochrane Central Trials Register were systematically searched in Mars 2020 for studies examining locoregional anesthesia for management of pain in adults after breast surgery. The methodological quality of the studies and their results were appraised using the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist and specific measurement properties criteria, respectively. Results Nineteen studies evaluating locoregional anesthesia were included: 1058 patients underwent lumpectomy/mastectomy, 142 breast augmentation and 79 breast reduction. Locoregional anesthesia provides effective anesthesia and analgesia in the perioperative setting, however no statistically significant difference emerged if compared to other techniques. For mastectomy only, the use of locoregional techniques reduces pain in the first hour after the end of the surgery if compared to other procedures (p = 0.02). Other potentially beneficial effects of locoregional anesthesia include decreased need for opioids, decreased postoperative nausea and vomiting, fewer complications and increased patient satisfaction. All this improves postoperative recovery and shortens hospitalization stay. In none of these cases, locoregional anesthesia was statistically superior to other techniques. Conclusion The results of our review showed no differences between locoregional anesthesia and other techniques in the management of breast surgery. Locoregional techniques are superior in reducing pain in the first hour after mastectomy.


BMJ Open ◽  
2019 ◽  
Vol 9 (9) ◽  
pp. e029311 ◽  
Author(s):  
Isobel Marion Harris ◽  
Sophie Beese ◽  
David Moore

ObjectiveThis systematic review aimed to evaluate the ability of risk tools to predict the future episodes of suicide/self-harm in adolescents.DesignSystematic review.Data sourcesMEDLINE, EMBASE, CINAHL and PsycINFO were searched from inception to 3 March 2018.Eligibility criteria for selecting studiesCohort studies, case–control studies and randomised controlled trials of adolescents aged 10–25 who had undergone risk assessment in a clinical setting following an episode of self-harm were included.Data extraction and synthesisTwo independent reviewers extracted data and assessed risk of bias. Data were grouped by tool and narrative synthesis undertaken, with studies appraised using a checklist combining the QUIPS (Quality In Prognosis Studies) and QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies) tools.ResultsOf the 17 137 articles initially identified, 11 studies evaluating 10 separate tools were included. The studies varied in setting, population and outcome measure. The majority of the studies were rated as having an unclear risk of bias, and meta-analysis was not possible due to high variability between studies.The ability of the tools to correctly identify those adolescents going on to make a self-harm/suicide attempt ranged from 27% (95% CI 10.7% to 50.2%) to 95.8% (95% CI 78.9% to 99.9%). A variety of metrics were provided for 1–10 points increases in various tools, for example, odds and HRs.ConclusionsThis systematic review is the first to explore the use of assessment tools in adolescents. The predictive ability of these tools varies greatly. No single tool is suitable for predicting a higher risk of suicide or self-harm in adolescent populations.PROSPERO registration numberCRD42017058686


Sign in / Sign up

Export Citation Format

Share Document