scholarly journals Assessing anaesthesiology and intensive care specialty physicians: An Italian language multisource feedback system

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0250404
Author(s):  
Luca Carenzo ◽  
Tiziana Cena ◽  
Fabio Carfagna ◽  
Valentina Rondi ◽  
Pier Luigi Ingrassia ◽  
...  
Keyword(s):  
Intensive Care ◽  
Clinical Practice ◽  
Construct Validity ◽  
Feedback System ◽  
Internal Consistency Reliability ◽  
Multisource Feedback ◽  
Assessment System ◽  
The Self ◽  
Italian Language ◽  
Medical Colleague

Background Physician professionalism, including anaesthesiologists and intensive care doctors, should be continuously assessed during training and subsequent clinical practice. Multi-source feedback (MSF) is an assessment system in which healthcare professionals are assessed on several constructs (e.g., communication, professionalism, etc.) by multiple people (medical colleagues, coworkers, patients, self) in their sphere of influence. MSF has gained widespread acceptance for both formative and summative assessment of professionalism for reflecting on how to improve clinical practice. Methods Instrument development and psychometric analysis (feasibility, reliability, construct validity via exploratory factor analysis) for MSF questionnaires in a postgraduate specialty training in Anaesthesiology and intensive care in Italy. Sixty-four residents at the Università del Piemonte Orientale (Italy) Anesthesiology Residency Program. Main outcomes assessed were: development and psychometric testing of 4 questionnaires: self, medical colleague, coworker and patient assessment. Results Overall 605 medical colleague questionnaires (mean of 9.3 ±1.9) and 543 coworker surveys (mean 8.4 ±1.4) were collected providing high mean ratings for all items (> 4.0 /5.0). The self-assessment item mean score ranged from 3.1 to 4.3. Patient questionnaires (n = 308) were returned from 31 residents (40%; mean 9.9 ± 6.2). Three items had high percentages of “unable to assess” (> 15%) in coworker questionnaires. Factor analyses resulted in a two-factor solution: clinical management with leadership and accountability accounting for at least 75% of the total variance for the medical colleague and coworker’s survey with high internal consistency reliability (Cronbach’s α > 0.9). Patient’s questionnaires had a low return rate, a limited exploratory analysis was performed. Conclusions We provide a feasible and reliable Italian language MSF instrument with evidence of construct validity for the self, coworkers and medical colleague. Patient feedback was difficult to collect in our setting.

scholarly journals The adolescent and young adult self-management and independence scale (AMIS-II): Expanding evidence for validity and reliability

2021 ◽  
pp. 1-14
Author(s):  
Monique M. Ridosh ◽  
Colleen Stiles-Shields ◽  
Alexa Stern ◽  
Adrien M. Winning ◽  
Lara Anderson ◽  
...  
Keyword(s):  
Young Adults ◽  
Young Adult ◽  
Spina Bifida ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Assessment System ◽  
Adolescents And Young Adults ◽  
Self Management ◽  
Adaptive Behaviors

PURPOSE: The purpose of this longitudinal study was to evaluate the internal consistency reliability and construct validity of the Adolescent/Young Adult Self-Management and Independence Scale-II (AMIS-II), an interview-based measure of self-management for youth with chronic health conditions. METHODS: A diverse sample of adolescents and young adults (AYA) with spina bifida (SB) (n = 64 AYA; mean 20.88; age range 18–25 years) completed an AMIS-II interview. Six years earlier, parents from 55 families completed questionnaires that assessed children’s responsibility for SB-related care (Sharing of Spina Bifida Management Responsibilities) and their ability to perform skills across condition-related tasks (The Spina Bifida Independence Survey). Parents also reported on child’s communication skills, adaptive behaviors, and independent management of finances (Adaptive Behavior Assessment System-Second Edition; Scales of Independent Behavior-Revised). Descriptive and correlational analyses were conducted to assess the construct validity and the internal consistency reliability of the AMIS-II. RESULTS: The AMIS-II demonstrated excellent internal consistency reliability (AMIS-II total scale α= 0.95; subscales α= 0.90 –0.91). Evidence in support of construct validity was found in associations between the AMIS-II and measures of child responsibility for SB-related care, ability to perform condition-related skills, and adaptive behaviors (r’s = 0.378 –0.777; p’s <  0.05). CONCLUSION: This study provides further evidence of strong reliability and validity for the AMIS-II. Additional research with this measure will facilitate a better understanding of factors related to self-management behaviors in adolescents and young adults with spina bifida.

scholarly journals Multisource feedback to assess pediatric practice: a systematic review

2013 ◽  
Vol 4 (1) ◽  
pp. e86-e95 ◽  
Author(s):  
Samah Al Alawi ◽  
Ahmed Al Ansari ◽  
Ayman Raees ◽  
Salman Al Khalifa
Keyword(s):  
Systematic Review ◽  
English Language ◽  
Principal Component ◽  
Feedback System ◽  
Internal Consistency Reliability ◽  
Multisource Feedback ◽  
Principal Component Factor Analysis ◽  
Inclusion Criteria ◽  
Key Competencies ◽  
Practice Methods

Introduction: The assessment and maintenance of competence for pediatricians has recently received increased attention. The aim of the present study was to investigate further the use of multisource feedback for assessing pediatricians in practice. Methods: A systematic literature review was conducted using the electronic databases EMBASE, PsycINFO, MEDLINE, PUBMED, and CINAHL for English-language articles. Results: 762 articles were identified with the initial search and 756 articles were excluded for a total of six studies that met the inclusion criteria for this systematic review. Internal consistency reliability was reported in five studies with α > 0.95 for both subscales and full scales. Generalizability was also reported in two studies with Ep2 generally > 0.78. These adequate Ep2 coefficients were achieved with different numbers of raters. Evidence for content, criterion-related (e.g., Pearson’s r) and construct validity (e.g., principal component factor analysis) was reported in all 6 studies. Conclusion: Multisource feedback is a feasible, reliable, and valid method to assess pediatricians in practice. The results indicate that multisource feedback system can be used to assess key competencies such as communication skills, interpersonal skills, collegiality, and medical expertise. Further implementation of multisource feedback is desirable.

Instrumental and Ideological Union Commitment: Longitudinal Assessment of Construct Validity

2001 ◽  
Vol 17 (2) ◽  
pp. 98-111 ◽  
Author(s):  
Anders Sjöberg ◽  
Magnus Sverke
Keyword(s):  
Construct Validity ◽  
Temporal Stability ◽  
Strong Support ◽  
Internal Consistency Reliability ◽  
Measurement Model ◽  
Two Dimensions ◽  
Model Parameters ◽  
Longitudinal Assessment ◽  
Union Commitment ◽  
Union Participation

Summary: Previous research has identified instrumentality and ideology as important aspects of member attachment to labor unions. The present study evaluated the construct validity of a scale designed to reflect the two dimensions of instrumental and ideological union commitment using a sample of 1170 Swedish blue-collar union members. Longitudinal data were used to test seven propositions referring to the dimensionality, internal consistency reliability, and temporal stability of the scale as well as postulated group differences in union participation to which the scale should be sensitive. Support for the hypothesized factor structure of the scale and for adequate reliabilities of the dimensions was obtained and was also replicated 18 months later. Tests for equality of measurement model parameters and test-retest correlations indicated support for the temporal stability of the scale. In addition, the results were consistent with most of the predicted differences between groups characterized by different patterns of change/stability in union participation status. The study provides strong support for the construct validity of the scale and indicates that it can be used in future theory testing on instrumental and ideological union commitment.

The Colorado Cognitive Assessment (CoCA): Development of an Advanced Neuropsychological Screening Tool

2019 ◽  
Author(s):  
Ashita S. Gurnani ◽  
Shayne S.-H. Lin ◽  
Brandon E Gavett
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Cognitive Assessment ◽  
Screening Tool ◽  
Depression Scale ◽  
Internal Consistency Reliability ◽  
Screening Tests ◽  
Cognitive Screening ◽  
Analysis Model ◽  
Factor Analysis Model

Objective: The Colorado Cognitive Assessment (CoCA) was designed to improve upon existing screening tests in a number of ways, including enhanced psychometric properties and minimization of bias across diverse groups. This paper describes the initial validation study of the CoCA, which seeks to describe the test; demonstrate its construct validity; measurement invariance to age, education, sex, and mood symptoms; and compare it to the Montreal Cognitive Assessment (MoCA). Method: Participants included 151 older adults (MAge = 71.21, SD = 8.05) who were administered the CoCA, MoCA, Judgment test from the Neuropsychological Assessment Battery (NAB), 15-item version of the Geriatric Depression Scale (GDS-15), and 10-item version of the Geriatric Anxiety Scale (GAS-10). Results: A single factor confirmatory factor analysis model of the CoCA fit the data well, CFI = 0.955; RMSEA = 0.033. The CoCA’s internal consistency reliability was .84, compared to .74 for the MoCA. The CoCA had stronger disattenuated correlations with the MoCA (r = .79) and NAB Judgment (r = .47) and weaker correlations with the GDS-15 (r = -.36) and GAS-10 (r = -.15), supporting its construct validity. Finally, when analyzed using multiple indicators, multiple causes (MIMIC) modeling, the CoCA showed no evidence of measurement non-invariance, unlike the MoCA. Conclusions: These results provide initial evidence to suggest that the CoCA is a valid cognitive screening tool that offers numerous advantages over the MoCA, including superior psychometric properties and measurement non-invariance. Additional validation and normative studies are warranted.

Nurses’ Perceptions of a Care Plan Information Technology Solution With Hundreds of Clinical Practice Guidelines in Adult Intensive Care Units: Survey Study (Preprint)

2018 ◽  
Author(s):  
Azizeh Khaled Sowan ◽  
Meghan Leibas ◽  
Albert Tarriela ◽  
Charles Reed
Keyword(s):  
Intensive Care ◽  
Quality Of Care ◽  
Clinical Practice ◽  
Nursing Care ◽  
Clinical Practice Guidelines ◽  
Practice Guidelines ◽  
Care Plan ◽  
System Use ◽  
Nurses Perceptions

BACKGROUND The integration of clinical practice guidelines (CPGs) into the nursing care plan and documentation systems aims to translate evidence into practice, improve safety and quality of care, and standardize care processes. OBJECTIVE This study aimed to evaluate nurses’ perceptions of the usability of a nursing care plan solution that includes 234 CPGs. METHODS A total of 100 nurses from 4 adult intensive care units (ICUs) responded to a survey measuring nurses’ perceptions of system usability. The survey included 37 rated items and 3 open-ended questions. RESULTS Nurses’ perceptions were favorable with more than 60.0% (60/100) in agreement on 12 features of the system and negative to moderate with 20.0% (20/100), to 59.0% (59/100) in agreement on 19 features. The majority of the nurses (80/100, 80.0% to 90/100, 90.0%) agreed on 4 missing safety features within the system. More than half of the nurses believed they would benefit from refresher classes on system use. Overall satisfaction with the system was just above average (54/100, 54.0%). Common positive themes from the narrative data were related to the system serving as a reminder for complete documentation and individualizing patient care. Common negative aspects were related to duplicate charting, difficulty locating CPGs, missing unit-specific CPGs, irrelevancy of information, and lack of perceived system value on patient outcomes. No relationship was found between years of system use or ICU experience and satisfaction with the system (P=.10 to P=.25). CONCLUSIONS Care plan systems in ICUs should be easy to navigate; support efficient documentation; present relevant, unit-specific, and easy-to-find information; endorse interdisciplinary communication; and improve safety and quality of care.

scholarly journals Beyond torture checklists: an exploratory study of the reliability and construct validity of the Torturing Environment Scale (TES)

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Pau Pérez-Sales ◽  
Raquel González-Rubio ◽  
Blanca Mellor-Marsá ◽  
Gonzalo Martínez-Alés
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Quantitative Research ◽  
Subjective Experience ◽  
Basque Country ◽  
Internal Consistency Reliability ◽  
Torture Survivors ◽  
Security Forces ◽  
Validity Assessment ◽  
Environment Scale

Abstract Background Torture methods have traditionally been quantified using checklists. However, checklists fail to capture accurately both the almost infinite range of available methods of torture and the victims’ subjective experience. The Torturing Environment Scale (TES) was designed as a multidimensional alternative that groups torture methods according to the specific human function under attack. This study aims to do an exploratory assessment of the internal consistency reliability and discriminatory validity of the TES as part of a construct validity assessment in a sample of Basque torture survivors. Methods We applied the TES to a sample of 201 torture survivors from the Istanbul Protocol Project in the Basque Country Study (IPP-BC) to profile torturing environments in detention. To estimate the internal consistency reliability of the scale, categorical omega values were obtained for each subscale of the TES. To assess its discriminatory validity, the “known groups” method was used comparing mean scorings by gender, state security forces involved in the detention, and decade (the 1980s to the present) when the events took place. Results Men reported more physical pain, while women reported more attacks on self-identity and sexual integrity. The TES also showed significant differences as regards the security forces involved in the detention: Civil Guard (a militarised police) used more manipulation of the environment, threats, fear, pain and extreme pain, as compared to national and regional corps. Finally, although patterns of torture remained mostly unchanged across decades, more recent detentions included more emphasis on psychological attacks: context manipulation, humiliation linked to sexual identity, and attacks to meaning and identity. For all subscales of the TES, categorical omega values ranged from 0.44 to 0.72. Conclusion The TES may be a useful tool in profiling torturing environments. Its sensitivity to key contextual variables supports the discriminatory validity of the scale. While some of the subscales showed an acceptable degree of internal consistency, others require further analysis to improve reliability. The scale provides unique insights into the profile of contemporary torture. It will allow for future quantitative research on the relationship between different torturing environments and the medical and psychological consequences thereof.

Shortening the Application Time of Alcohol-Based Hand Rubs to 15 Seconds May Improve the Frequency of Hand Antisepsis Actions in a Neonatal Intensive Care Unit

2017 ◽  
Vol 38 (12) ◽  
pp. 1430-1434 ◽  
Author(s):  
Axel Kramer ◽  
Didier Pittet ◽  
Romana Klasinc ◽  
Stefan Krebs ◽  
Torsten Koburger ◽  
...  
Keyword(s):  
Intensive Care Unit ◽  
Intensive Care ◽  
Clinical Practice ◽  
Neonatal Intensive Care Unit ◽  
Neonatal Intensive Care ◽  
Application Time ◽  
Improve Hand Hygiene ◽  
Independent Observer ◽  
Hand Antisepsis

BACKGROUNDFor alcohol-based hand rubs, the currently recommended application time of 30 seconds is longer than the actual time spent in clinical practice. We investigated whether a shorter application time of 15 seconds is microbiologically safe in neonatal intensive care and may positively influence compliance with the frequency of hand antisepsis actions.METHODSWe conducted in vitro experiments to determine the antimicrobial efficacy of hand rubs within 15 seconds, followed by clinical observations to assess the effect of a shortened hand antisepsis procedure under clinical conditions in a neonatal intensive care unit (NICU). An independent observer monitored the frequency of hand antisepsis actions during shifts.RESULTSAll tested hand rubs fulfilled the requirement of equal or even significantly higher efficacy within 15 seconds when compared to a reference alcohol propan-2-ol 60% (v/v) within 30 seconds. Microbiologically, reducing the application time to 15 seconds had a similar effect when compared to 30-second hand rubbing, but it resulted in significantly increased frequency of hand antisepsis actions (7.9±4.3 per hour vs 5.8±2.9 per hour; P=.05).CONCLUSIONTime pressure and workload are recognized barriers to compliance. Therefore, reducing the recommended time for hand antisepsis actions, using tested and well-evaluated hand rub formulations, may improve hand hygiene compliance in clinical practice.Infect Control Hosp Epidemiol 2017;38:1430–1434

Sign in / Sign up

Export Citation Format

Share Document