Development and Validation of a Questionnaire to Measure Attitude change in Health Professionals after Completion of an Aboriginal Health and Cultural Safety Training Programme

2017 ◽  
Vol 48 (01) ◽  
pp. 24-38 ◽  
Author(s):  
Courtney Ryder ◽  
Tamara Mackean ◽  
Shahid Ullah ◽  
Heather Burton ◽  
Heather Halls ◽  
...  
Keyword(s):  
Health Professional ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Attitude Change ◽  
Focal Point ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Weighted Kappa ◽  
Aboriginal Health ◽  
Cultural Safety

Socially accountable health curricula, designed to decrease Aboriginal health inequities through the transformation of health professional students into culturally safe practitioners, has become a focal point for health professional programmes. Despite this inclusion in health curricula there remains the question of how to best assess students in this area in relation to the concept, of cultural safety and transformative unlearning, to facilitate attitudinal change. To address this question, this study developed a research questionnaire to measure thematic areas of transformative unlearning, cultural safety and critical thinking in Aboriginal Health for application on undergraduate and postgraduate students and faculty staff. The Likert-scale questionnaire was developed and validated through face and content validity. Test–retest methodology was utilised to determine stability and reliability of the questionnaire with 40 participants. The extent of agreement and reliability were determined through weighted kappa and intraclass correlation coefficient. Exploratory factor analysis was calculated to determine construct validity for questionnaire items. For the overall population subset the tool met good standards of reliability and validity, with 11 of the 15 items reaching moderate agreement (κ > 0.6) and an intraclass correlation coefficient of 0.72, suggesting substantial agreement. Cronbach's alpha was calculated above 0.7 for the thematic areas. The majority of items provided high factor loadings, low loading items will be reviewed to strengthen the tool, where validations of the revised tool with a larger cohort will allow future use to compare and determine effective teaching methodologies in Aboriginal health and cultural safety curricula.

Reliability and Validity of the Thai Version of the Carolinas Comfort Scale

2021 ◽  
Vol 104 (11) ◽  
pp. 1784-1787
Keyword(s):  
Inguinal Hernia ◽  
Hernia Repair ◽  
Inguinal Hernia Repair ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objective: To evaluate the reliability and validity of the Thai version of the Carolinas Comfort Scale (CCS) to measure health-related quality of life (HRQoL) in post-hernia repaired patients. Materials and Methods: Three hundred twenty-eight patients that underwent the inguinal hernia repair procedure in Vajira Hospital were recruited in the present study. The Thai version of CCS (TCCS) was performed entirely by the patient, and the test-retest reliability was conducted at a 2-week interval. Results: The TCCS’s internal consistency reliability was excellent (Cronbach’s alpha 0.89). The inter-rater reliability was found to agree with the intraclass correlation coefficient of 0.90. The test-retest reliability over two weeks was high, with an intraclass correlation coefficient of 0.92. Conclusion: The Thai version of CCS was found to have adequate reliability and validity and could be used to measure HRQoL in Thai patients that undergo inguinal hernia repair. Keywords: Reliability; Validity; Carolinas Comfort Scale; Thai version

Learning how to Differ: Agreement and Reliability Statistics in Psychiatry

1995 ◽  
Vol 40 (2) ◽  
pp. 60-66 ◽  
Author(s):  
L. Streiner David
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Weighted Kappa ◽  
The Other ◽  
Cohen’S Kappa ◽  
Cohen's Kappa ◽  
The Subject

Whenever two or more raters evaluate a patient or student, it may be necessary to determine the degree to which they assign the same label or rating to the subject. The major problem in deciding which statistic to use is the plethora of different techniques which are available. This paper reviews some of the more commonly used techniques, such as Raw Agreement, Cohen's kappa and weighted kappa, and shows that, in most circumstances, they can all be replaced by the intraclass correlation coefficient (ICC). This paper also shows how the ICC can be used in situations where the other statistics cannot be used and how to select the best subset of raters.

scholarly journals The reliability and validity of goniometric elbow measurements in adults: A systematic review of the literature

2018 ◽  
Vol 10 (4) ◽  
pp. 274-284 ◽  
Author(s):  
Suzanne F van Rijn ◽  
Elisa L Zwerus ◽  
Koen LM Koenraadt ◽  
Wilco CH Jacobs ◽  
Michel PJ van den Bekerom ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Interrater Reliability ◽  
Literature Search ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Diagnostic Reliability ◽  
Measuring Tool ◽  
Simple Measuring

Background The universal goniometer is a simple measuring tool. With this review we aimed to investigate the reliability and validity of the universal goniometer in measurements of the adults' elbow. Methods Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines were followed and our study protocol was published online at PROSPERO. A literature search was conducted on relevant studies. Methodological quality was assessed using the Quality Appraisal of Diagnostic Reliability (QAREL) scoring system. Results Out of 697 studies yielded from our literature search, 12 were included. Six studies were rated as high quality. The intrarater reliability intraclass correlation coefficient ranged from 0.45 to 0.99, the interrater reliability ranged from intraclass correlation coefficient 0.53–0.97. One study providing instructions on goniometric alignment did not find a difference in expert versus non-expert examiners. Another study in which examiners were not instructed found a higher interrater reliability in expert examiners. One study investigating the validity of the goniometer in elbow measurements found a maximum standard error of the mean of 11.5° for total range of motion. Discussion Overall, the studies showed high intra- and interrater reliability of the universal goniometer. The reliability of the universal goniometer in non-expert examiners can be increased by clear instructions on goniometric alignment.

The Neurologic and Adaptive Capacity Score Is Not a Reliable Method of Newborn Evaluation

2001 ◽  
Vol 94 (6) ◽  
pp. 958-962 ◽  
Author(s):  
Stephen H. Halpern ◽  
Judith A. Littleford ◽  
Nicole J. Brockhurst ◽  
Paul J. Youngs ◽  
Nariman Malik ◽  
...  
Keyword(s):  
Adaptive Capacity ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Obstetric Anesthesia ◽  
Measurement Scales ◽  
Health Measurement ◽  
Vertex Presentation ◽  
Test Retest Reliability

Background The Neurologic and Adaptive Capacity Score (NACS) is a multi-item scale that was published in 1982 to measure the effects of intrapartum drugs on the neonate. Although this scoring system has been widely used in obstetric anesthesia research, studies confirming its reliability have not been published. The purpose of this study was to assess the reliability of the NACS. Methods Two teams of observers were trained to perform the NACS on healthy, term neonates born in the vertex presentation. Two examinations were performed on each neonate within the first 2.5 h of life. Simultaneous (or "split-half") reliability was assessed using the alpha coefficient. Test-retest reliability was assessed using the intraclass correlation coefficient. The test was considered to be reliable if a was greater than 0.7 and the intraclass correlation coefficient was greater than 0.6. Results Two hundred babies were studied. The a was 0.47 and the intraclass correlation coefficient was 0.38 (95% confidence interval, 0.24-0.52). Conclusions The NACS had poor reliability both on simultaneous testing and in the test-retest situation when used to evaluate term, healthy neonates. The authors suggest that other measures need to be developed to evaluate the effect of intrapartum drug administration in the neonate. Health measurement scales should undergo rigorous assessment for reliability and validity before they are used in clinical practice or for research purposes.

scholarly journals Development of the Huddle Observation Tool for structured case management discussions to improve situation awareness on inpatient clinical wards

2017 ◽  
Vol 27 (5) ◽  
pp. 365-372 ◽  
Author(s):  
Julian Edbrooke-Childs ◽  
Jacqueline Hayes ◽  
Evelyn Sharples ◽  
Dawid Gondek ◽  
Emily Stapley ◽  
...  
Keyword(s):  
Case Management ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Situation Awareness ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Weighted Kappa ◽  
Observational Assessment ◽  
Rater Reliability ◽  
Team Processes

Background‘Situation Awareness For Everyone’ (SAFE) was a 3-year project which aimed to improve situation awareness in clinical teams in order to detect potential deterioration and other potential risks to children on hospital wards. The key intervention was the ‘huddle’, a structured case management discussion which is central to facilitating situation awareness. This study aimed to develop an observational assessment tool to assess the team processes occurring during huddles, including the effectiveness of the huddle.MethodsA cross-sectional observational design was used to psychometrically develop the ‘Huddle Observation Tool’ (HOT) over three phases using standardised psychometric methodology. Huddles were observed across four NHS paediatric wards participating in SAFE by five researchers; two wards within specialist children hospitals and two within district general hospitals, with location, number of beds and length of stay considered to make the sample as heterogeneous as possible. Inter-rater reliability was calculated using the weighted kappa and intraclass correlation coefficient.ResultsInter-rater reliability was acceptable for the collaborative culture (weighted kappa=0.32, 95% CI 0.17 to 0.42), environment items (weighted kappa=0.78, 95% CI 0.52 to 1) and total score (intraclass correlation coefficient=0.87, 95% CI 0.68 to 0.95). It was lower for the structure and risk management items, suggesting that these were more variable in how observers rated them. However, agreement on the global score for huddles was acceptable.ConclusionWe developed an observational assessment tool to assess the team processes occurring during huddles, including the effectiveness of the huddle. Future research should examine whether observational evaluations of huddles are associated with other indicators of safety on clinical wards (eg, safety climate and incidents of patient harm), and whether scores on the HOT are associated with improved situation awareness and reductions in deterioration and adverse events in clinical settings, such as inpatient wards.

Reliability and Validity of the Sit-to-Stand as a Muscular Power Measure in Older Adults

2020 ◽  
Vol 28 (3) ◽  
pp. 455-466 ◽  
Author(s):  
Jennifer J. Sherwood ◽  
Cathy Inouye ◽  
Shannon L. Webb ◽  
Jenny O
Keyword(s):  
Older Adults ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Handgrip Strength ◽  
Intraclass Correlation ◽  
Negative Relationship ◽  
Reliability And Validity ◽  
Sit To Stand ◽  
Relationship Of ◽  
The Relationship

The study aims were to analyze the reliability and validity of the GymAware™ linear position transducer’s velocity and power measures during the sit-to-stand, compared with the Dartfish 2D videography analysis, and to assess the relationship of age and handgrip strength with velocity and power in 48 older men and women (77.6 ± 11.1 years). The results showed excellent agreement between GymAware- and Dartfish-derived sit-to-stand velocity (intraclass correlation coefficient2-1 = .94 and power intraclass correlation coefficient2-1 = .98) measures. A moderate and negative relationship was found between age and velocity (r = −.62; p < .001) and age and power (r = −.63; p < .001). A moderate and positive relationship was found between handgrip strength and velocity (r = .43; p = .002) and handgrip strength and power (r = .54; p < .001). The results show the GymAware velocity and power measures during the sit-to-stand in older adults to be reliable and valid.

The Reliability and Validity of the Turkish Kaiser Physical Activity Survey for Pregnant Women

2019 ◽  
Vol 16 (11) ◽  
pp. 962-967
Author(s):  
Esra Uzelpasaci ◽  
Türkan Akbayrak ◽  
Serap Özgül ◽  
Ceren Orhan ◽  
Emine Baran ◽  
...  
Keyword(s):  
Physical Activity ◽  
Pregnant Women ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Activity Survey ◽  
Activity Questionnaire

Background: Evaluation of physical activity by condition-specific surveys provides more accurate results than generic physical activity questionnaires. The aim of this study was to investigate the reliability and validity of the Kaiser Physical Activity Survey (KPAS) in Turkish pregnant women. Methods: In the translation and cultural adaptation of the KPAS, the 6-phase guidelines recommended in the literature were followed. The study included a total of 151 pregnant women who were assessed using the Turkish version of KPAS, the Pregnancy Physical Activity Questionnaire, and the SenseWear Pro3 Armband. To determine the test–retest reliability, the KPAS was reapplied after 7 days. The psychometric properties of KPAS were analyzed with respect to internal consistency, test–retest reliability, and concurrent validity. Results: Cronbach α coefficient indicating the internal consistency of the Turkish KPAS was found to be .60 to .80, showing moderate reliability. The intraclass correlation coefficient for test–retest reliability was very strong (intraclass correlation coefficient: .96–.98). The total KPAS scores were found to be moderately correlated with the total Pregnancy Physical Activity Questionnaire score and the total energy expenditure value on the SenseWear Pro3 Armband. Conclusions: This study showed that KPAS is a valid and reliable instrument for evaluating physical activity in Turkish pregnant women in different aspects.

scholarly journals Reliability and Validity of the Belt-Stabilized Handheld Dynamometer in Hip- and Knee-Strength Tests

2017 ◽  
Vol 52 (9) ◽  
pp. 809-819 ◽  
Author(s):  
Jaqueline Martins ◽  
Janaina Rodrigues da Silva ◽  
Marcelo Rodrigues Barbosa da Silva; ◽  
Débora Bevilaqua-Grossi
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Isokinetic Dynamometer ◽  
Hip Muscle ◽  
Bland Altman Method ◽  
Muscle Groups

Context:  The belt-stabilized handheld dynamometer (HHD) has been used to assess the strength of knee- and hip-muscle groups. However, few researchers have examined its reliability and validity for assessing the strength of these muscles. Objective:  To evaluate the intra-examiner reliability of the belt-stabilized HHD and its validity and agreement with the isokinetic dynamometer for assessing the strength of knee- and hip-muscle groups. Design:  Cross-sectional study. Setting:  University laboratory. Patients or Other Participants:  We evaluated 26 healthy participants (13 men, 13 women; age = 23.5 ± 2.8 years, height = 1.7 ± 0.1 m, mass = 68.6 ± 12.4 kg) in 2 sessions using the belt-stabilized HHD and an isokinetic dynamometer for maximum strength of the hip adductors, abductors, flexors, extensors, internal rotators, and external rotators and the knee flexors and extensors. Main Outcome Measure(s):  We used reliability values provided by the intraclass correlation coefficient (2,3), standard error of measurement (SEM and percentage SEM), and minimal detectable change; correlation values comparing the belt-stabilized HHD and the isokinetic instrument using the Pearson correlation coefficient (r); and the mean difference in values comparing the 2 instruments using the Bland-Altman method. Results:  The intrarater HHD reliability was excellent for most measurements (range = 0.80–0.96; SEM = 1.3–5.3 kilograms of force or 4.8−18.9 Nm, percentage SEM = 7.0%–22.0%, minimal detectable change = 3.6–18.8 kilograms of force or 13.2−52.4 Nm) and was moderate only for bilateral knee flexion and left hip internal rotation (intraclass correlation coefficient [2,3] = 0.62–0.66 and 0.70, respectively). Correlation with the isokinetic dynamometer was moderate to high (r = 0.60–0.90), but the absolute values did not demonstrate concordance between results using the Bland-Altman method. Conclusions:  The belt-stabilized HHD measurements were reliable, and although they did not agree with those from the isokinetic dynamometer, the values were correlated for the hip- and knee-muscle groups.

scholarly journals Three-dimensional Acetabular Bone Defect Classification System Aided with Rapid Prototyping Model and Reliability and Validity Test

2021 ◽  
Author(s):  
Jingwei Zhang ◽  
Yi Hu ◽  
Hua Ying ◽  
Yuanqing Mao ◽  
Zhenan Zhu ◽  
...  
Keyword(s):  
Rapid Prototyping ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Bone Defect ◽  
Intraclass Correlation ◽  
Three Dimensional ◽  
Revision Arthroplasty ◽  
Reliability And Validity ◽  
Defect Classification ◽  
Observer Reliability

Abstract Background: Accurately assessing acetabular defects and designing precise and feasible surgical plans are important before hip revision arthroplasty. With the development of three-dimensional printing, rapid prototyping is a novel technique used to print isometric physical object models. We aimed to propose a three-dimensional acetabular bone defect classification system aided with rapid prototyping and evaluated its reliability and validity.Methods: We reviewed 104 consecutive patients who underwent hip revision arthroplasty in our department between January 2014 and December 2019. Forty five of them had rapid prototyping and were included for reliability and validity test. Three doctors retrospectively evaluated bone defects of these 45 patients with this classification and made surgical plans, and repeated it after 2 weeks. The intra- and inter-observer reliability and the validity to surgical records were assessed using intraclass correlation coefficient or Kappa correlation coefficient.Results: The reliability and validity for classification results were high. The mean initial intraclass correlation coefficient for inter-observer reliability was 0.947, which increased to 0.972 when texted second time. As for inter-observer reliability, it ranged from 0.958 to 0.980. The validity showed high Kappa correlation coefficient of 0.951 to 0.967. When considering detailed surgical plans, the reliability and validity were also high with intraclass correlation coefficient and Kappa correlation coefficient all over 0.9.Conclusions: This three-dimensional acetabulum defect classification was of high reliability and convincing validity. With this classification and objective rapid prototyping models, accurate bone defect assessment and reliable surgical plans were achieved. This classification aided with rapid prototyping could serve as a promising tool for surgeons for preoperative evaluation.

Sign in / Sign up

Export Citation Format

Share Document