scholarly journals Development of a Clinical Tool for Rating the Body Function Categories of the ICF Generic-30/Rehabilitation Set in Japanese Rehabilitation Practice, and Examination of its Interrater Reliability

2020 ◽  
Author(s):  
Yuki Senju ◽  
Masahiko Mukaino ◽  
Birgit Prodinger ◽  
Melissa Selb ◽  
Yuki Okouchi ◽  
...  
Keyword(s):  
Field Test ◽  
Interrater Reliability ◽  
Weighted Kappa ◽  
Kappa Coefficient ◽  
The Body ◽  
Interrater Agreement ◽  
Reliability Test ◽  
Body Function ◽  
Reference Guide ◽  
Weighted Kappa Coefficient

Abstract BackgroundThe International Classification of Functioning, Disability, and Health (ICF) Generic-30 (Rehabilitation) Set is a tool for assessing the functioning of a clinical population in rehabilitation. The ICF Generic-30 consists of 9 ICF categories from the component “body functions” and 21 from the component “activities and participation”. This study aimed to develop a rating reference guide for the 9 body function categories of the ICF Generic-30 Set using a predefined, structured process and to examine the interrater reliability of the ratings using the rating reference guide.MethodsThe development of the first version of the rating reference guide involved the following steps: (1) A trial of rating patients by several raters; (2) cognitive interviews with each rater to analyze the thought process involved in each rating; (3) the drafting of the rating reference guide by a multidisciplinary panel; and (4) a review by ICF specialists to confirm consistency with the ICF. Subsequently, we conducted a first field test to gain insight on the use of the guide in practice. The reference guide was modified based on the raters’ feedback in the field test, and an interrater reliability test was conducted thereafter. Interrater agreement was evaluated using weighted kappa statistics with linear weights.ResultsThe first version of the rating reference guide was successfully developed and field tested. The weighted kappa coefficient in the field testing ranged from 0.25 to 0.92. The interrater reliability testing of the rating reference guide modified based on the field test results yielded an improved weighted kappa coefficient ranging from 0.54 to 0.85. ConclusionsIn this study, we developed and modified a rating reference guide for the body function categories of the ICF Generic-30 Set. The interrater reliability test using the final version of the rating reference guide showed moderate to excellent interrater agreement, which encourages the use of the ICF in rehabilitation practice.Trial registrationNot applicable.

scholarly journals Development of a clinical tool for rating the body function categories of the ICF generic-30/rehabilitation set in Japanese rehabilitation practice and examination of its interrater reliability

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Yuki Senju ◽  
Masahiko Mukaino ◽  
Birgit Prodinger ◽  
Melissa Selb ◽  
Yuki Okouchi ◽  
...  
Keyword(s):  
Field Test ◽  
Interrater Reliability ◽  
Weighted Kappa ◽  
Kappa Coefficient ◽  
The Body ◽  
Interrater Agreement ◽  
Reliability Test ◽  
Body Function ◽  
Reference Guide ◽  
Weighted Kappa Coefficient

Abstract Background The International Classification of Functioning, Disability, and Health (ICF) Generic-30 (Rehabilitation) Set is a tool used to assess the functioning of a clinical population in rehabilitation. The ICF Generic-30 consists of nine ICF categories from the component “body functions” and 21 from the component “activities and participation”. This study aimed to develop a rating reference guide for the nine body function categories of the ICF Generic-30 Set using a predefined, structured process and to examine the interrater reliability of the ratings using the rating reference guide. Methods The development of the first version of the rating reference guide involved the following steps: (1) a trial of rating patients by several raters; (2) cognitive interviews with each rater to analyze the thought process involved in each rating; (3) the drafting of the rating reference guide by a multidisciplinary panel; and (4) a review by ICF specialists to confirm consistency with the ICF. Subsequently, we conducted a first field test to gain insight into the use of the guide in practice. The reference guide was modified based on the raters’ feedback in the field test, and an inter-rater reliability test was conducted thereafter. Interrater agreement was evaluated using weighted kappa statistics with linear weights. Results The first version of the rating reference guide was successfully developed and tested. The weighted kappa coefficient in the field testing ranged from 0.25 to 0.92. The interrater reliability testing of the rating reference guide modified based on the field test results yielded an improved weighted kappa coefficient ranging from 0.53 to 0.78. Relative improvements in the weighted kappa coefficients were observed in seven out of the nine categories. Consequently, seven out of nine categories were found to have a weighted kappa coefficient of 0.61 or higher. Conclusions In this study, we developed and modified a rating reference guide for the body function categories of the ICF Generic-30 Set. The interrater reliability test using the final version of the rating reference guide showed moderate to substantial interrater agreement, which encouraged the use of the ICF in rehabilitation practice.

scholarly journals Ανίχνευση ασβέστωσης των στεφανιαίων αρτηριών με ψηφιακή ακτινοσκόπηση

2016 ◽  
Author(s):  
Μαρία Παπαθανασίου
Keyword(s):  
Weighted Kappa ◽  
Kappa Coefficient ◽  
Weighted Kappa Coefficient

Εισαγωγή:Η μελέτη αυτή διερευνά τη διαγνωστική ακρίβεια της ψηφιακής ακτινοσκόπησης επίπεδων ανιχνευτών (FPDD) για την ανίχνευση ασβέστωσης των στεφανιαίων αρτηριών λαμβάνοντας ως μέθοδο αναφοράς την πολυτομική αξονική τομογραφία καρδιάς (MDCT).Μέθοδος:Μελετήθηκε η ασβέστωση των στεφανιαίων σε ασυμπτωματικούς ενήλικες χαμηλού έως μετρίου καρδιαγγειακού κινδύνου χωρίς γνωστή στεφανιαία νόσο με πολυτομική αξονική τομογραφία και με ψηφιακή ακτινοσκόπηση καρδιάς με την τεχνολογία FPDD. Η ασβέστωση κατηγοριοποιήθηκε με βάση την ακτινοσκοπική εξέταση ημιποσοτικά σε απούσα (0), ήπιου (1), μέτριου (2) και σοβαρού βαθμού (3). Εφαρμόζοντας τη μεθόδο Agatston υπολογίστηκε το σκορ ασβεστίου των στεφανιαίων αρτηριών στην MDCT.Αποτελέσματα:Στη μελέτη συμμετείχαν συνολικά 151 ασυμπτωματικοί εθελοντές, 40-60 ετών (μέση ηλικία 53,1 ± 7,4). Οι άνδρες συνιστούν το 76,5% του πληθυσμού της μελέτης. Η ύπαρξη στεφανιαίας ασβέστωσης ανιχνεύθηκε σε 79 (52,3%) και 69 (45,7%) άτομα με την MDCT και την ακτινοσκόπηση αντίστοιχα. Η συμφωνία ανάμεσα στην MDCT και την ακτινοσκόπηση ήταν 77,5% (weighted kappa coefficient 0,75). Η ακτινοσκόπηση ανίχνευσε ασβέστιο σε 50% των ατόμων με ελάχιστη ασβέστωση στην MDCT (σκορ ασβεστίου <10). Με τη χρήση ROC ανάλυσης και λαμβάνοντας ως ουδό σκορ ασβεστίου μηδέν, η AUC ήταν 0,89 (95% CI 0,83-0,93, p=0,0001) με ευαισθησία 82,3% και ειδικότητα 94,4%. Για σκορ ασβεστίου 10, η AUC ήταν 0,91 (95% CI 0,86-0,95 p=0.0001) με ευαισθησία 91,8% και ειδικότητα 85,6%. Για σκορ ασβεστίου 400, η AUC ήταν 0,97 (95% CI 0,94-0,99, p=0,0001) με ευαισθησία 100% και ειδικότητα 88,7%. Η ενεργός δόση ακτινοβολίας ήταν 1,8 ± 0,09 mSv για την MDCT και 0,26 ± 0,13 mSv για την ακτινοσκόπηση.Συμπεράσματα:Η ψηφιακή ακτινοσκόπηση με την τεχνολογία FPDD έχει εξαιρετική διαγνωστική ακρίβεια σε σύγκριση με την καθιερωμένη MDCT για τη διάγνωση της ασβέστωσης των στεφανιαίων σε ασυμπτωματικά άτομα μέσης ηλικίας, με χαμηλό έως μέτριο καρδιαγγειακό κίνδυνο, με το πλεονέκτημα της μειωμένης έκθεσης σε ακτινοβολία.

scholarly journals Adaptation of an instrument to classify neonatal patients into care categories

2021 ◽  
Vol 55 ◽  
Author(s):  
Ariane Polidoro Dini ◽  
Andrezza de Cassia Vannucci de Oliveira ◽  
Beatriz Pera de Almeida-Hamasaki ◽  
Norma Mejias Quinteiro ◽  
Elenice Valentim Carmona
Keyword(s):  
Intensive Care ◽  
Pediatric Patients ◽  
Weighted Kappa ◽  
Kappa Coefficient ◽  
Patient Classification ◽  
Methodological Study ◽  
Validity Index ◽  
Nursing Team ◽  
Agreement Coefficient ◽  
Weighted Kappa Coefficient

ABSTRACT Objective: To adapt and validate a patient classification instrument for neonatal units. Method: Methodological study, with adaptation of the Pediatric Patients Classification Instrument for neonatal patients. After content validation by judges, the instrument was tested for reliability, applied to 33 neonates by two nurses, simultaneously. To assess the agreement among nurses regarding the scores of each patient on the classification scale, an intraclass agreement coefficient was applied. To assess the agreement regarding the classification in care categories, the weighted Kappa coefficient was calculated. Results: The adapted instrument consisted of a total of nine indicators, with three care categories: high dependence on care, semi-intensive care and intensive care. The Content Validity Index varied between 0.85 and 0.92 for items of the instrument. The intraclass agreement was 0.87 and the weighted Kappa for care categories was 0.56. Conclusion: An instrument that allows neonatal patients to be classified into care categories, with satisfactory reliability was validated to support the dimensioning of the nursing team.

scholarly journals Comparison of Visual and Digital Color Measurement Methods on Anterior Natural Teeth

2018 ◽  
Vol 22 (2) ◽  
pp. 87-92
Author(s):  
Sait Ege Eryürük ◽  
Canan Hekimoğlu ◽  
Elif Tuba Akçin ◽  
Yeliz Çavuşoğlu
Keyword(s):  
Weighted Kappa ◽  
Kappa Coefficient ◽  
Measurement Methods ◽  
Color Measurement ◽  
Central Incisor ◽  
Digital Device ◽  
Natural Teeth ◽  
Digital Methods ◽  
Shade Guide ◽  
Weighted Kappa Coefficient

SummaryBackground/Aim: The purpose of this study was to evaluate compatibility between visual and digital color measurement methods.Material and Methods: The color measurement components of intact natural maxillary right central incisor and left canine teeth of eighty patients were measured with visually shade guide and, digitally, with digital device. The color matchings were performed for each teeth on labial surfaces divided into three regions: cervical, middle and incisal. Ligthness, MLR (M: means middle hue, L designates greener, R designates redder) and chroma levels were assessed for each tooth on divided regions respectively. Measurements were performed by the same and experinced dentist with healthy eyes. The data were analyzed with Kappa and weighted Kappa coefficient (p< 0.05).Results: The compatibility between visual and digital methods did not exist for MLR and chroma. The compatibility between both methods were determined only for ligthness of maxillary central and canine teeth at all regions of labial surfaces.Conclusions: There was compatibility only for ligthness of intact natural teeth at all regions with both methods.

scholarly journals Self-reported weight and height are valid measures to determine weight status: results from the Brazilian National Health Survey (PNS 2013)

2018 ◽  
Vol 34 (5) ◽  
Author(s):  
Naiara Ferraz Moreira ◽  
Verônica Gronau Luz ◽  
Caroline Camila Moreira ◽  
Rosângela Alves Pereira ◽  
Rosely Sichieri ◽  
...  
Keyword(s):  
National Health ◽  
Health Survey ◽  
Weight Status ◽  
Weighted Kappa ◽  
National Health Survey ◽  
Kappa Coefficient ◽  
Bland Altman Method ◽  
Epidemiological Surveys ◽  
Exact Agreement ◽  
Weighted Kappa Coefficient

Self-reported measures have been used to obtain weight and height information in some epidemiological surveys. The validation of such information is necessary to guarantee data quality. This study assessed the validity of self-reported weight and height to determine weight status. Data were obtained in the Brazilian National Health Survey, a Brazilian household-based nationwide survey carried out in 2013. In this survey, 40,366 individuals (aged ≥ 18 years) provided self-reported and measured information about weight and height. Student’s paired t-test was used to verify the differences between self-reported and measured data. The agreement between measurements was obtained using the intraclass correlation coefficient (ICC) and Bland-Altman method. To evaluate variations in weight status categorizations, the weighted kappa coefficient and exact agreement were used. Sensitivity and specificity were estimated for the self-reported information to classify overweight and obese individuals. There was high agreement between self-reported and measured weight, height, and body mass index (ICC > 0.88). The mean agreements estimated by the Bland-Altman method were 99.6% for weight and 100.6% for height. The weighted kappa coefficient showed substantial agreement among the weight status categories (> 0.66); the exact agreement was 77%. Sensibility and specificity for overweight (83% and 87.5%, respectively) and obesity (73.4% and 96.7%, respectively) were considered high for the sociodemographic characteristics evaluated. According to our results, self-reported measurements of weight and height can be used cautiously as valid alternatives to determine weight status.

scholarly journals Does reduced cough capacity in minor thoracic injury is associated with atelectasis development?

2021 ◽  
Author(s):  
Sandrine Hegg ◽  
Brice Batomen ◽  
Esther Thériault ◽  
Valérie Boucher ◽  
Marcel Émond
Keyword(s):  
Weighted Kappa ◽  
Kappa Coefficient ◽  
Chief Complaint ◽  
Thoracic Injury ◽  
Substantial Agreement ◽  
Medical Evaluation ◽  
Attending Physician ◽  
Weighted Kappa Coefficient ◽  
Injury Causes

Abstract Context: Minor thoracic injury causes non-negligible pain that could reduce the cough capacity and can cause infectious problems and atelectasis. Objectives: To describe the association between atelectasis and cough capacity, and to assess the concordance of cough capacity perceptions between health professionals and the patient. Design:The data were collected from 2006 to 2012 in 4 Canadian emergency departments (ED). Participants: Patients with a chief complaint of minor thoracic injury, ≥ 16 years old, discharged home from the ED after an evaluation by the attending physician, were included. They have three visits, at the ED, 7-day and 14-day follow-up. The initial ED visit included medical evaluation, data collection and mandatory chest and rib radiography. Main outcome measures: The presence of atelectasis was noted at the initial ED and subsequent visits.Participants cough capacity was noted by a physician, a nurse and the patients himself at subsequentvisits and classified as good, diminished, weak /absent.Results: Among the 1474 patients, 8.89% (95% CI: 7.55 - 10.47), 7.33% (95% CI: 6.04 – 8.89) and 4.63% (95% CI: 3.51 – 6.09) had atelectasis at the initial visit, 7-day and 14-day follow-up visit respectively. Except for patients with weak or absent cough capacity at the 7-day visit, which had a 2.89 (95%CI: 2.05 – 4.05) folds atelectasis proportion relative to those with a good cough capacity, they were no associations between cough capacity and atelectasis. The weighted kappa coefficient suggests a moderate to substantial agreement between the cough capacity measured by patients and nurses (0.52 to 0.65).Conclusion: There was not strong evidence of an association between atelectasis and cough capacity and the best agreement between cough capacity perception was between nurses and patients.

Sign in / Sign up

Export Citation Format

Share Document