scholarly journals Development of an Activity Scale for Individuals With Advanced Parkinson Disease: Reliability and “On-Off” Variability

2000 ◽  
Vol 80 (11) ◽  
pp. 1087-1096 ◽  
Author(s):  
Alice Nieuwboer ◽  
Willy De Weerdt ◽  
René Dom ◽  
Kris Bogaerts ◽  
Godelieve Nuyens
Keyword(s):  
Parkinson Disease ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Weighted Kappa ◽  
Repeated Measurements ◽  
Functional Mobility ◽  
Variable Response ◽  
Phase Measurements ◽  
The Impact

Abstract Background and Purpose. Functional mobility in people with advanced Parkinson disease, some of whom have a variable response to drug treatment, is often difficult to evaluate. The objectives of this study were to investigate the interrater reliability of measurements obtained with a scale designed to measure mobility and to determine the impact of self-rated dyskinesias and fluctuations on the measure. Subjects. Twenty-nine people with Parkinson disease and with disability and considerable disease duration (X̄=11.7 years, SD=4.9, range=6–22) took part in the study. Methods. The subjects' performance on a 10-item scale was videotaped. The videotapes were then scored by 2 independent raters, and the scores were used to determine interrater reliability. The stability of 6 repeated measurements was examined in the home situation, taking into account self-rated fluctuations of motor performance. Results. Weighted Kappa values of agreement (.86–.98) confirmed the reliability between testers. Measurement during the “on” phase (when medication was working optimally) and the “off” phase (when the action of medication was strongly decreased or absent) led to different measurements. Measuring frequently within “on” and “off” phases gave relatively stable measurements for total function, bed transfers, and gait akinesia, the latter during the “off” phase only (intraclass correlation coefficients [ICCs]=.70–.93). However, more modest repeatability applied to transfers from a chair (ICC=.65–.67). Conclusion and Discussion. To ensure valid results in future effect studies, clinical differentiation between “on” and “off” phase measurements is proposed on the basis of patients' own perception of their medication status.

scholarly journals Interrater Reliability of AM-PAC “6-Clicks” Basic Mobility and Daily Activity Short Forms

2015 ◽  
Vol 95 (5) ◽  
pp. 758-766 ◽  
Author(s):  
Diane U. Jette ◽  
Mary Stilphen ◽  
Vinoth K. Ranganathan ◽  
Sandra Passek ◽  
Frederick S. Frost ◽  
...  
Keyword(s):  
Daily Activity ◽  
Interrater Reliability ◽  
Physical Therapists ◽  
Short Form ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Occupational Therapists ◽  
Weighted Kappa ◽  
Item Scores ◽  
Mean Differences

BackgroundThe interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) “6-Clicks” basic mobility and daily activity scores, has yet to be established.ObjectiveThe purpose of this study was to examine the interrater reliability of AM-PAC “6-Clicks” measures.DesignA prospective observational study was conducted.MethodsFour pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC “6-Clicks” scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa.ResultsThe ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=−.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero.LimitationsRaters were from one health system. Each pair of raters assessed different patients in different services.ConclusionsThe ICCs for AM-PAC “6-Clicks” total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.

scholarly journals HoNOS–ABI: a reliable outcome measure of neuropsychiatric sequelae to brain injury?

2005 ◽  
Vol 29 (2) ◽  
pp. 53-55 ◽  
Author(s):  
S. Fleminger ◽  
E. Leigh ◽  
P. Eames ◽  
L. Langrell ◽  
R. Nagraj ◽  
...  
Keyword(s):  
Brain Injury ◽  
Interrater Reliability ◽  
Outcome Measure ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Acquired Brain Injury ◽  
Weighted Kappa ◽  
Routine Clinical Practice ◽  
Clinical Implications ◽  
Intraclass Correlation Coefficients

Aims and MethodThe Health of the Nation Outcome Scale for Acquired Brain Injury (HoNOS–ABI) is a relatively new outcome measure designed to assess the neuropsychiatric sequelae of brain damage. This study investigated the interrater reliability of this scale. Fifty patients with traumatic brain injury receiving rehabilitation were each rated twice on the HoNOS–ABI, by two different raters. There were 24 raters in total.ResultsWeighted kappa values ranged from 0.43 to 0.84 and intraclass correlation coefficients from 0.58 to 0.97 for the ten items assessed. This indicated that agreement was moderate to substantial for all items.Clinical ImplicationsThe scales consistently measured the items of interest across different raters. This indicates that HoNOS–ABI is a reliable outcome measure when applied by different raters in routine clinical practice.

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

scholarly journals Development and Relative Validity of a Semiquantitative Food Frequency Questionnaire to Estimate Dietary Intake among a Multi-Ethnic Population in the Malaysian Cohort Project

Nutrients ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 1163
Author(s):  
Suzana Shahar ◽  
Mohd Razif Shahril ◽  
Noraidatulakma Abdullah ◽  
Boekhtiar Borhanuddin ◽  
Mohd Arman Kamaruddin ◽  
...  
Keyword(s):  
Vitamin C ◽  
Correlation Coefficient ◽  
Food Frequency Questionnaire ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Weighted Kappa ◽  
Dietary Intakes ◽  
Food Frequency ◽  
Relative Validity ◽  
Spearman’S Correlation

Measuring dietary intakes in a multi-ethnic and multicultural setting, such as Malaysia, remains a challenge due to its diversity. This study aims to develop and evaluate the relative validity of an interviewer-administered food frequency questionnaire (FFQ) in assessing the habitual dietary exposure of The Malaysian Cohort (TMC) participants. We developed a nutrient database (with 203 items) based on various food consumption tables, and 803 participants were involved in this study. The output of the FFQ was then validated against three-day 24-h dietary recalls (n = 64). We assessed the relative validity and its agreement using various methods, such as Spearman’s correlation, weighed Kappa, intraclass correlation coefficient (ICC), and Bland–Altman analysis. Spearman’s correlation coefficient ranged from 0.24 (vitamin C) to 0.46 (carbohydrate), and almost all nutrients had correlation coefficients above 0.3, except for vitamin C and sodium. Intraclass correlation coefficients ranged from −0.01 (calcium) to 0.59 (carbohydrates), and weighted Kappa exceeded 0.4 for 50% of nutrients. In short, TMC’s FFQ appears to have good relative validity for the assessment of nutrient intake among its participants, as compared to the three-day 24-h dietary recalls. However, estimates for iron, vitamin A, and vitamin C should be interpreted with caution.

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  
Keyword(s):  
Critical Thinking ◽  
Interrater Reliability ◽  
Clinical Chemistry ◽  
Core Competencies ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Thinking Skills ◽  
Project Evaluation ◽  
Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Development of a Model for the Acquisition and Assessment of Advanced Laparoscopic Suturing Skills Using an Automated Device

2018 ◽  
Vol 25 (3) ◽  
pp. 286-290 ◽  
Author(s):  
Elif Bilgic ◽  
Madoka Takao ◽  
Pepa Kaneva ◽  
Satoshi Endo ◽  
Toshitatsu Takao ◽  
...  
Keyword(s):  
Laparoscopic Surgery ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Instructional Video ◽  
Validity Evidence ◽  
Laparoscopic Suturing ◽  
Intraclass Correlation Coefficients ◽  
Operative Assessment ◽  
Suturing Skills

Background. Needs assessment identified a gap regarding laparoscopic suturing skills targeted in simulation. This study collected validity evidence for an advanced laparoscopic suturing task using an Endo StitchTM device. Methods. Experienced (ES) and novice surgeons (NS) performed continuous suturing after watching an instructional video. Scores were based on time and accuracy, and Global Operative Assessment of Laparoscopic Surgery. Data are shown as medians [25th-75th percentiles] (ES vs NS). Interrater reliability was calculated using intraclass correlation coefficients (confidence interval). Results. Seventeen participants were enrolled. Experienced surgeons had significantly greater task (980 [964-999] vs 666 [391-711], P = .0035) and Global Operative Assessment of Laparoscopic Surgery scores (25 [24-25] vs 14 [12-17], P = .0029). Interrater reliability for time and accuracy were 1.0 and 0.9 (0.74-0.96), respectively. All experienced surgeons agreed that the task was relevant to practice. Conclusion. This study provides validity evidence for the task as a measure of laparoscopic suturing skill using an automated suturing device. It could help trainees acquire the skills they need to better prepare for clinical learning.

scholarly journals Psychometric Properties of the MyotonPRO in Dementia Patients with Paratonia

Gerontology ◽  
2017 ◽  
Vol 64 (4) ◽  
pp. 401-412 ◽  
Author(s):  
Hans Drenth ◽  
Sytse U. Zuidema ◽  
Wim P. Krijnen ◽  
Ivan Bautmans ◽  
Cees van der Schans ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Correlation Coefficient ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Mobility ◽  
Future Research ◽  
Minimal Detectable Change ◽  
Muscle Properties ◽  
Dementia Patients ◽  
Longitudinal Outcome

Background: Paratonia is a distinctive form of hypertonia, causing loss of functional mobility in early stages of dementia to severe high muscle tone and pain in the late stages. For assessing and evaluating therapeutic interventions, objective instruments are required. Objective: Determine the psychometric properties of the MyotonPRO, a portable device that objectively measures muscle properties, in dementia patients with paratonia. Methods: Muscle properties were assessed with the MyotonPRO by 2 assessors within one session and repeated by the main researcher after 30 min and again after 6 months. Receiver operating characteristic curves were constructed for all MyotonPRO outcomes to discriminate between participants with (n = 70) and without paratonia (n = 82). In the participants with paratonia, correlation coefficients were established between the MyotonPRO outcomes and the Modified Ashworth Scale for paratonia (MAS-P) and muscle palpation. In participants with paratonia, reliability (intraclass correlation coefficient) and agreement values (standard error of measurement and minimal detectable change) were established. Longitudinal outcome from participants with paratonia throughout the study (n = 48) was used to establish the sensitivity for change (correlation coefficient) and responsiveness (minimal clinical important difference). Results: Included were 152 participants with dementia (mean [standard deviation] age of 83.5 [98.2]). The area under the curve ranged from 0.60 to 0.67 indicating the MyotonPRO is able to differentiate between participants with and without paratonia. The MyotonPRO explained 10-18% of the MAS-P score and 8-14% of the palpation score. Interclass correlation coefficients for interrater reliability ranged from 0.57 to 0.75 and from 0.54 to 0.71 for intrarater. The best agreement values were found for tone, elasticity, and stiffness. The change between baseline and 6 months in the MyotonPRO outcomes explained 8-13% of the change in the MAS-P scores. The minimal clinically important difference values were all smaller than the measurement error. Conclusion: The MyotonPRO is potentially applicable for cross-sectional studies between groups of paratonia patients and appears less suitable to measure intraindividual changes in paratonia. Because of the inherent variability in movement resistance in paratonia, the outcomes from the MyotonPRO should be interpreted with care; therefore, future research should focus on additional guidelines to increase the clinical interpretation and improving reproducibility.

Infant with Clefts Observation Outcomes Instrument (iCOO): A New Outcome for Infants and Young Children with Orofacial Clefts

2021 ◽  
pp. 105566562110403
Author(s):  
Todd C. Edwards ◽  
Carrie L. Heike ◽  
Kathleen A. Kapp-Simon ◽  
Salene M. Jones ◽  
Brian G. Leroux ◽  
...  
Keyword(s):  
Cleft Lip ◽  
Intraclass Correlation ◽  
Primary Caregivers ◽  
Correlation Coefficients ◽  
Measurement Properties ◽  
Cross Sectional ◽  
Scale Scores ◽  
Health Domains ◽  
And Function ◽  
The Impact

Objective We evaluated the measurement properties for item and domain scores of the Infant with Clefts Observation Outcomes Instrument (iCOO). Design Cross-sectional (before lip surgery) and longitudinal study (preoperative baseline and 2 days and 2 months after lip surgery). Setting Three academic craniofacial centers and national online advertisements. Participants Primary caregivers with an infant with cleft lip with or without cleft palate (CL  ±  P) scheduled to undergo primary lip repair. There were 133 primary caregivers at baseline, 115 at 2 days postsurgery, and 112 at 2 months postsurgery. Main Outcome Measure(s) Caregiver observation items ( n = 61) and global impression of health and function items ( n = 8) across eight health domains. Results Mean age at surgery was 6.0 months (range 2.7-11.8 months). Five of eight iCOO domains have scale scores, with Cronbach’s alphas ranging from 0.67 to 0.87. Except for the Facial Skin and Mouth domain, iCOO scales had acceptable intraclass correlation coefficients (ICCs) ranging from 0.76 to 0.84. The internal consistency of the Global Impression items across all domains was 0.90 and had acceptable ICCs (range 0.76-0.91). Sixteen out of 20 (nonscale) items had acceptable ICCs (range 0.66-0.96). As anticipated, iCOO scores 2 days postoperatively were generally lower than baseline and scores 2 months postsurgery were consistent with baseline or higher. The iCOO took approximately 10 min to complete. Conclusions The iCOO meets measurement standards and may be used for assessing the impact of cleft-related treatments in clinical research and care. More research is needed on its use in various treatment contexts.

scholarly journals The 14q32 maternally imprinted locus is a major source of longitudinally stable circulating microRNAs as measured by small RNA sequencing

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Gabriel N. Valbuena ◽  
Sophia Apostolidou ◽  
Rhiannon Roberts ◽  
Julie Barnes ◽  
Wendy Alderton ◽  
...  
Keyword(s):  
Chronic Disease ◽  
Rna Sequencing ◽  
Small Rna ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Critical Factor ◽  
Alternative Methods ◽  
Small Rna Sequencing ◽  
Diagnosis And Prognosis ◽  
The Impact

Abstract Understanding the normal temporal variation of serum molecules is a critical factor for identifying useful candidate biomarkers for the diagnosis and prognosis of chronic disease. Using small RNA sequencing in a longitudinal study of 66 women with no history of cancer, we determined the distribution and dynamics (via intraclass correlation coefficients, ICCs) of the miRNA profile over 3 time points sampled across 2–5 years in the course of the screening trial, UKCTOCS. We were able to define a subset of longitudinally stable miRNAs (ICC >0.75) that were individually discriminating of women who had no cancer over the study period. These miRNAs were dominated by those originating from the C14MC cluster that is subject to maternal imprinting. This assessment was not significantly affected by common confounders such as age, BMI or time to centrifugation nor alternative methods to data normalisation. Our analysis provides important benchmark data supporting the development of miRNA biomarkers for the impact of life-course exposure as well as diagnosis and prognostication of chronic disease.

scholarly journals Reliability of Physiological Responses Induced by Basic Emotions: A Pilot Study

2019 ◽  
Vol 38 (1) ◽  
Author(s):  
Eun-Hye Jang ◽  
Sangwon Byun ◽  
Mi-Sook Park ◽  
Jin-Hun Sohn
Keyword(s):  
Internal Consistency ◽  
Interrater Reliability ◽  
Physiological Responses ◽  
Skin Conductance Level ◽  
Intraclass Correlation ◽  
Repeated Measurements ◽  
Physiological Signals ◽  
Basic Emotions ◽  
Reliability Indices ◽  
Film Clips

Abstract Background Although emotion-specific autonomic responses based on the discrete theory of emotion have been widely studied, studies on the reliability of physiological responses to emotional stimuli are limited. In this study, we aimed to assess the reliability of physiological changes induced by the six basic emotions (happiness, sadness, anger, fear, disgust, and surprise) that were measured during 10 weekly repeated experiments. Methods Twelve college students participated, and in each experiment, physiological signals were collected before and while participants were watching emotion-provoking film clips. Additionally, the participants self-evaluated the emotions that they experienced during the film presentation at the end of each emotional stimulus. To avoid adaptation of participants to identical stimuli during repeated measurements, we used 10 different film clips for each emotion, and thus a total of 60 film clips over 10 weeks were used. Physiological features, such as skin conductance level (SCL), fingertip temperature (FT), heart rate (HR), and blood volume pulse (BVP), were extracted from the physiological signals. Two reliability indices, Cronbach’s alpha and intraclass correlation coefficient, were calculated from the physiological features to assess internal consistency and interrater reliability, respectively. Results We found that SCL, HR, and BVP measured during the emotion-provoking phase over the 10 weekly sessions were more reliable than those assessed at baseline. Furthermore, SCL, HR, and BVP from the emotion-provoking phase exhibited excellent internal consistency and interrater reliability. Conclusions Our findings suggest that these features can be used as reliable physiological indices in emotion studies. The results also support the significance of physiological signals as meaningful indicators for emotion recognition in HCI (human computer interface) area.

Sign in / Sign up

Export Citation Format

Share Document