Remote evaluation of upper extremity motor function following stroke: The Arm Capacity and Movement Test (ArmCAM) (Preprint)

Special Equipment ◽

Good Reliability ◽

Rater Reliability ◽

Movement Test

BACKGROUND Developing a simple measure that can be administered remotely via videoconferencing is needed for telerehabilitation for rural and remote population, or during the COVID-19 pandemic. OBJECTIVE To develop a valid and reliable measure [the Arm Capacity and Movement Test (ArmCAM)] administered remotely via videoconferencing to evaluate upper extremity motor function after stroke. METHODS A sample of individuals with stroke (N=31) was used to assess the reliability and validity of the ArmCAM (range: 0-30). Test-retest and inter-rater reliability were assessed through the intraclass correlation coefficients (ICC), standard error of measurement (SEM) and minimal detectable change (MDC). Validity was examined by the Pearson and Spearman rank correlation coefficients. RESULTS The ArmCAM consists of 10 items and takes 15 minutes to administer without any special equipment except for a computer and internet access. The ICC for test-retest reliability and inter-rater reliability were 0.997 and 0.993, respectively. The SEM and MDC95 were 0.74 and 2.05 points, respectively. With respect to validity, correlations between the ArmCAM and the Rating of Everyday Arm-use in the Community and Home Scale, Stroke Impact Scale-Hand, Fugl-Meyer Assessment for upper extremity, and Action Research Arm Test were good to excellent (correlation coefficients: 0.811-0.944). CONCLUSIONS he ArmCAM has good reliability and validity. It is an easy-to-use assessment that is designed to be administered remotely via video conferencing. CLINICALTRIAL NA (This is not a clinical trial)

The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity in dementia

International Psychogeriatrics ◽

10.1017/s1041610213000811 ◽

2013 ◽

Vol 25 (9) ◽

pp. 1503-1511 ◽

Cited By ~ 16

Author(s):

Florindo Stella ◽

Orestes Vicente Forlenza ◽

Jerson Laks ◽

Larissa Pires de Andrade ◽

Michelle A. Ljubetic Avendaño ◽

...

Keyword(s):

Concurrent Validity ◽

Convergent Validity ◽

Rating Scale ◽

Neuropsychiatric Symptoms ◽

Intraclass Correlation ◽

Neuropsychiatric Inventory ◽

Rater Reliability ◽

Clinician Rating

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.

Validation of the pediatric Radboud dysarthria assessment

Journal of Pediatric Rehabilitation Medicine ◽

10.3233/prm-190671 ◽

2021 ◽

pp. 1-12

Author(s):

Marieke Ruessink ◽

Lenie van den Engel-Hoek ◽

Marjo van Gerven ◽

Bea Spek ◽

Bert de Swart ◽

...

Keyword(s):

Correlation Coefficient ◽

Intraclass Correlation ◽

Self Care ◽

Activity Level ◽

Clinical Use ◽

Spearman Correlation ◽

Rater Reliability ◽

Video Recordings

PURPOSE: The Radboud Dysarthria Assessment (RDA) was published in 2014. Adaptation into a pediatric version (p-RDA) was required because of relevant differences between children and adults. The purpose of this study was to assess the feasibility of the p-RDA and to test intra-rater and inter-rater reliability as well as the validity of the two severity scales (function and activity level). METHODS: Video recordings were made of 35 participants with (suspected) dysarthria (age 4 to 17 years) while being assessed using the p-RDA. Intra-rater reliability was assessed by one, and inter-rater reliability by two experiments using the Intraclass Correlation Coefficient (ICC). Validity of the severity scales was tested by correlating the consensus scores with the independently rated scores on four communication scales, three mobility scales, and one self-care scale using Spearman correlation coefficients (r s). RESULTS: The assessment was applicable for 89% of the tested sample, with good intra-rater and inter-rater reliability (ICC = 0.88–0.98 and 0.83–0.93). The p-RDA severity scales (function and activity level) correlated from substantially to strongly with the communication scales (r s = 0.69–0.82 and 0.77–0.92) and self-care scale (r s = 0.76–0.71) and correlated substantially with the mobility scales (r s = 0.49–0.60). CONCLUSION: The feasibility, reliability and validity of the p-RDA are sufficient for clinical use.

Assessment of Physical Activity in Adults: A Review of Validated Questionnaires From a Nutritionist’s Point of View

Evaluation & the Health Professions ◽

10.1177/0163278720928500 ◽

2020 ◽

Vol 43 (4) ◽

pp. 235-254

Author(s):

Angela Patricia Bacelis-Rivero ◽

Anabel Vázquez-Rodríguez ◽

Claudia E. Carrasco-Legleu ◽

Lidia G. De León ◽

Sandra Alicia Reza-López

Keyword(s):

Physical Activity ◽

Energy Expenditure ◽

Intraclass Correlation ◽

Intraclass Correlation Coefficients

Epidemiological Studies ◽

Point Of View ◽

Eligibility Criteria ◽

Good Reliability ◽

Physical activity (PA) is a component of total energy expenditure. PA and PA energy expenditure (PAEE) can be estimated by objective techniques (OTs). However, the use of questionnaires is frequent in clinical settings and epidemiological studies. We conducted a search on PubMed, Scopus, and Google Scholar databases to perform a review of studies reporting the reliability and validity of PA questionnaires validated against OTs—doubly labeled water (DLW) or accelerometers—in free-living adults. We selected original articles published between 2009 and 2019 that reported validation studies of PA questionnaires. We identified 53 studies that fulfilled the eligibility criteria. Four PA questionnaires were validated against DLW and the remaining against accelerometers. Three questionnaires were compared with both DLW and accelerometer results. The correlation between questionnaire-estimated PAEE and DLW results ranged from r = .22 to r = .46, while that between questionnaire-estimated total PA (TPA) and accelerometer results ranged from r = .11 to r = .54 The intraclass correlation coefficients were between .56 and .84. Despite having good reliability, most of the questionnaires included in this review have shown limited validity for estimating TPA in adults. OTs should be considered as a first option, when possible. Further research is warranted on techniques to obtain more accurate PA and PAEE estimates.

Reliability and validity of the iSense optical scanner for measuring volume of transtibial residual limb models

Prosthetics and Orthotics International ◽

10.1177/0309364618806038 ◽

2018 ◽

Vol 43 (2) ◽

pp. 213-220 ◽

Author(s):

Lucy Armitage ◽

Li Khim Kwah ◽

Lauren Kark

Keyword(s):

Intraclass Correlation ◽

Criterion Validity ◽

Residual Limb ◽

Limb Volume ◽

Rater Reliability ◽

Measuring Volume ◽

Intraclass Correlation Coefficients ◽

Optical Scanner

Background: Residual limb volume is often measured as part of routine care for people with amputations. These measurements assist in the timing of prosthetic fitting or replacement. In order to make well informed decisions, clinicians need access to measurement tools that are valid and reliable. Objectives: To assess the reliability and criterion validity of the iSense optical scanner in measuring volume of transtibial residual limb models. Study Design: Three assessors performed two measurements each on 13 residual limb models with an iSense optical scanner (3D systems, USA). Intra-rater and inter-rater reliability were calculated using intraclass correlation coefficients. Bland Altman plots were inspected for agreement. Criterion validity was assessed using a steel rod of known dimensions. Ten repeated measurements were performed by one assessor. A t-test was used to determine differences between measured and true rod volume. Results: Intra-rater reliability was excellent (range of intraclass correlation coefficients: 0.991–0.997, all with narrow 95% confidence intervals). While the intraclass correlation coefficients suggest excellent inter-rater reliability between all three assessors (range of intraclass correlation coefficients: 0.952–0.986), the 95% confidence intervals were wide between assessor 3 and the other two assessors. Poor agreement with assessor 3 was also seen in the Bland-Altman plots. Criterion validity was very poor with a significant difference between the mean iSense measurement and the true rod volume (difference: 221.18 mL; p < 0.001). Conclusions: Although intra-rater reliability was excellent for the iSense scanner, we did not find similar results for inter-rater reliability and validity. These results suggest that further testing of the iSense scanner is required prior to use in clinical practice. Clinical relevance The iSense offers a low cost scanning option for residual limb volume measurement. Intra-rater reliability was excellent, but inter-rater reliability and validity were such that clinical adoption is not indicated at present.

Depth Sensor–Based Assessment of Reachable Work Space for Visualizing and Quantifying Paretic Upper Extremity Motor Function in People With Stroke

Physical Therapy ◽

10.1093/ptj/pzaa025 ◽

2020 ◽

Vol 100 (5) ◽

pp. 870-879 ◽

Author(s):

Kohei Okuyama ◽

Michiyuki Kawakami ◽

Shohei Tsuchimoto ◽

Miho Ogura ◽

Kohsuke Okada ◽

...

Keyword(s):

Upper Extremity ◽

Motor Function ◽

Repeated Measures ◽

Intraclass Correlation ◽

Motor Score ◽

Depth Sensor ◽

Intensive Training ◽

Work Space ◽

Hemiparetic Stroke

Abstract Background Quantitative evaluation of upper extremity (UE) motor function is important in people with hemiparetic stroke. A depth sensor–based assessment of reachable work space (RWS) was applied to visualize and quantify paretic UE motor function. Objective The objectives of this study were to examine the characteristics of RWS and to assess its validity, reliability, measurement error, and responsiveness in people with hemiparetic stroke. Design This was a descriptive, repeated-measures, observational study. Methods Fifty-eight people with stroke participated. RWS was assessed on both paretic and nonparetic UEs, and the RWS ratio was determined by dividing the RWS of the paretic UE by that of the nonparetic UE. The concurrent validity of the RWS was determined by examining the relationship with the Fugl-Meyer Assessment UE motor score. Test-retest reproducibility was examined in 40 participants. Responsiveness was determined by examining the RWS results before and after 3 weeks of intensive training of the paretic UE in 32 participants. Results The lower area of RWS bordering shoulder was significantly larger than the upper area, and the medial-lower area of RWS bordering shoulder was significantly larger than the lateral-lower area. The RWS ratio was highly correlated with the Fugl-Meyer Assessment UE motor score (r = 0.81). The RWS ratio showed good intrarater relative reliability (intraclass correlation coefficient = 0.94) and no fixed or proportional bias. The minimal detectable change of the RWS ratio was 16.6. The responsiveness of the RWS ratio was large (standardized response mean = 0.83). Limitations Interexaminer reliability was not assessed. Conclusions The RWS assessment showed sufficient validity, reliability, and responsiveness in people with hemiparetic stroke. A depth sensor–based RWS evaluation is useful for visualizing and quantifying paretic UE motor function in the clinical setting.

The Self-Assessment Corner for Shoulder Strength: Reliability, Validity, and Correlations With Upper Extremity Physical Performance Tests

Journal of Athletic Training ◽

10.4085/1062-6050-471-18 ◽

2020 ◽

Vol 55 (4) ◽

pp. 350-358 ◽

Author(s):

Philippe Decleve ◽

Joachim Van Cant ◽

Ellen De Buck ◽

Justine Van Doren ◽

Julie Verkouille ◽

...

Keyword(s):

Upper Extremity ◽

Correlation Coefficient ◽

Physical Performance ◽

Intraclass Correlation ◽

Performance Tests ◽

Self Assessment ◽

Rotational Strength ◽

Shoulder Strength

Context Rotator cuff weakness and rotation ratio imbalances are possible risk factors for shoulder injury among overhead athletes. In consensus statements, organizations have highlighted the importance of a screening examination to identify athletes at risk of injury. The screening should be portable and designed to be feasible in many different environments and contexts. Objective To evaluate the reliability and validity of the Self-Assessment Corner (SAC) for self-assessing shoulder isometric rotational strength and examining whether performance on 2 physical performance tests was correlated with isometric shoulder rotational strength using the SAC in handball players. Design Cross-sectional study. Setting Sport setting. Patients or Other Participants A first sample of 42 participants (18 men, 24 women) was recruited to determine the reliability and validity of the SAC. In a second sample of 34 handball players (18 men, 16 women), we examined correlations between physical performance tests and the SAC. Main Outcome Measure(s) The SAC was used to measure isometric rotational strength with the upper extremity at 90° of abduction in the frontal plane and 90° of external rotation and the elbow flexed to 90° with neutral rotation of the forearm. The SAC findings were compared with those from manual testing. Results from the seated medicine ball throw (SMBT) and closed kinetic chain upper extremity stability test (CKCUEST) were used to establish relationships with the SAC. We calculated intraclass correlation coefficients to determine relative reliability and used standard error of measurement and minimal detectable change to quantify absolute reliability. Relationships among the different strength-testing procedures and with the physical performance tests were determined using the Pearson product moment correlation coefficient (r) or Spearman rank correlation coefficient (rs). Results We observed good to excellent reliability (intraclass correlation coefficient [2,k] range = 0.89 to 0.92). The standard error of measurement varied from 3.45 to 3.48 N. The minimal detectable change with 95% confidence intervals ranged from 8.06 to 8.13 N. Strong correlations were present among strength procedures (r = 0.824, rs range = 0.754–0.816). We observed moderate to strong correlations between the CKCUEST findings and rotational strength (r range = 0.570–0.767). Moderate correlations were found between rotational strength and SMBT (r range = 0.573–0.626). Conclusions The SAC is a clinically applicable and standardized protocol for self-assessing rotational strength in young healthy adults without pathologic conditions. Performance on the SMBT and CKCUEST may be valuable as a screening tool to further assess shoulder strength.

Reliability and Validity of Three Instruments for Measuring Implant Stability Quotient

10.20944/preprints202007.0457.v1 ◽

2020 ◽

Author(s):

Monica Blazquez-Hinarejos ◽

Constanza Saka-Herrán ◽

Victor Diez-Alonso ◽

Jose Lopez-Lopez ◽

Raúl Ayuso‐Montero ◽

...

Keyword(s):

Correlation Coefficient ◽

Pearson Correlation ◽

Intraclass Correlation ◽

The Other ◽

Resonance Frequency Analysis ◽

Implant Stability ◽

Good Reliability ◽

Rater Reliability ◽

Implant Stability Quotient

Background: Actually, resonance frequency analysis (RFA) is the most extended method for measuring implant stability. The implant stability quotient (ISQ) is the measure obtained by the different RFA devices, however, inter- and intra- rater reliability and validity of some devices remains unknown. Methods: Thirty implants were placed in 3 different pig mandibles. ISQ was measured axial and parallel with Osstell® Beacon, Penguin® and MegaISQ® by 2 different operators and one operator performed a test-retest. Intraclass correlation coefficient was calculated to assess the intra- and inter-rater reliability. Pearson correlation coefficient was used to assess the validity. Results: The higher inter- and intra- rater reliability was obtained by Penguin® when measuring axial. The highest ISQ values were obtained using Penguin® in an axial measurement; the lowest, using the MegaISQ® in an axial measurement. The highest correlation values with the other devices were obtained by MegaISQ® measuring axially. Conclusion: Penguin® had a good reliability for measuring ISQ both inter- and intra- rater. Osstell® had good validity for measuring ISQ both axial and parallel and MegaISQ® had the best validity for measuring ISQ axial.

Reliability of Thoracic Spine Rotation Range-of-Motion Measurements in Healthy Adults

Journal of Athletic Training ◽

10.4085/1062-6050-47.1.52 ◽

2012 ◽

Vol 47 (1) ◽

pp. 52-60 ◽

Cited By ~ 36

Author(s):

Katherine D. Johnson ◽

Kyung-Min Kim ◽

Byung-Kyu Yu ◽

Susan A. Saliba ◽

Terry L. Grindstaff

Keyword(s):

Range Of Motion ◽

Thoracic Spine ◽

Measurement Techniques ◽

Intraclass Correlation ◽

Good Reliability ◽

Intraclass Correlation Coefficients ◽

Reliability Estimates ◽

Standard Error Of Measurement

Context:The reliability of clinical techniques to quantify thoracic spine rotation range of motion (ROM) has not been evaluated.Objective:To determine the intratester and intertester reliability of 5 thoracic rotation measurement techniques.Design:Descriptive laboratory study.Setting:University research laboratory.Patients or Other Participants:Forty-six healthy volunteers (age = 23.6±4.3 years, height = 171.0±9.6 cm, mass = 71.4 ±16.7 kg).Main Outcome Measure(s):We tested 5 thoracic rotation ROM techniques over 2 days: seated rotation (bar in back and front), half-kneeling rotation (bar in back and front), and lumbar-locked rotation. On day 1, 2 examiners obtained 2 sets of measurements (sessions 1, 2) to determine the within-session intertester reliability and within-day intratester reliability. A single examiner obtained measurements on day 2 (session 3) to determine the intratester reliability between days. Each technique was performed 3 times per side, and averages were used for data analysis. Reliability was determined using intraclass correlation coefficients, standard error of measurement (SEM), and minimal detectable change (MDC). Differences between raters during session 1 were determined using paired t tests.Results:Within-session intertester reliability estimates ranged from 0.85 to 0.94. Ranges for the SEM were 1.0° to 2.3° and for the MDC were 2.8° to 6.3°. No differences were seen between examiners during session 1 for seated rotation (bar in front, both sides), half-kneeling rotation (bar in front, left side), or the lumbar locked position (both sides) (all values of P > .05). Within-day intratester reliability estimates ranged from 0.86 to 0.95. Ranges for the SEM were 0.8° to 2.1° and for the MDC were 2.1 ° to 5. 9°. Between-days intratester reliability estimates ranged from 0.84 to 0.91. Ranges for the SEM were 1.4° to 2.0° and for the MDC were 3.9° to 5.6°.Conclusions:All techniques had good reliability and low levels of measurement error. The seated rotation, bar in front, and lumbar-locked rotation tests may be used reliably when more than 1 examiner is obtaining measurements.

The reliability of the graded Wolf Motor Function Test for stroke

British Journal of Occupational Therapy ◽

10.1177/0308022620902697 ◽

2020 ◽

Vol 83 (9) ◽

pp. 585-594 ◽

Author(s):

Beverley Turtle ◽

Alison Porter-Armstrong ◽

May Stinson

Keyword(s):

Motor Function ◽

Intraclass Correlation ◽

Video Recording ◽

Rater Reliability ◽

Intraclass Correlation Coefficients ◽

Upper Limb Function ◽

Item Level ◽

Function Test ◽

Wolf Motor Function Test

Introduction The graded Wolf Motor Function Test assesses upper limb function following stroke. Clinical utility is limited by the requirement to video record for scoring purposes. This study aimed to (a) assess whether video recording is required through examination of inter-rater reliability and agreement; and (b) assess intra-rater reliability and agreement. Method A convenience sample of 30 individuals were recruited following stroke. The graded Wolf Motor Function Test was administered within 2 weeks of rehabilitation commencement and at 3 months. Two occupational therapists scored participants through either direct observation or video. Inter- and intra-rater reliability and agreement were examined for item-level and summary scores. Results Excellent inter-rater reliability ( n = 28) was found between scoring through direct observation and by video (intraclass correlation coefficients >0.9), and excellent intra-rater reliability ( n = 21) was found (intraclass correlation coefficients >0.9) for item-level and summary scores. Low agreement was found between raters at the item level. Adequate agreement was found for total functional ability, with increased measurement error found for total performance time. Conclusion The graded Wolf Motor Function Test is a reliable measure of upper limb function. Video recording may not be required by therapists. In view of low agreement, future studies should assess the impact of standardised training.

Cross-cultural translation and validation of the Chinese Oxford Knee Score and the Activity and Participation Questionnaire

Journal of Orthopaedic Surgery ◽

10.1177/2309499020910668 ◽

2020 ◽

Vol 28 (2) ◽

pp. 230949902091066

Author(s):

Cheng Chen ◽

Weijun Wang ◽

Hao Wu ◽

Anqi Gao ◽

Yong Qiu ◽

...

Keyword(s):

Knee Replacement ◽

Short Form ◽

Intraclass Correlation ◽

Oxford Knee Score ◽

Knee Score ◽

Good Reliability ◽

Sf 36 ◽

Patient Reported

Objective: To cross-culturally translate and validate the Chinese versions of the Oxford Knee Score (OKS) and the Activity and Participation Questionnaire (APQ) in patients with end-stage knee osteoarthritis who are also candidates for knee replacement. Methods: The Chinese version of the OKS and APQ was completed by standard forward–backward translation and adaption. The feasibility was validated by a pretest in 30 patients. The final version together with the Short Form-36 (SF-36), EQ-5D, and EQ visual analog scale were assessed in 150 patients, and the OKS and APQ were repeated in 30 patients after a 2-week interval. The psychometric properties of the OKS and APQ were evaluated for test–retest reliability using intraclass correlation coefficients (ICCs), internal consistency using Cronbach’s α, and construct validity using Spearman’s correlation analysis. Results: All patients were able to understand and complete both the OKS and APQ without difficulty (i.e. no missing data). The ICCs were 0.959 for the OKS, 0.956 for the APQ for total scores, and >0.7 for each item. Cronbach’s α was greater than 0.7, and the corrected item-total correlation was greater than 0.4 for each item of both questionnaires. The OKS and APQ showed better correlations with questions from the pain and function domains than with those from the mental status domains of the SF-36 and EQ-5D. No floor or ceiling effect was identified in either questionnaire. Conclusions: The Chinese versions of the OKS and APQ are easy to understand and complete and showed good reliability and validity. They can be used to assess patient-reported outcomes after undergoing knee replacement in mainland China.