Inter-Rater Reliability and Validity of the Elderly Mobility Scale in Chronic Stroke Patients

Author(s):  
Chang Sik Park
Author(s):  
Joanne Nolan ◽  
Lucinda Remilton ◽  
Margaret Green

This study aimed to evaluate the psychometric properties of the Elderly Mobility Scale (EMS) in an acute hospital setting. Intra-rater (n=15) and inter-rater (n=18) reliability were investigated using physiotherapists who viewed and scored video-recorded mobility assessments using the EMS on two occasions, one week apart. Latent class analysis of EMS scores showed that neither the occasion of testing (intra-rater reliability) (R2=0.0035, p=0.72), therapist (inter-rater reliability (R2=0.0051, p=1.00), years of experience (R2=0.0058, p=1.00) nor number of EMS assessments previously completed (R2=0.0048, p=1.00) had any impact on the EMS scores. The only factor which impacted on clustering was the EMS score (R2=0.8263, p=0.000). Concurrent validity was assessed by comparison with the Modified Rivermead Mobility Index (MRMI) in patients aged ≥ 55 years (n = 32) and demonstrated that EMS scores were highly correlated with the MRMI (Spearman’s ρ=0.887). Therefore intra-rater reliability of the EMS has been reported for the first time, and inter-rater reliability and concurrent validity of the EMS have been further supported and extended into a younger patient group for mobility assessment in acute hospital patients.


2020 ◽  
Author(s):  
Junliang yuan ◽  
yunxiao wang ◽  
Wenli Hu ◽  
Askiel Bruno

Abstract Background The slightly revised English version simplified modified Rankin scale questionnaire smRSq(2011) was shown to be reliable, valid, and useful in scoring the modified Rankin scale (mRS) after stroke. Our aim was to assess the inter-rater reliability and validity of a novel Chinese version smRSq(2011). Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores by the first rater and the conventional mRS scores by the second rater in each pair was 55%, κ=0.47 (95% CI, 0.40-0.54), and κw=0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores by the first rater with the NIHSS and the BI scores by the second rater were 0.83 (P<0.001) and -0.86 (P<0.001), respectively. Conclusions Our results show good clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.


1981 ◽  
Vol 138 (1) ◽  
pp. 15-16 ◽  
Author(s):  
A. H. W. Smith ◽  
B. R. Ballinger ◽  
A. S. Presly

SummaryThe Clifton Assessment Schedule and the Shortened Stockton Rating Scale were administered to 38 elderly, mentally handicapped patients. Inter-rater reliability was high and the CAS was found to be a useful measure of cognitive ability. The tests measure different features of patients, but both correlated significantly with estimated levels of independence.


1998 ◽  
Vol 27 (2) ◽  
pp. 107-113 ◽  
Author(s):  
CHING-LIN HSIEH ◽  
I-PING HSUEH ◽  
FU-MEI CHIANG ◽  
PO-HSIN LIN

2020 ◽  
Author(s):  
Junliang yuan ◽  
yunxiao wang ◽  
Wenli Hu ◽  
Askiel Bruno

Abstract Background The modified Rankin Scale (mRS) is a key global outcome measure after stroke internationally. The latest English version of the simplified modified Rankin scale questionnaire (smRSq)(2011) is a reliable and valid tool in scoring the mRS after stroke. In order to use this tool in Chinese patients, we translated it into Chinese and tested its clinimetric properties. Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores and the conventional mRS scores was 55%, κ=0.47 (95% CI, 0.40-0.54), and κw=0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores with the NIHSS and the BI scores were 0.83 (P<0.001) and -0.86 (P<0.001), respectively. Conclusions Our results show good to excellent clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.


Stroke ◽  
2012 ◽  
Vol 43 (suppl_1) ◽  
Author(s):  
Jeanette Stebelton ◽  
Diane Savolainen ◽  
Margo Carli ◽  
Roxanne Filizetti ◽  
Barb Massey

Background Dysphagia occurs in approximately 55% of acute stroke patients and is associated with aspiration pneumonia. Clinical practice guidelines recommend that all patients who are admitted with the diagnosis of stroke or suspected stroke should be screened for dysphagia utilizing a validated screening tool prior to receiving any food, fluid, or medication by mouth. Purpose The purpose of the study is to determine the reliability and validity of the Marquette General Health Systems Dysphagia Screen for identifying patients at risk for aspiration. Method This non-randomized study utilized a collaborative tracking tool that compared results of the Nursing Dysphagia Screen (NDS) to the Speech Language Pathologist Swallow Evaluation (SLPSE). Two Registered Nurses rated each patient utilizing the NDS and then the patient was rated on the SLPSE. The NDS includes10 items: and the Speech Language Pathologist portion of the tool consisted of 8 items. Results One hundred subjects ranged in age from 20-94 (M=70.31, SD=14.6). There were more males (n=58) than females (n=42). The majority were admitted to the medical unit (64%), followed by cardiac (14%), ICU (12%) and CCU (10%). Length of stay ranged from 1-15 days (M=3.73, SD=2.8). NIH scores ranged from 0-20 (M=6.8, SD=7.4). Kappa was calculated to determine inter-rater reliability. For 63 pairs of ratings between two staff nurses, Kappa=.81 indicates strong reliability. Scores on the Nursing Dysphagia Screen were compared to 86 Speech Language Pathologist Swallow Evaluations. The Phi Coefficient was not significant indicating that the nurses’ and speech therapists ratings’ were similar. In addition, when there were differences it was false positives by nurses. Conclusion The MGHS NDS is a quick screening tool used by nursing in an effort to prevent aspiration. Prior to implementing the use of the tool, it was important to establish the reliability and validity of the tool. Results indicate that there is strong inter-rater reliability. Validity was established given that there were no significant difference in ratings between the nurses and speech therapists. It appears that the MGHS NDS is an effective early screening tool for dysphagia.


2020 ◽  
Author(s):  
Junliang yuan ◽  
yunxiao wang ◽  
Wenli Hu ◽  
Askiel Bruno

Abstract Background The modified Rankin Scale (mRS) is a key global outcome measure after stroke internationally. The latest English version of the simplified modified Rankin scale questionnaire (smRSq)(2011) is a reliable and valid tool in scoring the mRS after stroke. In order to use this tool in Chinese patients, we translated it into Chinese and tested its clinimetric properties. Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa ( κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa ( κ w ) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores and the conventional mRS scores was 55%, κ =0.47 (95% CI, 0.40-0.54), and κ w =0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores with the NIHSS and the BI scores were 0.83 ( P <0.001) and -0.86 ( P <0.001), respectively. Conclusions Our results show good to excellent clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.


2019 ◽  
Author(s):  
Junliang yuan ◽  
yunxiao wang ◽  
Wenli Hu ◽  
Askiel Bruno

Abstract Background: The slightly optimized English version simplified modified Rankin scale questionnaire smRSq(2011) was shown to be reliable, valid, and useful in scoring the modified Rankin scale (mRS) after stroke. Our aim was to assess the inter-rater reliability and validity of a novel Chinese version smRSq(2011). Methods: The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results: Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the conventional mRS and the smRSq(2011) was 63%, κ=0.57 (95% CI, 0.50-0.63) and κw=0.93 (95% CI, 0.91-0.95). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) to the NIHSS and the BI were 0.83 (P<0.001) and 0.86 (P<0.001), respectively. Conclusions: Our results suggest usefulness of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.


Sign in / Sign up

Export Citation Format

Share Document