Inter-rater reliability and validity of the Action Research arm test in stroke patients

Abstract Background The slightly revised English version simplified modified Rankin scale questionnaire smRSq(2011) was shown to be reliable, valid, and useful in scoring the modified Rankin scale (mRS) after stroke. Our aim was to assess the inter-rater reliability and validity of a novel Chinese version smRSq(2011). Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores by the first rater and the conventional mRS scores by the second rater in each pair was 55%, κ=0.47 (95% CI, 0.40-0.54), and κw=0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores by the first rater with the NIHSS and the BI scores by the second rater were 0.83 (P<0.001) and -0.86 (P<0.001), respectively. Conclusions Our results show good clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.

Download Full-text

The reliability and validity of a novel Chinese version simplified modified Rankin scale questionnaire(2011)

10.21203/rs.2.13565/v4 ◽

2020 ◽

Author(s):

Junliang yuan ◽

yunxiao wang ◽

Wenli Hu ◽

Askiel Bruno

Keyword(s):

Ischemic Stroke ◽

Reliability And Validity ◽

Chinese Version ◽

Chinese Patients ◽

The Novel ◽

Modified Rankin Scale ◽

English Version ◽

Stroke Patients ◽

Rater Reliability ◽

Percent Agreement

Abstract Background The modified Rankin Scale (mRS) is a key global outcome measure after stroke internationally. The latest English version of the simplified modified Rankin scale questionnaire (smRSq)(2011) is a reliable and valid tool in scoring the mRS after stroke. In order to use this tool in Chinese patients, we translated it into Chinese and tested its clinimetric properties. Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores and the conventional mRS scores was 55%, κ=0.47 (95% CI, 0.40-0.54), and κw=0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores with the NIHSS and the BI scores were 0.83 (P<0.001) and -0.86 (P<0.001), respectively. Conclusions Our results show good to excellent clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.

Download Full-text

Abstract 2284: Reliability and Validity of the MGHS Dysphagia Screening Tool for Stroke Patients

Stroke ◽

10.1161/str.43.suppl_1.a2284 ◽

2012 ◽

Vol 43 (suppl_1) ◽

Author(s):

Jeanette Stebelton ◽

Diane Savolainen ◽

Margo Carli ◽

Roxanne Filizetti ◽

Barb Massey

Keyword(s):

Screening Tool ◽

Randomized Study ◽

Reliability And Validity ◽

Stroke Patients ◽

Early Screening ◽

Rater Reliability ◽

Speech Language Pathologist ◽

Significant Difference ◽

Patients At Risk ◽

Speech Therapists

Background Dysphagia occurs in approximately 55% of acute stroke patients and is associated with aspiration pneumonia. Clinical practice guidelines recommend that all patients who are admitted with the diagnosis of stroke or suspected stroke should be screened for dysphagia utilizing a validated screening tool prior to receiving any food, fluid, or medication by mouth. Purpose The purpose of the study is to determine the reliability and validity of the Marquette General Health Systems Dysphagia Screen for identifying patients at risk for aspiration. Method This non-randomized study utilized a collaborative tracking tool that compared results of the Nursing Dysphagia Screen (NDS) to the Speech Language Pathologist Swallow Evaluation (SLPSE). Two Registered Nurses rated each patient utilizing the NDS and then the patient was rated on the SLPSE. The NDS includes10 items: and the Speech Language Pathologist portion of the tool consisted of 8 items. Results One hundred subjects ranged in age from 20-94 (M=70.31, SD=14.6). There were more males (n=58) than females (n=42). The majority were admitted to the medical unit (64%), followed by cardiac (14%), ICU (12%) and CCU (10%). Length of stay ranged from 1-15 days (M=3.73, SD=2.8). NIH scores ranged from 0-20 (M=6.8, SD=7.4). Kappa was calculated to determine inter-rater reliability. For 63 pairs of ratings between two staff nurses, Kappa=.81 indicates strong reliability. Scores on the Nursing Dysphagia Screen were compared to 86 Speech Language Pathologist Swallow Evaluations. The Phi Coefficient was not significant indicating that the nurses’ and speech therapists ratings’ were similar. In addition, when there were differences it was false positives by nurses. Conclusion The MGHS NDS is a quick screening tool used by nursing in an effort to prevent aspiration. Prior to implementing the use of the tool, it was important to establish the reliability and validity of the tool. Results indicate that there is strong inter-rater reliability. Validity was established given that there were no significant difference in ratings between the nurses and speech therapists. It appears that the MGHS NDS is an effective early screening tool for dysphagia.

Download Full-text

The reliability and validity of a novel Chinese version simplified modified Rankin scale questionnaire(2011)

10.21203/rs.2.13565/v5 ◽

2020 ◽

Author(s):

Junliang yuan ◽

yunxiao wang ◽

Wenli Hu ◽

Askiel Bruno

Keyword(s):

Ischemic Stroke ◽

Reliability And Validity ◽

Chinese Version ◽

Chinese Patients ◽

The Novel ◽

Modified Rankin Scale ◽

English Version ◽

Stroke Patients ◽

Rater Reliability ◽

Percent Agreement

Abstract Background The modified Rankin Scale (mRS) is a key global outcome measure after stroke internationally. The latest English version of the simplified modified Rankin scale questionnaire (smRSq)(2011) is a reliable and valid tool in scoring the mRS after stroke. In order to use this tool in Chinese patients, we translated it into Chinese and tested its clinimetric properties. Methods The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa ( κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa ( κ w ) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores and the conventional mRS scores was 55%, κ =0.47 (95% CI, 0.40-0.54), and κ w =0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores with the NIHSS and the BI scores were 0.83 ( P <0.001) and -0.86 ( P <0.001), respectively. Conclusions Our results show good to excellent clinimetric properties of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.

Download Full-text

The reliability and validity of a slightly optimized Chinese version simplified modified Rankin scale questionnaire

10.21203/rs.2.13565/v1 ◽

2019 ◽

Author(s):

Junliang yuan ◽

yunxiao wang ◽

Wenli Hu ◽

Askiel Bruno

Keyword(s):

Ischemic Stroke ◽

Reliability And Validity ◽

Weighted Kappa ◽

Chinese Version ◽

The Novel ◽

Modified Rankin Scale ◽

English Version ◽

Stroke Patients ◽

Rater Reliability ◽

Percent Agreement

Abstract Background: The slightly optimized English version simplified modified Rankin scale questionnaire smRSq(2011) was shown to be reliable, valid, and useful in scoring the modified Rankin scale (mRS) after stroke. Our aim was to assess the inter-rater reliability and validity of a novel Chinese version smRSq(2011). Methods: The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results: Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the conventional mRS and the smRSq(2011) was 63%, κ=0.57 (95% CI, 0.50-0.63) and κw=0.93 (95% CI, 0.91-0.95). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) to the NIHSS and the BI were 0.83 (P<0.001) and 0.86 (P<0.001), respectively. Conclusions: Our results suggest usefulness of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.

Download Full-text

The reliability and validity of a slightly revised Chinese version simplified modified Rankin scale questionnaire

10.21203/rs.2.13565/v2 ◽

2019 ◽

Author(s):

Junliang yuan ◽

yunxiao wang ◽

Wenli Hu ◽

Askiel Bruno

Keyword(s):

Ischemic Stroke ◽

Reliability And Validity ◽

Weighted Kappa ◽

Chinese Version ◽

The Novel ◽

Modified Rankin Scale ◽

English Version ◽

Stroke Patients ◽

Rater Reliability ◽

Percent Agreement

Abstract Background: The slightly revised English version simplified modified Rankin scale questionnaire smRSq(2011) was shown to be reliable, valid, and useful in scoring the modified Rankin scale (mRS) after stroke. Our aim was to assess the inter-rater reliability and validity of a novel Chinese version smRSq(2011). Methods: The English version smRSq(2011) was translated into Chinese by a standard process. We recruited 300 consecutive hospitalized ischemic stroke patients in the department of neurology, Beijing Chaoyang Hospital. Six randomly paired raters scored the conventional mRS, the novel Chinese version smRSq(2011), the National Institutes of Health Stroke Scale (NIHSS), and the Barthel index (BI) in-person. Inter-rater reliability and validity were assessed. Results: Among the 300 ischemic stroke patients, mean age was 64.9±12.1 years, and 220 (73%) were male. For inter-rater reliability of the smRSq(2011), the percent agreement among the paired raters was 87%, the kappa (κ) was 0.84 (95% CI, 0.79-0.88), and the weighted kappa (κw) was 0.96 (95% CI, 0.95-0.98). The percent agreement between the smRSq(2011) scores by the first rater and the conventional mRS scores by the second rater in each pair was 55%, κ=0.47 (95% CI, 0.40-0.54), and κw=0.91 (95% CI, 0.89-0.93). In construct validity testing, the Spearman’s correlation coefficients comparing the smRSq(2011) scores by the first rater with the NIHSS and the BI scores by the second rater were 0.83 (P<0.001) and -0.86 (P<0.001), respectively. Conclusions: Our results suggest usefulness of the novel Chinese version smRSq(2011) in scoring the mRS in Chinese stroke patients. Further validation in other clinical settings, including in communities and by remote methods in China is warranted.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Inter-rater Reliability and Validity of the Arabic Version of Categories of Auditory Performance-II (CAP-II) Among Children With Cochlear Implant

Otology & Neurotology ◽

10.1097/mao.0000000000002593 ◽

2020 ◽

Vol 41 (5) ◽

pp. e597-e602

Author(s):

Yazeed Al-shawi ◽

Tamer A. Mesallam ◽

Rayan Alfallaj ◽

Turki Aldrees ◽

Nouf Albakheet ◽

...

Keyword(s):

Cochlear Implant ◽

Reliability And Validity ◽

Arabic Version ◽

Rater Reliability ◽

Auditory Performance

Download Full-text