The Reliability of the Occupational Therapy Adult Perceptual Screening Test (OT-APST)

2005 ◽  
Vol 68 (11) ◽  
pp. 509-517 ◽  
Author(s):  
Deirdre M Cooke ◽  
Kryss McKenna ◽  
Jennifer Fleming ◽  
Ross Darnell
Keyword(s):  
Occupational Therapy ◽  
Screening Test ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Occupational Therapists ◽  
Intrarater Reliability ◽  
Reliability Study ◽  
Retest Reliability ◽  
One Year ◽  
Test Retest Reliability

The Occupational Therapy Adult Perceptual Screening Test (OT-APST) is designed to screen for impairments in visual perception and apraxia in adults following stroke. The OT-APST is a comprehensive battery that contains 25 items in the following seven subscale areas: agnosia (5 items); visuospatial relations covering elements of body scheme (4 items) and unilateral neglect (5 items); constructional skills (3 items); apraxia (6 items); acalculia (1 item); and functional skills (5 items). Several OT-APST items contribute to more than one subscale, hence there is a difference in the number of items in each subscale and the overall number of items. This study reports three aspects of the reliability of the OT-APST: interrater, intrarater and test-retest reliability. The participants in the interrater and intrarater reliability study were 15 people following stroke. Videotaped OT-APST performance was scored by nine occupational therapists and the results compared with the scores of the first author as the gold-standard rater. The participants in the test-retest reliability study were 10 people who were neurologically stable one year after stroke and were assessed 2 weeks apart on the OT-APST. The results obtained for each of the 25 OT-APST items included intraclass correlation coefficients (Type 3,1) for interrater reliability ranging from 0.66 to 1.0, for intrarater reliability ranging from 0.64 to 1.0, and for test-retest reliability ranging from 0.76 to 0.95. These results indicate that the OT-APST has good interrater, intrarater and test-retest reliability and offers a reliable screening tool for use by occupational therapists working in the area of stroke.

Performance Evaluation of Occupational Therapy Students: A Reliability Study

1994 ◽  
Vol 61 (1) ◽  
pp. 20-27 ◽  
Author(s):  
Helene Polatajko ◽  
Leala Lee ◽  
Ann Bossers
Keyword(s):  
Performance Evaluation ◽  
Occupational Therapy ◽  
Confounding Factor ◽  
Occupational Therapists ◽  
Preliminary Evaluation ◽  
Evaluation Tool ◽  
Reliability Study ◽  
Retest Reliability ◽  
Occupational Therapy Students ◽  
Test Retest Reliability

The Performance Evaluation of Occupational Therapy Students (PEOTS) is an instrument designed to evaluate the clinical competence of occupational therapy students. The purpose of this study was to carry out a preliminary evaluation of the inter-rater and test-retest reliability of the PEOTS. Thirteen occupational therapy students, completed a one week placement at one of four facilities. Two occupational therapists supervised each student and evaluated performance using the PEOTS on day three and day five of this placement. The results indicated that the instrument has good inter-rater reliability. Test-retest reliability was difficult to evaluate since learning was a confounding factor. These preliminary findings support the use of the PEOTS as an evaluation tool. Further research, however, is needed to establish test-retest reliability and internal consistency of the PEOTS.

The Minnesota Manual Dexterity Test: Reliability, Validity and Reference Values Studies with Healthy Elderly People

1997 ◽  
Vol 64 (5) ◽  
pp. 270-276 ◽  
Author(s):  
Johanne Desrosiers ◽  
Annie Rochette ◽  
Réjean Hébert ◽  
Gina Bravo
Keyword(s):  
Elderly People ◽  
Reference Values ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Manual Dexterity ◽  
Test Reliability ◽  
Retest Reliability ◽  
Healthy Elderly ◽  
Block Test ◽  
Test Retest Reliability

Several dexterity tests have been developed, including the Minnesota Rate of Manipulation Test (MRMT) and a new version, the Minnesota Manual Dexterity Test (MMDT). The objectives of the study were: a) to verify the test-retest reliability of the MMDT; b) to compare the MRMT and the MMDT; c) to study the concurrent validity of the MMDT; and d) to establish reference values for elderly people with the MMDT. Two hundred and forty-seven community-living healthy elderly were evaluated with the MMDT, and two other dexterity tests, the Box and Block Test (BBT) and the Purdue Pegboard (PP). Thirty-five of them were evaluated twice with the MMDT and 44 were evaluated with both the MMDT and MRMT. The results show that the test-retest reliability of the MMDT is acceptable to high (intraclass correlation coefficients of 0.79 to 0.87, depending on the subtest) and the validity of the test is demonstrated by significant correlations between the MMDT, the BBT and the PP (0.63 to 0.67). There is a high correlation (0.85 to 0.95) between the MMDT and the MMRT in spite of different results. The reference values will help occupational therapists to differentiate better between real dexterity difficulties and those that may be attributed to normal aging.

Psychometric Comparisons of 2 Versions of the Fugl-Meyer Motor Scale and 2 Versions of the Stroke Rehabilitation Assessment of Movement

2008 ◽  
Vol 22 (6) ◽  
pp. 737-744 ◽  
Author(s):  
I-Ping Hsueh ◽  
Miao-Ju Hsu ◽  
Ching-Fan Sheu ◽  
Su Lee ◽  
Ching-Lin Hsieh ◽  
...  
Keyword(s):  
Stroke Rehabilitation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Stroke Patients ◽  
Chronic Patients ◽  
Retest Reliability ◽  
Intraclass Correlation Coefficients ◽  
Mild Stroke ◽  
Test Retest Reliability ◽  
Rehabilitation Assessment

Objective. To provide empirical justification for selecting motor scales for stroke patients, the authors compared the psychometric properties (validity, responsiveness, test-retest reliability, and smallest real difference [SRD]) of the Fugl-Meyer Motor Scale (FM), the simplified FM (S-FM), the Stroke Rehabilitation Assessment of Movement instrument (STREAM), and the simplified STREAM (S-STREAM). Methods. For the validity and responsiveness study, 50 inpatients were assessed with the FM and the STREAM at admission and discharge to a rehabilitation department. The scores of the S-FM and the S-STREAM were retrieved from their corresponding scales. For the test-retest reliability study, a therapist administered both scales on a different sample of 60 chronic patients on 2 occasions. Results. Only the S-STREAM had no notable floor or ceiling effects at admission and discharge. The 4 motor scales had good concurrent validity (rho ≥ .91) and satisfactory predictive validity (rho = .72-.77). The scales showed responsiveness (effect size d ≥ 0.34; standardized response mean ≥ 0.95; P < .0001), with the S-STREAM most responsive. The test-retest agreements of the scales were excellent (intraclass correlation coefficients ≥ .96). The SRD of the 4 scales was 10% of their corresponding highest score, indicating acceptable level of measurement error. The upper extremity and the lower extremity subscales of the 4 showed similar results. Conclusions. The 4 motor scales showed acceptable levels of reliability, validity, and responsiveness in stroke patients. The S-STREAM is recommended because it is short, responsive to change, and able to discriminate patients with severe or mild stroke.

scholarly journals Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Counseling Competencies ◽  
Counselors In Training ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

scholarly journals One-year test-retest reliability of ten vision tests in Canadian athletes

F1000Research ◽  
2020 ◽  
Vol 8 ◽  
pp. 1032
Author(s):  
Mehdi Aloosh ◽  
Suzanne Leclerc ◽  
Stephanie Long ◽  
Guowei Zhong ◽  
James M. Brophy ◽  
...  
Keyword(s):  
Sensitivity Analysis ◽  
Intraclass Correlation ◽  
Limits Of Agreement ◽  
Male Athletes ◽  
Retest Reliability ◽  
Concussion Management ◽  
Baseline Testing ◽  
One Year ◽  
The One ◽  
Test Retest Reliability

Background: Vision tests are increasingly being suggested for use in concussion management and baseline testing. Concussions, however, often occur months after baseline testing and reliability studies generally examine intervals limited to days or one week. Therefore, our objective was to determine the one-year test-retest reliability of these tests. Methods: We assessed one-year test-retest reliability of ten vision tests in elite Canadian athletes followed by the Institut National du Sport du Quebec. We included athletes who completed two baseline (preseason) annual evaluations by one clinician within 365±30 days. We excluded athletes with any concussion or vision training in between the annual evaluations or presented with any factor that is believed to affect the tests (e.g. migraines, etc.). Data were collected from clinical charts. We evaluated test-retest reliability using Intraclass Correlation Coefficient (ICC) and 95% limits of agreement (LoA). Results: We examined nine female and seven male athletes with a mean age of 22.7 (SD 4.5) years. Among the vision tests, we observed excellent test-retest reliability in Positive Fusional Vergence at 30cm (ICC=0.93) but this dropped to 0.55 when an outlier was excluded in a sensitivity analysis. There was good to moderate reliability in Negative Fusional Vergence at 30cm (ICC=0.78), Phoria at 30cm (ICC=0.68), Near Point of Convergence break (ICC=0.65) and Saccade (ICC=0.56). The ICC for Positive Fusional Vergence at 3m (ICC=0.56) also decreased to 0.21 after removing one outlier. We found poor reliability in Near Point of Convergence (ICC=0.47), Gross Stereoscopic Acuity (ICC=0.03) and Negative Fusional Vergence at 3m (ICC=0.0). ICC for Phoria at 3m was not appropriate because scores were identical in 14/16 athletes. 95% LoA of the majority of tests were ±40% to ±90%. Conclusions: Four tests had moderate one-year test-retest reliability. The remaining tests had poor reliability. The tests would therefore be useful only if concussion has a moderate-large effect on scores.

scholarly journals Reliability of Safe Maximum Lifting Determinations of a Functional Capacity Evaluation

2002 ◽  
Vol 82 (4) ◽  
pp. 364-371 ◽  
Author(s):  
Douglas P Gross ◽  
Michele C Battié
Keyword(s):  
Functional Capacity ◽  
Repeated Measures ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Capacity Evaluation ◽  
Measurement Variability ◽  
Retest Reliability ◽  
Repeated Measures Design ◽  
Test Retest Reliability

Abstract Background and Purpose. Functional capacity evaluations (FCEs) are measurement tools used in predicting readiness to return to work following injury. The interrater and test-retest reliability of determinations of maximal safe lifting during kinesiophysical FCEs were examined in a sample of people who were off work and receiving workers' compensation. Subjects. Twenty-eight subjects with low back pain who had plateaued with treatment were enrolled. Five occupational therapists, trained and experienced in kinesiophysical methods, conducted testing. Methods. A repeated-measures design was used, with raters testing subjects simultaneously, yet independently. Subjects were rated on 2 occasions, separated by 2 to 4 days. Analyses included intraclass correlation coefficients (ICCs) and 95% confidence intervals. Results. The ICC values for interrater reliability ranged from .95 to .98. Test-retest values ranged from .78 to .94. Discussion and Conclusion. Inconsistencies in subjects' performance across sessions were the greatest source of FCE measurement variability. Overall, however, test-retest reliability was good and interrater reliability was excellent.

scholarly journals Test-retest reliability and minimal detectable change of the Balance Evaluation Systems Test and its two abbreviated versions in persons with mild to moderate spinocerebellar ataxia: A pilot study

2020 ◽  
Vol 47 (4) ◽  
pp. 479-486
Author(s):  
Yuki Kondo ◽  
Kyota Bando ◽  
Yosuke Ariake ◽  
Wakana Katsuta ◽  
Kyoko Todoroki ◽  
...  
Keyword(s):  
Spinocerebellar Ataxia ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Retest Reliability ◽  
Evaluation Systems ◽  
Intraclass Correlation Coefficients ◽  
Interclass Correlation ◽  
Test Retest Reliability

BACKGROUND: The reliability of the evaluation of the Balance Evaluation Systems Test (BESTest) and its two abbreviated versions are confirmed for balance characteristics and reliability. However, they are not utilized in cases of spinocerebellar ataxia (SCA). OBJECTIVE: We aimed to examine the test-retest reliability and minimal detectable change (MDC) of the BESTest and its abbreviated versions in persons with mild to moderate spinocerebellar ataxia. METHODS: The BESTest was performed in 20 persons with SCA at baseline and one month later. The scores of the abbreviated version of the BESTest were determined from the BESTest scores. The interclass correlation coefficient (1,1) was used as a measure of relative reliability. Furthermore, we calculated the MDC in the BESTest and its abbreviated versions. RESULTS: The intraclass correlation coefficients (1,1) and MDC at 95% confidence intervals were 0.92, 8.7(8.1%), 0.91, 4.1(14.5%), and 0.81, 5.2(21.6%) for the Balance, Mini-Balance, and Brief-Balance Evaluation Systems Tests, respectively. CONCLUSIONS: The BESTest and its abbreviated versions had high test-retest reliability. The MDC values of the BESTest could enable clinicians and researchers to interpret changes in the balance of patients with SCA more precisely.

scholarly journals Test-retest reliability of visual-evoked potential habituation

Cephalalgia ◽  
2015 ◽  
Vol 36 (9) ◽  
pp. 831-839 ◽  
Author(s):  
Veronika Rauschel ◽  
Ruth Ruscheweyh ◽  
Siegbert Krafczyk ◽  
Andreas Straube
Keyword(s):  
Cortical Excitability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Episodic Migraine ◽  
Control Group ◽  
Retest Reliability ◽  
Regression Slopes ◽  
Test Retest Reliability ◽  
Changes Over Time ◽  
Visual Evoked

Objective Habituation of visual-evoked potentials (VEPs) is typically described as deficient interictally in migraine patients, supposedly indicating altered cortical excitability. Use of this parameter for monitoring changes over time, e.g. under treatment, requires demonstration of test-retest reliability. Methods VEPs were recorded interictally in 41 episodic migraine patients and 40 controls. N75–P100 amplitudes were measured over six consecutive blocks of 75 VEPs each. Amplitude regression slopes and block ratios were used to quantify VEP habituation. Test-retest reliability was assessed over 15 minutes and two to three weeks. Results Controls showed significantly more negative VEP habituation slopes than migraine patients (−0.21 ± 0.40 vs. 0.04 ± 0.46 µV/block, p < 0.05). Results were similar for block ratios, though, in the migraine group, VEP habituation significantly increased from test to two- to three-week retest ( p < 0.05). In addition, VEP habituation test-retest correlations were mostly poor both in migraine patients and controls (intraclass correlation coefficients, 15 minutes: −0.13 to 0.30, two to three weeks: 0.07 to 0.59). Conclusions Deficient VEP habituation in migraine was confirmed. However, the test-retest reliability of VEP habituation was rather weak. Therefore, we suggest that VEP habituation should be used for evaluation of cortical excitability under treatment only at the group level and only when a control group with sham treatment is included.

scholarly journals The Reliability of Pharyngeal High Resolution Manometry with Impedance for Derivation of Measures of Swallowing Function in Healthy Volunteers

2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Taher I. Omari ◽  
Johanna Savilampi ◽  
Karmen Kokkinn ◽  
Mistyka Schar ◽  
Kristin Lamvik ◽  
...  
Keyword(s):  
High Resolution ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Interrater Agreement ◽  
Swallowing Function ◽  
Retest Reliability ◽  
High Resolution Manometry ◽  
Intraclass Correlation Coefficients ◽  
Test Retest Reliability ◽  
Swallow Function

Purpose. We evaluated the intra- and interrater agreement and test-retest reliability of analyst derivation of swallow function variables based on repeated high resolution manometry with impedance measurements.Methods. Five subjects swallowed10×10 mL saline on two occasions one week apart producing a database of 100 swallows. Swallows were repeat-analysed by six observers using software. Swallow variables were indicative of contractility, intrabolus pressure, and flow timing.Results. The average intraclass correlation coefficients (ICC) for intra- and interrater comparisons of all variable means showedsubstantialtoexcellentagreement (intrarater ICC 0.85–1.00; mean interrater ICC 0.77–1.00). Test-retest results were less reliable. ICC for test-retest comparisons ranged fromslighttoexcellentdepending on the class of variable. Contractility variables differed most in terms of test-retest reliability. Amongst contractility variables, UES basal pressure showedexcellenttest-retest agreement (mean ICC 0.94), measures of UES postrelaxation contractile pressure showedmoderatetosubstantialtest-retest agreement (mean Interrater ICC 0.47–0.67), and test-retest agreement of pharyngeal contractile pressure ranged fromslighttosubstantial(mean Interrater ICC 0.15–0.61).Conclusions. Test-retest reliability of HRIM measures depends on the class of variable. Measures of bolus distension pressure and flow timing appear to be more test-retest reliable than measures of contractility.

Sign in / Sign up

Export Citation Format

Share Document