scholarly journals Does the Method of Administration Affect Reliability of the Foot and Ankle Ability Measure?

2020 ◽  
Vol 29 (7) ◽  
pp. 1038-1041
Author(s):  
Christopher J. Burcal ◽  
Sunghoon Chung ◽  
Madison L. Johnston ◽  
Adam B. Rosen

Background: Region-specific patient-reported outcomes (PROs) are commonly used in rehabilitation medicine. Digital versions of PROs may be implemented into electronic medical records and are also commonly used in research, but the validity of this method of administration (MOA) must be established. Purpose: To determine the agreement between and compare the test–retest reliability of a paper version (FAAM-P) and digital version (FAAM-D) of the Foot and Ankle Ability Measure (FAAM). Study Design: Randomized, nonblinded, crossover observational study. Methods: A total of 90 adults were randomized to complete the FAAM-P or FAAM-D first, and then completed the second MOA (first day [D1]). The FAAM-D was a digital adaptation of both FAAM-P subscales on Qualtrics. Identical test procedures were completed 1 week later (D2). Data were removed if a participant scored 100% on both MOA, reported injury between D1 and D2, or did not complete both MOA. Agreement was assessed on 46 participants between the 2 MOA using intraclass correlation coefficients (ICC) at D1. There was good-to-excellent test–retest reliability for the FAAM activities of daily living. Results: The authors observed good agreement between the FAAM-P and FAAM-D for the activities of daily living (ICC = .88) and sport scales (ICC = .87). Test–retest reliability was good-to-excellent for the FAAM activities of daily living (FAAM-P: ICC = .87; FAAM-D: ICC = .89) and sport (FAAM-P: ICC = .71; FAAM-D: ICC = .91). Conclusions: The MOA does not appear to affect the responses on the FAAM; however, the authors observed slightly higher reliability on the FAAM-D. The FAAM-D is sufficient to be used for generating practice-based evidence in rehabilitation medicine.

2015 ◽  
Vol 50 (1) ◽  
pp. 65-70 ◽  
Author(s):  
Daisuke Uematsu ◽  
Hidetomo Suzuki ◽  
Shogo Sasaki ◽  
Yasuharu Nagano ◽  
Nobuyuki Shinozuka ◽  
...  

Context: The Foot and Ankle Ability Measure (FAAM) is a valid, reliable, and self-reported outcome instrument for the foot and ankle region. Objective: To provide evidence for translation, cross-cultural adaptation, validity, and reliability of the Japanese version of the FAAM (FAAM-J). Design: Cross-sectional study. Setting: Collegiate athletic training/sports medicine clinical setting. Patients or Other Participants: Eighty-three collegiate athletes. Main Outcome Measure(s): All participants completed the Activities of Daily Living and Sports subscales of the FAAM-J and the Physical Functioning and Mental Health subscales of the Japanese version of the Short Form-36v2 (SF-36). Also, 19 participants (23%) whose conditions were expected to be stable completed another FAAM-J 2 to 6 days later for test-retest reliability. We analyzed the scores of those subscales for convergent and divergent validity, internal consistency, and test-retest reliability. Results: The Activities of Daily Living and Sports subscales of the FAAM-J had correlation coefficients of 0.86 and 0.75, respectively, with the Physical Functioning section of the SF-36 for convergent validity. For divergent validity, the correlation coefficients with Mental Health of the SF-36 were 0.29 and 0.27 for each subscale, respectively. Cronbach α for internal consistency was 0.99 for the Activities of Daily Living and 0.98 for the Sports subscale. A 95% confidence interval with a single measure was ±8.1 and ±14.0 points for each subscale. The test-retest reliability measures revealed intraclass correlation coefficient values of 0.87 for the Activities of Daily Living and 0.91 for the Sports subscales with minimal detectable changes of ±6.8 and ±13.7 for the respective subscales. Conclusions: The FAAM was successfully translated for a Japanese version, and the FAAM-J was adapted cross-culturally. Thus, the FAAM-J can be used as a self-reported outcome measure for Japanese-speaking individuals; however, the scores must be interpreted with caution, especially when applied to different populations and other types of injury than those included in this study.


2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Juan Pablo Martinez-Cano ◽  
Daniel Vernaza-Obando ◽  
Julián Chica ◽  
Andrés Mauricio Castro

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.


2019 ◽  
Vol 40 (6) ◽  
pp. 694-701 ◽  
Author(s):  
Sameer Desai ◽  
Alexander C. Peterson ◽  
Kevin Wing ◽  
Alastair Younger ◽  
Trafford Crump ◽  
...  

Background: Patient-reported outcomes are increasingly used as measures of effectiveness of interventions. To make the tools more useful, therapeutic thresholds known as minimally important differences have been developed. The objective of this study was to calculate minimally important differences for the domains of the Foot and Ankle Outcome Score for hallux valgus surgery. Methods: The study was based on a retrospective analysis of patients newly scheduled for bunion correction surgery and completing patient-reported outcomes between October 2013 and January 2018. This study used anchor- and distribution-based approaches to calculate the minimally important difference for the instrument’s 5 domains. Confidence intervals were calculated for each approach. There were 91 participants included in the study. Results: Using anchor- and distribution-based approaches, the minimally important difference for the pain domain ranged from 5.8 to 10.2, from 0.3 to 6.9 for the symptoms domain, 8.3 to 10.3 for the activities of daily living domain, 7.4 to 11.1 for the quality of life domain, and from 7.0 to 15.7 for the sports and recreation domain. Small differences in the activities of daily living domain may be more clinically important for patients with better function. Discussion: The range of minimally important difference values for each domain indicate how the Foot and Ankle Outcome Score corresponded to bunion correction surgery. The sports and recreation domain showed considerable variability in the range of values and may be associated with the domain’s lack of responsiveness. Overall, most minimally important difference values for the domains of FAOS ranged from above 4 to below 16. Level of Evidence: Level III, retrospective comparative series.


2020 ◽  
Vol 8 (3) ◽  
pp. 232596712091044 ◽  
Author(s):  
Ashim Gupta ◽  
Ajish S.R. Potty ◽  
Deepak Ganta ◽  
R. Justin Mistovich ◽  
Sreeram Penna ◽  
...  

Background: Functional outcome scores provide valuable data, yet they can be burdensome to patients and require significant resources to administer. The Knee injury and Osteoarthritis Outcome Score (KOOS) is a knee-specific patient-reported outcome measure (PROM) and is validated for anterior cruciate ligament (ACL) reconstruction outcomes. The KOOS requires 42 questions in 5 subscales. We utilized a machine learning (ML) algorithm to determine whether the number of questions and the resultant burden to complete the survey can be lowered in a subset (activities of daily living; ADL) of KOOS, yet still provide identical data. Hypothesis: Fewer questions than the 17 currently provided are actually needed to predict KOOS ADL subscale scores with high accuracy. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Pre- and postoperative patient-reported KOOS ADL scores were obtained from the Surgical Outcome System (SOS) data registry for patients who had ACL reconstruction. Categorical Boosting (CatBoost) ML models were built to analyze each question and its value in predicting the patient’s actual functional outcome (ie, KOOS ADL score). A streamlined set of minimal essential questions were then identified. Results: The SOS registry contained 6185 patients who underwent ACL reconstruction. A total of 2525 patients between the age of 16 and 50 years had completed KOOS ADL scores presurgically and 3 months postoperatively. The data set consisted of 51.84% male patients and 48.16% female patients, with a mean age of 29 years. The CatBoost model predicted KOOS ADL scores with high accuracy when only 6 questions were asked ( R2 = 0.95), similar to when all 17 questions of the subscale were asked ( R2 = 0.99). Conclusion: ML algorithms successfully identified the essential questions in the KOOS ADL questionnaire. Only 35% (6/17) of KOOS ADL questions (descending stairs, ascending stairs, standing, walking on flat surface, putting on socks/stockings, and getting on/off toilet) are needed to predict KOOS ADL scores with high accuracy after ACL reconstruction. ML can be utilized successfully to streamline the burden of patient data collection. This, in turn, can potentially lead to improved patient reporting, increased compliance, and increased utilization of PROMs while still providing quality data.


2020 ◽  
pp. 153944922096107
Author(s):  
Ecem Karanfil ◽  
Yeliz Salcı ◽  
Ayla Fil-Balkan ◽  
Can Ebru Bekircan-Kurt ◽  
Sevim Erdem Özdamar ◽  
...  

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.


1998 ◽  
Vol 61 (3) ◽  
pp. 127-132 ◽  
Author(s):  
Lori Letts ◽  
Sheri Scott ◽  
Jill Burtney ◽  
Linda Marshall ◽  
Martha McKean

The Safety Assessment of Function and the Environment for Rehabilitation (SAFER Too)) was developed to assess people's abilities to manage functional activities safety within their homes. The results of a study to evaluate the instruments inter-rater and test-retest reliability and construct validity are reported. Reliability was evaluated using kappa for each dichotomous item. For inter-rater reliability, 59 of 66 items had acceptable reliability. For test-retest reliability, 63 of 70 items had acceptable kappa scores. For items where kappa could not be calculated because of limited variation between raters, percentage agreement was over 80%. For validity, higher SAFER Tool scores (that is, more safety problems) were hypothesised to be associated with less independence in activities of daily living (ADL) and instrumental activities of daily living (IADL) and more cognitive impairment. The correlation between SAFER Tool scores and cognitive impairment supported this hypothesis. The results of the correlations with ADL and IADL scores were less clear. This could be attributed to caregivers' assistance with activities which might have reduced risk, and generally limited variation in ADL scores. The reliability results from this study are positive. Further research to assure the SAFER Tools validity and predictive ability are needed.


2020 ◽  
Vol 46 (1) ◽  
Author(s):  
Fernanda Rodrigues Fonseca ◽  
Roberta Rodolfo Mazzali Biscaro ◽  
Alexânia de Rê ◽  
Maíra Junkes-Cunha ◽  
Cardine Martins dos Reis ◽  
...  

ABSTRACT Objective: To test the construct validity, reliability, and measurement error of the Brazilian Portuguese-language version of the Manchester Respiratory Activities of Daily Living (MRADL) questionnaire in patients with COPD. Methods: We evaluated 50 patients with COPD, among whom 30 were men, the mean age was 64 ± 8 years, and the median FEV1 as a percentage of the predicted value (FEV1%predicted) was 38.4% (interquartile range, 29.1-57.4%). Pulmonary function and limitations in activities of daily living (ADLs) were assessed by spirometry and by face-to-face application of the MRADL, respectively. For the construct validity analysis, we tested the hypothesis that the total MRADL score would show moderate correlations with spirometric parameters. We analyzed inter-rater reliability, test-retest reliability, inter-rater measurement error, and test-retest measurement error. Results: The total MRADL score showed moderate correlations with the FEV1/FVC ratio, FEV1 in liters, FEV1%predicted, and FVC%predicted, all of the correlations being statistically significant (r = 0.34, r = 0.31, r = 0.42, and r = 0.38, respectively; p < 0.05 for all). For the reliability and measurement error of the total MRADL score, we obtained the following inter-rater and test-retest values, respectively: two-way mixed-effects model intraclass correlation coefficient for single measures, 0.92 (95% CI: 0.87-0.96) and 0.89 (95% CI: 0.81-0.93); agreement standard error of measurement, 1.03 and 0.97; smallest detectable change at the individual level, 2.86 and 2.69; smallest detectable change at the group level, 0.40 and 0.38; and limits of agreement, −2.24 to 1.96 and −2.65 to 2.69. Conclusions: In patients with COPD in Brazil, this version of the MRADL shows satisfactory construct validity, satisfactory inter-rater/test-retest reliability, and indeterminate inter-rater/test-retest measurement error.


2007 ◽  
Vol 87 (9) ◽  
pp. 1155-1163 ◽  
Author(s):  
Mia Conradsson ◽  
Lillemor Lundin-Olsson ◽  
Nina Lindelöf ◽  
Håkan Littbrand ◽  
Lisa Malmqvist ◽  
...  

Background and Purpose: The Berg Balance Scale (BBS) is frequently used to assess balance in older people, but knowledge is lacking about the absolute reliability of BBS scores. The aim of this study was to investigate the absolute and relative intrarater test-retest reliability of data obtained with the BBS when it is used among older people who are dependent in activities of daily living and living in residential care facilities.Subjects: The participants were 45 older people (36 women and 9 men) who were living in 3 residential care facilities. Their mean age was 82.3 years (SD=6.6, range=68–96), and their mean score on the Mini Mental State Examination was 17.5 (SD=6.3, range=4–30).Methods: The BBS was assessed twice by the same assessor. The intrarater test-retest reliability assessments were made at approximately the same time of day and with 1 to 3 days in between assessments. Absolute reliability was calculated using an analysis of variance with a 95% confidence level, as suggested by Bland and Altman. Relative reliability was calculated using the intraclass correlation coefficient (ICC).Results: The mean score was 30.1 points (SD=15.9, range=3–53) for the first BBS test and 30.6 points (SD=15.6, range=4–54) for the retest. The mean absolute difference between the 2 tests was 2.8 points (SD=2.7, range=0–11). The absolute reliability was calculated as being 7.7 points, and the ICC was calculated to .97.Discussion and Conclusion: Despite a high ICC value, the absolute reliability showed that a change of 8 BBS points is required to reveal a genuine change in function among older people who are dependent in activities of daily living and living in residential care facilities. This knowledge is important in the clinical setting when evaluating an individual's change in balance function over time in this group of older people.


2012 ◽  
Vol 20 (2) ◽  
pp. 186-197 ◽  
Author(s):  
Ching-Yi Wang ◽  
Ming-Hsia Hu ◽  
Hui-Ya Chen ◽  
Ren-Hau Li

To determine the test–retest reliability and criterion validity of self-reported function in mobility and instrumental activities of daily living (IADL) in older adults, a convenience sample of 70 subjects (72.9 ± 6.6 yr, 34 male) was split into able and disabled groups based on baseline assessment and into consistently able, consistently disabled, and inconsistent based on repeat assessments over 2 weeks. The criterion validities of the self-reported measures of mobility domain and IADL-physical subdomain were assessed with concurrent baseline measures of 4 mobility performances, and that of the self-reported measure of IADL-cognitive subdomain, with the Mini-Mental State Examination. Test–retest reliability was moderate for the mobility, IADL-physical, and IADL-cognitive subdomains (κ = .51–.66). Those who reported being able at baseline also performed better on physical- and cognitive-performance tests. Those with variable performance between test occasions tended to report inconsistently on repeat measures in mobility and IADL-cognitive, suggesting fluctuations in physical and cognitive performance.


Sign in / Sign up

Export Citation Format

Share Document