Development of a Comprehensive Outcome Measure for Motor Coordination; Step 1: Three-Phase Content Validity Process

2020 ◽  
pp. 154596832098195
Author(s):  
Sandra R. Alouche ◽  
Roni Molad ◽  
Marika Demers ◽  
Mindy F. Levin

Background Motor coordination, the ability to produce context-dependent organized movements in spatial and temporal domains, is impaired after neurological injuries. Outcome measures assessing coordination mostly quantify endpoint performance variables (ie, temporal qualities of whole arm movement) but not movement quality (ie, trunk and arm joint displacements). Objective To develop an outcome measure to assess coordination of multiple body segments at both endpoint trajectory and movement quality levels, based on observational kinematics, in adults with neurological injuries. Methods A 3-phase study was used to develop the Comprehensive Coordination Scale (CCS): instrument development, Delphi process, and focus group meeting. The CCS was constructed from common tests used in clinical practice and research. Rating scales for different behavioral elements were developed to guide analysis. For content validation, 8 experts (ie, neurological clinicians/researchers) answered questionnaires about relevance, comprehension, and feasibility of each test and rating scale. A focus group conducted with 6 of 8 experts obtained consensus on rating scale and instruction wording, and identified gaps. Three additional experts reviewed the revised CCS content to obtain a final version. Results Experts identified a gap regarding assessment of hand/finger coordination. The CCS final version is composed of 6 complementary tests of coordination: finger-to-nose, arm-trunk, finger, lower extremity, and 2- and 4-limb interlimb coordination. Constructs include spatial and temporal variables totaling 69 points. Higher scores indicate better performance. Conclusions The CCS may be an important, understandable and feasible outcome measure to assess spatial and temporal coordination. CCS measurement properties are presented in the companion article.

2020 ◽  
pp. 089443932090246
Author(s):  
Jan Karem Höhne ◽  
Dagmar Krebs ◽  
Steffen-M. Kühnel

In social science research, unipolar and bipolar scales are commonly used methods in measuring respondents’ attitudes and opinions. Compared to other rating scale characteristics, scale polarity (unipolar and bipolar) and its effects on response behavior have rarely been addressed in previous research. To fill this gap in the literature, we investigate whether and to what extent fully verbalized unipolar and bipolar scales influence response behavior by analyzing observed and latent response distributions and latent thresholds of response categories. For this purpose, we conducted a survey experiment in a probability-based online panel and randomly assigned respondents to a unipolar or bipolar scale condition. The results reveal substantial differences between the two rating scales. They show significantly different response distributions and measurement non-invariance. In addition, response categories (and latent thresholds) of unipolar and bipolar scales are not equally distributed. The findings show that responses to unipolar and bipolar scales differ not only on the observational level but also on the latent level. Both rating scales vary with respect to their measurement properties, so that the responses obtained using each scale are not easily comparable. We recommend not considering unipolar and bipolar scales as interchangeable.


2019 ◽  
Vol 5 (1) ◽  
pp. e000541 ◽  
Author(s):  
John Ressman ◽  
Wilhelmus Johannes Andreas Grooten ◽  
Eva Rasmussen Barr

Single leg squat (SLS) is a common tool used in clinical examination to set and evaluate rehabilitation goals, but also to assess lower extremity function in active people.ObjectivesTo conduct a review and meta-analysis on the inter-rater and intrarater reliability of the SLS, including the lateral step-down (LSD) and forward step-down (FSD) tests.DesignReview with meta-analysis.Data sourcesCINAHL, Cochrane Library, Embase, Medline (OVID) and Web of Science was searched up until December 2018.Eligibility criteriaStudies were eligible for inclusion if they were methodological studies which assessed the inter-rater and/or intrarater reliability of the SLS, FSD and LSD through observation of movement quality.ResultsThirty-one studies were included. The reliability varied largely between studies (inter-rater: kappa/intraclass correlation coefficients (ICC) = 0.00–0.95; intrarater: kappa/ICC = 0.13–1.00), but most of the studies reached ‘moderate’ measures of agreement. The pooled results of ICC/kappa showed a ‘moderate’ agreement for inter-rater reliability, 0.58 (95% CI 0.50 to 0.65), and a ‘substantial’ agreement for intrarater reliability, 0.68 (95% CI 0.60 to 0.74). Subgroup analyses showed a higher pooled agreement for inter-rater reliability of ≤3-point rating scales while no difference was found for different numbers of segmental assessments.ConclusionOur findings indicate that the SLS test including the FSD and LSD tests can be suitable for clinical use regardless of number of observed segments and particularly with a ≤3-point rating scale. Since most of the included studies were affected with some form of methodological bias, our findings must be interpreted with caution.PROSPERO registration numberCRD42018077822.


2021 ◽  
Author(s):  
Agessandro Abrahao ◽  
LIANE PHUNG ◽  
Eliza Freitas ◽  
Cornelia M Borkhoff ◽  
Lorne Zinman

Tracking disease progression and treatment effect of spinal bulbar muscular atrophy, or Kennedy's disease, is challenging given its slowly progressive nature. To achieve success in SBMA clinical trials, a reliable, responsive, and validated patient-reported motor function scale must capture progression of SBMA-specific motor dysfunction. Here, we conducted a systematic review, meta-analysis, and appraisal of core measurement properties of the SBMA functional rating scale (SBMAFRS). We established that the SBMAFRS has satisfactory internal consistency, inter-rater reliability, and construct validity for measuring progressive motor dysfunction over similar neurodegenerative motor function scales but inadequate sensitivity to change over time. Further development to validate and improve the SBMAFRS' ability to capture longitudinal responsiveness in larger cohorts is warranted.


2005 ◽  
Vol 30 (2) ◽  
pp. 207-216 ◽  
Author(s):  
C. C. CHEN ◽  
C. V. GRANGER ◽  
C. A. PEIMER ◽  
O. J. MOY ◽  
S. WALD

The purpose of this study was to develop an easy-to-use and psychometrically sound outcome instrument that is task-oriented and patient-centred. One hundred fifteen patients with a variety of hand impairments completed a rating scale of perceived manual ability (i.e., the Manual Ability Measure). The first 70 patients also completed two other questionnaires about physical health and psychological well-being. Rasch Analyses were conducted to transform the ordinal ratings into linear measures; Rasch statistics were used to evaluate its measurement properties at both scale and item levels. Eighty-three original items were reduced to 16 common tasks; Rasch reliabilities were good; the easy-to-difficult item hierarchy makes sense clinically. Moderate correlations were found between manual ability, physical function and general sense of well-being. The results of this preliminary study suggest that the MAM is a promising outcome measure that has adequate psychometric properties and can be used to complement other objective clinical measurements.


2021 ◽  
Vol 35 (2) ◽  
pp. 194-203
Author(s):  
Roni Molad ◽  
Sandra R. Alouche ◽  
Marika Demers ◽  
Mindy F. Levin

Background A comprehensive scale assessing motor coordination of multiple body segments was developed using a 3-phase content validation process. The Comprehensive Coordination Scale (CCS) evaluates motor coordination defined as the ability to produce context-dependent movements of multiple effectors in both spatial and temporal domains. The scale assesses motor coordination in individuals with neurological injuries at 2 levels of movement description: the motor performance level describes end point movements (ie, hand, foot), and the movement quality level describes limb joints/trunk movements contributing to end point movement. Objective To determine measurement properties of the scale in people with chronic stroke. Methods Standardized approaches determined the internal consistency (factor loadings), intrarater and interrater reliability (interclass correlation coefficient), measurement error (SEM; minimal detectable change [MDC]), construct validity, and interpretability (ie, ceiling and floor effects) of the CCS. Results Data from 30 patients with chronic stroke were used for the analysis. The internal consistency of the scale was high (0.94), and the scale consisted of separate factors characterizing end point motor performance and movement quality. Intrarater (intraclass correlation coefficient [ICC] = 0.97-0.97) and interrater (ICC=0.76-0.98) reliability of the whole scale and subscales were good to excellent. The CCS had an SEM of 1.80 points (total score = 69 points) and an MDC95 of 4.98 points. The CCS total score was related to Fugl-Meyer Assessment total and motor scores and had no ceiling or floor effects. Conclusions The CCS scale has strong measurement properties and may be a useful measure of spatial and temporal coordination deficits in chronic stroke survivors.


2020 ◽  
Vol 77 (11) ◽  
pp. 1119-1125
Author(s):  
Petar Vojvodic ◽  
Ana Andonov ◽  
Dejan Stevanovic ◽  
Ivana Perunicic-Mladenovic ◽  
Goran Mihajlovic ◽  
...  

Background/Aim. Various rating scales for depression are avalable, but the Montgomery-Asberg Depression Rating Scale (MADRS) is one of the most frequently used scales. The aim of this study was to analyze the measurement properties of the MADRS Serbian version for quantifying depression severity in the clinical setting. Methods. Two studies have been conducted in order to validate the MADRS. The first study included sixty-four adult patients with major depressive disorder (MDD), with test-retest situ-ation, and the second one included 19 participants (also with MDD), who had six test-retest situations. Psychomet-ric evaluation included descriptive analysis, internal con-sistency and test-retest reliability, and concurrent validity (correlations with the Hamilton Depression Rating Scale 17 ? HAMD-17). Results. The internal consistency for test-retest reliability was 0.93 in total for the MADRS, and for six test-retest situations was 0.95. The MADRS had one fac-tor structure, with explained variance of 66.26% for the first testing, and 61.29% for the retest. There were statistical sig-nificant correlations between the MADRS and HAMD-17 (r = 0.96 for test and r = 0.94 for retest). Also, it was shown a great correlation between all items on the MADRS, and for the instrument in total (r = 0.89). Conclusion. The MADRS was shown good statistical results, and it could be used in everyday clinical practice for discriminating MDD.


2012 ◽  
Vol 21 (4) ◽  
pp. 136-143
Author(s):  
Lynn E. Fox

Abstract The self-anchored rating scale (SARS) is a technique that augments collaboration between Augmentative and Alternative Communication (AAC) interventionists, their clients, and their clients' support networks. SARS is a technique used in Solution-Focused Brief Therapy, a branch of systemic family counseling. It has been applied to treating speech and language disorders across the life span, and recent case studies show it has promise for promoting adoption and long-term use of high and low tech AAC. I will describe 2 key principles of solution-focused therapy and present 7 steps in the SARS process that illustrate how clinicians can use the SARS to involve a person with aphasia and his or her family in all aspects of the therapeutic process. I will use a case study to illustrate the SARS process and present outcomes for one individual living with aphasia.


2006 ◽  
Vol 22 (4) ◽  
pp. 259-267 ◽  
Author(s):  
Eelco Olde ◽  
Rolf J. Kleber ◽  
Onno van der Hart ◽  
Victor J.M. Pop

Childbirth has been identified as a possible traumatic experience, leading to traumatic stress responses and even to the development of posttraumatic stress disorder (PTSD). The current study investigated the psychometric properties of the Dutch version of the Impact of Event Scale-Revised (IES-R) in a group of women who recently gave birth (N = 435). In addition, a comparison was made between the original IES and the IES-R. The scale showed high internal consistency (α = 0.88). Using confirmatory factor analysis no support was found for a three-factor structure of an intrusion, an avoidance, and a hyperarousal factor. Goodness of fit was only reasonable, even after fitting one intrusion item on the hyperarousal scale. The IES-R correlated significantly with scores on depression and anxiety self-rating scales, as well as with scores on a self-rating scale of posttraumatic stress disorder. Although the IES-R can be used for studying posttraumatic stress reactions in women who recently gave birth, the original IES proved to be a better instrument compared to the IES-R. It is concluded that adding the hyperarousal scale to the IES-R did not make the scale stronger.


Methodology ◽  
2011 ◽  
Vol 7 (3) ◽  
pp. 88-95 ◽  
Author(s):  
Jose A. Martínez ◽  
Manuel Ruiz Marín

The aim of this study is to improve measurement in marketing research by constructing a new, simple, nonparametric, consistent, and powerful test to study scale invariance. The test is called D-test. D-test is constructed using symbolic dynamics and symbolic entropy as a measure of the difference between the response patterns which comes from two measurement scales. We also give a standard asymptotic distribution of our statistic. Given that the test is based on entropy measures, it avoids smoothed nonparametric estimation. We applied D-test to a real marketing research to study if scale invariance holds when measuring service quality in a sports service. We considered a free-scale as a reference scale and then we compared it with three widely used rating scales: Likert-type scale from 1 to 5 and from 1 to 7, and semantic-differential scale from −3 to +3. Scale invariance holds for the two latter scales. This test overcomes the shortcomings of other procedures for analyzing scale invariance; and it provides researchers a tool to decide the appropriate rating scale to study specific marketing problems, and how the results of prior studies can be questioned.


2021 ◽  
pp. 001698622098594
Author(s):  
Nielsen Pereira

The purpose of this study was to investigate the validity of the HOPE Scale for identifying gifted English language learners (ELs) and how classroom and English as a second language (ESL) teacher HOPE Scale scores differ. Seventy teachers completed the HOPE Scale on 1,467 students in grades K-5 and four ESL teachers completed the scale on 131 ELs. Measurement invariance tests indicated that the HOPE Scale yields noninvariant latent means across EL and English proficient (EP) samples. However, confirmatory factor analysis results support the use of the scale with ELs or EP students separately. Results also indicate that the rating patterns of classroom and ESL teachers were different and that the HOPE Scale does not yield valid data when used by ESL teachers. Caution is recommended when using the HOPE Scale and other teacher rating scales to compare ELs to EP students. The importance of invariance testing before using an instrument with a population that is different from the one(s) for which the instrument was developed is discussed.


Sign in / Sign up

Export Citation Format

Share Document