scholarly journals Measurement Properties of Canadian Agility and Movement Skill Assessment for Children Aged 9–12 Years Using Rasch Analysis

2021 ◽  
Vol 9 ◽  
Author(s):  
Jindong Chang ◽  
Liming Yong ◽  
Hai Yan ◽  
Jibing Wang ◽  
Naiqing Song
Keyword(s):  
Rasch Analysis ◽  
Goodness Of Fit ◽  
Item Difficulty ◽  
Chinese Children ◽  
Skill Assessment ◽  
Guizhou Province ◽  
Measurement Properties ◽  
Rater Reliability ◽  
Item Fit ◽  
Movement Skill Assessment

The Canadian Agility and Movement Skill Assessment (CAMSA) was recently widely used to assess fundamental motor skills in children. Although the CAMSA is reported to be reliable and valid, its measurement properties are not clear. This study aimed to examine the measurement properties of the CAMSA in a sample of Chinese children using Rasch analysis. The study sample was from 1,094 children aged 9–12 years in Zunyi City, Guizhou Province. Descriptive data were analyzed using SPSS 24.0 software, and the dichotomous data were analyzed by Winsteps version 4.5.4 and Facets 3.67.1 software performing Rasch analysis. The present study investigated CAMSA measurement characteristics by Rasch analysis, including the reliability of the rating instrument, unidimensionality, item-fit statistics, and differential item functioning (DIF). Inter-rater reliability and retest reliability showed that the CAMSA had a good internal consistency. Rasch analysis indicated that the CAMSA was unidimensional, locally independent, and had a good item-fit-statistic. Additionally, the CAMSA displayed a good fit for the item separation index (12.50 > 2.0), as well as for item reliability (0.99 > 0.90). However, the item difficulty of the CAMSA did not fit well with personal ability, and a significant DIF was found across genders. In the Chinese children sample test, the CAMSA demonstrated appropriate goodness-of-fit validity and rater reliability. Thus, future research will explore item difficulty and person ability fit, as well as DIF across genders.

A Quantitative Approach to Movement Skill Assessment for Children with Mental Retardation

2004 ◽  
Vol 21 (3) ◽  
pp. 269-280 ◽  
Author(s):  
Joonkoo Yun ◽  
Deborah R. Shapiro
Keyword(s):  
Mental Retardation ◽  
Goodness Of Fit ◽  
Skill Assessment ◽  
Multidimensional Model ◽  
Physical Competence ◽  
Confirmatory Factor Analyses ◽  
Object Control ◽  
Confirmatory Factor ◽  
Test Retest Reliability ◽  
Movement Skill Assessment

This study examined the psychometric properties of Ulrich’s (1988) Actual Physical Competence Scale for children with mental retardation. A total of 139 children with MR, 7 to 13 years of age participated. Confirmatory factor analyses indicated that a multidimensional model of skill assessment captures the motor performance of those with MR more accurately than a unidimensional model. Indices of goodness of fit for the multidimensional model were GFI = .91, RMSEA = .09, (χ2/df) = 2.15, and CFI = .93. Test-retest reliability and internal consistency for the total test battery was ICC = .91 and α = .62, respectively. When evaluating movement skills of children with mental retardation, a multidimensional model incorporating both locomotor and object control skills is recommended.

scholarly journals Analysis of the psychometric properties of the Multiple Sclerosis Impact Scale-29 (MSIS-29) in relapsing–remitting multiple sclerosis using classical and modern test theory

2016 ◽  
Vol 2 ◽  
pp. 205521731667323 ◽  
Author(s):  
ED Bacci ◽  
KW Wyrwich ◽  
GA Phillips ◽  
T Vollmer ◽  
S Guo
Keyword(s):  
Multiple Sclerosis ◽  
Clinical Trial ◽  
Psychometric Properties ◽  
Rasch Analysis ◽  
Test Theory ◽  
Measurement Properties ◽  
Community Based ◽  
Item Fit ◽  
Impact Scale ◽  
Relapsing Remitting

Background Investigations using classical test theory support the psychometric properties of the original version of the Multiple Sclerosis Impact Scale (MSIS-29v1), a disease-specific measure of multiple sclerosis (MS) impact (physical and psychological subscales). Later, assessments of the MSIS-29v1 in an MS community-based sample using Rasch analysis led to revisions of the instrument’s response options (MSIS-29v2). Objective The objective of this paper is to evaluate the psychometric properties of the MSIS-29v1 in a clinical trial cohort of relapsing–remitting MS patients (RRMS). Methods Data from 600 patients with RRMS enrolled in the SELECT clinical trial were used. Assessments were performed at baseline and at Weeks 12, 24, and 52. In addition to traditional psychometric analyses, Item Response Theory (IRT) and Rasch analysis were used to evaluate the measurement properties of the MSIS-29v1. Results Both MSIS-29v1 subscales demonstrated strong reliability, construct validity, and responsiveness. The IRT and Rasch analysis showed overall support for response category threshold ordering, person-item fit, and item fit for both subscales. Conclusions Both MSIS-29v1 subscales demonstrated robust measurement properties using classical, IRT, and Rasch techniques. Unlike previous research using a community-based sample, the MSIS-29v1 was found to be psychometrically sound to assess physical and psychological impairments in a clinical trial sample of patients with RRMS.

scholarly journals Evaluating Instrument Quality: Rasch Model – Analyses of Post Test of Curriculum 2013 Training

2018 ◽  
Vol 9 (1) ◽  
pp. 67-86
Author(s):  
Komalasari
Keyword(s):  
Rasch Model ◽  
Rasch Analysis ◽  
Item Difficulty ◽  
Measurement Model ◽  
Test Items ◽  
Item Fit ◽  
Ability Levels ◽  
Post Test ◽  
Instrument Quality

The main purpose of this study was to evaluate the quality of post test utilized by LPMP Central Kalimantan Indonesia in curriculum 2013 training for X grade teachers. It uses Rasch analysis to explore the item fit, the reliability ( item and person), item difficulty, and the Wrigh map of post test. This study also applies Classical Test Teory (CTT) to determine item discrimination and distracters. Following a series of iterative Rasch analyses that adopted the “data should fit the model” approach, 30 items post test of curriculum 2013 training was analyzed using Acer Conquest 4 software, software based on Rasch measurement model. All items of post test of curriculum 2013 training are sufficient fit to the Rasch model. The difficulty levels (i.e. item measures) for the 30 items range from –1.746 logits to +1.861 logits. The item separation reliability is acceptable at 0.990 and person separation reliability is low at 0.485. The wright map indicates that the test is difficult for the teachers or the teachers have low ability in knowledge of curriculum 2013. The post test items cannot cover all the ranges of the teachers’ ability levels. Items discrimination of post test of curriculum 2013 training grouped into fair discrimination (item 2, 4, 5, 8, 11, 18) and poor discrimination (1, 3, 6, 7, 9, 10,12, 13, 14, 15, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30). Some distracters from item 1, 2, 6, 7, 8, 9, 11, 13, 16, 17, 18, 19, 20, 22, 24, 25, 27, 28, 29 and 30 are problematic. These distracters require further investigation or revision.   Key words: Rasch analysis, training, curriculum 2013, post test

scholarly journals Psychometric Properties of the Korean Dispositional Hope Scale Using the Rasch Analysis in Stroke Patients

2019 ◽  
Vol 2019 ◽  
pp. 1-6
Author(s):  
Eun-Young Park ◽  
Yoo Im Choi ◽  
Jung-Hee Kim
Keyword(s):  
Psychometric Properties ◽  
Rasch Analysis ◽  
Rating Scale ◽  
Item Difficulty ◽  
Well Being ◽  
Community Dwelling ◽  
Stroke Patients ◽  
Separation Index ◽  
Item Fit ◽  
Dispositional Hope

Background. It is reported that hopeful thinking plays a positive role in encouraging patients to achieve functional goals during the rehabilitation process. Hope is a key concept in evaluating stroke outcomes in research and rehabilitation practice. Aims. The purpose of this study was to investigate the psychometric properties of the Korean Dispositional Hope Scale (K-DHS) using the Rasch analysis in patients with hemiplegic stroke. Methods. The K-DHS was completed by 166 community-dwelling hemiplegic stroke patients in Korea. Data were analyzed according to item fit, item difficulty, and the appropriateness of the rating scale using the Rasch analysis. Results. Item fit analysis showed that 8 items of the K-DHS are appropriate because the infit MSNQ was between 0.7 and 1.3. Item difficulty results revealed that there is a difference in distribution between personal attributes and item difficulty. It shows that the item fit statistics of the 4-point Likert scale of K-DHS are all good. The person separation index demonstrated that the K-DHS could differentiate two or three hope status strata in stroke patients. The item separation index indicated that the items were useful with high reliability. Conclusion. The K-DHS comprises appropriate items for measuring the hope of stroke patients living in the community, and the rating scale of the K-DHS is also appropriate. This study is the first to conduct an analysis of the rating scale and its appropriateness, as well as the difficulty of items based on item response theory, and offers new insights for enhancing hope and improving well-being following stroke.

scholarly journals MEASUREMENT PROPERTIES OF A STANDARDIZED ELICITED IMITATION TEST: AN INTEGRATIVE DATA ANALYSIS

2021 ◽  
pp. 1-27
Author(s):  
Daniel R. Isbell ◽  
Young-A Son
Keyword(s):  
Second Language ◽  
Data Analysis ◽  
Second Language Acquisition ◽  
Item Difficulty ◽  
Measurement Properties ◽  
Linguistic Features ◽  
Elicited Imitation ◽  
Integrative Data Analysis ◽  
Rater Severity ◽  
Study Participants

Abstract Elicited Imitation Tests (EITs) are commonly used in second language acquisition (SLA)/bilingualism research contexts to assess the general oral proficiency of study participants. While previous studies have provided valuable EIT construct-related validity evidence, some key gaps remain. This study uses an integrative data analysis to further probe the validity of the Korean EIT score interpretations by examining the performances of 318 Korean learners (198 second language, 79 foreign language, and 41 heritage) on the Korean EIT scored by five different raters. Expanding on previous EIT validation efforts, this study (a) examined both inter-rater reliability and differences in rater severity, (b) explored measurement bias across subpopulations of language learners, (c) identified relevant linguistic features which relate to item difficulty, and (d) provided a norm-referenced interpretation for Korean EIT scores. Overall, findings suggest that the Korean EIT can be used in diverse SLA/bilingualism research contexts, as it measures ability similarly across subgroups and raters.

scholarly journals The client satisfaction with device: a Rasch validation of the Arabic version in patients with upper and lower limb amputation

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Hadeel R. Bakhsh ◽  
Nilüfer Kablan ◽  
Walaa Alammar ◽  
Yaşar Tatar ◽  
Giorgio Ferriero
Keyword(s):  
Client Satisfaction ◽  
Item Difficulty ◽  
Principal Component ◽  
Limb Amputation ◽  
Convenience Sample ◽  
Reliability Indices ◽  
Arabic Speakers ◽  
Item Fit ◽  
Item Functioning ◽  
Local Item Dependency

Abstract Background The Client Satisfaction with Devices (CSD) module of the Orthotics and Prosthetics Users’ Survey is an extensively used questionnaire that measures patients’ satisfaction with orthosis and prosthesis. However, the validated version for Arabic speakers (CSD-Ar) is only applicable for orthosis users. Objectives The aim of this study was to evaluate the psychometric proprieties of the CSD-Ar for prosthetics users. Methods The study used a convenience sample of prosthesis users from Saudi Arabia and Turkey (N = 183), who completed the CSD-Ar. The collected data were analysed using Rasch analysis to evaluate item fit, reliability indices, item difficulty, local item dependency, and differential item functioning (DIF) using WINSTEPS version 4.6.1. Results Based on the analysis, the four-response Likert-scale was acceptable, as shown by the category functioning test, All eight items did achieve a fit to the Rasch Model [(infit) and (outfit) mean-square 0.75 to 1.3]. Person separation reliability was 0.76, and item separation reliability was 0.94. A principal component analysis (PCA) showed satisfactory unidimensionality and no local item dependency. The DIF analysis showed no notable dependency among items on participant characteristics in terms of age, gender, duration of use, country, and level of amputation. Conclusion This study contributes to the confidence of using CSD-Ar to evaluate users’ satisfaction with different prostheses, affirming the need for further refinement of the quality of the outcome measure.

scholarly journals Validity of the French version of Catquest-9SF and use of an electronic notepad for entering patient-reported outcome measures

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Gregory Katz ◽  
Alexandra Rouquette ◽  
François Lignereux ◽  
Thierry Mourgues ◽  
Michel Weber ◽  
...  
Keyword(s):  
Cataract Surgery ◽  
Psychometric Properties ◽  
Rasch Analysis ◽  
Item Difficulty ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Good Precision ◽  
French Version ◽  
Patient Reported ◽  
Before And After

Abstract Background The Catquest-9SF questionnaire is a patient reported outcome measure that quantifies the visual benefits from cataract surgery. The purpose of this study was to translate and adapt the Catquest-9SF questionnaire for France, to assess its psychometric properties via Rasch analysis, and to assess its validity when completed using an electronic notepad. Methods The Catquest-9SF questionnaire was translated following the guidelines of the International Society for Pharmacoeconomics and Outcomes Research. Catquest-9SF and clinical data were collected from patients before and after routine cataract surgery. All questionnaire data were collected via an electronic notepad. Rasch analysis was performed to assess psychometric properties, and sensitivity to change was analysed for patients with complete paired pre- and post-operative questionnaires. Results A complete filled-in preoperative questionnaire was obtained for 848 patients. Rasch analysis showed good precision (person separation: 2.32, person reliability: 0.84), ordered category probability curves, no item misfit, and unidimensionality. The respondents were slightly more able than the level of item difficulty (targeting: −1.12 logits). Sensitivity was analysed on 211 paired questionnaires, and the postoperative questionnaires showed a clear ceiling effect. The effect size was 2.6. The use of an electronic notepad for completing the questionnaire worked out very well after some adjustments. Conclusions The French version of Catquest-9SF has good psychometric properties and is suitable for use in French-speaking patients. The use of the Catquest-9SF questionnaire in an electronic format showed good validity.

scholarly journals The Group Nurturance Inventory — initial psychometric evaluation using Rasch and factor analysis

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Magnus Johansson ◽  
Anthony Biglan
Keyword(s):  
Factor Analysis ◽  
Rasch Analysis ◽  
Protective Factor ◽  
Group Development ◽  
Psychometric Evaluation ◽  
Psychological Flexibility ◽  
Well Being ◽  
Measurement Precision ◽  
Assessment Instrument ◽  
Measurement Properties

Abstract Background This paper describes the development and psychometric evaluation of a behavioral assessment instrument primarily intended for use with workgroups in any type of organization. The instrument was developed based on the Nurturing Environments framework which describes four domains important for health, well-being, and productivity; minimizing toxic social interactions, teaching and reinforcing prosocial behaviors, limiting opportunities for problem behaviors, and promoting psychological flexibility. The instrument is freely available to use and adapt under a CC-BY license and intended as a tool that is easy for any group to use and interpret to identify key behaviors to improve their psychosocial work environment. Methods Questionnaire data of perceived frequency of behaviors relevant to nurturance were collected from nine different organizations in Sweden. Data were analyzed using confirmatory factor analysis, Rasch analysis, and correlations to investigate relationships with relevant workplace measures. Results The results indicate that the 23-item instrument is usefully divided in two factors, which can be described as risk and protective factors. Toxic social behaviors make up the risk factor, while the protective factor includes prosocial behavior, behaviors that limit problems, and psychological flexibility. Rasch analysis showed that the response categories work as intended for all items, item fit is satisfactory, and there was no significant differential item functioning across age or gender. Targeting indicates that measurement precision is skewed towards lower levels of both factors, while item thresholds are distributed over the range of participant abilities, particularly for the protective factor. A Rasch score table is available for ordinal to interval data transformation. Conclusions This initial analysis shows promising results, while more data is needed to investigate group-level measurement properties and validation against concrete longitudinal outcomes. We provide recommendations for how to work in practice with a group based on their assessment data, and how to optimize the measurement precision further. By using a two-dimensional assessment with ratings of both frequency and perceived importance of behaviors the instrument can help facilitate a participatory group development process. The Group Nurturance Inventory is freely available to use and adapt for both commercial and non-commercial use and could help promote transparent assessment practices in organizational and group development.

Sign in / Sign up

Export Citation Format

Share Document