The Toileting Habit Profile Questionnaire (THPQ): Examining Construct Validity Using the Rasch Model

Background: The BETA nursing measure has been introduced as a tool to routinely measure and monitor the outcomes of patients' activities of daily living in a restorative nursing care context.Objectives: To investigate the BETA's construct validity using the Rasch model with specific reference to the BETA's potential to be used as an interval scale providing metric or interval data.Method: A quantitative analytical design was followed using Rasch analyses whereby BETA raw data was collected from patients (n = 4235) receiving nursing care in 28 South African sub-acute and non-acute nursing facilities. The data was prepared for Rasch analyses and imported into WINSTEP® Software version 3.70.1.1 (2010). Final results were shown by means of figures and graphs.Results: A successful outcome was achieved by dividing the BETA into four subscales. In this process one of the original BETA items was omitted and seven other items required collapsing of their categories before the four subscales achieved a satisfactory fit to the Rasch model.Conclusion: The four BETA subscales achieved “very well” to “excellent” levels of fit to the Rasch model. This finding thus creates an opportunity to convert the BETA's Likert qualities into an interval measure to calculate change in patients' activities of daily living metric allyas a direct result of effective restorative nursing.

Download Full-text

Examination of validity, reliability, and interpretability of a self-reported questionnaire on Occupational Balance in Informal Caregivers (OBI-Care) – A Rasch analysis

PLoS ONE ◽

10.1371/journal.pone.0261815 ◽

2021 ◽

Vol 16 (12) ◽

pp. e0261815

Author(s):

Anna Röschel ◽

Christina Wagner ◽

Mona Dür

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Rasch Model ◽

Informal Caregivers ◽

Measurement Properties ◽

German Version ◽

Person Separation Index ◽

Separation Index ◽

Item Fit ◽

The Rasch Model

Objectives Informal caregivers often experience a restriction in occupational balance. The self-reported questionnaire on Occupational Balance in Informal Caregivers (OBI-Care) is a measurement instrument to assess occupational balance in informal caregivers. Measurement properties of the German version of the OBI-Care had previously been assessed in parents of preterm infants exclusively. Thus, the aim of this study was to examine the measurement properties of the questionnaire in a mixed population of informal caregivers. Methods A psychometric study was conducted, applying a multicenter cross-sectional design. Measurement properties (construct validity, internal consistency, and interpretability) of each subscale of the German version of the OBI-Care were examined. Construct validity was explored by assessing dimensionality, item fit and overall fit to the Rasch model, and threshold ordering. Internal consistency was examined with inter-item correlations, item-total correlations, Cronbach’s alpha, and person separation index. Interpretability was assessed by inspecting floor and ceiling effects. Results A total of 196 informal caregivers, 171 (87.2%) female and 25 (12.8%) male participated in this study. Mean age of participants was 52.27 (±12.6) years. Subscale 1 was multidimensional, subscale 2 and subscale 3 were unidimensional. All items demonstrated item fit and overall fit to the Rasch model and displayed ordered thresholds. Cronbach’s Alpha and person separation index values were excellent for each subscale. There was no evidence of ceiling or floor effects. Conclusions We identified satisfying construct validity, internal consistency, and interpretability. Thus, the findings of this study support the application of the German version of the OBI-Care to assess occupational balance in informal caregivers.

Download Full-text

Evaluating Construct Validity and Reliability of Intention to Transfer Training Conduct Instrument Using Rasch Model Analysis

Pertanika Journal of Social Sciences and Humanities ◽

10.47836/pjssh.29.2.17 ◽

2021 ◽

Vol 29 (2) ◽

Author(s):

Shaliza Shafie ◽

Faizah Abd Majid ◽

Teoh Sian Hoon ◽

Siti Maftuhah Damio

Keyword(s):

Construct Validity ◽

Rasch Model ◽

Mean Square ◽

Validity And Reliability ◽

Self Assessment ◽

New Instrument ◽

Transfer Training ◽

Point Measure ◽

The Impact ◽

The Rasch Model

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.

Download Full-text

Construct Validity of the Sensory Integration and Praxis Tests

The Occupational Therapy Journal of Research ◽

10.1177/153944929601600201 ◽

1996 ◽

Vol 16 (2) ◽

pp. 75-97 ◽

Cited By ~ 20

Author(s):

Jin-Shei Lai ◽

Anne G. Fisher ◽

Lívia C. Magalhães ◽

Anita C. Bundy

Keyword(s):

Construct Validity ◽

Rasch Model ◽

Sensory Integration ◽

Goodness Of Fit ◽

The United States ◽

Future Research ◽

Motor Tasks ◽

The Hierarchical Structure ◽

The Rasch Model ◽

Developmental Dyspraxia

The purpose of this study was to examine the construct validity of the praxis tests of the Sensory Integration and Praxis Tests (SIPT) and to determine whether the practic component of sensory integration-based developmental dyspraxia is a unitary or a multidimensional disorder. Developmental dyspraxia is an impaired ability to plan and execute skilled or nonhabitual motor tasks; however, its underlying cause, or even whether praxis is a unitary or multidimensional function, is not yet clarified. In this study, the Rasch model of measurement (Linacre, 1989; Wright & Masters, 1982; Wright & Stone, 1979) was used to explore the underlying construct of developmental dyspraxia. The Rasch model was chosen because its use enabled us to (a) confirm goodness-of-fit of individual items within SIPT praxis tests and (b) examine the hierarchical structure of item difficulties. The data included the raw scores of the SIPT praxis tests of 210 subjects from Canada and the United States. The results of the Rasch analyses revealed that each of these five SIPT praxis tests measures a single, unidimensional construct. When the items from the five tests were combined to create a single 117-item test, the items continued to define a single practic function. This indicates that a unitary practic component underlies both bilateral integration and sequencing deficits and somatodyspraxia. Finally, examination of the hierarchy of item difficulties resulted in recommendations for the development of a single screening test for developmental dyspraxia. The implications of these results for clinical practice and future research are discussed.

Download Full-text

Rasch Model of the COVID-19 Symptom Checklist—A Psychometric Validation Study

Viruses ◽

10.3390/v13091762 ◽

2021 ◽

Vol 13 (9) ◽

pp. 1762

Author(s):

Tanja A. Stamm ◽

Valentin Ritschl ◽

Maisa Omara ◽

Margaret R. Andrews ◽

Nils Mevenkamp ◽

...

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Rasch Model ◽

Pollen Allergy ◽

Measurement Model ◽

Psychometric Validation ◽

Symptom Checklist ◽

Personal Factors ◽

Specific Symptom ◽

The Rasch Model

While self-reported Coronavirus Disease 2019 (COVID-19) symptom checklists have been extensively used during the pandemic, they have not been sufficiently validated from a psychometric perspective. We, therefore, used advanced psychometric modelling to explore the construct validity and internal consistency of an online self-reported COVID-19 symptom checklist and suggested adaptations where necessary. Fit to the Rasch model was examined in a sample of 1638 Austrian citizens who completed the checklist on up to 20 days during a lockdown. The items’ fatigue’, ‘headache’ and ‘sneezing’ had the highest likelihood to be affirmed. The longitudinal application of the symptom checklist increased the fit to the Rasch model. The item ‘cough’ showed a significant misfit to the fundamental measurement model and an additional dependency to ‘dry cough/no sputum production’. Several personal factors, such as gender, age group, educational status, COVID-19 test status, comorbidities, immunosuppressive medication, pregnancy and pollen allergy led to systematic differences in the patterns of how symptoms were affirmed. Raw scores’ adjustments ranged from ±0.01 to ±0.25 on the metric scales (0 to 10). Except for some basic adaptations that increases the scale’s construct validity and internal consistency, the present analysis supports the combination of items. More accurate item wordings co-created with laypersons would lead to a common understanding of what is meant by a specific symptom. Adjustments for personal factors and comorbidities would allow for better clinical interpretations of self-reported symptom data.

Download Full-text

Examining the Original Grasmick Scale

Criminal Justice and Behavior ◽

10.1177/0093854806290071 ◽

2007 ◽

Vol 34 (2) ◽

pp. 157-178 ◽

Cited By ~ 58

Author(s):

George E. Higgins

Keyword(s):

Construct Validity ◽

Rasch Model ◽

Rating Scale ◽

Self Control ◽

Scale Model ◽

Control Scale ◽

Student Sample ◽

College Student Sample ◽

Rasch Rating Scale Model ◽

The Rasch Model

The original Grasmick, Tittle, Bursik, and Arneklev self-control scale is frequently used in self-control theory studies. Examining self-control requires precision in measurement. Using the Rasch rating scale model analysis, the Grasmick et al. scale is evaluated for construct validity in a college student sample. The results show that the 4-point Likert-type format response categories are not suitable for the scale. The distribution of the measures does not align with the distribution of the item measures in the original Grasmick et al. scale. The items do not fit the Rasch model, they do not form a unidimensional trait, and they function differently for males and females. Thus, the original Grasmick et al. scale does not have construct validity. A revised scale is presented that meets the standards of the Rasch model.

Download Full-text

Psychometric properties and construct validity of PLAYself: a self-reported measure of physical literacy for children and youth

Applied Physiology Nutrition and Metabolism ◽

10.1139/apnm-2020-0410 ◽

2020 ◽

Author(s):

Philip Jefferies ◽

Emily Bremer ◽

Tanya Kozera ◽

John Cairney ◽

Dean Kriellaars

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Rasch Model ◽

Classical Test Theory ◽

Test Theory ◽

Children And Youth ◽

Physical Literacy ◽

Internal Reliability ◽

Classical Test ◽

The Rasch Model

PLAYself is a tool designed for self-description of physical literacy in children and youth. We examined the tool using both the Rasch model and Classical Test Theory to explore its psychometric properties. A random selection of 300 children aged 8-14 (47.3% female) from a dataset of 8,513 Canadian children were involved in the Rasch analysis. The three subscales of the measure demonstrated good fit to the Rasch model, satisfying requirements of unidimensionality, having good fit statistics (item and person fit residuals =-.17-1.47) and internal reliability (PSI=.70-.82), and a lack of item bias and problematic local dependency. In a separate comparable sample, 297 children also aged 8-14 (53.9% female) completed the PLAYfun, Physical Self-Description Questionnaire (PSDQ), Physical Activities Measure-Revised (MPAM-R), a physical activity inventory (PLAYinventory), and repeated the PLAYself seven days later. The tests with this sample confirmed test-retest reliability (ICC=.81-.84), and convergent and construct validity consistent with contemporary physical literacy definitions. Overall, the PLAYself demonstrated robust psychometric properties, and is recommended for researchers and practitioners who are interested in assessing self-reported physical literacy. Novelty bullets: • The PLAYself is a self-reported measure of physical literacy • This study validates the measure using the Rasch model and classical test theory • The PLAYself was found to have strong psychometric properties

Download Full-text

The reliability and validity of a scale through the comparison between the traditional method and the Rasch model

Journal of Educational and Psychological Studies [JEPS] ◽

10.24200/jeps.vol5iss1pp22-41 ◽

2011 ◽

Vol 5 (1) ◽

pp. 22

Author(s):

Mikail Ibrahim ◽

Osama Omar M. Elazzabi

Keyword(s):

Construct Validity ◽

Statistical Methods ◽

Internal Consistency ◽

Rasch Model ◽

Content Validity ◽

Traditional Method ◽

Reliability And Validity ◽

External Factors ◽

Standard Errors ◽

The Rasch Model

The present study addressed the issue of reliability and validity of scale through the comparison between the traditional method and the Rasch model, which is seen by statisticians as the best method to psychometrically validate the scale and test its properties. Researchers have demonstrated the failure of traditional statistical methods to take into account the characteristics of the items and people when testing the reliability of the scale as well as respondents. They usually turn to alpha Cronbanch to examine the internal consistency of the scale without taking into consideration that alpha Cronbanch has been affected by external factors such as the length of the scale. However, the Rasch model that is relatively considered to be modern statistics, is not affected by external factors especially the length of the scale, even a short scale might be more reliable than the long one. Moreover, the Rasch model can also be used to investigate various types of validities such as content validity, construct validity, and criterion validity. Interestingly, the Rasch model is also a powerful statistics tool used to determine the contribution of the items and people in the total reliability of the scale. For example, the variable map is used to examine the extent to which the items adequately target the respondents taking into account the difficulty of items and ability of the subjects. Nevertheless, the traditional methods normally calculate the uniqueness of the scale by focusing on the sum of squares and these methods do not offer standard errors for each item to determine the accuracy of the measurement. Hence, the researchers suggested in this paper that favorability of the Rasch model in testing scales’ reliability and validity was recommended compared to conventional statistical methods.

Download Full-text