Examination of validity, reliability, and interpretability of a self-reported questionnaire on Occupational Balance in Informal Caregivers (OBI-Care) – A Rasch analysis

Objectives Informal caregivers often experience a restriction in occupational balance. The self-reported questionnaire on Occupational Balance in Informal Caregivers (OBI-Care) is a measurement instrument to assess occupational balance in informal caregivers. Measurement properties of the German version of the OBI-Care had previously been assessed in parents of preterm infants exclusively. Thus, the aim of this study was to examine the measurement properties of the questionnaire in a mixed population of informal caregivers. Methods A psychometric study was conducted, applying a multicenter cross-sectional design. Measurement properties (construct validity, internal consistency, and interpretability) of each subscale of the German version of the OBI-Care were examined. Construct validity was explored by assessing dimensionality, item fit and overall fit to the Rasch model, and threshold ordering. Internal consistency was examined with inter-item correlations, item-total correlations, Cronbach’s alpha, and person separation index. Interpretability was assessed by inspecting floor and ceiling effects. Results A total of 196 informal caregivers, 171 (87.2%) female and 25 (12.8%) male participated in this study. Mean age of participants was 52.27 (±12.6) years. Subscale 1 was multidimensional, subscale 2 and subscale 3 were unidimensional. All items demonstrated item fit and overall fit to the Rasch model and displayed ordered thresholds. Cronbach’s Alpha and person separation index values were excellent for each subscale. There was no evidence of ceiling or floor effects. Conclusions We identified satisfying construct validity, internal consistency, and interpretability. Thus, the findings of this study support the application of the German version of the OBI-Care to assess occupational balance in informal caregivers.

Download Full-text

Development and validation of a self-reported questionnaire to assess occupational balance in parents of preterm infants

PLoS ONE ◽

10.1371/journal.pone.0259648 ◽

2021 ◽

Vol 16 (11) ◽

pp. e0259648

Author(s):

Mona Dür ◽

Anna Röschel ◽

Christiane Oberleitner-Leeb ◽

Verena Herrmanns ◽

Elisabeth Pichler-Stachl ◽

...

Keyword(s):

Construct Validity ◽

Differential Item Functioning ◽

Preterm Infants ◽

Internal Consistency ◽

Rasch Model ◽

Neonatal Care ◽

Measurement Properties ◽

Cronbach's Alpha ◽

Item Fit ◽

Item Functioning

Background Parents’ meaningful activities (occupations) and occupational balance are relevant to neonatal care. Valid and reliable self-reported measurement instruments are needed to assess parents’ occupational balance and to evaluate occupational balance interventions in neonatal care. The aims of this study were to develop a self-reported questionnaire on occupational balance in informal caregivers (OBI-Care) and to examine its measurement properties including construct validity and internal consistency. Methods and findings A mixed method multicenter study design was employed. Items of the OBI-Care were created with parents of preterm infants based on qualitative research methods. Measurement properties were analyzed with quantitative data of parents of preterm infants. Construct validity was assessed by determining dimensionality, overall and item fit to a Rasch model, differential item functioning and threshold ordering. Internal consistency was examined by determining inter-item and item-total correlations, Cronbach’s alpha and Rasch’s person separation index. Fourteen parents participated in item creation. Measurement properties were explored in data of 304 parents. Twenty-two items, summarized in three subscales were compiled to the OBI-Care. Items showed an overall fit and except one item, an item fit to the Rasch model. There was no evidence of differential item functioning and all items displayed ordered thresholds. Each subscale had good values of person separation indices and Cronbach’s alpha. Conclusions The OBI-Care demonstrates construct validity and internal consistency and is thus a suitable measurement instrument to assess occupational balance of parents of preterm infants in neonatal care. OBI-Care is generic and can be applied in various health care settings.

Download Full-text

Rasch Model of the COVID-19 Symptom Checklist—A Psychometric Validation Study

Viruses ◽

10.3390/v13091762 ◽

2021 ◽

Vol 13 (9) ◽

pp. 1762

Author(s):

Tanja A. Stamm ◽

Valentin Ritschl ◽

Maisa Omara ◽

Margaret R. Andrews ◽

Nils Mevenkamp ◽

...

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Rasch Model ◽

Pollen Allergy ◽

Measurement Model ◽

Psychometric Validation ◽

Symptom Checklist ◽

Personal Factors ◽

Specific Symptom ◽

The Rasch Model

While self-reported Coronavirus Disease 2019 (COVID-19) symptom checklists have been extensively used during the pandemic, they have not been sufficiently validated from a psychometric perspective. We, therefore, used advanced psychometric modelling to explore the construct validity and internal consistency of an online self-reported COVID-19 symptom checklist and suggested adaptations where necessary. Fit to the Rasch model was examined in a sample of 1638 Austrian citizens who completed the checklist on up to 20 days during a lockdown. The items’ fatigue’, ‘headache’ and ‘sneezing’ had the highest likelihood to be affirmed. The longitudinal application of the symptom checklist increased the fit to the Rasch model. The item ‘cough’ showed a significant misfit to the fundamental measurement model and an additional dependency to ‘dry cough/no sputum production’. Several personal factors, such as gender, age group, educational status, COVID-19 test status, comorbidities, immunosuppressive medication, pregnancy and pollen allergy led to systematic differences in the patterns of how symptoms were affirmed. Raw scores’ adjustments ranged from ±0.01 to ±0.25 on the metric scales (0 to 10). Except for some basic adaptations that increases the scale’s construct validity and internal consistency, the present analysis supports the combination of items. More accurate item wordings co-created with laypersons would lead to a common understanding of what is meant by a specific symptom. Adjustments for personal factors and comorbidities would allow for better clinical interpretations of self-reported symptom data.

Download Full-text

The reliability and validity of a scale through the comparison between the traditional method and the Rasch model

Journal of Educational and Psychological Studies [JEPS] ◽

10.24200/jeps.vol5iss1pp22-41 ◽

2011 ◽

Vol 5 (1) ◽

pp. 22

Author(s):

Mikail Ibrahim ◽

Osama Omar M. Elazzabi

Keyword(s):

Construct Validity ◽

Statistical Methods ◽

Internal Consistency ◽

Rasch Model ◽

Content Validity ◽

Traditional Method ◽

Reliability And Validity ◽

External Factors ◽

Standard Errors ◽

The Rasch Model

The present study addressed the issue of reliability and validity of scale through the comparison between the traditional method and the Rasch model, which is seen by statisticians as the best method to psychometrically validate the scale and test its properties. Researchers have demonstrated the failure of traditional statistical methods to take into account the characteristics of the items and people when testing the reliability of the scale as well as respondents. They usually turn to alpha Cronbanch to examine the internal consistency of the scale without taking into consideration that alpha Cronbanch has been affected by external factors such as the length of the scale. However, the Rasch model that is relatively considered to be modern statistics, is not affected by external factors especially the length of the scale, even a short scale might be more reliable than the long one. Moreover, the Rasch model can also be used to investigate various types of validities such as content validity, construct validity, and criterion validity. Interestingly, the Rasch model is also a powerful statistics tool used to determine the contribution of the items and people in the total reliability of the scale. For example, the variable map is used to examine the extent to which the items adequately target the respondents taking into account the difficulty of items and ability of the subjects. Nevertheless, the traditional methods normally calculate the uniqueness of the scale by focusing on the sum of squares and these methods do not offer standard errors for each item to determine the accuracy of the measurement. Hence, the researchers suggested in this paper that favorability of the Rasch model in testing scales’ reliability and validity was recommended compared to conventional statistical methods.

Download Full-text

Measuring Subjective Sleep Quality: A Review

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph18031082 ◽

2021 ◽

Vol 18 (3) ◽

pp. 1082

Author(s):

Marco Fabbri ◽

Alessia Beracci ◽

Monica Martoni ◽

Debora Meneo ◽

Lorenzo Tonetti ◽

...

Keyword(s):

Construct Validity ◽

Sleep Quality ◽

Psychometric Properties ◽

Internal Consistency ◽

Self Report ◽

Measurement Properties ◽

Poor Sleep ◽

Daily Routine ◽

Factorial Structure ◽

Poor Sleep Quality

Sleep quality is an important clinical construct since it is increasingly common for people to complain about poor sleep quality and its impact on daytime functioning. Moreover, poor sleep quality can be an important symptom of many sleep and medical disorders. However, objective measures of sleep quality, such as polysomnography, are not readily available to most clinicians in their daily routine, and are expensive, time-consuming, and impractical for epidemiological and research studies., Several self-report questionnaires have, however, been developed. The present review aims to address their psychometric properties, construct validity, and factorial structure while presenting, comparing, and discussing the measurement properties of these sleep quality questionnaires. A systematic literature search, from 2008 to 2020, was performed using the electronic databases PubMed and Scopus, with predefined search terms. In total, 49 articles were analyzed from the 5734 articles found. The psychometric properties and factor structure of the following are reported: Pittsburgh Sleep Quality Index (PSQI), Athens Insomnia Scale (AIS), Insomnia Severity Index (ISI), Mini-Sleep Questionnaire (MSQ), Jenkins Sleep Scale (JSS), Leeds Sleep Evaluation Questionnaire (LSEQ), SLEEP-50 Questionnaire, and Epworth Sleepiness Scale (ESS). As the most frequently used subjective measurement of sleep quality, the PSQI reported good internal reliability and validity; however, different factorial structures were found in a variety of samples, casting doubt on the usefulness of total score in detecting poor and good sleepers. The sleep disorder scales (AIS, ISI, MSQ, JSS, LSEQ and SLEEP-50) reported good psychometric properties; nevertheless, AIS and ISI reported a variety of factorial models whereas LSEQ and SLEEP-50 appeared to be less useful for epidemiological and research settings due to the length of the questionnaires and their scoring. The MSQ and JSS seemed to be inexpensive and easy to administer, complete, and score, but further validation studies are needed. Finally, the ESS had good internal consistency and construct validity, while the main challenges were in its factorial structure, known-group difference and estimation of reliable cut-offs. Overall, the self-report questionnaires assessing sleep quality from different perspectives have good psychometric properties, with high internal consistency and test-retest reliability, as well as convergent/divergent validity with sleep, psychological, and socio-demographic variables. However, a clear definition of the factor model underlying the tools is recommended and reliable cut-off values should be indicated in order for clinicians to discriminate poor and good sleepers.

Download Full-text

Psychometric Testing of the Spanish Modified Version of the Mini-Suffering State Examination

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph18157821 ◽

2021 ◽

Vol 18 (15) ◽

pp. 7821

Author(s):

Daniel Gutiérrez-Sánchez ◽

Rafael Gómez-García ◽

Isabel María López-Medina ◽

Antonio I. Cuesta-Vargas

Keyword(s):

Internal Consistency ◽

Content Validity ◽

Convergent Validity ◽

Informal Caregivers ◽

Psychometric Testing ◽

Spanish Version ◽

Measurement Properties ◽

Quality Of Dying ◽

State Examination

Background: The mini-suffering state examination is a valid and reliable measure that have been used to assess suffering in patients with advanced cancer. The aim of this study was to carry out a psychometric analysis of the Spanish version of the mini-suffering state examination. Method: A validation study was conducted. Seventy-two informal caregivers of deceased patients in palliative care were included in this study. A psychometric testing of content validity, internal consistency, and convergent validity with the Spanish version of the quality of dying and death questionnaire was performed. Results: The original instrument was modified to be used by informal caregivers. The content validity was acceptable (0.96), and the internal consistency was moderate (α = 0.67). Convergent validity was demonstrated (r = −0.64). Conclusion: The Spanish modified version of the MSSE showed satisfactory measurement properties. The Spanish modified version of MSSE can be useful to facilitate screening, monitor progress, and guide treatment decisions in end-of-life cancer patients.

Download Full-text

Evaluation of Hajj Instrument (HAJI) Psychometric Properties Using Rasch Measurement

Asian Social Science ◽

10.5539/ass.v12n8p212 ◽

2016 ◽

Vol 12 (8) ◽

pp. 212

Author(s):

Muhammad Iqbal Tariq Idris ◽

Abdul Hafidz Omar ◽

Dayang Hjh Tiawa Awang Hj Hamid ◽

Fahmi Bahri Sulaiman

Keyword(s):

Physical Activity ◽

Psychometric Properties ◽

Healthy Eating ◽

Rasch Model ◽

Rasch Measurement ◽

Mental Toughness ◽

Validity And Reliability ◽

Item Fit ◽

The Rasch Model ◽

Physical Care

<p>Hajj Instrument (HAJI) was developed to determine hajj pilgrim’s wellness. This study used Rasch measurement to evaluate the psychometric properties including validity and reliability of the HAJI. The respondents involved in this study were 300 comprised of Malaysian hajj pilgrims. HAJI consists of eight constructs namely physical care, physical activity, healthy eating, knowledge, mental toughness, intrapersonal, interpersonal and relationship with Creator and natures. Validity of each construct and content was determined through dimensionality, item fit and item polarity while the reliability was achieved by administered person and item separation. The results showed that the reliability for both item and person were 0.99 and 0.96 respectively. Besides, there were no items need to be dropped based on PTMEA CORR and INFIT MNSQ results. The study revealed that the items of HAJI fit the Rasch model as well as able to measure hajj pilgrim’s wellness. </p>

Download Full-text

A Rasch-Validated Version of the Upper Extremity Functional Index for Interval-Level Measurement of Upper Extremity Function

Physical Therapy ◽

10.2522/ptj.20130041 ◽

2013 ◽

Vol 93 (11) ◽

pp. 1507-1519 ◽

Cited By ~ 13

Author(s):

Clayon B. Hamilton ◽

Bert M. Chesworth

Keyword(s):

Differential Item Functioning ◽

Upper Extremity ◽

Rasch Model ◽

Rasch Analysis ◽

Measurement Properties ◽

Functional Index ◽

Extremity Function ◽

Item Functioning ◽

Upper Extremity Function ◽

The Rasch Model

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.

Download Full-text

The BETA® nursing measure: Calibrating construct validity with Rasch analyses*

Health SA Gesondheid ◽

10.4102/hsag.v20i1.917 ◽

2015 ◽

Vol 20 (1) ◽

Author(s):

Hendrik J. Loubser ◽

Daleen Casteleijn ◽

Judith C. Bruce

Keyword(s):

Construct Validity ◽

Activities Of Daily Living ◽

Nursing Care ◽

Rasch Model ◽

Daily Living ◽

Successful Outcome ◽

Direct Result ◽

Specific Reference ◽

Rasch Analyses ◽

The Rasch Model

Background: The BETA nursing measure has been introduced as a tool to routinely measure and monitor the outcomes of patients' activities of daily living in a restorative nursing care context.Objectives: To investigate the BETA's construct validity using the Rasch model with specific reference to the BETA's potential to be used as an interval scale providing metric or interval data.Method: A quantitative analytical design was followed using Rasch analyses whereby BETA raw data was collected from patients (n = 4235) receiving nursing care in 28 South African sub-acute and non-acute nursing facilities. The data was prepared for Rasch analyses and imported into WINSTEP® Software version 3.70.1.1 (2010). Final results were shown by means of figures and graphs.Results: A successful outcome was achieved by dividing the BETA into four subscales. In this process one of the original BETA items was omitted and seven other items required collapsing of their categories before the four subscales achieved a satisfactory fit to the Rasch model.Conclusion: The four BETA subscales achieved “very well” to “excellent” levels of fit to the Rasch model. This finding thus creates an opportunity to convert the BETA's Likert qualities into an interval measure to calculate change in patients' activities of daily living metric allyas a direct result of effective restorative nursing.

Download Full-text

The Toileting Habit Profile Questionnaire (THPQ): Examining Construct Validity Using the Rasch Model

American Journal of Occupational Therapy ◽

10.5014/ajot.2019.73s1-po8022 ◽

2019 ◽

Vol 73 (4_Supplement_1) ◽

pp. 7311500055p1

Author(s):

Isabelle Beaudry-Bellefeuille ◽

Shelly Lane ◽

Anita Bundy ◽

Alison Lane ◽

Eduardo Ramos-Polo

Keyword(s):

Construct Validity ◽

Rasch Model ◽

The Rasch Model

Download Full-text

Validation of Instrument on Teaching Practices Among Lecturers at Community Colleges, Yemen

Sains Humanika ◽

10.11113/sh.v9n3-2.1274 ◽

2017 ◽

Vol 9 (3-2) ◽

Author(s):

Samah Ali Mohsen Mofreh ◽

Mohamed Najib Abul Gafar ◽

Abdul Hafidz Hj Omar ◽

Adibah Abdul Latif ◽

Dayang Hjh Tiawa Awg Hj Hamid

Keyword(s):

Community Colleges ◽

Rasch Model ◽

Teaching Practice ◽

Model Analysis ◽

Five Dimensions ◽

Item Fit ◽

Reliability Estimates ◽

The Rasch Model ◽

Polarity Parameters ◽

Item Reliability

This study aims to explore a set of items measuring the lecturers’ teaching practice for developing a true scale of teaching practice. Rasch Model is applied to produce specific measurements on the lecturers’ teaching practice in order to generalize results and inferential studies. The items proved to measure a single dimension of lecturers’ teaching practice. The developed instrument termed LTP covers five dimensions. Construct validity was achieved through the Rasch Model Analysis using the dimensionality, item fit, and item polarity parameters. The reliability of the instrument was achieved by conducting person and item separation analysis, Cronbach alpha, and calculated person and item reliability estimates. The results of Rasch Model Analysis show that the items of LTP fit the model appropriately.

Download Full-text