Development and psychometric testing of an instrument to assess psychosocial determinants of sleep hygiene practice

This study examined the psychometric properties of a newly developed instrument to assess psychosocial determinants of sleep hygiene. Baseline data ( n = 160) from an m-health physical activity and sleep intervention were analyzed to examine scale validity. Additional participants ( n = 20) were recruited to compute test–retest reliability. Four of seven constructs correlated significantly with sleep hygiene practice ( r = −0.17 to −0.36). The scales generally displayed unidimensional component structures. Internal consistency was good to excellent ( α = 0.76–0.92). Test–retest reliability was good to excellent (ICC = 0.61–0.84). Though satisfactory, these findings warrant replication in larger samples.

Download Full-text

Validation of the Beliefs of Physical Activity among Clergy (B-PAC) Instrument

American Journal of Health Studies ◽

10.47779/ajhs.2017.91 ◽

2017 ◽

Vol 32 (2) ◽

Author(s):

Shannon Gwin ◽

Paul Branscum ◽

E. Laurette Taylor

Keyword(s):

Physical Activity ◽

Factor Analysis ◽

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Internal Consistency Reliability ◽

Retest Reliability ◽

Reliable Instrument ◽

The Stability ◽

Test Retest Reliability

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.

Download Full-text

A Short Version of the Physical Activity Enjoyment Scale: Development and Psychometric Properties

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182111035 ◽

2021 ◽

Vol 18 (21) ◽

pp. 11035

Author(s):

Cheng Chen ◽

Susanne Weyland ◽

Julian Fritsch ◽

Alexander Woll ◽

Claudia Niessner ◽

...

Keyword(s):

Physical Activity ◽

Factor Analysis ◽

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Concurrent Validity ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability ◽

Activity Enjoyment

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.

Download Full-text

Reliability and validity of the Persian version of 5-D itching scale among patients with chronic kidney disease

BMC Nephrology ◽

10.1186/s12882-020-02220-x ◽

2021 ◽

Vol 22 (1) ◽

Author(s):

Amin Kordi Yoosefinejad ◽

Fatemeh Karjalian ◽

Marzieh Momennasab ◽

Shahrokh Ezzatzadegan Jahromi

Keyword(s):

Chronic Kidney Disease ◽

Kidney Disease ◽

Psychometric Properties ◽

Internal Consistency ◽

Reliability And Validity ◽

Hemodialysis Patients ◽

Life Questionnaire ◽

Retest Reliability ◽

Persian Version ◽

Test Retest Reliability

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.

Download Full-text

Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

BMC Medical Education ◽

10.1186/s12909-020-02437-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Liyuan Cui ◽

Yaxin Zhu ◽

Jinglou Qu ◽

Liming Tie ◽

Ziqi Wang ◽

...

Keyword(s):

Factor Analysis ◽

Critical Thinking ◽

Medical Students ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Retest Reliability ◽

Critical Thinking Disposition ◽

Thinking Disposition ◽

Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Download Full-text

Psychometric properties of instruments to measure parenting practices and children’s movement behaviors in low-income families from Brazil

BMC Medical Research Methodology ◽

10.1186/s12874-021-01320-y ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Widjane Sheila Ferreira Goncalves ◽

Rebecca Byrne ◽

Pedro Israel Cabral de Lira ◽

Marcelo Tavares Viana ◽

Stewart G. Trost

Keyword(s):

Physical Activity ◽

Internal Consistency ◽

Screen Time ◽

Parenting Practices ◽

Concurrent Validity ◽

Retest Reliability ◽

Culturally Adapted ◽

Total Movement ◽

Objectively Measured ◽

Test Retest Reliability

Abstract Background Childhood obesity has increased remarkably in low and middle-income (LMIC) countries. Movement behaviors (physical activity, screen time, and sleep) are crucial in the development of overweight and obesity in young children. Yet, few studies have investigated the relationship between children’s movement behaviors and parenting practices because validated measures for use among families from LMIC are lacking. This study evaluated the psychometric properties of previously validated measures of young children’s physical activity, screen time, and sleep and parenting practices, translated and culturally adapted to Brazilian families. Methods A total of 78 parent-child dyads completed an interviewer-administered survey twice within 7 days. Child physical activity, sedentary time and sleep were concurrently measured using a wrist-worn accelerometer. Internal consistency and test-retest reliability was assessed using McDonald’s Omega and Intraclass Correlation Coefficients (ICC’s). Concurrent validity was evaluated by calculating Spearman correlations between parent reported child behaviors and accelerometer measured behaviors. Results Seventeen of the 19 parenting practices scales exhibited acceptable internal consistency reliability (Ω ≥ 0.70). Test-retest reliability ICC’s were acceptable and ranged from 0.82 - 0.99. Parent reported child physical activity was positively correlated with objectively measured total movement (rho= 0.29 - 0.46, p < .05) and energetic play (rho= 0.29 – 0.40, p < .05). Parent reported child screen time was positively correlated with objectively measured sedentary time; (rho = 0.26, p < .05), and inversely correlated with total movement (rho = - 0.39 – - 0.41, p < .05) and energetic play (rho = - 0.37 – - 0.41, p < .05). Parent reported night-time sleep duration was significantly correlated with accelerometer measured sleep duration on weekdays (rho = 0.29, p < .05), but not weekends. Conclusions Measurement tools to assess children’s movement behaviors and parenting practices, translated and culturally adapted for use in Brazilian families, exhibited acceptable evidence of concurrent validity, internal consistency, and test-retest reliability.

Download Full-text

Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

International Journal of Behavioral Nutrition and Physical Activity ◽

10.1186/s12966-021-01169-w ◽

2021 ◽

Vol 18 (1) ◽

Author(s):

Helmut Schröder ◽

Isaac Subirana ◽

Julia Wärnberg ◽

María Medrano ◽

Marcela González-Gross ◽

...

Keyword(s):

Physical Activity ◽

Predictive Validity ◽

Internal Consistency ◽

Regression Models ◽

Weighted Kappa ◽

Linear Regression Models ◽

Retest Reliability ◽

Activity Unit ◽

Test Retest Reliability ◽

Acceptable Internal Consistency

Abstract Background Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested. Methods A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation. Results The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls. Conclusion The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents. Trial registration Trial registration numberISRCTN34251612.

Download Full-text

Psychometric properties of patient reported outcome (PRO) instruments in patients with small cell lung cancer (SCLC) in RESILIENT part 1.

Journal of Clinical Oncology ◽

10.1200/jco.2021.39.15_suppl.e24027 ◽

2021 ◽

Vol 39 (15_suppl) ◽

pp. e24027-e24027

Author(s):

Jaba Kokhreidze ◽

Veleka Allen ◽

Cristina Ivanescu ◽

Xiaopan Valerie Yao ◽

Bin Zhang ◽

...

Keyword(s):

Lung Cancer ◽

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Life Questionnaire ◽

Retest Reliability ◽

Patient Reported ◽

Eortc Qlq ◽

Test Retest Reliability ◽

Pro Instruments

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]

Download Full-text

The Persian Version of the Fear of Cancer Recurrence Inventory (FCRI): Translation and Evaluation of Its Psychometric Properties

Archives of Breast Cancer ◽

10.32768/abc.201964174-180 ◽

2019 ◽

pp. 174-180

Author(s):

Fatemeh Sadat Bateni ◽

Maryam Rahmatian ◽

Ahmad Kaviani ◽

Sebastian Simard ◽

Mehdi Soleimani ◽

...

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Concurrent Validity ◽

Goodness Of Fit ◽

Cancer Recurrence ◽

Fear Of Cancer Recurrence ◽

Retest Reliability ◽

Persian Version ◽

Fear Of Cancer ◽

Test Retest Reliability

Background: This study aimed to translate and validate the Fear of Cancer Recurrence Inventory (FCRI) questionnaire into Persian and to investigate its psychometric properties. Methods: The FCRI was translated to Persian using a linguistic methodology according to WHO guidelines. A total of 450 breast cancer survivors who had the following inclusion criteria were included: time elapse of more than six months after the treatment prior to the study; absence ofobjective markers of recurrence, fluency in the Persian language, and signing the informed consent. Internal consistency was estimated with Cronbach's α coefficient and test-retest reliability with Interclass correlation. Concurrent validity was estimated through Pearson’s correlation between the FCRI and Hospital Anxiety and Depression Scale (HADS). Principal component analysis (PCA) and confirmatory factor analysis (CFA) were employed to evaluate dimensionality. Results: The Persian version was acceptable for patients. The content validity index (CVI) was 0.80. The instrument had good test-retest reliability (ICC= 0.96) and internal consistency (Cronbach’s α=0.86). PCA and CFA indicated that the factor structure of the Persian version was similar to the original questionnaire and had acceptable goodness of fit. Correlations between the FCRI and HADS was remarkable (r= 0.252 – 0.639), indicating acceptable concurrent validity. Conclusions: The Persian version of FCRI could be considered a good cross-cultural equivalent for the original English version. The questionnaire was a reliable and valid instrument in terms of internal consistency, test-retest reliability, and dimensionality.

Download Full-text

Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

10.31219/osf.io/8ghda ◽

2020 ◽

Cited By ~ 1

Author(s):

Julia Velten ◽

Gerrit Hirschfeld ◽

Milena Meyers ◽

Jürgen Margraf

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Sexual Interest ◽

Intraclass Correlation ◽

Self Report ◽

Clinical Psychologist ◽

Retest Reliability ◽

Absolute Agreement ◽

Test Retest Reliability ◽

Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

Download Full-text

Patient Continuity of Care Questionnaire in a cardiac sample: A Confirmatory Factor Analysis

BMJ Open ◽

10.1136/bmjopen-2020-037129 ◽

2020 ◽

Vol 10 (7) ◽

pp. e037129

Author(s):

Emma Säfström ◽

Lena Nasstrom ◽

Maria Liljeroos ◽

Lena Nordgren ◽

Kristofer Årestedt ◽

...

Keyword(s):

Psychometric Properties ◽

Factor Structure ◽

Continuity Of Care ◽

Internal Consistency ◽

Intraclass Correlation ◽

Evaluation Study ◽

Sampling Procedure ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectiveEven though continuity is essential after discharge, there is a lack of reliable questionnaires to measure and assess patients’ perceptions of continuity of care. The Patient Continuity of Care Questionnaire (PCCQ) addresses the period before and after discharge from hospital. However, previous studies show that the factor structure needs to be confirmed and validated in larger samples, and the aim of this study was to evaluate the psychometric properties of the PCCQ with focus on factor structure, internal consistency and stability.DesignA psychometric evaluation study. The questionnaire was translated into Swedish using a forward–backward technique and culturally adapted through cognitive interviews (n=12) and reviewed by researchers (n=8).SettingData were collected in four healthcare settings in two Swedish counties.ParticipantsA consecutive sampling procedure included 725 patients discharged after hospitalisation due to angina, acute myocardial infarction, heart failure or atrial fibrillation.MeasurementTo evaluate the factor structure, confirmatory factor analyses based on polychoric correlations were performed (n=721). Internal consistency was evaluated by ordinal alpha. Test–retest reliability (n=289) was assessed with intraclass correlation coefficient (ICC).ResultsThe original six-factor structure was overall confirmed, but minor refinements were required to reach satisfactory model fit. The standardised factor loadings ranged between 0.68 and 0.94, and ordinal alpha ranged between 0.82 and 0.95. All subscales demonstrated satisfactory test–retest reliability (ICC=0.76–0.94).ConclusionThe revised version of the PCCQ showed sound psychometric properties and is ready to be used to measure perceptions of continuity of care. High ordinal alpha in some subscales indicates that a shorter version of the questionnaire can be developed.

Download Full-text