scholarly journals Psychometric properties of an instrument 2: structural validity, internal consistency, and cross-cultural validity/measurement invariance

2021 ◽  
Author(s):  
Eun-Hyun Lee
Keyword(s):  
Psychometric Properties ◽  
Measurement Invariance ◽  
Internal Consistency ◽  
Cross Cultural ◽  
Structural Validity ◽  
Cultural Validity

scholarly journals Psychometric properties of the patient-reported outcomes measurement information system scale v1.2: global health (PROMIS-GH) in a Dutch general population

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Leonardo Pellicciari ◽  
Alessandro Chiarotto ◽  
Emanuele Giusti ◽  
Martine H. P. Crins ◽  
Leo D. Roorda ◽  
...  
Keyword(s):  
Information System ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Cross Cultural ◽  
Model Fit ◽  
Measurement Information ◽  
Local Independence ◽  
Cultural Validity ◽  
Patient Reported ◽  
Measurement Information System

Abstract Purpose To assess the psychometric properties of the Dutch-Flemish Patient-Reported Outcome Measurement Information System Scale v1.2 – Global Health (PROMIS-GH). Methods The PROMIS-GH (also referred to as PROMIS-10) was administered to 4370 persons from the Dutch general population. Unidimensionality (CFI ≥ 0.95; TLI ≥ 0.95; RMSEA ≤ 0.06; SRMR ≤ 0.08), local independence (residual correlations < 0.20), monotonicity (H > 0.30), model fit with the Graded Response Model (GRM, p < 0.001), internal consistency (alpha > 0.75), precision (total score information across the latent trait), measurement invariance (no Differential Item Functioning [DIF]), and cross-cultural validity (no DIF for language, Dutch vs. United States English) of its subscales, composed of four items each, Global Mental Health (GMH) and Global Physical Health (GPH), were assessed. Results Confirmatory factor analyses, on both subscales, revealed slight departures from unidimensionality for GMH (CFI = 0.98; TLI = 0.95, RMSEA = 0.22; SRMR = 0.04) and GPH (CFI = 0.99; TLI = 0.97; RMSEA = 0.12; SRMR = 0.03). Local independence, monotonicity, GRM model fit, internal consistency, precision and cross-cultural validity were supported. However, Global10 (emotional problems) showed misfit on the GMH subscale, while Global08 (fatigue) presented DIF for age. Conclusion The psychometric properties of the PROMIS-GH in the Dutch population were considered acceptable. Sufficient local independence, monotonicity, GRM fit, internal consistency, measurement invariance and cross-cultural validity were found. If future studies find similar results, structural validity of the GMH could be enhanced by improving or replacing Global10 (emotional problems).

scholarly journals Development and psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form

2020 ◽  
Vol 32 (10) ◽  
pp. 701-707
Author(s):  
Mehtap Akgün ◽  
Selma Turan Kavradim ◽  
İlkay Boz ◽  
Zeynep Özer
Keyword(s):  
Psychometric Properties ◽  
Root Mean Square ◽  
Internal Consistency ◽  
Content Validity ◽  
Assessment Tool ◽  
Short Form ◽  
Mean Square ◽  
Structural Validity ◽  
Caring Behaviors ◽  
Fit Index

Abstract Objectives To develop and examine the psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form (CBAN-SF) based on the Theory of Human Caring to assess the nurses’ perceptions about caring behaviors. Design This study is based on the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. Setting The study was conducted at the medical-surgical services of Akdeniz University Hospital between October 2019 and January 2020. Participants This study was conducted with 216 nurses working in the surgery and internal clinics. Main Outcome Measures Psychometric properties of the Turkish version of the CBAN-SF with 27 items. Results It was found that the Content Validity Index (CVI) for the items of the draft scale was between 0.972 and 1.00 and the instrument’s CVI had an average score of 0.994. The CBAN-SF had good fit indexes (chi-square goodness of fit / degrees of freedom = 2.914, root mean square error of approximation = 0.075, comparative fit index = 0.984, non-normed fit index = 0.983, normed fit index = 0.972 and standardized root mean square residuals = 0.054) in structural validity. For internal consistency, the Cronbach’s alpha, Spearman–Brown and the Guttman split-half coefficients were all 0.974. The Cronbach’s alpha coefficient for the seven subfactors of the scale ranged between 0.793 and 0.904 and had acceptable internal consistency. The item-total score correlation of the scale was 0.648–0.829, and the factor loadings were 0.455–0.769. Conclusion The structural validity, internal consistency and content validity of the CBAN-SF supported to be a reliable and valid tool for assessment of caring behaviors by nurses.

scholarly journals Cross-cultural adaptation of the primary health care satisfaction questionnaire

2014 ◽  
Vol 27 (5) ◽  
pp. 419-426 ◽  
Author(s):  
Elisabete Pimenta Araujo Paz ◽  
Pedro Miguel Santos Dinis Parreira ◽  
Alexandrina de Jesus Serra Lobo ◽  
Rosilene Rocha Palasson ◽  
Sheila Nascimento Pereira de Farias
Keyword(s):  
Primary Care ◽  
Health Care ◽  
Primary Health Care ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Cultural Adaptation ◽  
Care Service ◽  
Cross Cultural ◽  
Care Services ◽  
Primary Health

Objective To develop the cross-cultural validation and assessment of the psychometric properties of the Questionnaire about the quality and satisfaction dimensions of patients with primary health care. Methods Methodological cultural adaptation and assessment study of the psychometric properties, involving 398 users from a primary care service. The construct validity was verified through principal components factor analysis and internal consistency assessment as determined by Cronbach’s alpha, using SPSS. Results A factorial structure was identified that is equivalent to the original instrument, showing six factors that explain 70.81% of the total variance. All internal consistency coefficients were higher than 0.84, indicating appropriate psychometric properties. Conclusion The results show that the Brazilian Portuguese version of the instrument is culturally and linguistically appropriate to assess the satisfaction of users attended in primary care services.

scholarly journals Internal Consistency and Structural Validity of the Norwegian Translation of the Ten-Item Personality Inventory

2021 ◽  
Vol 12 ◽  
Author(s):  
Mikkel Magnus Thørrisen ◽  
Talieh Sadeghi ◽  
Jannecke Wiers-Jenssen
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Factor Model ◽  
Rank Order ◽  
Five Factor Model ◽  
Principal Component ◽  
Cross Sectional Study ◽  
Personality Inventory ◽  
Structural Validity ◽  
Cross Sectional

Background: The Ten-Item Personality Inventory (TIPI) is a validated brief instrument measuring the five-factor model (FFM) personality dimensions, developed for instances where more comprehensive FFM instruments are impractical to use. The TIPI has been translated into several languages, but psychometric properties of the Norwegian version (N-TIPI) have not been systematically explored.Objectives: This study aimed to explore the psychometric properties of the N-TIPI, in terms of internal consistency and structural validity.Methods: In a cross-sectional study, responses on the N-TIPI were collected from 5,009 Norwegian master graduates. Descriptive statistics for the subscales and correlations between subscales were calculated. Internal consistency was assessed with inter-item correlations, Cronbach’s α and Spearman-Brown coefficients. Structural validity was explored with principal component analysis, parallel analysis, and visual scree plot inspection. Results for the N-TIPI were compared with those previously reported for the original TIPI as well as the German, French, Spanish, and Portuguese versions.Results: Compared with the original and non-English versions of TIPI, results for N-TIPI showed comparable subscale rank order of means, standard deviations, and pattern of correlations between subscales, as well as inter-item correlations and Cronbach’s α. The 10 N-TIPI items were adequately reduced to five components, theoretically corresponding with the FFM personality domains.Conclusion: The N-TIPI demonstrated acceptable internal consistency and satisfactory structural validity. Although further research is warranted, the instrument stands out as feasible when it is essential to minimize participants’ response burden in studies that aim to explore personality as one among several concepts or utilize personality traits as covariates.

scholarly journals Hidden Invalidity Among 15 Commonly Used Measures in Social and Personality Psychology

2020 ◽  
Vol 3 (2) ◽  
pp. 166-184 ◽  
Author(s):  
Ian Hussey ◽  
Sean Hughes
Keyword(s):  
Measurement Invariance ◽  
Internal Consistency ◽  
Degrees Of Freedom ◽  
Self Report ◽  
Structural Validity ◽  
Data Set ◽  
Personality Psychology ◽  
Reliability Factor ◽  
And Gender ◽  
Gender Groups

It has recently been demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We comprehensively assessed structural validity in a uniquely large and varied data set ( N = 144,496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures ( k = 15 questionnaires, 26 scales) in social and personality psychology. When the scales were assessed using the modal practice of considering only internal consistency, 88% of them appeared to possess good validity. Yet when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for age and gender groups), only 4% demonstrated good validity. Furthermore, the less commonly a test was reported in the literature, the more likely the scales were to fail that test (e.g., scales failed measurement invariance much more often than internal consistency). This suggests that the pattern of underreporting in the field may represent widespread hidden invalidity of the measures used and may therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity and introduce the concept of validity hacking ( v-hacking), similar to the better-known concept of p-hacking. We argue that the practice of v-hacking should be acknowledged and addressed.

scholarly journals Cross-cultural adaptation and psychometric validation of the Persian version of the Cardiac Rehabilitation Barriers Scale (CRBS-P)

BMJ Open ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. e034552
Author(s):  
Mahdieh Ghanbari-Firoozabadi ◽  
Masoud Mirzaei ◽  
Mohammadreza Vafaii Nasab ◽  
Sherry L Grace ◽  
Hassan Okati-Aliabad ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Cardiac Rehabilitation ◽  
Internal Consistency ◽  
Goodness Of Fit ◽  
Cross Cultural ◽  
Psychometric Validation ◽  
Structural Validity ◽  
Retest Reliability ◽  
Persian Version ◽  
Test Retest Reliability

ObjectivesThis study aimed to translate, cross-culturally adapt and psychometrically validate a Persian version of the Cardiac Rehabilitation Barriers Scale (CRBS-P) and to identify the main barriers in an Iranian setting.SettingAfshar cardiac rehabilitation (CR) centre, affiliated with the Yazd University of Medical Sciences, in the centre of Iran.DesignThis was a multimethod study, culminating in a cross-sectional survey.ParticipantsInpatient CR graduates who did not attend their initial outpatient CR appointment.MethodThe 21-item CRBS was translated and cross-culturally adapted in accordance with best practices; an expert panel considered the items and previous non-attending patients were interviewed via phone to refine the scale. Next, structural validity was assessed; participants were invited to complete the CRBS on the phone between March 2017 and February 2018. Using exploratory factor analysis (EFA) with principal component analysis extraction and oblique rotation. Second, confirmatory factor analysis (CFA) was used to verify the results; several goodness-of-fit indices were considered. The internal consistency and 3-week test–retest reliability of the scale (5% subsample) were evaluated using Cronbach’s α and intraclass correlation (ICC), respectively.ResultsFace, content and cross-cultural validity were established by the experts and patients (n=50). One thousand and one hundred (40.7%) of the 2700 patients completed the CRBS-P. Structural validity was established by EFA (Bartlett’s test p<0.001; =0.759) and confirmed by the CFA; a four-factor solution with 18 items accounting for 61.256% of variance had the best fit (χ2/df=3.206, root mean square error of approximation=0.061 and Comparative Fit Index=0.959). The internal consistency and test–retest reliability (n=42) of the scale were acceptable (ICC=0.743 95% CI (0.502 to 0.868); overall α=0.797). The top barriers were not knowing about CR, cost and lack of encouragement from physicians.ConclusionThe four-factor, 18-item CRBS-P had good psychometric properties, and hence can be reliably and validly used to measure CR barriers in Iran and other Persian-speaking populations.

Cross-cultural adaptation and validation of the VISA-P questionnaire for Portuguese-speaking (Portugal) patients with patellar tendinopathy

2020 ◽  
Vol 30 (Supplement_2) ◽  
Author(s):  
P Chaves ◽  
D Ribeiro ◽  
J Gomes ◽  
M Monteiro ◽  
S Marote ◽  
...  
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Important Change ◽  
Cross Cultural ◽  
Clinical Severity ◽  
Patellar Tendinopathy ◽  
Expert Committee ◽  
Functional Evaluation ◽  
Minimum Interval

Abstract Introduction Patellar tendinopathy is a condition frequently verified in individuals who practice regular physical activity, therefore functional evaluation is crucial to monitor symptoms. The VISA-P was developed for English-speaking population to evaluate patients with this condition, and there is a need to adapt this tool to Portuguese (Portugal). Objectives To cross-cultural adapt and validate the VISA-P questionnaire for Portuguese-speaking (Portugal) patellar tendinopathy patients Methodology The VISA-P questionnaire was translated and cross-culturally adapted into Portuguese (VISA-P-Por) according to specific guidelines, using six steps: Translation, synthesis, back translation, expert committee review, pretesting (n = 10), and appraisal of the adaptation process. The resulting VISA-P-Por was then subjected to an analysis of the psychometric properties (construct validity, reproducibility [agreement and reliability], internal consistency and floor and ceiling effects) in 73 patellar tendinopathy patients and 73 asymptomatic people. Participants completed the questionnaire at baseline and after a minimum interval of 48 hours. Results The Visa-P-Por questionnaire revealed a high level of agreement, presenting semantic and content validity. Construct validity showed differences between both groups (p &lt; 0,001) and the questionnaire exhibited very good internal consistency, with an excellent α Cronbach (0,91). Concerning reproducibility, agreement levels were considered optimal which can be proven by the Bland Altman graph, the standard error of measurement (5,74) and the minimally important change (15,91 points), as well as the excellent ICC value (0,92). There were no ceiling and floor effects detected. Conclusion The VISA-P-Por questionnaire is a valid and reliable tool, with psychometric properties comparable with the original version. Thus, it can be recommended as a robust tool for measuring clinical severity and functional impact of patellar tendinopathy in Portuguese-speaking (Portugal) patients.

VALIDATION OF THE EP4 NEUROTICISM SUBSCALES USING A JAPANESE SAMPLE

1995 ◽  
Vol 23 (2) ◽  
pp. 131-136 ◽  
Author(s):  
Robert Loo
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Cross Cultural ◽  
Eysenck Personality Questionnaire ◽  
Personality Questionnaire ◽  
Dual Nature ◽  
Social Sensitivity ◽  
Japanese Sample

Recently, researchers have been examining the structure of the Neuroticism (N) scale in the Eysenck Personality Questionnaire (EPQ). Several have proposed that the N scale reflects two distinct components. The purpose of the present study was to provide a cross-cultural examination of the dual nature of the EPQ's N scale using a sample of 246 Japanese undergraduates. This study found support for Roger and Morris' (1991) position that the N scale reflects a “Social Sensitivity” and a “Moodiness” component. There was also some support for Francis' (1993) sex-related component (N-S) but not the sex-free component (N-A). Concerns were raised over the psychometric properties of the scale especially the internal consistency reliability.

Sign in / Sign up

Export Citation Format

Share Document