scholarly journals Psychometric properties of an instrument 3: convergent, discriminant, known-groups, and criterion validity

2021 ◽  
Vol 27 (3) ◽  
pp. 176-179
Author(s):  
Eun-Hyun Lee

Before evaluating convergent, discriminant, and known-groups validity, it is suggested to design an instrument that reflects hypothetical relationships or differences with other comparator instruments or groups. For criterion validity, a gold-standard instrument measuring the same construct should be carefully selected.

Author(s):  
Ling-Yu Guo ◽  
Phyllis Schneider ◽  
William Harrison

Purpose This study provided reference data and examined psychometric properties for clausal density (CD; i.e., number of clauses per utterance) in children between ages 4 and 9 years from the database of the Edmonton Narrative Norms Instrument (ENNI). Method Participants in the ENNI database included 300 children with typical language (TL) and 77 children with language impairment (LI) between the ages of 4;0 (years;months) and 9;11. Narrative samples were collected using a story generation task, in which children were asked to tell stories based on six picture sequences. CD was computed from the narrative samples. The split-half reliability, concurrent criterion validity, and diagnostic accuracy were evaluated for CD by age. Results CD scores increased significantly between ages 4 and 9 years in children with TL and those with LI. Children with TL produced higher CD scores than those with LI at each age level. In addition, the correlation coefficients for the split-half reliability and concurrent criterion validity of CD scores were all significant at each age level, with the magnitude ranging from small to large. The diagnostic accuracy of CD scores, as revealed by sensitivity, specificity, and likelihood ratios, was poor. Conclusions The finding on diagnostic accuracy did not support the use of CD for identifying children with LI between ages 4 and 9 years. However, given the attested reliability and validity for CD, reference data of CD from the ENNI database can be used for evaluating children's difficulties with complex syntax and monitoring their change over time. Supplemental Material https://doi.org/10.23641/asha.13172129


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Antonio Hernández-Martínez ◽  
Sergio Martínez-Vázquez ◽  
Julian Rodríguez-Almagro ◽  
Khalid Saeed Khan ◽  
Miguel Delgado-Rodríguez ◽  
...  

AbstractTo determine the psychometric properties of the Perinatal Post-Traumatic Stress Disorder (PTSD) Questionnaire (PPQ) in Spanish. A cross-sectional study of 432 Spanish puerperal women was conducted, following ethical approval. The PPQ was administered online through midwives' associations across Spain. The Edinburgh Postnatal Depression Scale was used to diagnose postnatal depression for examining criterion validity. Data were collected on sociodemographic, obstetric, and neonatal variables. An exploratory factorial analysis (EFA) was performed with convergence and criterion validation. Internal consistency was evaluated using Cronbach's α. The EFA identified three components that explained 63.3% of variance. The PPQ's convergence validation associated the risk of PTSD with variables including birth plan, type of birth, hospital length of stay, hospital readmission, admission of the newborn to care unit, skin-to-skin contact, maternal feeding at discharge, maternal perception of partner support, and respect shown by healthcare professionals during childbirth and puerperium. The area under the ROC curve for the risk of postnatal depression (criterion validity) was 0.86 (95% CI 0.82–0.91). Internal consistency with Cronbach's α value was 0.896. The PPQ used when screening for PTSD in postpartum Spanish women showed adequate psychometric properties.


2001 ◽  
Vol 11 ◽  
pp. 1-20 ◽  
Author(s):  
Andrew J. Martin

This paper assesses the psychometric properties of the Student Motivation Scale, an instrument measuring school students' motivation. Motivation is assessed through nine measures, separated into what are referred to as boosters and guzzlers. Boosters are constructs that reflect adaptive motivation and guzzlers are constructs that reflect less adaptive motivation. Boosters are subsumed by thoughts (self-belief, learning focus, value of schooling) and behaviours (persistence and planning and monitoring). Guzzlers are subsumed by thoughts or feelings (low control and anxiety) and behaviours (avoidance and self-sabotage). Data show that the Student Motivation Scale has a clear factor structure reflecting the hypothesised five boosters and four guzzlers, is reliable, and correlated with achievement. Gender and year level differences also emerge: girls are significantly more learning focused and engage in more planning and monitoring than boys; girls are significantly more anxious than boys; Year 9 students are significantly lower than Year 10 and Year 11 students in learning focus, significantly higher than Year 11 students in avoidance, and significantly higher than Year 10 and Year 11 students in self-sabotage. Strategies for intervention are discussed in the context of these findings and the issue of academic resilience is introduced as an additional aspect of motivation that the Student Motivation Scale is able to assess.


2021 ◽  
Author(s):  
Gwendolyn Mayer ◽  
Svenja Hummel ◽  
Nadine Gronewold ◽  
Oetjen Neele ◽  
Thomas Hilbel ◽  
...  

BACKGROUND E-mental-health applications targeting at depression and anxiety have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental-health apps. The app SELFPASS (Self-administered-Psycho-TherApy-SystemS) is a self-management app to manage depressive and anxious symptoms. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been tested. OBJECTIVE The aim of this study is to investigate the validity and reliability of the SELFPASS item pool that has been developed for an internet-based daily self-assessment of depressive and anxious symptoms. METHODS An online link with the SELFPASS item pool and validated mood assessment scales were distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). The reliability was examined using Cronbach’s α. The construct validity was assessed via Pearson correlations with the Patients Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7) and the WHO-5-Wellbeing-Scale (WHO-5). A logistic regression was performed as an indicator for concurrent criterion validity of SP-D and SP-A. A factor analysis provides information about the underlying factor structure of the item pool. Item-scale-correlations were calculated in order to determine item quality. RESULTS A total of n=284 participants were included, with n=192 (67.6%) healthy subjects and n=92 (32.4%) patients. Cronbach’s α was α=0.94 for SP-D and α=0.88 for SP-A. We found significant positive correlations of SP-D and PHQ-9 (r=0.87, P<.001), SP-A and GAD-7 (r=0.80, P<.001), and negative correlations of SP-D and WHO-5 (r=-0.80, P<.001) and SP A and WHO-5 (r=-.69, P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: OR=1.03 (1.01 – 1.05), P<.001; SP-A: 1.05 (1.05 – 1.01), P=.01). The item pool showed two factors with one that consisted of mood-related items and another factor with somatic-related items. CONCLUSIONS The SELFPASS item pool showed good psychometric properties in terms of reliability, construct and criterion validity. However, the underlying factor structure could not be reduced to the two diagnostic categories depression and anxiety, but to a more mood related and a rather somatic factor. Few items should be replaced for future use.


2017 ◽  
Vol 9 (3) ◽  
pp. 21 ◽  
Author(s):  
Sofia von Humboldt ◽  
Isabel Leal

Objectives: Literature suggests some inconsistent results in the validity and reliability of the Satisfaction with Life Scale (SwLS) in older samples. The objective was to evaluate the psychometric properties of the SwLS in a cross-cultural sample of older adults.Methods: This is a validation study to assess the psychometric properties of the SWLS in a sample of 1291 older adults 75 years of age or older, cross-culturally diverse and living in the community. A confirmatory factor analysis was performed. Item analysis and reliability, were also assessed.Results: The systematic procedure used in the SwLS validation points to a good level of psychometric properties, such as reliability, construct, criterion validity, external validity and divergent criterion validity, suggesting that the SwL is assessing a construct different from the ones evaluated by PANAS and OtLQ.Conclusion: The SwLS has demonstrated reliability, validity, and reproducibility for use in measuring health-related satisfaction with life among older adults in policy programs and interventions in community settings.


2019 ◽  
Vol 10 ◽  
Author(s):  
Shuqun Yan ◽  
Yuting Feng ◽  
Yaoshan Xu ◽  
Yongjuan Li

2019 ◽  
Vol 10 ◽  
Author(s):  
Viktorija Cepukiene

AbstractThis article presents the development of an instrument measuring relationship satisfaction, based on the theory that separates ‘relationship quality’ from ‘satisfaction’ concerning the semantic meaning of the concepts, and to evaluate psychometric properties of the new measure. Two studies were conducted in order to investigate the psychometric properties of the new scale, with 372 and 1,185 participants taking part in Study 1 and Study 2 respectively. Results revealed that the new scale has two-factor structure, adequate internal consistency reliability, and convergent, discriminant and known-groups validity.


Sign in / Sign up

Export Citation Format

Share Document