scholarly journals Assessing construct structural validity of epidemiological measurement tools: a seven-step roadmap

2014 ◽  
Vol 30 (5) ◽  
pp. 927-939 ◽  
Author(s):  
Michael E. Reichenheim ◽  
Yara Hahr M. Hökerberg ◽  
Claudia Leite Moraes
Keyword(s):  
Measurement Errors ◽  
Discriminant Validity ◽  
Latent Trait ◽  
Dimensional Structure ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Structural Validity ◽  
Convergent And Discriminant Validity ◽  
Loading Patterns ◽  
Measurement Tools

Guidelines have been proposed for assessing the quality of clinical trials, observational studies and validation studies of diagnostic tests. More recently, the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative extended those in regards to epidemiological measurement tools in general. Among various facets proposed for assessment is the validity of an instrument’s dimensional structure (or structural validity). The purpose of this article is to extend these guidelines. A seven-step roadmap is proposed to examine (1) the hypothesized dimensional structure; (2) strength of component indicators regarding loading patterns and measurement errors; (3) measurement error correlations; (4) factor-based convergent and discriminant validity of scales; (5) item discrimination and intensity vis-à-vis the latent trait spectrum; and (6) the properties of raw scores; and (7) factorial invariance. The paper also holds that the suggested steps still require debate and are open to refinements.

scholarly journals Refining the assessment of disrupted maternal communication: Using item response models to identify central indicators of disrupted behavior

2017 ◽  
Vol 31 (1) ◽  
pp. 261-277 ◽  
Author(s):  
John D. Haltigan ◽  
Sheri Madigan ◽  
Elisa Bronfman ◽  
Heidi N. Bailey ◽  
Catherine Borland-Kerr ◽  
...  
Keyword(s):  
Item Response ◽  
Discriminant Validity ◽  
Developmental Psychopathology ◽  
Latent Trait ◽  
Maternal Sensitivity ◽  
Coding System ◽  
Infant Attachment ◽  
Irt Models ◽  
Convergent And Discriminant Validity ◽  
Maternal Communication

AbstractThe Atypical Maternal Behavior Instrument for Assessment and Classification (AMBIANCE; Bronfman, Madigan, & Lyons-Ruth, 2009–2014; Bronfman, Parsons, & Lyons-Ruth, 1992–2004) is a widely used and well-validated measure for assessing disrupted forms of caregiver responsiveness within parent–child interactions. However, it requires evaluating approximately 150 behavioral items from videotape and extensive training to code, thus making its use impractical in most clinical contexts. Accordingly, the primary aim of the current study was to identify a reduced set of behavioral indicators most central to the AMBIANCE coding system using latent-trait item response theory (IRT) models. Observed mother–infant interaction data previously coded with the AMBIANCE was pooled from laboratories in both North America and Europe (N = 343). Using 2-parameter logistic IRT models, a reduced set of 45 AMBIANCE items was identified. Preliminary convergent and discriminant validity was evaluated in relation to classifications of maternal disrupted communication assigned using the full set of AMBIANCE indicators, to infant attachment disorganization, and to maternal sensitivity. The results supported the construct validity of the refined item set, opening the way for development of a brief screening measure for disrupted maternal communication. IRT models in clinical scale refinement and their potential for bridging clinical and research objectives in developmental psychopathology are discussed.

scholarly journals Plant Experience Questionnaire (Rioux & Wertz 2021)

2021 ◽  
Author(s):  
camille rioux ◽  
Annie E. Wertz
Keyword(s):  
Early Childhood ◽  
Cultural Transmission ◽  
Discriminant Validity ◽  
Human Cognition ◽  
Dimensional Structure ◽  
Parental Report ◽  
Convergent And Discriminant Validity ◽  
Infancy And Early Childhood ◽  
Age Range ◽  
Experience Questionnaire

A growing body of research investigating plant-related cognition and behaviors demonstrates that plants have shaped human minds and societies and that pursuing empirical research in this area can yield new insights into many aspects of human cognition and development, including food learning, danger avoidance, and cultural transmission. This research would greatly benefit from a validated measure that assesses experience with plants early in life. Here we present the validation of a new measure to assess such experience: The Plant Experience Questionnaire (PEQ), filling a major gap in the literature on plant-related cognition in infancy and early childhood. The PEQ was tested on a sample of 576 caregivers who completed the questionnaire about their child (age = 5-81 months). Factorial analysis revealed a four-dimensional structure of the questionnaire: (1) experience with indoor plants, (2) experience with outdoor plants, (3) eating from plants, and (4) parental prohibition from touching plants. The PEQ displayed good psychometric properties as shown with satisfactory internal consistency and convergent and discriminant validity and is suitable for a broad age range from infancy to early childhood. Therefore, the PEQ is an efficient and valuable tool for assessing plant experience in early life via parental report.

scholarly journals When I don't Like Myself: Portuguese Version of the Internalized Shame Scale

2012 ◽  
Vol 15 (3) ◽  
pp. 1411-1423 ◽  
Author(s):  
Marcela Matos ◽  
José Pinto-Gouveia ◽  
Cristiana Duarte
Keyword(s):  
Internal Consistency ◽  
Discriminant Validity ◽  
Temporal Stability ◽  
Self Esteem ◽  
Self Report ◽  
Dimensional Structure ◽  
Internalized Shame ◽  
Portuguese Version ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

In the past two decades, there has been a growing theoretical and empirical interest on the role of shame, namely internal shame, on the conceptualization of human functioning and several interpersonal and emotional problems. The current study explores the psychometric properties of the Portuguese version of the Internalized Shame Scale (ISS), a self-report measure which assesses trait shame, composed by an Internal Shame subscale, measuring internalized shame, and a Self-Esteem subscale. The factor structure, internal consistency, test-retest reliability and convergent and discriminant validity for both subscales, are presented, in a sample of 385 college students. The Principal Components Analyses reveal that both Internal Shame and Self-Esteem subscales present a one-dimensional structure which explains, respectively, 48.54% and 57.7% of the variance. The subscales present high internal consistency, with high Cronbach'alphas (.95 and .85) and moderate to high item-total correlations. The two subscales present an excellent temporal stability. Convergent and discriminant validity of the subscales was corroborated through the moderate correlations with a measure of shame and of social comparison, and through the low and moderate correlations with the subscales depression, anxiety, and stress. The Portuguese version of the ISS is a valid and reliable instrument to measure internalized shame.

scholarly journals Construct Validity of the Montreal Cognitive Assessment (MoCA)

2011 ◽  
Vol 18 (2) ◽  
pp. 242-250 ◽  
Author(s):  
Sandra Freitas ◽  
Mário R. Simões ◽  
João Marôco ◽  
Lara Alves ◽  
Isabel Santana
Keyword(s):  
Cognitive Assessment ◽  
Discriminant Validity ◽  
Factor Model ◽  
Good Evidence ◽  
Montreal Cognitive Assessment ◽  
Dimensional Structure ◽  
Cognitive Screening ◽  
Good Reliability ◽  
Cognitive Domains ◽  
Convergent And Discriminant Validity

AbstractThe Montreal Cognitive Assessment (MoCA) is a brief instrument developed for the screening of milder forms of cognitive impairment. The present study aims to assess the construct related validity of the MoCA through the establishment of the factorial, convergent, and discriminant related validities, and the reliability of data. In a Portuguese sample of 830 participants, several models were tested using Confirmatory Factor Analysis. Although all tested models showed a good fit, the six-factor model based on the conceptual model proposed by the MoCA's authors showed a significantly better fit. The results allowed us to establish the factorial, convergent, and discriminant validity of this six-dimensional structure. An overall psychometric adequacy of the items, and a good reliability were also found. This study contributes to overcome an important gap in the construct related validity of this instrument. The present findings corroborate the six-dimensional structure of the MoCA and provide good evidence of the construct related validity. The MoCA has proved to be an appropriate measure for cognitive screening taking into account different cognitive domains, which will enable clinicians and researchers to use this test and its six latent dimensions to achieve a better understanding of the individuals’ cognitive profile. (JINS, 2012, 18, 242–250)

scholarly journals Factor Structure, Convergent Validity, and Discriminant Validity of the NIH Toolbox Cognitive Health Battery (NIHTB-CHB) in Adults

2014 ◽  
Vol 20 (6) ◽  
pp. 579-587 ◽  
Author(s):  
Dan Mungas ◽  
Robert Heaton ◽  
David Tulsky ◽  
Philip David Zelazo ◽  
Jerry Slotkin ◽  
...  
Keyword(s):  
Working Memory ◽  
Episodic Memory ◽  
Factor Structure ◽  
Gold Standard ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Dimensional Structure ◽  
Cognitive Health ◽  
Convergent And Discriminant Validity ◽  
Standard Tests

AbstractThe objective of this study is to evaluate the construct validity of the NIH Neurobehavioral Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. Confirmatory factor analysis was used to evaluate the dimensional structure underlying the NIHTB-CHB and Gold Standard tests chosen to serve as concurrent validity criteria for the NIHTB-CHB. These results were used to evaluate the convergent and discriminant validity of the NIHTB-CHB in adults ranging from 20 to 85 years of age. Five dimensions were found to explain the correlations among NIHTB-CHB and Gold Standard tests: Vocabulary, Reading, Episodic Memory, Working Memory and Executive Function/Processing Speed. NIHTB-CHB measures and their Gold Standard analogues defined factors in a pattern that broadly supported the convergent and discriminant validity of the NIHTB-CHB tests. This 5-factor structure was found to be invariant across 20–60 year old (N=159) and 65–85 year old (N=109) age groups that were included in the current validity study. Second order Crystallized Abilities (Vocabulary and Reading) and Fluid Abilities (Episodic Memory, Working Memory, Executive/Speed) factors parsimoniously explained correlations among the five first order factors. These results suggest that the NIHTB-CHB will provide both fine-grained and broad characterization of cognition across the adult age span. (JINS, 2014, 20, 1–9)

What Does the Implicit Association Test Measure? A Test of the Convergent and Discriminant Validity of Prejudice-Related IATs

2002 ◽  
Vol 49 (3) ◽  
pp. 171-180 ◽  
Author(s):  
Bertram Gawronski
Keyword(s):  
Implicit Association Test ◽  
Discriminant Validity ◽  
Association Test ◽  
Recent Criticism ◽  
Implicit Association ◽  
East Asians ◽  
Student Sample ◽  
Convergent And Discriminant Validity ◽  
Explicit Prejudice ◽  
Turkish People

Abstract. Drawing on recent criticism of the Implicit Association Test (IAT), the present study tested the convergent and discriminant validity of two prejudice-related IATs to corresponding explicit prejudice measures in a German student sample (N = 61). Confirming convergent validity, (a) an IAT designed to assess negative associations related to Turkish people was significantly related to the explicit endorsement of prejudiced beliefs about Turkish people, and (b) an IAT designed to assess negative associations related to East Asians was significantly related to explicit prejudice against East Asians. Moreover, confirming discriminant validity, (c) the Asian IAT was unrelated to the explicit endorsement of prejudiced beliefs about Turkish people, and (d) the Turkish IAT was unrelated to explicit prejudice against Asian people. These results further corroborate the assumption that the IAT is a valid method to assess the strength of evaluative associations in the domain of prejudice and stereotypes.

An Initial Investigation of the Use of Comparative Referents to Assess Social Anxiety

2018 ◽  
Vol 34 (6) ◽  
pp. 367-375 ◽  
Author(s):  
Laura D. Seligman ◽  
Erin F. Swedish ◽  
Jason P. Rose ◽  
Jessica M. Baker
Keyword(s):  
Social Anxiety ◽  
Discriminant Validity ◽  
Self Report ◽  
Injunctive Norms ◽  
Good Reliability ◽  
Convergent And Discriminant Validity ◽  
Excellent Internal Consistency ◽  
Social Quality Of Life ◽  
Comparison Measures

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.

Development of the Fear of Intimacy Components Questionnaire (FICQ)

2015 ◽  
Vol 31 (4) ◽  
pp. 302-309 ◽  
Author(s):  
Maria Pedro Sobral ◽  
Maria Emília Costa
Keyword(s):  
Convergent Validity ◽  
Discriminant Validity ◽  
Two Dimensions ◽  
Dimensional Structure ◽  
Future Research ◽  
Fear Of Intimacy ◽  
Confirmatory Factor Analyses ◽  
New Instrument ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.

The Sorting Paired Features Task

2009 ◽  
Vol 56 (5) ◽  
pp. 329-343 ◽  
Author(s):  
Yoav Bar-Anan ◽  
Brian A. Nosek ◽  
Michelangelo Vianello
Keyword(s):  
Discriminant Validity ◽  
Association Measures ◽  
Response Options ◽  
Convergent And Discriminant Validity ◽  
Attitude Measures ◽  
Stimulus Features ◽  
Single Response

The sorting paired features (SPF) task measures four associations in a single response block. Using four response options (e.g., good-Republicans, bad-Republicans, good-Democrats, and bad-Democrats), each trial requires participants to categorize two stimuli at once to a category pair (e.g., wonderful-Clinton to good-Democrats). Unlike other association measures, the SPF requires simultaneous categorization of both components of the association in the same trial. Providing measurement flexibility, it is sensitive to both focal, attended concepts and nonfocal, unattended stimulus features (e.g., gender of individuals in a politics SPF). Three studies measure race, gender, and political evaluations, differentiate automatic evaluations between known groups, provide evidence of convergent and discriminant validity with other attitude measures, and illustrate the SPF’s unique measurement qualities.

Sign in / Sign up

Export Citation Format

Share Document