Whom to trust about what: Criterion validity of trait judgments by source

2014 ◽  
Author(s):  
Andrew Beer
Keyword(s):  
Criterion Validity

Clausal Density Between Ages 4 and 9 Years for the Edmonton Narrative Norms Instrument: Reference Data and Psychometric Properties

2020 ◽  
pp. 1-15
Author(s):  
Ling-Yu Guo ◽  
Phyllis Schneider ◽  
William Harrison
Keyword(s):  
Diagnostic Accuracy ◽  
Psychometric Properties ◽  
Language Impairment ◽  
Reference Data ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Criterion Validity ◽  
Likelihood Ratios ◽  
Generation Task ◽  
Sensitivity Specificity

Purpose This study provided reference data and examined psychometric properties for clausal density (CD; i.e., number of clauses per utterance) in children between ages 4 and 9 years from the database of the Edmonton Narrative Norms Instrument (ENNI). Method Participants in the ENNI database included 300 children with typical language (TL) and 77 children with language impairment (LI) between the ages of 4;0 (years;months) and 9;11. Narrative samples were collected using a story generation task, in which children were asked to tell stories based on six picture sequences. CD was computed from the narrative samples. The split-half reliability, concurrent criterion validity, and diagnostic accuracy were evaluated for CD by age. Results CD scores increased significantly between ages 4 and 9 years in children with TL and those with LI. Children with TL produced higher CD scores than those with LI at each age level. In addition, the correlation coefficients for the split-half reliability and concurrent criterion validity of CD scores were all significant at each age level, with the magnitude ranging from small to large. The diagnostic accuracy of CD scores, as revealed by sensitivity, specificity, and likelihood ratios, was poor. Conclusions The finding on diagnostic accuracy did not support the use of CD for identifying children with LI between ages 4 and 9 years. However, given the attested reliability and validity for CD, reference data of CD from the ENNI database can be used for evaluating children's difficulties with complex syntax and monitoring their change over time. Supplemental Material https://doi.org/10.23641/asha.13172129

Meta-Analysis of Criterion Validity for Curriculum-Based Measurement in Written Language

2016 ◽  
Vol 51 (2) ◽  
pp. 72-82 ◽  
Author(s):  
John Elwood Romig ◽  
William J. Therrien ◽  
John W. Lloyd
Keyword(s):  
Grade Level ◽  
Meta Analysis ◽  
Criterion Validity ◽  
Written Language ◽  
Curriculum Based Measurement ◽  
Inclusion Criteria ◽  
Correct Word

We used meta-analysis to examine the criterion validity of four scoring procedures used in curriculum-based measurement of written language. A total of 22 articles representing 21 studies ( N = 21) met the inclusion criteria. Results indicated that two scoring procedures, correct word sequences and correct minus incorrect sequences, have acceptable criterion validity with commercially developed and state- or locally developed criterion assessments. Results indicated trends for scoring procedures at each grade level. Implications for researchers and practitioners are discussed.

scholarly journals Validation of perinatal post-traumatic stress disorder questionnaire for Spanish women during the postpartum period

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Antonio Hernández-Martínez ◽  
Sergio Martínez-Vázquez ◽  
Julian Rodríguez-Almagro ◽  
Khalid Saeed Khan ◽  
Miguel Delgado-Rodríguez ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Post Traumatic Stress Disorder ◽  
Traumatic Stress ◽  
Postnatal Depression ◽  
Stress Disorder ◽  
Criterion Validity ◽  
Post Traumatic Stress ◽  
Spanish Women ◽  
Post Traumatic

AbstractTo determine the psychometric properties of the Perinatal Post-Traumatic Stress Disorder (PTSD) Questionnaire (PPQ) in Spanish. A cross-sectional study of 432 Spanish puerperal women was conducted, following ethical approval. The PPQ was administered online through midwives' associations across Spain. The Edinburgh Postnatal Depression Scale was used to diagnose postnatal depression for examining criterion validity. Data were collected on sociodemographic, obstetric, and neonatal variables. An exploratory factorial analysis (EFA) was performed with convergence and criterion validation. Internal consistency was evaluated using Cronbach's α. The EFA identified three components that explained 63.3% of variance. The PPQ's convergence validation associated the risk of PTSD with variables including birth plan, type of birth, hospital length of stay, hospital readmission, admission of the newborn to care unit, skin-to-skin contact, maternal feeding at discharge, maternal perception of partner support, and respect shown by healthcare professionals during childbirth and puerperium. The area under the ROC curve for the risk of postnatal depression (criterion validity) was 0.86 (95% CI 0.82–0.91). Internal consistency with Cronbach's α value was 0.896. The PPQ used when screening for PTSD in postpartum Spanish women showed adequate psychometric properties.

512 Confirmatory Factor Analysis of the Sleep Inertia Questionnaire in a Clinical Sample with Sleep Disorders

SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A201-A202
Author(s):  
Kristina Puzino ◽  
Susan Calhoun ◽  
Allison Harvey ◽  
Julio Fernandez-Mendoza
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Sleep Disorders ◽  
Goodness Of Fit ◽  
Criterion Validity ◽  
Clinical Samples ◽  
Sleep Inertia ◽  
Confirmatory Factor ◽  
Sensitivity Specificity

Abstract Introduction The Sleep Inertia Questionnaire (SIQ) was developed and validated in patients with mood disorders to evaluate difficulties with becoming fully awake after nighttime sleep or daytime naps in a multidimensional manner. However, few data are available regarding its psychometric properties in clinical samples with sleep disorders. Methods 211 patients (43.0±16.4 years old, 68% female, 17% minority) evaluated at the Behavioral Sleep Medicine (BSM) program of Penn State Health Sleep Research & Treatment Center completed the SIQ. All patients were diagnosed using ICSD-3 criteria, with 111 receiving a diagnosis of chronic insomnia disorder (CID), 48 of a central disorder of hypersomnolence (CDH), and 52 of other sleep disorders (OSD). Structural equation modelling was used to conduct confirmatory factor analysis (CFA) of the SIQ. Results CFA supported four SIQ dimensions of “physiological”, “cognitive”, “emotional” and “response to” (RSI) sleep inertia with adequate goodness-of-fit (TLI=0.90, CFI=0.91, GFI=0.85, RMSEA=0.08). Internal consistency was high (α=0.94), including that of its dimensions (physiological α=0.89, cognitive α=0.94, emotional α=0.67, RSI α=0.78). Dimension inter-correlations were moderate to high (r=0.42–0.93, p<0.01), indicating good construct validity. Convergent validity showed moderate correlations with Epworth sleepiness scale (ESS) scores (r=0.38) and large correlations with Flinders fatigue scale (FFS) scores (r=0.65). Criterion validity showed significantly (p<0.01) higher scores in subjects with CDH (69.0±16.6) as compared to those with CID (54.4±18.3) or OSD (58.5±20.0). A SIQ cut-off score ≥57.5 provided a sensitivity/specificity of 0.77/0.65, while a cut-off score ≥61.5 provided a sensitivity/specificity of 0.71/0.70 to identify CDH vs. ESS<10 (AUC=0.76). Conclusion The SIQ shows satisfactory indices of reliability and construct validity in a clinically-diverse sleep disorders sample. Its criterion validity is supported by its divergent association with hypersomnia vs. insomnia disorders, as well as its adequate sensitivity/specificity to identify patients with CDH. The SIQ can help clinicians easily assess the complex dimensionality of sleep inertia and target behavioral sleep treatments. Future studies should confirm the best SIQ cut-off score by including good sleeping controls, while clinical studies should determine its minimal clinically important difference after pharmacological or behavioral treatments. Support (if any):

scholarly journals Patients with Axial Spondyloarthritis Show an Altered Flexion/Relaxation Phenomenon

Diagnostics ◽  
2021 ◽  
Vol 11 (5) ◽  
pp. 810
Author(s):  
I. Concepción Aranda-Valera ◽  
Juan Luis Garrido-Castro ◽  
Alfonso Martínez-Galisteo ◽  
José Peña-Amaro ◽  
Cristina González-Navas ◽  
...  
Keyword(s):  
Back Pain ◽  
Discriminant Validity ◽  
Axial Spondyloarthritis ◽  
Criterion Validity ◽  
Erector Spinae ◽  
Relaxation Phenomenon ◽  
Control Group ◽  
Flexion Relaxation Phenomenon ◽  
Flexion Relaxation ◽  
Semg Activity

Axial spondyloarthritis (axSpA) is a chronic rheumatic disease characterized by the presence of inflammatory back pain. In patients with chronic low back pain, the lumbar flexion relaxation phenomenon measured by surface electromyography (sEMG) differs from that in healthy individuals. However, sEMG activity in axSpA patients has not been studied. The purpose of this study was to analyze the flexion relaxation phenomenon in axSpA patients. A study evaluating 39 axSpA patients and 35 healthy controls was conducted. sEMG activity at the erector spinae muscles was measured during lumbar full flexion movements. sEMG activity was compared between axSpA patients and the controls, as well as between active (BASDAI ≥ 4) and non-active (BASDAI < 4) patients. The reliability (using intraclass correlation coefficients (ICC)), criterion validity and discriminant validity using the area Under the curve (AUC) for the inverse flexion/relaxation ratio (1/FRR) were evaluated. Significant differences (p < 0.05) were observed between axSpA patients and the control group in lumbar electric activity, especially during flexion, relaxation, and extension and in FRR and 1/FRR (0.66 ± 0.39 vs. 0.25 ± 0.19, respectively). In addition, significant differences were found between active and non-active but also between non-active and healthy subjects. The sEMG showed good reliability (ICC > 0.8 for 1/FRR) and criterion validity. ROC analysis showed good discriminant validity for axSpA patients (AUC = 0.835) vs. the control group using 1/FRR. An abnormal flexion/relaxation phenomenon exists in axSpA patients compared with controls. sEMG could be an additional objective tool in the evaluation of patient function and disease activity status.

scholarly journals A less evaluative measure of Big Five personality: Comparison of structure and criterion validity

2021 ◽  
pp. 089020702110129
Author(s):  
Joshua K Wood ◽  
Jeromy Anglim ◽  
Sharon Horwood
Keyword(s):  
Big Five ◽  
Personality Assessment ◽  
Blood Donation ◽  
Past Research ◽  
Criterion Validity ◽  
Communication Styles ◽  
General Factor ◽  
Big Five Personality ◽  
Large Sample Size ◽  
Academic Grades

Researchers and practitioners have long been concerned about detrimental effects of socially desirable responding on the structure and criterion validity of personality assessments. The current research examined the effect of reducing evaluative item content of a Big Five personality assessment on test structure and criterion validity. We developed a new public domain measure of the Big Five called the Less Evaluative Five Factor Inventory (LEFFI), adapted from the standard 50-item IPIP NEO, and intended to be less evaluative. Participants ( n = 3164) then completed standard (IPIP) and neutralized (LEFFI) measures of personality. Criteria were also collected, including academic grades, age, sex, smoking, alcohol consumption, exercise, protesting, religious worship, music preferences, dental hygiene, blood donation, other-rated communication styles, other-rated HEXACO personality, and cognitive ability (ICAR). Evaluativeness of items was reduced in the neutralized measure. Cronbach's alpha and test-retest reliability were maintained. Correlations between the Big Five were reduced in the neutralized measure and criterion validity was similar or slightly reduced in the neutralized measure. The large sample size and use of objective criteria extend past research. The study also contributes to debates about whether the general factor of personality and agreement with socially desirable content reflect substance or bias.

scholarly journals Reliability and validity of an adapted hip abductor strength measure as a potential new fall risk assessment for older persons: a study protocol

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Simone Chantal Gafner ◽  
Caroline Henrice Germaine Bastiaenen ◽  
Emmanuel Biver ◽  
Serge Ferrari ◽  
Lara Allet
Keyword(s):  
Fall Risk ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
Risk Assessments ◽  
Index Test ◽  
Timed Up And Go ◽  
External Criterion ◽  
Closed Chain ◽  
Hip Abductor ◽  
Abductor Strength

Abstract Background Persons aged ≥ 65 years are currently the world’s fastest growing age group. An important complication of age is the increasing risk of falls. Falls have multifactorial etiology and modifiable risk factors open for interventions in prevention and rehabilitation, are of high interest. In this context, strong hip abductors seem to be important to prevent falls. A newly adapted measurement device to measure hip abductor strength (HAS) in a closed chain position was developed. We aim to assess feasibility, intra- and inter-tester reliability and construct and criterion validity of the new measure. Methods In two subsequent parts a feasibility, reliability and validity study with an adapted measurement instrument for the assessment of HAS (index test) in a closed chain position in persons aged ≥ 65 years will be conducted. Part I investigates feasibility of the measure in clinical settings as well as reliability of the new HAS test (n = 26). Part II evaluates construct and criterion validity (n = 169). Construct validity will be assessed cross-sectional, criterion validity by comparison with prospectively followed up fall history for 12 months (external criterion) and other functional fall risk assessments (Short Physical Performance Battery, Timed Up and Go test, usual gait speed and hand grip strength). Discussion Results of feasibility, will give insight in its applicability in daily clinical life and clinimetric properties will show if measurements of HAS in a closed chain position should be encouraged to include in fall risk assessments in older adults.

scholarly journals Measuring Forgiveness: Psychometric Properties of the Heartland Forgiveness Scale in the Spanish Population

2020 ◽  
Vol 18 (1) ◽  
pp. 45
Author(s):  
Karla Gallo-Giunzioni ◽  
María Prieto-Ursúa ◽  
Cristina Fernández-Belinchón ◽  
Octavio Luque-Reca
Keyword(s):  
Factor Analysis ◽  
Structural Equation ◽  
Discriminant Validity ◽  
Criterion Validity ◽  
Validity Evidence ◽  
Dispositional Forgiveness ◽  
Scale Reduction ◽  
Convergent And Discriminant Validity ◽  
Confirmatory Factor ◽  
Acceptable Internal Consistency

Given the scarcity of instruments in Spanish to measure forgiveness, two studies were conducted in this population to obtain validity evidence of the Heartland Forgiveness Scale (HFS), an instrument that measures dispositional forgiveness of self, others, and situations. In the first study, 203 students (65% women) participated. After ensuring the linguistic adequacy and clarity of the wording of the items, a lack of congruence was found between the factors obtained in the exploratory factor analysis and the original theoretical structure of the HFS. A sample of 512 participants (63.9% women) attended the second study. This study aimed to analyze the construct validity of the HFS using confirmatory factor analysis through structural equation modelling and to explore convergent, discriminant, and criterion validity. Of the different factorial configurations tested (including the original), only a scale reduction to eight items, grouped into three factors, showed an appropriate fit. The HFS eight-item version also showed acceptable internal consistency, adequate convergent and discriminant validity, and criterion validity with respect to related variables. These findings suggest that the eight-item version of the HFS may be a valid and reliable tool for assessing forgiveness for self, others, and situations in Spanish adults.

Sign in / Sign up

Export Citation Format

Share Document