The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part I: A Checklist for Dimensional Measurement of Selected DSM-5 Disorders

Objectives: To describe the development and psychometric properties of the 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) for dimensional measurement of 7 disorders based on criteria from the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders ( DSM-5). Methods: Scale items were selected by agreement among 19 child psychologists and psychiatrists rating the correspondence between item descriptions and DSM-5 symptoms. Psychometric evaluation of the item properties and parent/caregiver and youth scales came from a general population study of 10,802 children and youth aged 4 to 17 years in 6537 families. Test-retest reliability data were collected from a subsample of 280 children and their caregivers who independently completed the OCHS-EBS checklist on 2 occasions 7 to 14 days apart. Structural equation modelling was used to assess internal and external convergent and discriminant validity—the latter tested against the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Results: Confirmatory factor analyses exhibited adequate item fit to all scales. Except for conduct disorder and youth-assessed separation anxiety disorder, internal (Cronbach’s α) and test-retest reliability (Pearson’s r) for scale scores were 0.70 or above. Except for youth-assessed conduct disorder, the OCHS-EBS met criteria for internal and convergent and discriminant validity. Compared with the MINI-KID, the OCHS-EBS met criteria for external convergent and discriminant validity. Conclusions: The OCHS-EBS provide reliable and valid dimensional measurement of 7 DSM-5 disorders assessed by caregivers and youth in the general population. Part II describes use of the OCHS-EBS as a categorical (present/absent) measure of disorder.

Download Full-text

The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182312507 ◽

2021 ◽

Vol 18 (23) ◽

pp. 12507

Author(s):

Lavinia De Chiara ◽

Cristina Mazza ◽

Eleonora Ricci ◽

Alexia Emilia Koukopoulos ◽

Georgios D. Kotzalidis ◽

...

Keyword(s):

Convergent Validity ◽

Predictive Power ◽

Discriminant Validity ◽

Late Pregnancy ◽

Italian Version ◽

Retest Reliability ◽

Dsm 5 ◽

Insomnia Symptom ◽

Symptom Questionnaire ◽

Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

Download Full-text

Reliability, and Convergent and Discriminant Validity of Gaming Disorder Scales: A Meta-Analysis

Frontiers in Psychology ◽

10.3389/fpsyg.2021.764209 ◽

2021 ◽

Vol 12 ◽

Author(s):

Seowon Yoon ◽

Yeji Yang ◽

Eunbin Ro ◽

Woo-Young Ahn ◽

Jueun Kim ◽

...

Keyword(s):

Systematic Review ◽

Internet Addiction ◽

Discriminant Validity ◽

Meta Analysis ◽

Effect Sizes ◽

Gaming Disorder ◽

Reliability Generalization ◽

Retest Reliability ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

Background: An association between gaming disorder (GD) and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs.Methods: Five representative GD instruments (GAS-7, AICA, IGDT-10, Lemmens IGD-9, and IGDS9-SF) were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized.Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 (95% CI = 0.85–0.87) and a mean test-retest estimate of 0.86 (95% CI = 0.81–0.89). Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression (k = 45; number of effect sizes), 0.29 with anxiety (k = 37), 0.30 with aggression (k = 19), –0.22 with quality of life (k = 18), 0.29 with loneliness (k = 18), 0.56 with internet addiction (k = 20), and 0.40 with game playtime (k = 53), respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented.Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies.Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study.Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781].

Download Full-text

E-Cigarette Demand: Impact of Commodity Definitions and Test–Retest Reliability

Nicotine & Tobacco Research ◽

10.1093/ntr/ntaa139 ◽

2020 ◽

Author(s):

Justin C Strickland ◽

Olga A Vsevolozhskaya ◽

William W Stoops

Keyword(s):

Effect Size ◽

Discriminant Validity ◽

Good Test ◽

Retest Reliability ◽

Cigarette Demand ◽

Convergent And Discriminant Validity ◽

Human Participants ◽

Puff Intensity ◽

Test Retest Reliability

Abstract Introduction Behavioral economic demand provides a multidimensional understanding of reinforcement. Commodity purchase tasks are an efficient method for measuring demand in human participants. One challenge in translating these procedures to electronic nicotine delivery systems (ENDS or e-cigarettes) is defining commodity units given the lack of standardization in the e-cigarette marketplace. Aims and Methods The purpose of this study was to directly compare methods of operationalizinge-cigarette purchases, puffs, cartridges, and mLs liquid, using a within-subject design. Participants (N = 132) reporting past week e-cigarette use were recruited using crowdsourcing. Purchase tasks were completed operationalizing e-cigarette units as puffs or cartridges at baseline and puffs or mLs liquid at a 3-month follow-up. Results Bivariate associations supported convergent and discriminant validity with the largest effect size correlations for intensity and elasticity observed for the puff version. Interaction models suggested that product preferences moderated the relationship between time-to-first use and cartridge demand with larger effect size correlations among persons reporting a preference for JUULs, but weaker relationships among persons reporting other device preferences. Puff intensity (rxx = .61) and elasticity (rxx = .62) showed good test–retest reliability for participants reporting stable consumption, but poor test–retest reliability for individuals with changed consumption levels (intensity rxx = −.08; elasticity rxx = −.10). Conclusions This study highlights the relevance of commodity definitions in the e-cigarette purchase task. Puffs as an experimental commodity may provide flexibility for studying e-cigarette demand in heterogenous or unknown populations, whereas more tailored or personalized approaches like cartridge or mL-based tasks will likely be helpful when studying known subgroups. Implications The commodity purchase task procedure is widely used for understanding cigarette and e-cigarette demand in nicotine dependence research. This study evaluates the importance of operational definitions of e-cigarette commodities in the purchase task (ie, puffs, cartridges, or mLs liquid). Puffs may provide a more flexible commodity unit when evaluating e-cigarette demand in general or heterogenous populations, whereas device-specific units may prove more valuable when studying populations with consistent and known product use.

Download Full-text

Assessing Obsessive-compulsive Symptoms: The Portuguese Version of the Padua Inventory

European Psychiatry ◽

10.1016/j.eurpsy.2017.01.225 ◽

2017 ◽

Vol 41 (S1) ◽

pp. S70-S70

Author(s):

A. Galhardo ◽

J. Pinto-Gouveia ◽

M. Cunha ◽

I. Massano-Cardoso

Keyword(s):

Psychometric Properties ◽

Factor Structure ◽

Internal Consistency ◽

Discriminant Validity ◽

Obsessive Compulsive ◽

Retest Reliability ◽

Obsessive Compulsive Symptoms ◽

Portuguese Version ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

IntroductionSelf-report instruments are useful tools for the assessment of psychopathological symptoms such as obsessive-compulsive symptoms. The Padua Inventory (PI) is a measure that has been widely used in clinical and research settings and studied in several countries.ObjectivesThis study explores the psychometric properties and factor structure of the Portuguese version of the PI.MethodsTranslation and translation-back of the original version were executed. A total of 847 participants (468 women and 379 men) from the general population was recruited through a snowball procedure and completed the PI and other mental health measures. The data set was randomly split in order to conduct principal component analysis (PCA) and confirmatory factor (CFA) analysis in two different samples. Moreover, internal consistency, convergent and discriminant validity and test-retest reliability analyses were conducted.ResultsFrom the PCA analysis four factors emerged, comprising clusters of items related to doubting/impaired control over mental activities, contamination/washing/cleaning, checking and worries about losing control over motor behaviors. CFA results revealed that the model presented a poor fit to the data and indicated that the model would benefit from the establishment of correlations between pairs of error terms of items with identical contents. The PI exhibited excellent internal consistency, good test-retest reliability and good convergent and discriminant validity.ConclusionsThe PI Portuguese version showed a similar factor structure to the one presented in other studies and revealed good psychometric properties. Nevertheless, results from the CFA suggest that shortening the PI may be advantageous.Disclosure of interestThe authors have not supplied their declaration of competing interest.

Download Full-text

The development and psychometric properties of a self-report Catastrophising Questionnaire

10.31234/osf.io/h726k ◽

2020 ◽

Author(s):

Alexandra C Pike ◽

Jade Serfaty ◽

Oliver Joe Robinson

Keyword(s):

Discriminant Validity ◽

Self Report ◽

Underlying Structure ◽

Short Version ◽

Good Test ◽

Total N ◽

Retest Reliability ◽

Convergent And Discriminant Validity ◽

Exploratory Factor Analyses ◽

Test Retest Reliability

Catastrophising is a cognitive process that can be defined as predicting the worst possible outcome. It has been shown to be related to psychiatric diagnoses such as depression and anxiety, yet there are no self-report questionnaires specifically measuring it outside the context of pain research. Here, we therefore develop a novel, comprehensive self-report measure of general catastrophising. We performed five online studies (total n=734), in which we created and refined a Catastrophising Questionnaire, and used a factor analytic approach to understand its underlying structure. We also assessed convergent and discriminant validity, and analysed test-retest reliability. Furthermore, we tested the ability of Catastrophising Questionnaire scores to predict relevant clinical variables over and above other questionnaires. Finally, we also developed a four-item short version of this questionnaire. We found that our questionnaire is best fit by a single underlying factor, and shows convergent and discriminant validity. Exploratory factor analyses indicated that catastrophising is independent from other related constructs, including anxiety and worry. Moreover, we demonstrate incremental validity for this questionnaire in predicting diagnostic and medication status. Finally, we demonstrate that our Catastrophising Questionnaire has good test-retest reliability (Intra-Class-Correlation Coefficient=0.77, p<.001). Critically, we can now, for the first time, obtain detailed self-report data on catastrophising.

Download Full-text

The 25-Item Ontario Child Health Study Emotional Behavioural Scales-Brief Version (OCHS-EBS-B): Test-Retest Reliability and Construct Validity When Used as Categorical Measures

The Canadian Journal of Psychiatry ◽

10.1177/07067437211037125 ◽

2021 ◽

pp. 070674372110371

Author(s):

Michael H. Boyle ◽

Laura Duncan ◽

Li Wang ◽

Katholiki Georgiades

Keyword(s):

Measurement Error ◽

Child Health ◽

Construct Validity ◽

Structural Equation Models ◽

Health Study ◽

Retest Reliability ◽

Statistical Equivalence ◽

Child Psychiatric ◽

Child Psychiatric Disorder ◽

Test Retest Reliability

Objective Child and youth mental health problems are often assessed by parent self-completed checklists that produce dimensional scale scores. When converted to binary ratings of disorder, little is known about their psychometric properties in relation to classifications based on lay-administered structured diagnostic interviews. In addition to estimating agreement, our objective is to test for statistical equivalence in the test-retest reliability and construct validity of two instruments used to classify child emotional, behavioural, and attentional disorders: the 25-item, parent completed Ontario Child Health Study Emotional Behavioural Scales-Brief Version (OCHS-EBS-B) and the Mini International Neuropsychiatric Interview for Children and Adolescents-parent version (MINI-KID-P). Methods This study draws on independent samples ( n = 452) and uses the confidence interval approach to test for statistical equivalence. Reliability is based on kappa (κ). Construct validity is based on standardized beta coefficients (β) estimated in structural equation models. Results The average differences between the MINI-KID-P and OCHS-EBS-B in κ and β were −0.022 and −0.020, respectively. However, in both instances, criteria for statistical equivalence were met in only 5 of 12 comparisons. Based on κ, between-instrument agreement on the classifications of disorder went from 0.481 (attentional disorder) to 0.721 (emotional disorder) but were substantially higher (0.731 to 0.895, respectively) when corrected for attenuation due to measurement error. Conclusions Although falling short of equivalence, the results suggest on balance that the reliability and validity of the two instruments for classifying child psychiatric disorder assessed by parents are highly comparable. This conclusion is supported by the high levels of agreement between the instruments after correcting for attenuation due to measurement error.

Download Full-text

Evaluation of the Original Ontario Child Health Study Scales

The Canadian Journal of Psychiatry ◽

10.1177/070674379303800605 ◽

1993 ◽

Vol 38 (6) ◽

pp. 397-405 ◽

Cited By ~ 63

Author(s):

Michael H. Boyle ◽

David R. Offord ◽

Yvonne Racine ◽

Mark Sanford ◽

Peter Szatmari ◽

...

Keyword(s):

Child Health ◽

Convergent Validity ◽

Discriminant Validity ◽

Urban Setting ◽

Health Study ◽

Health Clinic ◽

Convergent And Discriminant Validity ◽

Good Internal Consistency ◽

Individual Scale ◽

Ordinal Level

This article presents evaluative information on the use of the original Ontario Child Health Study scales to serve as ordinal-level measures of conduct disorder, hyperactivity and emotional disorder among children in the general (non clinic) population. Problem checklist assessments were obtained from parents and teachers of children aged six to 16 and youth aged 12 to 16 drawn from a general population (n = 1,751); and a mental health clinic sample (n = 1,027) in the same industrialized, urban setting. The results showed that the original OCHS scales possess adequate psychometric properties to be used as ordinal-level measures of disorder. Correlations between individual items and their hypothesized scales were very strong, indicating convergent validity, while correlations between the same items and other (non hypothesized) scales were lower, indicating discriminant validity. Item analyses indicated that individual scale items possess both convergent and discriminant validity. Although the scales were skewed to the positive end of the continuum, they demonstrated good internal consistency (all estimates ≥ 0.74) and test-retest (all estimates ≥ 0.65) reliability. Finally, three different validity analyses confirmed hypotheses about how the original OCHS scales should perform if they provide useful measures of disorder.

Download Full-text

The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part II: Psychometric Adequacy for Categorical Measurement of Selected DSM-5 Disorders

The Canadian Journal of Psychiatry ◽

10.1177/0706743718808251 ◽

2018 ◽

Vol 64 (6) ◽

pp. 434-442 ◽

Cited By ~ 6

Author(s):

Michael H. Boyle ◽

Laura Duncan ◽

Katholiki Georgiades ◽

Li Wang ◽

Jinette Comeau ◽

...

Keyword(s):

Anxiety Disorder ◽

Child Health ◽

Conduct Disorder ◽

Convergent Validity ◽

Separation Anxiety Disorder ◽

Health Study ◽

Dsm 5 ◽

Oppositional Defiant ◽

Child Psychiatric ◽

Child Psychiatric Disorder

Objectives: To compare the reliability and convergent validity of parent assessments from the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID —a structured diagnostic interview) and the Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) symptom checklist for classifying conduct disorder (CD), conduct disorder or oppositional defiant disorder (CD-ODD), attention-deficit hyperactivity disorder (ADHD), major depressive disorder (MDD), generalized anxiety disorder (GAD), and separation anxiety disorder (SAD) based on DSM-5 criteria. Methods: Data came from 283 parent-youth dyads aged 9 to 18 years. Parents and youth completed the assessments separately on 2 different occasions 7 to 14 days apart. After converting the OCHS-EBS scale scores to binary disorder classifications, we compare test-retest reliability estimates and use structural equation modelling (SEM) to compare estimates of convergent validity for the same disorders assessed by each instrument. Results: Average test-retest reliabilities based on κ were 0.71 (MINI-KID) and 0.67 (OCHS-EBS). The average β coefficients for 3 latent measures comprising the following indicators—parent perceptions of youth mental health need and impairment, diagnosis of specific disorders based on health professional communications and youth taking prescribed medication, and youth classifications of disorder based on the MINI-KID—were 0.67 (MINI-KID) and 0.69 (OCHS-EBS). Conclusion: The OCHS-EBS and MINI-KID achieve comparable levels of reliability and convergent validity for classifying child psychiatric disorder. The flexibility, low cost, and minimal respondent burden of checklists for classifying disorder make them well suited for studying disorder in the general population and screening in clinical settings.

Download Full-text

The development and psychometric properties of a self-report Catastrophizing Questionnaire

Royal Society Open Science ◽

10.1098/rsos.201362 ◽

2021 ◽

Vol 8 (1) ◽

pp. 201362

Author(s):

Alexandra C. Pike ◽

Jade R. Serfaty ◽

Oliver J. Robinson

Keyword(s):

Discriminant Validity ◽

Intraclass Correlation ◽

Self Report ◽

Underlying Structure ◽

Short Version ◽

Good Test ◽

Retest Reliability ◽

Convergent And Discriminant Validity ◽

Exploratory Factor Analyses ◽

Test Retest Reliability

Catastrophizing is a cognitive process that can be defined as predicting the worst possible outcome. It has been shown to be related to psychiatric diagnoses such as depression and anxiety, yet there are no self-report questionnaires specifically measuring it outside the context of pain research. Here, we therefore develop a novel, comprehensive self-report measure of general catastrophizing. We performed five online studies (total n = 734), in which we created and refined a Catastrophizing Questionnaire, and used a factor analytic approach to understand its underlying structure. We also assessed convergent and discriminant validity, and analysed test–retest reliability. Furthermore, we tested the ability of Catastrophizing Questionnaire scores to predict relevant clinical variables over and above other questionnaires. Finally, we also developed a four-item short version of this questionnaire. We found that our questionnaire is best fit by a single underlying factor, and shows convergent and discriminant validity. Exploratory factor analyses indicated that catastrophizing is independent from other related constructs, including anxiety and worry. Moreover, we demonstrate incremental validity for this questionnaire in predicting diagnostic and medication status. Finally, we demonstrate that our Catastrophizing Questionnaire has good test–retest reliability (intraclass correlation coefficient = 0.77, p < 0.001). Critically, we can now, for the first time, obtain detailed self-report data on catastrophizing.

Download Full-text

An Examination of the Reliability and Validity of Scores on the Italian Version of the Dieter's Inventory of Eating Temptations

Perceptual and Motor Skills ◽

10.2466/pms.1998.86.2.435 ◽

1998 ◽

Vol 86 (2) ◽

pp. 435-439 ◽

Cited By ~ 5

Author(s):

Giuseppe Riva

Keyword(s):

Internal Consistency ◽

Screening Test ◽

Discriminant Validity ◽

Reliability And Validity ◽

Psychometric Characteristics ◽

Italian Version ◽

Retest Reliability ◽

Convergent And Discriminant Validity ◽

The Individual ◽

Test Retest Reliability

The aim of this paper was to highlight some psychometric characteristics of scores on the Italian version of the Dieter's Inventory of Eating Temptations. The analysis included assessment of the internal consistency of the individual scales, test-retest reliability, and estimates of both convergent and discriminant validity. Analyses showed that the Italian version of the inventory can be considered reliable and valid, which suggested its use as screening test for the identification of subjects who may be at risk for over-eating.

Download Full-text