Development and Evaluation of a Recovery College Fidelity Measure

Objective: Recovery Colleges are widespread, with little empirical research on their key components. This study aimed to characterize key components of Recovery Colleges and to develop and evaluate a developmental checklist and a quantitative fidelity measure. Methods: Key components were identified through a systematized literature review, international expert consultation ( n = 77), and semistructured interviews with Recovery College managers across England ( n = 10). A checklist was developed and refined through semistructured interviews with Recovery College students, trainers, and managers ( n = 44) in 3 sites. A fidelity measure was adapted from the checklist and evaluated with Recovery College managers ( n = 39, 52%), clinicians providing psychoeducational courses ( n = 11), and adult education lecturers ( n = 10). Results: Twelve components were identified, comprising 7 nonmodifiable components (Valuing Equality, Learning, Tailored to the Student, Coproduction of the Recovery College, Social Connectedness, Community Focus, and Commitment to Recovery) and 5 modifiable components (Available to All, Location, Distinctiveness of Course Content, Strengths Based, and Progressive). The checklist has service user student, peer trainer, and manager versions. The fidelity measure meets scaling assumptions and demonstrates adequate internal consistency (0.72), test-retest reliability (0.60), content validity, and discriminant validity. Conclusions: Coproduction and an orientation to adult learning should be the highest priority in developing Recovery Colleges. The creation of the first theory-based empirically evaluated developmental checklist and fidelity measure (both downloadable at researchintorecovery.com/recollect ) for Recovery Colleges will help service users understand what Recovery Colleges offer, will inform decision making by clinicians and commissioners about Recovery Colleges, and will enable formal evaluation of their impact on students.

Download Full-text

Development of the Fear of Intimacy Components Questionnaire (FICQ)

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000238 ◽

2015 ◽

Vol 31 (4) ◽

pp. 302-309 ◽

Cited By ~ 3

Author(s):

Maria Pedro Sobral ◽

Maria Emília Costa

Keyword(s):

Convergent Validity ◽

Discriminant Validity ◽

Two Dimensions ◽

Dimensional Structure ◽

Future Research ◽

Fear Of Intimacy ◽

Confirmatory Factor Analyses ◽

New Instrument ◽

Confirmatory Factor ◽

Test Retest Reliability

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.

Download Full-text

The Big Five Inventory–2 in China: A Comprehensive Psychometric Evaluation in Four Diverse Samples

Assessment ◽

10.1177/10731911211008245 ◽

2021 ◽

pp. 107319112110082

Author(s):

Bo Zhang ◽

Yi Ming Li ◽

Jian Li ◽

Jing Luo ◽

Yonghao Ye ◽

...

Keyword(s):

Big Five ◽

Discriminant Validity ◽

Psychometric Evaluation ◽

Good Reliability ◽

Future Directions ◽

Big Five Inventory ◽

Education Levels ◽

Lower Education ◽

Content Coverage ◽

Test Retest Reliability

The Big Five Inventory-2 (BFI-2) has received wide recognition since its publication because it strikes a good balance between content coverage and brevity. The current study translated the BFI-2 into Chinese, evaluated its psychometric properties in four diverse Chinese samples (college students, adult employees, adults treated for substance use, and adolescents), and compared its factor structure with those obtained from two U.S. samples. Across two studies, the Chinese BFI-2 demonstrated good reliability (Cronbach’s α and test–retest reliability), structural validity, convergent/discriminant validity, and criterion-related validity at the domain level. At lower levels of analyses, some facets and negatively worded items functioned better among participants with higher than those with lower education levels. Implications, limitations, and future directions are discussed.

Download Full-text

Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

BMC Medical Education ◽

10.1186/s12909-020-02437-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Liyuan Cui ◽

Yaxin Zhu ◽

Jinglou Qu ◽

Liming Tie ◽

Ziqi Wang ◽

...

Keyword(s):

Factor Analysis ◽

Critical Thinking ◽

Medical Students ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Retest Reliability ◽

Critical Thinking Disposition ◽

Thinking Disposition ◽

Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Download Full-text

Reliability and validity of the Japanese version of the Ocular Surface Disease Index for dry eye disease

BMJ Open ◽

10.1136/bmjopen-2019-033940 ◽

2019 ◽

Vol 9 (11) ◽

pp. e033940 ◽

Cited By ~ 7

Author(s):

Akie Midorikawa-Inomata ◽

Takenori Inomata ◽

Shuko Nojiri ◽

Masahiro Nakamura ◽

Masao Iwagami ◽

...

Keyword(s):

Internal Consistency ◽

Dry Eye ◽

Ocular Surface ◽

Discriminant Validity ◽

Reliability And Validity ◽

Japanese Version ◽

Disease Index ◽

Eye Disease ◽

Ocular Surface Disease Index ◽

Test Retest Reliability

ObjectivesThe Ocular Surface Disease Index (OSDI) questionnaire is widely used to evaluate subjective symptoms of dry eye disease (DED) as a primary diagnostic criterion. This study aimed to develop a Japanese version of the OSDI (J-OSDI) and assess its reliability and validity.Design and settingHospital-based cross-sectional observational study.ParticipantsA total of 209 patients recruited from the Department of Ophthalmology at Juntendo University Hospital.MethodsWe translated and culturally adapted the OSDI into Japanese. The J-OSDI was then assessed for internal consistency, reliability and validity. We also evaluated the optimal cut-off value to suspect DED using an area under the receiver operating characteristic curve (AUC) analysis.Primary outcome measuresInternal consistency, test–retest reliability and discriminant validity of the J-OSDI as well as the optimal cut-off value to suspect DED.ResultsOf the participants, 152 had DED and 57 did not. The J-OSDI total score showed good internal consistency (Cronbach's alpha=0.884), test–retest reliability (interclass correlation coefficient=0.910) and discriminant validity by known-group comparisons (non-DED, 19.4±16.0; DED, 37.7±22.2; p<0.001). Factor validity was used to confirm three subscales within the J-OSDI according to the original version of the questionnaire. Concurrent validity was assessed by Pearson correlation analysis, and the J-OSDI total score showed a strong positive correlation with the Dry Eye-Related Quality-of-Life Score (γ=0.829). The optimal cut-off value of the J-OSDI total score was 36.3 (AUC=0.744).ConclusionsThe J-OSDI was developed and validated in terms of reliability and validity as an effective tool for DED assessment and monitoring in the Japanese population.

Download Full-text

Reliability and Validity of the Activity Participation Assessment for School-age Children in Korea

Hong Kong Journal of Occupational Therapy ◽

10.1016/j.hkjot.2016.08.001 ◽

2016 ◽

Vol 28 (1) ◽

pp. 33-42 ◽

Cited By ~ 3

Author(s):

Se-Yun Kim ◽

Eun-Young Yoo ◽

Min-Ye Jung ◽

Soo-Hyun Park ◽

Jae-Shin Lee ◽

...

Keyword(s):

Construct Validity ◽

Intellectual Disabilities ◽

Discriminant Validity ◽

School Age Children ◽

School Age ◽

Internal Reliability ◽

Outdoor Activities ◽

School Activities ◽

Five Factors ◽

Test Retest Reliability

Objective This pilot study examined the internal consistency, test—retest reliability, construct validity, and discriminant validity of the Activity Participation Assessment (APA) for school-age children in Korea. Methods The construct validity of the APA was first established by factor analysis on the response of 134 nondisabled children. Internal consistency was evaluated for each of the factors. A test—retest study was conducted on 22 nondisabled children. Discriminant validity was established by comparing the participation of 56 nondisabled children and 56 children with intellectual disabilities and examining sex differences of 61 boys and 61 girls. Results Analysis of the APA revealed five factors, which were labeled as instrumental activities of daily living (IADL), sports and outdoor activities, hobbies and school activities, social activities, and personal care. The factors showed acceptable levels of internal reliability (Cronbach's alpha = .63–.89). The intraclass correlation coefficient (ICC) for the five factors were all in the good range (ICC = .86–.92). We found statistically significant difference between nondisabled children and children with intellectual disabilities in five factors. We also found that girls participated in significantly more IADL, hobbies and school activities, and social activities. However, boys participated in significantly more sports and outdoor activities. Conclusion The APA shows good internal reliability, test—retest reliability, discriminant validity, and construct validity. However, evidence of psychometric properties was limited by a small sample size. Psychometric properties such as interrater reliability as well as concurrent validity and construct validity need to be tested using a larger sample size with representative demographics.

Download Full-text

The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part I: A Checklist for Dimensional Measurement of Selected DSM-5 Disorders

The Canadian Journal of Psychiatry ◽

10.1177/0706743718808250 ◽

2018 ◽

Vol 64 (6) ◽

pp. 423-433 ◽

Cited By ~ 13

Author(s):

Laura Duncan ◽

Katholiki Georgiades ◽

Li Wang ◽

Jinette Comeau ◽

Mark A. Ferro ◽

...

Keyword(s):

General Population ◽

Child Health ◽

Conduct Disorder ◽

Discriminant Validity ◽

Health Study ◽

Retest Reliability ◽

Dimensional Measurement ◽

Dsm 5 ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

Objectives: To describe the development and psychometric properties of the 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) for dimensional measurement of 7 disorders based on criteria from the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders ( DSM-5). Methods: Scale items were selected by agreement among 19 child psychologists and psychiatrists rating the correspondence between item descriptions and DSM-5 symptoms. Psychometric evaluation of the item properties and parent/caregiver and youth scales came from a general population study of 10,802 children and youth aged 4 to 17 years in 6537 families. Test-retest reliability data were collected from a subsample of 280 children and their caregivers who independently completed the OCHS-EBS checklist on 2 occasions 7 to 14 days apart. Structural equation modelling was used to assess internal and external convergent and discriminant validity—the latter tested against the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Results: Confirmatory factor analyses exhibited adequate item fit to all scales. Except for conduct disorder and youth-assessed separation anxiety disorder, internal (Cronbach’s α) and test-retest reliability (Pearson’s r) for scale scores were 0.70 or above. Except for youth-assessed conduct disorder, the OCHS-EBS met criteria for internal and convergent and discriminant validity. Compared with the MINI-KID, the OCHS-EBS met criteria for external convergent and discriminant validity. Conclusions: The OCHS-EBS provide reliable and valid dimensional measurement of 7 DSM-5 disorders assessed by caregivers and youth in the general population. Part II describes use of the OCHS-EBS as a categorical (present/absent) measure of disorder.

Download Full-text

Psychometric properties of the Short Leyton Obsessional Inventory-Child Version in a community sample of Spanish children and adolescents

Anales de Psicología ◽

10.6018/analesps.32.3.232201 ◽

2016 ◽

Vol 33 (1) ◽

pp. 26

Author(s):

Marina Iniesta-Sepúlveda ◽

Ana I. Rosa-Alcázar ◽

Beatriz Ruiz-García ◽

Jose A. López-Pina

Keyword(s):

Psychometric Properties ◽

Children And Adolescents ◽

Discriminant Validity ◽

Factor Model ◽

Community Sample ◽

Spanish Version ◽

Obsessive Compulsive ◽

Good Test ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

The aim of the current study was to analyze psychometric properties of the Short LOI-CV in Spanish community sample. Participants were 914 children and adolescents with mean age of 13.01 years (51.3% males). An EFA yielded a three-factor model representing Obsessions, Compulsions, and Cleanliness dimensions. Both, total score and subscales showed an adequate internal consistency. The Spanish version also exhibited good test-retest reliability and moderate convergent and discriminant validity. The younger participants (from 8 to 10 years) obtained higher means for total score and subscales than older participants (groups 11-13 and 14-18 years). Significant differences related to gender were also observed since males obtained higher means in Compulsions subscale. Despite more research is required, the Spanish version of the Short LOI-CV exhibited promising psychometric results to assess obsessive-compulsive symptoms in community population.

Download Full-text

Validation of the Headache Impact Test (HIT-6™) across episodic and chronic migraine

Cephalalgia ◽

10.1177/0333102410379890 ◽

2010 ◽

Vol 31 (3) ◽

pp. 357-367 ◽

Cited By ~ 146

Author(s):

Min Yang ◽

Regina Rendas-Baum ◽

Sepideh F Varon ◽

Mark Kosinski

Keyword(s):

Chronic Migraine ◽

Discriminant Validity ◽

High Reliability ◽

Reliability And Validity ◽

Episodic Migraine ◽

Migraine Headaches ◽

Scale Scores ◽

Headache Pain ◽

Test Retest Reliability ◽

Headache Impact

Objective: The purpose of this study was to assess psychometric properties of the six-item Headache Impact Text (HIT-6™) across episodic and chronic migraine. Methods: Using a migraine screener and number of headache days per month (HDPM), participants from the National Survey of Headache Impact (NSHI) study and the HIT-6 validation study (HIT6-V) were selected for this study. Eligible participants were categorized into three groups: chronic migraine (CM: ≥ 15 HDPM); episodic migraine (EM: < 15 HDPM); non-migraine headaches. Reliability and validity of the HIT-6 were evaluated. Results: A total of 2,049 survey participants met the inclusion/exclusion criteria for this study. Participants were identified as 6.4% CM; 42.1% EM; 51.5% non-migraine, with respective mean HIT-6 scores: 62.5 ± 7.8; 60.2 ± 6.8; and 49.1 ± 8.7. High reliability was demonstrated with internal consistency (time1/time2) of 0.83/0.87 in NSHI, and 0.82/0.92 in HIT6-V. Intra-class correlation for test-retest reliability was very good at 0.77. HIT-6 scores correlated significantly ( p < .0001) with total Migraine Disability Assessment Scale scores ( r = 0.56), headache pain severity ( r = 0.46), and HDPM ( r = 0.29). Discriminant validity analysis showed significantly different HIT-6 scores ( F = 488.02, p < .0001) across the groups. Conclusion: Results from these analyses confirm that the HIT-6 is a reliable and valid tool for discriminating headache impact across episodic and chronic migraine.

Download Full-text

Development and Psychometric Validation of the Music Receptivity Scale

Frontiers in Psychology ◽

10.3389/fpsyg.2020.585891 ◽

2021 ◽

Vol 11 ◽

Author(s):

Mahesh George ◽

Judu Ilavarasu

Keyword(s):

Discriminant Validity ◽

Emotional Experience ◽

Psychometric Validation ◽

Short Version ◽

Cronbach’S Alpha ◽

Factor Solution ◽

Good Test ◽

Music Psychology ◽

Cronbach's Alpha ◽

Test Retest Reliability

A new construct, termed music receptivity, is introduced and discussed in this work. Music receptivity can be defined as a measure of the extent of internalization that an individual has, to a given piece of music, as measured at the point of listening. Through three studies, we demonstrate the psychometric properties of the construct—the Music Receptivity Scale (MRS). Exploratory factor analysis on a sample of 313 revealed good psychometric validity, with a four-factor solution (emotional experience, interest, attention, and hurdles), with a Cronbach’s alpha of 0.89, and a two-factor solution (emotion experience and attention), with a Cronbach’s alpha of 0.87. The tool also had a good test–retest reliability (r = 0.87 for a 15 day interval and r = 0.91 for 1 month interval). Overall, the tool had 20 items in the long form and 12 items in the short version. The MRS could distinguish musicians and non-musicians supporting its discriminant validity. We have also discussed the implication of the MRS in the field of music psychology.

Download Full-text

The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182312507 ◽

2021 ◽

Vol 18 (23) ◽

pp. 12507

Author(s):

Lavinia De Chiara ◽

Cristina Mazza ◽

Eleonora Ricci ◽

Alexia Emilia Koukopoulos ◽

Georgios D. Kotzalidis ◽

...

Keyword(s):

Convergent Validity ◽

Predictive Power ◽

Discriminant Validity ◽

Late Pregnancy ◽

Italian Version ◽

Retest Reliability ◽

Dsm 5 ◽

Insomnia Symptom ◽

Symptom Questionnaire ◽

Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

Download Full-text