Test–Retest Reliability and Measurement Invariance of Executive Function Tasks in Young Children With and Without ADHD

Objective: Measurement reliability is assumed when executive function (EF) tasks are used to compare groups or to examine relationships between cognition and etiologic and maintaining factors of psychiatric disorders. However, the test–retest reliabilities of many commonly used EF tasks have rarely been examined in young children. Furthermore, measurement invariance between typically developing and psychiatric populations has not been examined. Method: Test–retest reliability of a battery of commonly used EF tasks was assessed in a group of children between the ages of 5 and 6 years old with ( n = 63) and without ( n = 44) ADHD. Results: Few individual tasks achieved adequate reliability. However, confirmatory factor analysis (CFA) models identified two factors, working memory and inhibition, with test–retest correlations approaching 1.0. Multiple indicators multiple causes (MIMIC) models confirmed configural measurement invariance between the groups. Conclusion: Problems created by poor reliability, including reduced power to detect group differences, index change over time, or to identify relationships with other measures, may be mitigated using latent variable approaches.

Download Full-text

Psychometric Properties of the Modified Social Environment Questionnaire in Chinese Older Adults

Journal of Aging and Physical Activity ◽

10.1123/japa.2017-0044 ◽

2018 ◽

Vol 26 (4) ◽

pp. 530-536 ◽

Cited By ~ 1

Author(s):

Ka-Man Leung ◽

Pak-Kwong Chung ◽

Tin-Lok Yuen ◽

Jing Dong Liu ◽

Donggen Wang

Keyword(s):

Older Adults ◽

Factor Analysis ◽

Hong Kong ◽

Confirmatory Factor Analysis ◽

Psychometric Properties ◽

Measurement Invariance ◽

Social Environment ◽

Convergent Validity ◽

Confirmatory Factor ◽

Test Retest Reliability

This study evaluated the psychometric properties of a Chinese version of the 24-item Social Environment Questionnaire (SEQ-C). Confirmatory factor analysis was used to examine the factor validity and measurement invariance (Purpose 1) of the SEQ-C in 453 older adults in Hong Kong. Convergent validity (Purpose 2) and test–retest reliability (Purpose 3) were also measured. The results of the confirmatory factor analysis and measurement invariance supported the four-factor structure (representing companionship, encouragement, neighborhood social cohesion, and role models) of the SEQ-C, in a 15-item model that closely fitted the data. The SEQ-C was also found to have acceptable to satisfactory internal consistency, test–retest reliability, composite reliability, and moderate convergent validity in correlating perceived social support. This study showed that the SEQ-C is a suitable means of measuring the social environments of older adults in Hong Kong.

Download Full-text

The Screen for Child Anxiety Related Emotional Disorders (SCARED): Informant Discrepancy, Measurement Invariance, and Test–Retest Reliability

Child Psychiatry & Human Development ◽

10.1007/s10578-018-0854-0 ◽

2018 ◽

Vol 50 (3) ◽

pp. 473-482 ◽

Cited By ~ 15

Author(s):

Brigid Behrens ◽

Caroline Swetlitz ◽

Daniel S. Pine ◽

David Pagliaccio

Keyword(s):

Measurement Invariance ◽

Emotional Disorders ◽

Child Anxiety ◽

Retest Reliability ◽

Informant Discrepancy ◽

Test Retest Reliability

Download Full-text

Attachment Avoidance and Anxiety in Adolescence: Turkish Adaptation of the Experiences in Close Relationships-Relationship Structures Scale

Psychological Reports ◽

10.1177/0033294118785562 ◽

2018 ◽

Vol 122 (4) ◽

pp. 1372-1394

Author(s):

Savaş Karataş ◽

İlkay Demir

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Factor Structure ◽

Close Relationships ◽

Attachment Avoidance ◽

Internal Reliability ◽

Retest Reliability ◽

Confirmatory Factor ◽

Relationship Structures ◽

Test Retest Reliability

The aim of the present study is to test the factor structure and reliability of the Experience of Close Relationships-Relationship Structures Scale (ECR-RS) mother, father, romantic partner, close friend forms among Turkish adolescents. In order to test the structure validity of the ECR-RS, exploratory factor analysis is performed on a sample of 214 participants in Study 1, and to further investigate the structure validity, confirmatory factor analysis is performed on a second sample of 286 participants in Study 2. Within the scope of the reliability studies of the ECR-RS, internal reliability and test–retest reliability of the Turkish ECR-RS are also tested. The results of the explanatory and confirmatory factor analysis, Cronbach’s alpha coefficients, and test–retest reliability scores supported the original two-factor structure (attachment avoidance and attachment anxiety) for all forms of the ECR-RS among Turkish adolescents.

Download Full-text

Development of a patient safety culture scale for maternal and child health institutions in China: a cross-sectional validation study

BMJ Open ◽

10.1136/bmjopen-2018-025607 ◽

2019 ◽

Vol 9 (9) ◽

pp. e025607

Author(s):

Yuanyuan Wang ◽

Hui Han ◽

Liqian Qiu ◽

Chaojie Liu ◽

Yan Wang ◽

...

Keyword(s):

Factor Analysis ◽

Patient Safety ◽

Safety Culture ◽

Health Workers ◽

Reliability And Validity ◽

Patient Safety Culture ◽

Cross Sectional ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectiveThis study aimed to develop a patient safety culture (PSC) scale for maternal and child healthcare (MCH) institutions in China.MethodsA theoretical framework of PSC for MCH institutions was proposed through in-depth interviews with MCH workers and patients and Delphi expert consultations. The reliability and validity of the PSC scale were tested in a cross-sectional survey of 1256 MCH workers from 14 MCH institutions in Zhejiang province of China. The study sample was randomly split into half for exploratory and confirmatory factor analyses, respectively. Test–retest reliability was assessed through a repeated survey of 63 voluntary participants 2 weeks apart.ResultsThe exploratory factor analysis extracted 10 components: patient engagement in patient safety (six items), managerial response to patient safety risks (four items), perceived management support (five items), staff empowerment (four items), staffing and workloads (four items), reporting of adverse events (three items), defensive medical practice (three items), work commitment (three items), training (two items) and transfer and handoff (three items). A good model fit was found in the confirmatory factor analysis: χ2/df=1.822, standardised root mean residual=0.048, root mean square error of approximation=0.038, comparative fit index=0.921, Tucker-Lewis index=0.907. The PSC scale had a Cronbach’s α coefficient of 0.89 (0.59–0.90 for dimensional scales) and a test–retest reliability of 0.81 (0.63–0.87 for dimensional reliability), respectively. The intracluster correlation coefficients confirmed a hierarchical nature of the data: individual health workers nested within MCH institutions.ConclusionThe PSC scale for MCH institutions has acceptable reliability and validity. Further studies are needed to establish benchmarking in a national representative sample through a multilevel modelling approach.

Download Full-text

Patient Continuity of Care Questionnaire in a cardiac sample: A Confirmatory Factor Analysis

BMJ Open ◽

10.1136/bmjopen-2020-037129 ◽

2020 ◽

Vol 10 (7) ◽

pp. e037129

Author(s):

Emma Säfström ◽

Lena Nasstrom ◽

Maria Liljeroos ◽

Lena Nordgren ◽

Kristofer Årestedt ◽

...

Keyword(s):

Psychometric Properties ◽

Factor Structure ◽

Continuity Of Care ◽

Internal Consistency ◽

Intraclass Correlation ◽

Evaluation Study ◽

Sampling Procedure ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectiveEven though continuity is essential after discharge, there is a lack of reliable questionnaires to measure and assess patients’ perceptions of continuity of care. The Patient Continuity of Care Questionnaire (PCCQ) addresses the period before and after discharge from hospital. However, previous studies show that the factor structure needs to be confirmed and validated in larger samples, and the aim of this study was to evaluate the psychometric properties of the PCCQ with focus on factor structure, internal consistency and stability.DesignA psychometric evaluation study. The questionnaire was translated into Swedish using a forward–backward technique and culturally adapted through cognitive interviews (n=12) and reviewed by researchers (n=8).SettingData were collected in four healthcare settings in two Swedish counties.ParticipantsA consecutive sampling procedure included 725 patients discharged after hospitalisation due to angina, acute myocardial infarction, heart failure or atrial fibrillation.MeasurementTo evaluate the factor structure, confirmatory factor analyses based on polychoric correlations were performed (n=721). Internal consistency was evaluated by ordinal alpha. Test–retest reliability (n=289) was assessed with intraclass correlation coefficient (ICC).ResultsThe original six-factor structure was overall confirmed, but minor refinements were required to reach satisfactory model fit. The standardised factor loadings ranged between 0.68 and 0.94, and ordinal alpha ranged between 0.82 and 0.95. All subscales demonstrated satisfactory test–retest reliability (ICC=0.76–0.94).ConclusionThe revised version of the PCCQ showed sound psychometric properties and is ready to be used to measure perceptions of continuity of care. High ordinal alpha in some subscales indicates that a shorter version of the questionnaire can be developed.

Download Full-text

Assessing psychological adjustment and cultural reintegration after military service: development and psychometric evaluation of the post-separation Military-Civilian Adjustment and Reintegration Measure (M-CARM)

BMC Psychiatry ◽

10.1186/s12888-020-02936-y ◽

2020 ◽

Vol 20 (1) ◽

Author(s):

Madeline Romaniuk ◽

Gina Fisher ◽

Chloe Kidd ◽

Philip J. Batterham

Keyword(s):

Factor Analysis ◽

Phase I ◽

Psychological Adjustment ◽

Internal Consistency ◽

Military Service ◽

Discriminant Validity ◽

Civilian Life ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

Abstract Background The transition out of military service and subsequent reintegration to civilian life has been established as a period associated with an increased risk of psychological adjustment difficulties, psychiatric disorders and suicide risk, yet no tool exists to measure cultural and psychological adjustment following permanent separation from the military. This study describes the two-phase mixed-methods development and validation of the self-report Military-Civilian Adjustment and Reintegration Measure (M-CARM). Methods In Phase I, four focus groups (n = 20) and semi-structured one-on-one interviews (n = 80) enabled thematic analysis and generation of 53 initial items that were reviewed by an expert multidisciplinary panel (n = 12) and piloted for clarity and relevance in an Australian service-veteran sample (n = 11). In Phase II, psychometric properties of the 47 items resulting from Phase I were evaluated with online assessment of a convenience sample of transitioned Australian Defence Force veterans (n = 725). Analyses included exploratory and confirmatory factor analyses, as well as evaluation of test-retest reliability, internal consistency, and convergent, divergent and discriminant validity. Results Exploratory factor analysis on a randomized split-half sample (n = 357), resulted in a 21-item, five-factor solution of Purpose and Connection, Help seeking, Beliefs about civilians, Resentment and regret, and Regimentation, explaining 53.22% of the variance. Confirmatory factor analysis (n = 368) verified this factor structure without modification (χ2 = 304.96, df = 160; CFI = .96, TLI = .94, NFI = .91, RMSEA = .05). Strong convergent, divergent and discriminant validity was demonstrated as M-CARM scores significantly correlated with related constructs assessed by standardised clinical measures as well as differentiated groups based on three binary reintegration items, with large effect sizes (d = > 1). Strong test-retest reliability for the total score (n = 186, r = .93) and excellent internal consistency (n = 725, a = .90) were also found. Conclusions Results provide promising evidence the M-CARM is a valid, reliable measure of psychological and cultural reintegration to civilian life, with potential for considerable clinical and research application.

Download Full-text

The development and initial validation of the Chinese Significant Wish Fulfillment Scale

International Psychogeriatrics ◽

10.1017/s1041610210001341 ◽

2010 ◽

Vol 23 (3) ◽

pp. 442-449

Author(s):

Amy Y. M. Chow ◽

Meetim Chow ◽

Catherine K. P. Wan ◽

Katherine K. L. Wong ◽

Rita W. T. Cheung

Keyword(s):

Older Adults ◽

Factor Analysis ◽

Convergent Validity ◽

Internal Reliability ◽

Retest Reliability ◽

Confirmatory Factor ◽

Wish Fulfillment ◽

Test Retest Reliability ◽

Development And Validation ◽

Depth Interviews

ABSTRACTBackground: This paper reports the development and validation of the Chinese Significant Wish Fulfillment Scale (CSWFS), a new multidimensional scale for assessing the perceived importance and level of fulfillment of wishes of older adults.Methods: Three studies were involved. Study 1 developed a 26-item pool on wish fulfillment through in-depth interviews with 22 older adults. Study 2 reduced the pool to 23 items through validation with a new sample of 315 older adults and examined the internal reliability. Study 3 involved a confirmatory factor analysis (CFA) and examined the test-retest reliability and the convergent validity of the scale with the construct of regret.Results: A five-factor structure model of 23 items was identified through exploratory factor analysis, which accounted for 51.67% of variance. As informed by the CFA in Study 3, a five-factor 22-item model was the best fit. Internal reliability and test-retest reliability was found to be good. Convergent validity was examined through correlation with the construct of future regret. The correlation, though statistically significant, was small.Conclusion: CSWFS demonstrates good psychometric properties, but the construct might be slightly different from that of future regrets. Probably, CSWFS addresses a construct that is under-explored but is of importance to older adults and especially to the Chinese community.

Download Full-text

The My Children’s Future Scale: Construct validity, measurement invariance, and reliability in a Turkish sample

Australian Journal of Career Development ◽

10.1177/1038416220941853 ◽

2020 ◽

Vol 29 (3) ◽

pp. 185-195

Author(s):

Erol Esen

Keyword(s):

Data Collection ◽

Construct Validity ◽

Measurement Invariance ◽

Factor Structure ◽

Reliable Data ◽

Data Collection Tool ◽

Psychometric Characteristics ◽

Retest Reliability ◽

Parent Gender ◽

Test Retest Reliability

The My Children’s Future Scale (MCFS) measures the support provided by parents for their children’s careers. The aim of this study was to adapt the MCFS to Turkish and examine its psychometric characteristics in a study conducted in the Turkish context. Participants consisted of 280 parents (190 mothers and 90 fathers). The factor structure of the MCFS and measurement invariance across parent gender were examined. The unidimensional factor structure was confirmed and the scale was invariant across parent gender. In addition, the reliability of the MCFS was assessed for internal consistency and test-retest reliability. Cronbach’s alpha and McDonald’s omega coefficients were calculated as .87, and test-retest reliability coefficient as .83. Our findings suggested that the Turkish form of the MCFS can be considered a valid and reliable data collection tool for use in Turkey to measure the support provided by parents for their children’s careers.

Download Full-text