Psychometric Properties of the Emotional Processing Scale in Individuals with Psychiatric Symptoms and the Development of a Brief 15-Item Version

Abstract Objective The 25-item Emotional Processing Scale (EPS) is a measure of emotional processing. There is a scarcity of research about its factor structure, test-retest reliability, and validity in individuals with psychiatric symptoms. Method We administered the EPS-25 to a sample (N=512) of people with elevated psychiatric symptoms, using confirmatory factor analysis to evaluate three a priori models from previous research. We then evaluated discriminant and convergent validity against measures of alexithymia (Toronto Alexithymia Scale-20; TAS-20), depressive symptoms (Patient Health Questionaire-9; PHQ-9) and anxiety symptoms (Generalized Anxiety Disorder-7; GAD-7). Results None of the a priori models achieved acceptable fit, and subsequent exploratory factor analysis did not lead to a convincing factor solution for the 25 items. A 5-factor model did, however, achieve acceptable fit if we retained only 15 items (EPS-15) and this solution could be replicated in a holdout sample. Convergent and discriminant validity for EPS-15 was r=-.19-.46 vs. TAS-20, r=.07-.25 vs. PHQ-9, r=.29-.57 vs. GAD-7. Test-retest reliability was ICC=.73. Conclusions This study strengthens the case for the reliability and validity of the five factor Emotional Processing Scale but suggest that only 15 items should be retained. Future studies should further examine the reliability and validity of the EPS-15.

Download Full-text

Reliability and Structural and Construct Validity of the Functional Strength Measurement in Children Aged 4 to 10 Years

Physical Therapy ◽

10.2522/ptj.20140018 ◽

2016 ◽

Vol 96 (6) ◽

pp. 888-897 ◽

Cited By ~ 13

Author(s):

Wendy F.M. Aertssen ◽

Gillian D. Ferguson ◽

Bouwien C.M. Smits-Engelsman

Keyword(s):

Factor Analysis ◽

Muscle Strength ◽

Construct Validity ◽

Exploratory Factor Analysis ◽

Convergent Validity ◽

Discriminant Validity ◽

Structural Validity ◽

Strength Measurement ◽

Retest Reliability ◽

Test Retest Reliability

Background Adequate muscle strength, power, and endurance are important in children's daily activities and sports. Various instruments have been developed for the assessment of muscle function; each measures different aspects. The Functional Strength Measurement (FSM) was developed to measure performance in activities in which strength is required. Objective The study objective was to establish the test-retest reliability and structural and construct validity of the FSM. Design A cross-sectional descriptive study was conducted. Methods The performance of 474 children with typical development on the FSM was examined. Test-retest reliability (n=47) was calculated with the intraclass correlation coefficient (2.1A) for agreement. Structural validity was examined with exploratory factor analysis, and internal consistency was established with the Cronbach alpha. Construct validity was determined by calculating correlations between FSM scores and scores obtained with a handheld dynamometer (HHD) (n=252) (convergent validity) and between FSM scores and scores on the Movement Assessment Battery for Children–2 (MABC-2) (n=77) (discriminant validity). Results The test-retest reliability of the FSM total score ranged from .91 to .94. The structural validity revealed one dimension, containing all 8 FSM items. The Cronbach alpha was .74. The convergent validity with the HHD ranged from .42 to .74. The discriminant validity with MABC-2 items revealed correlations that were generally lower than .39, and most of the correlations were not significant. Exploratory factor analysis of a combined data set (FSM, HHD, and MABC-2; n=77) revealed 2 factors: muscle strength/power and muscle endurance with an agility component. Limitations Discriminant validity was measured only in children aged 4 to 6 years. Conclusions The FSM, a norm-referenced test for measuring functional strength in children aged 4 to 10 years, has good test-retest reliability and good construct validity.

Download Full-text

Using photos of basic facial expressions as a new approach to measuring implicit attitudes

PLoS ONE ◽

10.1371/journal.pone.0250922 ◽

2021 ◽

Vol 16 (5) ◽

pp. e0250922

Author(s):

Klara Malinakova ◽

Richard Korinek ◽

Peter Tavel ◽

Iva Polackova Solcova ◽

Harold G. Koenig ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Online Survey ◽

Discriminant Validity ◽

Implicit Attitudes ◽

Selection Process ◽

Reliability And Validity ◽

Criterion Validity ◽

Retest Reliability ◽

Test Retest Reliability

Background Measuring implicit attitudes is difficult due to social desirability (SD). A new method, the Emotion Based Approach (EBA), can solve this by using emotions from a display of faces as response categories. We applied this on an EBA Spirituality tool (EBA-SPT) and an Actual Situation tool (EBA-AST). Our aim was to assess the structure, reliability and validity of the tools and to compare two EBA assessment approaches, i.e., an explicit one (only assessing final replies to items) and an implicit one (assessing also the selection process). Methods We obtained data on a sample of Czech adults (n = 522, age 30.3±12.58; 27.0% men) via an online survey; cortisol was assessed in 46 participants. We assessed the structure and psychometric properties (internal consistency and test-retest reliability; convergent, discriminant, and criterion validity) of the EBA, and examined the differences between explicit vs. implicit EBA approaches. Results We found an acceptable-good internal consistency reliability of the EBA tools, acceptable discriminant validity between them and low (neutral expression) to good (joy) test-retest reliability for concrete emotions assessed by the tools. An implicit EBA approach showed stronger correlations between emotions and weaker convergent validity, but higher criterion validity, than an explicit approach and standard questionnaires. Conclusion Compared to standard questionnaires, EBA is a more reliable approach for measuring attitudes, with an implicit approach that reflects the selection process yielding the best results.

Download Full-text

Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

BMC Medical Education ◽

10.1186/s12909-020-02437-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Liyuan Cui ◽

Yaxin Zhu ◽

Jinglou Qu ◽

Liming Tie ◽

Ziqi Wang ◽

...

Keyword(s):

Factor Analysis ◽

Critical Thinking ◽

Medical Students ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Retest Reliability ◽

Critical Thinking Disposition ◽

Thinking Disposition ◽

Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182312507 ◽

2021 ◽

Vol 18 (23) ◽

pp. 12507

Author(s):

Lavinia De Chiara ◽

Cristina Mazza ◽

Eleonora Ricci ◽

Alexia Emilia Koukopoulos ◽

Georgios D. Kotzalidis ◽

...

Keyword(s):

Convergent Validity ◽

Predictive Power ◽

Discriminant Validity ◽

Late Pregnancy ◽

Italian Version ◽

Retest Reliability ◽

Dsm 5 ◽

Insomnia Symptom ◽

Symptom Questionnaire ◽

Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

Download Full-text

The assessment of perceived information pollution in banking sector

Business Information Review ◽

10.1177/0266382118772891 ◽

2018 ◽

Vol 35 (2) ◽

pp. 68-76 ◽

Cited By ~ 5

Author(s):

Qaisar Iqbal ◽

Siti Hasnah Hassan ◽

Noor Hazlina Ahmad

Keyword(s):

Factor Analysis ◽

Convergent Validity ◽

Information Quality ◽

Discriminant Validity ◽

Banking Sector ◽

Reliability And Validity ◽

Measurement Scale ◽

Area Of Interest ◽

The Social ◽

Relationship Of

Infollution management is a substantial dilemma in this century. There is lacking empirical evidence about infollution management. Perceived infollution has been explored based on information quality. This study aims to identify the factors of perceived infollution (information pollution) and validate those factors using confirmatory factor analysis (CFA). Researchers have personally collected data from employees of the banking sector. Factor analysis was performed to explore the factors using Statistical Package for the Social Science, and CFA was conducted to check the reliability, validity, and the model fitness in SmartPLS. The scale developed in this study has exhibited high values of reliability and validity and ensured the presence of both discriminant validity and convergent validity. The newly developed scale of perceived infollution provides a basis for most of the academicians and researchers to empirically investigate the relationship of perceived infollution with individual’s performance and organizational effectiveness, which is considered an important area of interest among the academic researchers in recent years. Extent literature review suggests that it is the first study conducted to develop measurement scale of perceived infollution (information pollution).

Download Full-text

Development of a patient safety culture scale for maternal and child health institutions in China: a cross-sectional validation study

BMJ Open ◽

10.1136/bmjopen-2018-025607 ◽

2019 ◽

Vol 9 (9) ◽

pp. e025607

Author(s):

Yuanyuan Wang ◽

Hui Han ◽

Liqian Qiu ◽

Chaojie Liu ◽

Yan Wang ◽

...

Keyword(s):

Factor Analysis ◽

Patient Safety ◽

Safety Culture ◽

Health Workers ◽

Reliability And Validity ◽

Patient Safety Culture ◽

Cross Sectional ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectiveThis study aimed to develop a patient safety culture (PSC) scale for maternal and child healthcare (MCH) institutions in China.MethodsA theoretical framework of PSC for MCH institutions was proposed through in-depth interviews with MCH workers and patients and Delphi expert consultations. The reliability and validity of the PSC scale were tested in a cross-sectional survey of 1256 MCH workers from 14 MCH institutions in Zhejiang province of China. The study sample was randomly split into half for exploratory and confirmatory factor analyses, respectively. Test–retest reliability was assessed through a repeated survey of 63 voluntary participants 2 weeks apart.ResultsThe exploratory factor analysis extracted 10 components: patient engagement in patient safety (six items), managerial response to patient safety risks (four items), perceived management support (five items), staff empowerment (four items), staffing and workloads (four items), reporting of adverse events (three items), defensive medical practice (three items), work commitment (three items), training (two items) and transfer and handoff (three items). A good model fit was found in the confirmatory factor analysis: χ2/df=1.822, standardised root mean residual=0.048, root mean square error of approximation=0.038, comparative fit index=0.921, Tucker-Lewis index=0.907. The PSC scale had a Cronbach’s α coefficient of 0.89 (0.59–0.90 for dimensional scales) and a test–retest reliability of 0.81 (0.63–0.87 for dimensional reliability), respectively. The intracluster correlation coefficients confirmed a hierarchical nature of the data: individual health workers nested within MCH institutions.ConclusionThe PSC scale for MCH institutions has acceptable reliability and validity. Further studies are needed to establish benchmarking in a national representative sample through a multilevel modelling approach.

Download Full-text

Anxiety Symptoms Questionnaire (ASQ): development and validation

General Psychiatry ◽

10.1136/gpsych-2019-100144 ◽

2019 ◽

Vol 32 (6) ◽

pp. e100144

Author(s):

Amanda Baker ◽

Naomi Simon ◽

Aparna Keshaviah ◽

Amy Farabaugh ◽

Thilo Deckersbach ◽

...

Keyword(s):

College Students ◽

Factor Analysis ◽

Anxiety Disorder ◽

Reliability And Validity ◽

Anxiety Symptoms ◽

Self Report ◽

Retest Reliability ◽

Control Subjects ◽

Clinical Control ◽

Test Retest Reliability

BackgroundThe Anxiety Symptoms Questionnaire (ASQ) is a brief self-report questionnaire which measures frequency and intensity of symptoms and was developed to improve assessment of anxiety symptoms in a clinical setting. We examined the reliability and validity of the ASQ in patients with anxiety disorders and/or depression, non-clinical control subjects and college students.Methods240 outpatients with generalised anxiety disorder, social anxiety disorder, panic disorder or major depressive disorder were administered the ASQ and additional questionnaires measuring depression and anxiety, as were 111 non-clinical control subjects and 487 college students. Factor analysis, Pearson’s correlation coefficients and logistic regression were used to assess reliability and validity. Test–retest reliability of the ASQ was measured using a subset who were re-administered the ASQ after 4 weeks.ResultsFactor analysis revealed measurement of a single dimension by the ASQ. Internal consistency and test–retest reliability were strong. The ASQ total score also significantly distinguished patients with an anxiety disorder from the clinical controls above and beyond the clinician-rated Hamilton Anxiety Scale.ConclusionsThe ASQ is a valid, reliable and effective self-rated measure of anxiety and may be a useful tool for screening and assessing anxiety symptoms in psychiatric as well as college settings.

Download Full-text

Measuring the occupational balance of people with insomnia in a Chinese population: Preliminary psychometric evidence on the Chinese version of the Occupational Balance Questionnaire

Hong Kong Journal of Occupational Therapy ◽

10.1177/1569186120944534 ◽

2020 ◽

pp. 156918612094453

Author(s):

Eris CM Ho ◽

Mona Dür ◽

Tanja Stamm ◽

Andrew MH Siu

Keyword(s):

Factor Analysis ◽

Internal Consistency ◽

Convergent Validity ◽

Well Being ◽

Living Environment ◽

Chinese Version ◽

Retest Reliability ◽

Significant Difference ◽

Test Retest Reliability ◽

Insomnia Severity

Background Occupational balance, a fundamental concept in occupational therapy, is the arrangement of right amount and variety of occupations contributes to a person’s health and well-being. This study was aimed to investigate the reliability and validity of the Chinese version of the Occupational Balance Questionnaire (OB-Quest) for people with insomnia. Methods The OB-Quest was translated into traditional Chinese and reviewed by an expert panel for content validity, cultural relevance and translation accuracy. Internal consistency, factor analysis and convergent validity, as well as test–retest reliability, were explored. Results The participants (n = 205), 115 adults with insomnia and 90 adults without insomnia, completed a survey of demographic background, the Chinese version of OB-Quest and the Chinese Insomnia Severity Index (C-ISI). The Chinese version of OB-Quest demonstrated excellent test–retest reliability (ICC= 0.98) and good internal consistency (Cronbach’s α = 0.80). Factor analysis indicated that a single-factor solution explained 42% of the variance, and 9 out of 10 items had a factor loading of 0.4 or above. The Chinese version of OB-Quest had significant correlations with C-ISI (r = –0.88; p < 0.001). A significant difference was found in occupational balance between groups with different levels of insomnia severity and without insomnia (F = 169.72; p < 0.001). As in a previous study, age, living environment and life role had no significant relationship with occupational balance. Conclusion The Chinese version of OB-Quest is a short, easy to understand and culturally relevant assessment for Chinese. It demonstrates satisfactory psychometric properties and had significant correlations with insomnia.

Download Full-text

Assessing psychological adjustment and cultural reintegration after military service: development and psychometric evaluation of the post-separation Military-Civilian Adjustment and Reintegration Measure (M-CARM)

BMC Psychiatry ◽

10.1186/s12888-020-02936-y ◽

2020 ◽

Vol 20 (1) ◽

Author(s):

Madeline Romaniuk ◽

Gina Fisher ◽

Chloe Kidd ◽

Philip J. Batterham

Keyword(s):

Factor Analysis ◽

Phase I ◽

Psychological Adjustment ◽

Internal Consistency ◽

Military Service ◽

Discriminant Validity ◽

Civilian Life ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

Abstract Background The transition out of military service and subsequent reintegration to civilian life has been established as a period associated with an increased risk of psychological adjustment difficulties, psychiatric disorders and suicide risk, yet no tool exists to measure cultural and psychological adjustment following permanent separation from the military. This study describes the two-phase mixed-methods development and validation of the self-report Military-Civilian Adjustment and Reintegration Measure (M-CARM). Methods In Phase I, four focus groups (n = 20) and semi-structured one-on-one interviews (n = 80) enabled thematic analysis and generation of 53 initial items that were reviewed by an expert multidisciplinary panel (n = 12) and piloted for clarity and relevance in an Australian service-veteran sample (n = 11). In Phase II, psychometric properties of the 47 items resulting from Phase I were evaluated with online assessment of a convenience sample of transitioned Australian Defence Force veterans (n = 725). Analyses included exploratory and confirmatory factor analyses, as well as evaluation of test-retest reliability, internal consistency, and convergent, divergent and discriminant validity. Results Exploratory factor analysis on a randomized split-half sample (n = 357), resulted in a 21-item, five-factor solution of Purpose and Connection, Help seeking, Beliefs about civilians, Resentment and regret, and Regimentation, explaining 53.22% of the variance. Confirmatory factor analysis (n = 368) verified this factor structure without modification (χ2 = 304.96, df = 160; CFI = .96, TLI = .94, NFI = .91, RMSEA = .05). Strong convergent, divergent and discriminant validity was demonstrated as M-CARM scores significantly correlated with related constructs assessed by standardised clinical measures as well as differentiated groups based on three binary reintegration items, with large effect sizes (d = > 1). Strong test-retest reliability for the total score (n = 186, r = .93) and excellent internal consistency (n = 725, a = .90) were also found. Conclusions Results provide promising evidence the M-CARM is a valid, reliable measure of psychological and cultural reintegration to civilian life, with potential for considerable clinical and research application.

Download Full-text