Revisión sistemática de la Escala de Ansiedad y Depresión Hospitalaria (HADS) en muestras mexicanas. ¿Debemos regresar al principio?

Systematic review of the psychometric properties of the Hospital Anxiety and Depression Scale (HADS)in Mexican samples: Should we go back to the beginning Abstract: A systematic review was run in order to find validation studies on the Hospital Anxiety and Depression Scale (HADS) in Mexican samples. Specialized databases and referencia sections of some articles were searched to locate this evidence. We found 10 articles that analyzed the psychometric properties of the HADS. The analysis showed that in all of the studies reliability was adequate and generally a two-factor structure could be supported. Nevertheless, we identified five different versions of the HADS and did not find any information about the translation process. In conclusion, the adequate internal consistency of the HADS could be confirmed but regarding the two-factor structure and cut-off points evidence is not conclusive. Key words: HADS; reliability; validity; psychometric properties; Mexico. Resumen: El propósito de esta investigación fue realizar una revisión sistemática de los estudios de validación de las propiedades psicométricas de la Escala de Ansiedad y Depresión Hospitalaria (HADS) en muestras mexicanas. Se realizó una búsqueda en bases de datos especializadas y en las referencias de los artículos. Se encontraron 10 estudios en los que se analizaron las propiedades psicométricas de la HADS. El análisis mostró que en todas las invesigaciones se evaluó la fiabilidad y ésta fue adecuada; en general, los estudios apoyan una estructura de dos factores. Sin embargo, se identificaron cinco versiones diferentes de la HADS y no se encontró información sobre cómo se realizó la traducción. En conclusión, se confirma que la consistencia interna de la HADS es adecuada, si bien los estudios apoyan la estructura de dos factores la evidencia no es concluyente, como tampoco lo es respecto a los puntos de corte. Palabras clave: HADS; fiabilidad; validez; propiedades psicométricas; México.

Outcomes Assessment in Psychological Treatment: Spanish adaptation of OQ-45 (Outcome Questionnaire)

Introduction: The Lambert’s Outcomes Questionnaire (OQ-45) is a 45-item self-administered instrument used to measure clinical outcomes in psychotherapy. It measures functioning through three areas: symptoms distress, interpersonal relations and social role. The objective of this paper is to assess the reliability and the validity of its Spanish version. Method:A sample of 639 subjects, non-clinical and clinical, completed the instrument. Results: The psychometric evidences of the questionnaire showed an adequate internal consistency (.97 and .91) and acceptable convergent validity with the BDI, STAI, PSS and SF-12. The Confirmatory Factor Analyses suggested a bifactor structure. The cut-off points have been established for the subscales and total score (54.5), considering the clinical criterion, which means, prioritizing slightly the sensibility over the specificity. The RCI was 3.80 and Minimum Change Score 17.56. Conclusion: The OQ-45 showed acceptable psychometric properties, providing support for using this version of the questionnaire to assess Spanish’s functionality. Given these findings, this tool could help clinicians evaluate treatment efficacy and establish psychotherapy goals.

Formative Assessment of Social-Emotional Skills Using Rubrics: A Review of Knowns and Unknowns

Educational practitioners have been increasingly interested in the use of formative assessment and rubrics to develop social-emotional skills in children and adolescents. Although social-emotional rubrics are nowadays commonly used, a thorough evaluation of their psychometric properties has not been conducted. In this scoping review, we examine the knowns and unknowns of the use of formative assessment approaches and rubrics in social-emotional learning. We first review initiatives of formative assessment and development of rubrics to assess social-emotional skills. Then, we discuss challenges associated with the development and use of rubrics to evaluate social-emotional skills in youth focusing on 1) assessment of single skills versus assessment of a comprehensive taxonomy of skills; 2) developing rubrics’ performance level descriptions that accurately describe increasing mastery of skills; 3) obtaining adequate internal consistency and discriminant validity evidence; 4) self-reports versus observer reports of skills; and finally 5) how to account for adolescents’ development in the construction of rubrics. This review outlines a research agenda for the psychometric study of rubrics to be used in social-emotional skill assessment.

Development and validation of the acceptance of dating violence questionnaire

The purpose of this study was to develop and validate a questionnaire to measure the acceptance of dating violence among young Chileans, that evaluates both victimization and perpetration perspectives. Based on the Intimate Partner Violence Attitudes Scale, items were developed to fulfill these criteria and were refined through experts’ revisions and participant focus groups. The 30-item questionnaire created (with 15 similar items to measure both perpetration and victimization) was applied to 1120 Chilean high school and university students (14–27 years old, 59.9% females). Results of factorial analysis showed the questionnaire had an adequate fit with the correlated three-factor model (control, emotional violence, and physical violence) for each version (victimization and perpetration). Reliability analyses indicated an adequate internal consistency, and correlations with dating violence provide evidence on its concurrent validity. Results also showed that boys/men accepted more dating violence than girls/women, and adolescents than emerging adults.

Development and Validation of a Questionnaire to Assess Creative Potential Traits

The aim of the study was to develop an inventory to assess traits of creative potential and to analyze its psychometric properties. Three dimensions that could be associated with creative potential were proposed: willingness to transgress, willingness to take on challenges, and willingness to explore. For this purpose 551 participants were chosen to respond to an inventory composed of 12 items: Traits of Creative Potential Questionnaire, (TCPQ-12) and other tests to determine concurrent validity. The correlations between these instruments were significant. In addition, the instrument showed adequate internal consistency (Ω = 0.813) and the exploratory factor analysis yielded salient factors coincident with the proposed dimensions. The confirmatory factor analysis indicated an optimal fit (CFI = 0.984, TLI = 0.979, GFI = 0.963, RMSEA = 0.035). with composite reliability (CR) values > 0.70 in two factors and in one was slightly lower (CR = 0.684). The average variance extracted (AVE) was > 0.5 in two factors and in one < 0.5. The study data allow to highlight that the instrument presented here is a concise instrument with adequate psychometric properties.

Development of the set of scales to assess the job satisfaction among physicians in Peru: validity and reliability assessment

Background To assess the validity and reliability of the set of scales (general professional activity, health services management, and working conditions) on the different areas of job satisfaction in Peruvian physicians based on the data from the National Survey of Satisfaction of Users in Health (ENSUSALUD). Method We carried out a psychometric study based on the secondary data analysis of Questionnaire 2 of ENSUSALUD-2016. Participants were selected from a two-stage stratified national probability representative sampling by political region. Validity was assessed by exploratory and confirmatory factor analyses, and measurement invariance analysis. We assessed the reliability using internal consistency coefficients (alpha and omega). The set of scales were composed of items related to three different areas of job satisfaction: 1) satisfaction with general professional activity, 2) satisfaction with the health services management, and 3) satisfaction with the working conditions of the health center. Results We included 2137 participants in the analysis. The general professional activity scale with six items (Comparative Fit Index, CFI = 0.946; Root Mean Square Error of Approximation, RMSEA = 0.071; Standardized Root Mean Square Residual, SRMR = 0.035), the health services management scale with eight items (CFI) = 0.972; RMSEA = 0.081; SRMR = 0.028), showed good measurement properties for the one-dimensional model. The working conditions scale with eight items for individual conditions and three items for infrastructural conditions (CFI = 0.914; RMSEA = 0.080; SRMR = 0.055) presented adequate measurement properties with a two-dimensional model. The invariance analysis showed that comparisons between sex, age, civil status, medical speciality, working in other institutions, work-related illness, chronic disease, and time working in the healthcare center. All scales had adequate internal consistency (ω and α between 0.70 and 0.90). Conclusions The set of scales has a solid factorial structure and measurement invariance, making it possible for group comparison. The study achieved stability in the scores as they showed adequate internal consistency coefficients. Based on our findings, these instruments are suitable for measuring job satisfaction among outpatient physicians throughout Peru, as our data is representative of the country level.

Validation Study of the Korean Version of Rothbart’s Infant Behavior Questionnaire-Revised

This study presents the psychometric properties of the Infant Behavior Questionnaire-Revised (IBQ-R), including internal consistency, content validity, and construct validity. The IBQ-R is a caregiver (parent) reporting instrument designed to assess temperament in infants (aged 3-12 months). Two groups of participants were included. The first group comprised 92 infants and the second 83 infants, giving a total of 175 infants (M=8.3 months, 80 boys and 95 girls). Their caregivers completed IBQ-R. The IBQ-R subscales demonstrated adequate internal consistency. Also, confirmatory factor analyses of the IBQ-R scale found that three broad dimensions: surgency, negative affectivity, and orientation/regulation. This study confirmed that the IBQ-R is a reliable and valid temperament instrument that can be recommended for evaluating temperament in infants.

Modelos factoriales de la Escala de Autoestima de Rosenberg en adolescentes peruanos

Factorial models of Rosenberg’s Self-esteem Scale in Peruvian adolescentsAbstract: The Rosenberg Self-Esteem Scale (RSE) is an instrument widely used and designed to measure self-esteem in a single dimension. The aim of this research was to analyze the internal structure and the reliability of the RSE in Peruvian adolescents. The scale was administered to a total of 715 adolescents (51.3% female) with an average age of 12.20 years. Six models were identified by confirmatory factor analysis, which correspond to factorial structures reported in previous studies. The results showed a better goodness of fit for the one-dimensional model with control of method effects on inverse items, eliminating item 8 due to its ambiguity. Reliability was adequate and was calculated using the omega coefficient. The unifactorial structure of the RSE is discussed and it is concluded that the instrument reports evidence of validity and adequate internal consistency to be used in the Peruvian context.Keywords: Self-esteem; teenagers; validity; reliability.Resumen: La Escala de Autoestima de Rosenberg (RSE) es un instrumento ampliamente utilizado que fue diseñado para medir la autoestima en una sola dimensión. La presente investigación tuvo como objetivo principal analizar la estructura interna y la fiabilidad de la RSE en adolescentes peruanos. La escala fue administrada a un total de 715 adolescentes (51.3% de sexo femenino; M edad = 12.20 años). Se identificaron seis modelos mediante análisis factorial confirmatorio, los cuales corresponden a estructuras factoriales reportadas en estudios previos. Los resultados mostraron mejores bondades de ajuste para el modelo unidimensional con control del efecto del método en ítems inversos eliminando el ítem 8 por su ambigüedad. La fiabilidad fue adecuada y se calculó a través del coeficiente omega. Se discute la estructura unifactorial de la RSE y se concluye que el instrumento proporciona evidencia de validez y consistencia interna adecuadas para ser utilizada en el contexto peruano.Palabras clave: Autoestima; adolescentes; validez; fiabilidad.

Reliabilita a faktorová validita dotazníku SPARO

In 2009, the SPARO questionnaire was one of the most used assessment methods in the Czech Republic (Urbánek, 2010), especially between psychologists in human resources, prisons, police, or the army. However, empirical evidence of its reliability and validity is missing. Using a significant sample of police officers and applicants to police, we researched the questionnaire's re­liability and factor validity. About half of the scales do not have adequate internal consistency; the majority of them are not unidimensional. Factor validity is questionable, especially in the main components of the questionnaire, which are highly correlated. These correlations were also present in the original standardized samples as our and original correlation matrices do not differ. The factor structure of the two general factors items is not clear and two dimensional. Our results do not support the use of the questionnaire in practice. It is necessary to confirm its’ predictive validity; the criterion validity is evaluated in our follow up study (Cígler & Rudá, 2021).

Development a set of scales to assess job satisfaction among physicians in Peru: validity and reliability assessment

Background: To assess the evidences of validity and reliability of a set of scales on different areas of job satisfaction (general professional activity, health services management, and working conditions) in Peruvian physicians based on data from the National Survey of Satisfaction of Users in Health (ENSUSALUD). Method: We carried out a psychometric study based on secondary data analysis. Participants were selected from a two-stage probabilistic national representative sampling stratified by political region. Validity was assessed by exploratory and confirmatory factor analysis and measurement invariance analysis. Reliability was assessed by internal consistency coefficients (alpha and omega). The set of scales was composed of items related to three different areas of job satisfaction: 1) satisfaction with general professional activity, 2) satisfaction with the health services management, and 3) satisfaction with the working conditions of the health center. Results: We included 2,137 participants in the analysis. General professional activity scale with 6 items (CFI=0.946; RMSEA=0.071; SRMR=0.035) and the health services management scale with 8 items (CFI=0.972; RMSEA=0.081; SRMR=0.028) showed good measurement properties for the one-dimensional model. The scale of working conditions presented adequate measurement properties with a two-dimensional model (CFI=0.914; RMSEA=0.080; SRMR=0.055): individual conditions (8 items) and infrastructural conditions (3 items). The invariance analysis presented that comparisons can be made between sex, age, civil status, medical specialty, working in other institutions, work-related illness, chronic disease, and time working in health care center. All scales had adequate internal consistency (ω and α between 0.70 and 0.90). Conclusions: The set of scales solid factorial structure and measurement invariance, which makes it possible for group comparison. They also achieved stability in their scores as they showed adequate internal consistency coefficients. Based on our findings, these instruments are suitable for measuring job satisfaction among outpatient physicians throughout Peru, as our data is representative at the country level.