Validity and reliability of the Self-administered-Psycho-TherApy-SystemS (SELFPASS) depression and anxiety self-assessment item pool: a cross-sectional online survey (Preprint)

2021 ◽  
Author(s):  
Gwendolyn Mayer ◽  
Svenja Hummel ◽  
Nadine Gronewold ◽  
Oetjen Neele ◽  
Thomas Hilbel ◽  
...  

BACKGROUND E-mental-health applications targeting at depression and anxiety have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental-health apps. The app SELFPASS (Self-administered-Psycho-TherApy-SystemS) is a self-management app to manage depressive and anxious symptoms. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been tested. OBJECTIVE The aim of this study is to investigate the validity and reliability of the SELFPASS item pool that has been developed for an internet-based daily self-assessment of depressive and anxious symptoms. METHODS An online link with the SELFPASS item pool and validated mood assessment scales were distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). The reliability was examined using Cronbach’s α. The construct validity was assessed via Pearson correlations with the Patients Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7) and the WHO-5-Wellbeing-Scale (WHO-5). A logistic regression was performed as an indicator for concurrent criterion validity of SP-D and SP-A. A factor analysis provides information about the underlying factor structure of the item pool. Item-scale-correlations were calculated in order to determine item quality. RESULTS A total of n=284 participants were included, with n=192 (67.6%) healthy subjects and n=92 (32.4%) patients. Cronbach’s α was α=0.94 for SP-D and α=0.88 for SP-A. We found significant positive correlations of SP-D and PHQ-9 (r=0.87, P<.001), SP-A and GAD-7 (r=0.80, P<.001), and negative correlations of SP-D and WHO-5 (r=-0.80, P<.001) and SP A and WHO-5 (r=-.69, P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: OR=1.03 (1.01 – 1.05), P<.001; SP-A: 1.05 (1.05 – 1.01), P=.01). The item pool showed two factors with one that consisted of mood-related items and another factor with somatic-related items. CONCLUSIONS The SELFPASS item pool showed good psychometric properties in terms of reliability, construct and criterion validity. However, the underlying factor structure could not be reduced to the two diagnostic categories depression and anxiety, but to a more mood related and a rather somatic factor. Few items should be replaced for future use.

2017 ◽  
Vol 33 (3) ◽  
pp. 548 ◽  
Author(s):  
Maria Fernández-Capo ◽  
Silvia Recoder ◽  
Juana Gómez-Benito ◽  
María Gámiz ◽  
Pilar Gual ◽  
...  

<p>Introduction: The Transgression-Related Interpersonal Motivation (TRIM-18) Inventory is an instrument that assesses episodic forgiveness. This scale is composed of three subscales: <em>avoidance</em>, <em>revenge</em> and <em>benevolence</em>. The present study examined the dimensionality of the Spanish version of the TRIM-18 (TRIM-18-S) and provided evidence of validity and reliability. Method: A total of 943 participants completed the TRIM-18-S.  A subset of 277 participants completed additional measures of empathy, anger, and information regarding the relation with the offender. Results: The TRIM-18-S showed good psychometric properties, and confirmatory factor analyses revealed a three-factor structure. Conclusions: The scale presents adequate psychometric properties for its potential use in a Spanish population.</p><p> </p>


2017 ◽  
Vol 9 (3) ◽  
pp. 21 ◽  
Author(s):  
Sofia von Humboldt ◽  
Isabel Leal

Objectives: Literature suggests some inconsistent results in the validity and reliability of the Satisfaction with Life Scale (SwLS) in older samples. The objective was to evaluate the psychometric properties of the SwLS in a cross-cultural sample of older adults.Methods: This is a validation study to assess the psychometric properties of the SWLS in a sample of 1291 older adults 75 years of age or older, cross-culturally diverse and living in the community. A confirmatory factor analysis was performed. Item analysis and reliability, were also assessed.Results: The systematic procedure used in the SwLS validation points to a good level of psychometric properties, such as reliability, construct, criterion validity, external validity and divergent criterion validity, suggesting that the SwL is assessing a construct different from the ones evaluated by PANAS and OtLQ.Conclusion: The SwLS has demonstrated reliability, validity, and reproducibility for use in measuring health-related satisfaction with life among older adults in policy programs and interventions in community settings.


2021 ◽  
Vol 12 ◽  
Author(s):  
Eun Sol Lee ◽  
Vin Ryu ◽  
Ji Hyun Lee ◽  
Hyeon Hong ◽  
Hyeree Han ◽  
...  

Background: Job stress of mental health professionals can have a negative impact on them, particularly their psychological health and mortality, and may also affect organizations' and institutions' ability to provide quality mental health services to patients.Aim: This study aimed to: (1) investigate the validity and reliability of the Korean Mental Health Professionals Stress Scale (K-MHPSS), (2) develop K-MHPSS cut-off points to measure clinical depression and anxiety, and (3) examine whether specific stressors vary by area of expertise.Methodology: Data were collected via an online survey over 3 months, from August to October 2020. An online survey using a survey website was administered to volunteers who accessed the link and consented to participate. Data from 558 participants (200 clinical psychologists, 157 nurses, and 201 social workers) were included in the final analysis. Confirmatory and exploratory factor analyses were conducted to examine the factor structure of the K-MHPSS; concurrent validity of the scale was determined by analyzing correlation; internal consistency was determined by Cronbach's alpha coefficient. In addition, ROC curve analysis and Youden's index were used to estimate optimal cut-off points for K-MHPSS; one-way ANOVA was performed to investigate the difference among the three groups.Results: The seven-factor model of the original scale did not be replicated by Korean mental health professionals. The K-MHPSS had the best fit with the six-factor model, which consists of 34 items. Concurrent validity was confirmed, and overall reliability was found to be good. The K-MHPSS cut-off points for depression and anxiety appeared to slightly different by professional groups. Furthermore, nurses and social workers showed significantly higher total scores compared to clinical psychologists, and there are significant differences in subscale scores among professionals.Conclusion: The Korean version of the MHPSS has appropriate psychometric properties and can be used to assess the occupational stress of mental health professionals. It can also serve as a reference point for screening clinical level of depression and anxiety in mental health professionals.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Anna Helena Elisabeth Santesson ◽  
Martin Bäckström ◽  
Robert Holmberg ◽  
Sean Perrin ◽  
Håkan Jarbin

Abstract Background There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the Divergence subscale has been questioned because of its low correlation with the other subscales and low inter-item correlations. The EBPAS is widely used to tailor and evaluate implementation efforts, but a Swedish version has not yet been validated. This study aimed to contribute to the development and cross-validation of the EBPAS by examining the factor structure of t a Swedish-language version in a large sample of mental health professionals. Methods The EBPAS was translated into Swedish and completed by 570 mental health professionals working in child and adolescent psychiatry settings spread across Sweden. The factor structure was examined using first-order, second-order and bifactor confirmatory factor analytic (CFA) models. Results Results suggested adequate fit for all CFA models. The EBPAS Total was strongly supported in the Swedish version. Support for the hierarchical second-order model was also strong, while the bifactor model gave mixed support for the subscales. The Openness and Requirements subscales came out best, while there were problems with both the Appeal (e.g. not different from the General Attitudes factor) and the Divergence subscales (e.g. low reliability). Conclusions Overall, the psychometric properties were on par with the English version and the total score appears to be a valid measure of general attitudes towards EBP. This is the first study supporting this General Attitudes factor based on a bifactor model. Although comparatively better supported in this Swedish sample, we conclude that the use of the EBPAS subscale scores may result in misleading conclusions. Practical implications and future directions are discussed.


2021 ◽  
Author(s):  
David Lacko ◽  
Tomáš Prošek ◽  
Jiří Čeněk ◽  
Michaela Helísková ◽  
Pavel Ugwitz ◽  
...  

Cognitive styles are commonly studied constructs in cognitive psychology. It can be argued that measurement of these styles in the past had significant shortcomings in validity and reliability. The theory of analytic and holistic cognitive styles followed from traditional research of cognitive styles and attempted to overcome these shortcomings. Unfortunately, the psychometric properties of its measurement methods in many cases were debatable or not reported. New statistical approaches, such as analysis of reaction times, have been reported in the recent literature but remain overlooked by current research on analytic and holistic cognitive styles. The aim of this pre-registered study was to verify the psychometric properties (i.e., factor structure, split-half reliability, test-retest reliability, discriminant validity with intelligence and personality, and divergent, concurrent and predictive validity) of several methods routinely applied in the field. We developed/adapted six methods, and selected several types frequently applied in cognitive style research: self-report questionnaires, methods based on rod-and-frame test principles, embedded figures, and methods based on hierarchical figures. The analysis was conducted on 392 Czech participants, with two data collection waves. The results indicate that the use of self-report questionnaires and methods based on the rod-and-frame principle may be unreliable, demonstrating unsatisfactory factor structure and no absence of association with intelligence. The use of embedded and hierarchical figures is recommended. Because the concurrent and divergent validity of the methods did not correspond with the original two-dimensional theory, we formulated a new three-level hierarchical model of analytic and holistic cognitive styles which better described our empirical findings.


2021 ◽  
Vol volume 05 (issue 2) ◽  
pp. 267-283
Author(s):  
Prof. Dr. Rubina Hanif ◽  
Naila Batool

The present study is based on the development of scale to measure schadenfreude in adolescents. The objectives of the study are twofold i.e., the development of an indigenous scale to measure schadenfreude among adolescents and to establish the validity of this scale. To achieve these goals, study comprised of two phases. Item pool was generated on the basis of literature as well as content analysis of the information obtained through focus groups and it was finalized through committee approach. Factor structure of the scale was determined by conducting Exploratory Factor Analysis (N=330). In Phase-II, psychometric properties of the scale were established by conducting Confirmatory Factor Analysis on an independent sample (N=320). Descriptive statistics, alpha reliabilities and item total correlations were computed. The final scale comprised of 28 statements with six domains included Rivalry, Negative Emotions, Unfairness, Worthlessness, Comparison Bias, and Helplessness. It is a measure schadenfreude among adolescents.


2011 ◽  
Vol 14 (1) ◽  
pp. 478-485 ◽  
Author(s):  
Susana C. Marques ◽  
José Luis Pais-Ribeiro ◽  
Shane J. Lopez

The present study describes the psychometric properties of the Portuguese version of the Mental Health Inventory-5 for use with young adolescents. A sample of 367 Portuguese students (aged 10-15 years) completed the Portuguese-language versions of Mental Health Inventory-5 (MHI-5; Berwick et al., 1991), Children's Hope Scale (CHS; Snyder et al., 1997), Students' Life Satisfaction Scale (SLSS; Huebner, 1991a), and Global Self-Worth Sub-scale (Harter, 1985). Analysis of readability, reliability (internal consistency and 1-year stability), factor structure, and criterion-related validity suggested that the MHI-5 can be appropriately used in this age group. Implications of the findings are discussed.


2001 ◽  
Vol 179 (1) ◽  
pp. 67-72 ◽  
Author(s):  
Paul Lelliott ◽  
Anne Beevor ◽  
Gary Hogman ◽  
Jon Hyslop ◽  
Judith Lathlean ◽  
...  

BackgroundNo existing instrument measures all or even most of the issues considered important by users of mental health services.AimsTo develop and test a self-assessment instrument to enable users of mental health services to rate their experience across the range of domains that they consider to be important.MethodRelevant domains were identified and a new instrument was drafted and field tested to examine its psychometric properties.ResultsThe 17-item, self-rated Carers' and Users' Expectations of Services – User version (CUES–U) appears acceptable to most service users. Its items have reasonable test–retest reliability and a ‘total CUES–U score’ correlates significantly with a total score of the Health of the Nations Outcome Scales (Spearman's ρ=0.42; P<0.01).ConclusionsThe development and testing of CUES–U suggest that it might be feasible to apply a self-rated measure of the expectations and experience of users of mental health services.


2017 ◽  
Vol 35 (11-12) ◽  
pp. 2254-2270
Author(s):  
Kyoung Min Shin ◽  
Young Ki Chung ◽  
Nam Hee Kim ◽  
Kyoung Ah Kim ◽  
Hyoung Yoon Chang

Trauma-related cognitions play an important role in formation and persistence of posttraumatic stress symptoms. This study investigated the psychometric properties of the Korean version of the Posttraumatic Cognitions Inventory (PTCI) in a sample of 227 females who had experienced sexual violence. Data were collected from victims who sought victim support services following sexual violence between 2011 and 2015. The Impact of Event Scale–Revised, Beck Depression Inventory, and Beck Anxiety Inventory were used to measure posttraumatic stress disorder severity, depression, and anxiety, respectively. The three-factor solution of the PTCI (SELF, WORLD, BLAME) was supported; however, it was necessary to remove five items from the original 33-item scale. The 28-item PTCI displays good internal consistency, concurrent validity, and discriminant validity. SELF and WORLD subscales correlated with trauma symptom severity, controlling depression and anxiety. This is the first study to investigate factor structure and psychometric properties of the Korean version of the PTCI with female victims of sexual violence, which demonstrated that 28-item version of PTCI is an acceptable assessment measure of examining trauma-related cognitions.


1985 ◽  
Vol 147 (2) ◽  
pp. 127-136 ◽  
Author(s):  
R. P. Snaith ◽  
C. M. Taylor

SummaryThe heading of ‘Irritable Mood’ was introduced into the Index Medicus in 1985 and it is noted that this term is frequently used but seldom defined. It is therefore important that a consensus is reached concerning its definition in the context of psychopathology and a definition is offered. It seems important to distinguish irritable mood and its outward manifestations from violently assaultive behaviour although there may be a continuum of disturbance from mildly to severely disordered behaviour. Irritability has so far not attracted much attention from clinicians and yet it is a common mood associated with many psychiatric and non-psychiatric conditions. Severe irritability may cause considerable distress both to the patient, his associates and sometimes also those attempting to treat or otherwise help him. It may overshadow other symptoms and the correct diagnosis and management may be missed. The validity and reliability of a convenient self-assessment scale is re-examined in the light of further data. Data from previous studies in the context of mood disorders suggests that irritability is a mood state which is independent of the other major moods of depression and anxiety; the severity of irritability probably has an inverse correlation with age. The most important associated factors are listed in order to inform researchers of the possible methodological pitfalls.


Sign in / Sign up

Export Citation Format

Share Document