Super-unsupervised text classification for labeling online political hate

We live in a world of text but the sheer magnitude of social media data coupled with a need to measure complex psychological constructs have made this important source of data difficult to use for many social scientists. Either researchers engage in costly hand-coding of thousands of texts using supervised techniques or in unsupervised techniques where the measurement of predefined constructs are difficult. We propose a novel approach which we call super-unsupervised learning using the psychologically complex construct online political hate. This approach draws on the best features from both supervised and unsupervised learning techniques: Measurements of complex psychological constructs without a single labelled data source. We first outline the approach and then provide tests of (i) face validity, (ii) convergent and discriminant validity, (iii) criterion validity, (iv) external validity and (v) ecological validity.

Download Full-text

Diseño y análisis psicométrico de una escala para evaluar riesgo suicida en adolescentes argentinos

Revista de Psicopatología y Psicología Clínica ◽

10.5944/rppc.28625 ◽

2021 ◽

Vol 26 (3) ◽

pp. 203-216

Author(s):

Aixa Lidia Galarza ◽

Mercedes Fernández-Liporace ◽

Claudia Castañeiras ◽

Agustín Freiberg-Hoffmann

Keyword(s):

Suicide Risk ◽

Discriminant Validity ◽

Face Validity ◽

Public Health Issue ◽

Psychometric Analysis ◽

Convergent And Discriminant Validity ◽

Specific Dimension ◽

Apoyo Social ◽

Factores De Riesgo ◽

Multidimensional Screening

Design and psychometric analysis of a suicide risk scale for Argentinean adolescents and young people Abstract: Suicidal behavior in adolescents and youth has become a public health issue which requires improving the available scales in order to enable the early detection of risk cases. Therefore, for this purpose, this study presents the design and psychometric analysis of the Argentinean Scale of Suicidality for Adolescents (EASA-I by its Spanish acronym) Screening. It measures a specific dimension of suicidal ideation and five risk factors: low self-esteem, negative perspective of the future, low emotion regulation, difficulties in problem-solving and lack of social support. This study was aimed at analyzing content construct and face validity, as well as convergent and discriminant validity evidence with external measures. Internal consistency of the scores was also examined. The sample was composed of 291 adolescents and young adults. Results suggest that the EASA-I constitutes a short and simple scale with adequate psychometric properties suitable to be used in different areas of application and research. Keywords: adolescents; youth; suicide risk; multidimensional assessment; screening. Resumen: Los comportamientos suicidas en la adolescencia y la juventud constituyen un problema de salud pública que exige mejorar las herramientas de evaluación disponibles, de cara a detectar precozmente casos en riesgo. Se presenta el diseño y análisis psicométrico de la Escala Argentina de Suicidalidad para Adolescentes EASA-I Screening. Su objetivo reside en la medición de una dimensión específica, i.e., la ideación suicida, más cinco factores de riesgo: baja autoestima, perspectiva negativa del futuro, baja regulación emocional, dificultades para la resolución de problemas y falta de apoyo social. Basándonos en una muestra de 291 adolescentes y jóvenes, se analizaron evidencias de validez de contenido, aparente y de constructo, así como de validez convergente y discriminante con medidas externas. Se examinó, además, la consistencia interna de las puntuaciones obtenidas. Los resultados indican que la EASA-I posee adecuadas propiedades técnicas para su uso en población local en diferentes ámbitos de aplicación e investigación. Palabras clave: adolescentes; jóvenes; riesgo suicida; evaluación multidimensional; screening.

Download Full-text

A New Measure of Research Participant Burden

Journal of Empirical Research on Human Research Ethics ◽

10.1177/1556264614545037 ◽

2014 ◽

Vol 9 (4) ◽

pp. 46-49 ◽

Cited By ~ 21

Author(s):

Jennifer H. Lingler ◽

Karen L. Schmidt ◽

Amanda L. Gentry ◽

Lu Hu ◽

Lauren A. Terhorst

Keyword(s):

Internal Consistency ◽

Discriminant Validity ◽

Psychometric Evaluation ◽

Research Participant ◽

Face Validity ◽

Convergent And Discriminant Validity ◽

New Instrument ◽

Good Internal Consistency

Effective conceptualizations of research burden should address indirect burdens related to research duration, intensity, and invasiveness. Introducing the concept of perceived research burden, we developed, tested, and validated a new instrument, the Perceived Research Burden Assessment (PeRBA). Initial psychometric evaluation of PeRBA reveals good internal consistency, evidence of face validity, and acceptable convergent and discriminant validity.

Download Full-text

An Investigation of a Computerized Sequential Depression Module of the MMPI-2

Assessment ◽

10.1177/1073191116682297 ◽

2016 ◽

Vol 25 (8) ◽

pp. 1084-1097

Author(s):

Alex C. Nyquist ◽

Johnathan D. Forbey

Keyword(s):

Convergent Validity ◽

Discriminant Validity ◽

Minnesota Multiphasic Personality Inventory ◽

Sequential Testing ◽

Student Sample ◽

Psychological Constructs ◽

College Student Sample ◽

Convergent And Discriminant Validity ◽

Somatic Dysfunction ◽

Time Savings

The current study investigated the utility and validity of a computerized “depression” module of the Minnesota Multiphasic Personality Inventory–Second version (MMPI-2), with and without sequential testing rules, with a college student sample. Participants completed one of three MMPI-2 test–retest administrations (i.e., conventional–conventional, conventional–module, or conventional–sequential module) as well as 15 criterion measures across two testing sessions exactly 1 week apart. The findings pointed to statistically significant and clinically meaningful time-savings in administering selected MMPI-2 scales (for both full-length and variable-length versions). Criterion measures rationally selected to represent similar (depression, anhedonia, anxiety) and dissimilar (behavioral, thought, and somatic dysfunction) psychological constructs were administered to assess the convergent and discriminant validity of the depression module. The criterion correlations suggested minimal differences in discriminant and convergent validity across administration modes, suggesting limited to no impact of administering targeted MMPI-2 scales in terms of construct validity.

Download Full-text

Positive Emotions Scale: Construct Development and Validation

Pakistan Journal of Psychological Research ◽

10.33824/pjpr.2020.35.3.23 ◽

2020 ◽

Vol 35 (3) ◽

pp. 429-454

Author(s):

Amna Shamim ◽

Amina Muazzam

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Positive Emotions ◽

Discriminant Validity ◽

Face Validity ◽

Second Phase ◽

Structured Interviews ◽

Construct Development ◽

Convergent And Discriminant Validity ◽

Development And Validation

The purpose of the paper was to develop an indigenous and comprehensive scale to measure positive emotions and to establish its psychometric properties. In the first phase, the item pool of 40 items was generated by an in-depth review of literature, focus groups, and semi-structured interviews. Content Validity Index (CVI) was established on 6 expert’s ratings. The total scale CVI calculated was .84. Pilot study was conducted (n = 50) on the preliminary scale to measure its face validity. In the second phase, internal consistency and dimensionality of scale was empirically measured through Exploratory Factor Analysis (N = 273). Ten factors (i.e. Joy, Hope, Gratitude, Compassion, Gratitude towards God, Satisfaction, Awe, Inspiration, Love, and Humor) emerged. In the third phase, to confirm the factor structure of the Scale the Confirmatory Factor Analysis (N = 174) was run. Psychometric properties were established (α = .96). In the final phase, the convergent and discriminant validity was established by using Positive and Negative Affect Schedule (Watson, Clark, & Tellegen, 1988). Finally, the Positive Emotions Scale, measuring ten main constructs of positive emotions was constructed.

Download Full-text

What Does the Implicit Association Test Measure? A Test of the Convergent and Discriminant Validity of Prejudice-Related IATs

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1026//1618-3169.49.3.171 ◽

2002 ◽

Vol 49 (3) ◽

pp. 171-180 ◽

Cited By ~ 74

Author(s):

Bertram Gawronski

Keyword(s):

Implicit Association Test ◽

Discriminant Validity ◽

Association Test ◽

Recent Criticism ◽

Implicit Association ◽

East Asians ◽

Student Sample ◽

Convergent And Discriminant Validity ◽

Explicit Prejudice ◽

Turkish People

Abstract. Drawing on recent criticism of the Implicit Association Test (IAT), the present study tested the convergent and discriminant validity of two prejudice-related IATs to corresponding explicit prejudice measures in a German student sample (N = 61). Confirming convergent validity, (a) an IAT designed to assess negative associations related to Turkish people was significantly related to the explicit endorsement of prejudiced beliefs about Turkish people, and (b) an IAT designed to assess negative associations related to East Asians was significantly related to explicit prejudice against East Asians. Moreover, confirming discriminant validity, (c) the Asian IAT was unrelated to the explicit endorsement of prejudiced beliefs about Turkish people, and (d) the Turkish IAT was unrelated to explicit prejudice against Asian people. These results further corroborate the assumption that the IAT is a valid method to assess the strength of evaluative associations in the domain of prejudice and stereotypes.

Download Full-text

An Initial Investigation of the Use of Comparative Referents to Assess Social Anxiety

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000349 ◽

2018 ◽

Vol 34 (6) ◽

pp. 367-375 ◽

Cited By ~ 1

Author(s):

Laura D. Seligman ◽

Erin F. Swedish ◽

Jason P. Rose ◽

Jessica M. Baker

Keyword(s):

Social Anxiety ◽

Discriminant Validity ◽

Self Report ◽

Injunctive Norms ◽

Good Reliability ◽

Convergent And Discriminant Validity ◽

Excellent Internal Consistency ◽

Social Quality Of Life ◽

Comparison Measures

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.

Download Full-text

The Sorting Paired Features Task

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1027/1618-3169.56.5.329 ◽

2009 ◽

Vol 56 (5) ◽

pp. 329-343 ◽

Cited By ~ 46

Author(s):

Yoav Bar-Anan ◽

Brian A. Nosek ◽

Michelangelo Vianello

Keyword(s):

Discriminant Validity ◽

Association Measures ◽

Response Options ◽

Convergent And Discriminant Validity ◽

Attitude Measures ◽

Stimulus Features ◽

Single Response

The sorting paired features (SPF) task measures four associations in a single response block. Using four response options (e.g., good-Republicans, bad-Republicans, good-Democrats, and bad-Democrats), each trial requires participants to categorize two stimuli at once to a category pair (e.g., wonderful-Clinton to good-Democrats). Unlike other association measures, the SPF requires simultaneous categorization of both components of the association in the same trial. Providing measurement flexibility, it is sensitive to both focal, attended concepts and nonfocal, unattended stimulus features (e.g., gender of individuals in a politics SPF). Three studies measure race, gender, and political evaluations, differentiate automatic evaluations between known groups, provide evidence of convergent and discriminant validity with other attitude measures, and illustrate the SPF’s unique measurement qualities.

Download Full-text