Testing and Extending Schwartz Refined Value Theory Using a Best–Worst Scaling Approach

The theory of human values discriminated 10 basic values arrayed in a quasicircular structure. Analyses with several instruments in numerous samples supported this structure. The refined theory of human values discriminates 19 values in the same circle. Its support depends on one instrument, the revised Portrait Values Questionnaire. We introduce a forced choice method, the Best–Worst Refined Values scale (BWVr), to assess the robustness of the refined theory to method of measurement and also assess the distinctiveness and validity of a new animal welfare value. Three studies ( N = 784, 439, and 383) support the theory and the new value. Study 3 also demonstrates the convergent and discriminant validity of the 19 values by comparing the BWVr, the revised Portrait Values Questionnaire, and value-expressive behaviors and confirms the test–retest reliability of BWVr responses. These studies provide further information about the order of values in the value circle.

Download Full-text

The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part I: A Checklist for Dimensional Measurement of Selected DSM-5 Disorders

The Canadian Journal of Psychiatry ◽

10.1177/0706743718808250 ◽

2018 ◽

Vol 64 (6) ◽

pp. 423-433 ◽

Cited By ~ 13

Author(s):

Laura Duncan ◽

Katholiki Georgiades ◽

Li Wang ◽

Jinette Comeau ◽

Mark A. Ferro ◽

...

Keyword(s):

General Population ◽

Child Health ◽

Conduct Disorder ◽

Discriminant Validity ◽

Health Study ◽

Retest Reliability ◽

Dimensional Measurement ◽

Dsm 5 ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

Objectives: To describe the development and psychometric properties of the 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) for dimensional measurement of 7 disorders based on criteria from the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders ( DSM-5). Methods: Scale items were selected by agreement among 19 child psychologists and psychiatrists rating the correspondence between item descriptions and DSM-5 symptoms. Psychometric evaluation of the item properties and parent/caregiver and youth scales came from a general population study of 10,802 children and youth aged 4 to 17 years in 6537 families. Test-retest reliability data were collected from a subsample of 280 children and their caregivers who independently completed the OCHS-EBS checklist on 2 occasions 7 to 14 days apart. Structural equation modelling was used to assess internal and external convergent and discriminant validity—the latter tested against the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Results: Confirmatory factor analyses exhibited adequate item fit to all scales. Except for conduct disorder and youth-assessed separation anxiety disorder, internal (Cronbach’s α) and test-retest reliability (Pearson’s r) for scale scores were 0.70 or above. Except for youth-assessed conduct disorder, the OCHS-EBS met criteria for internal and convergent and discriminant validity. Compared with the MINI-KID, the OCHS-EBS met criteria for external convergent and discriminant validity. Conclusions: The OCHS-EBS provide reliable and valid dimensional measurement of 7 DSM-5 disorders assessed by caregivers and youth in the general population. Part II describes use of the OCHS-EBS as a categorical (present/absent) measure of disorder.

Download Full-text

Psychometric properties of the Short Leyton Obsessional Inventory-Child Version in a community sample of Spanish children and adolescents

Anales de Psicología ◽

10.6018/analesps.32.3.232201 ◽

2016 ◽

Vol 33 (1) ◽

pp. 26

Author(s):

Marina Iniesta-Sepúlveda ◽

Ana I. Rosa-Alcázar ◽

Beatriz Ruiz-García ◽

Jose A. López-Pina

Keyword(s):

Psychometric Properties ◽

Children And Adolescents ◽

Discriminant Validity ◽

Factor Model ◽

Community Sample ◽

Spanish Version ◽

Obsessive Compulsive ◽

Good Test ◽

Convergent And Discriminant Validity ◽

Test Retest Reliability

The aim of the current study was to analyze psychometric properties of the Short LOI-CV in Spanish community sample. Participants were 914 children and adolescents with mean age of 13.01 years (51.3% males). An EFA yielded a three-factor model representing Obsessions, Compulsions, and Cleanliness dimensions. Both, total score and subscales showed an adequate internal consistency. The Spanish version also exhibited good test-retest reliability and moderate convergent and discriminant validity. The younger participants (from 8 to 10 years) obtained higher means for total score and subscales than older participants (groups 11-13 and 14-18 years). Significant differences related to gender were also observed since males obtained higher means in Compulsions subscale. Despite more research is required, the Spanish version of the Short LOI-CV exhibited promising psychometric results to assess obsessive-compulsive symptoms in community population.

Download Full-text

Construct Validity Analyses of a “Nonverbal” Measure of Self-Esteem: The Sliding Person Test

Psychological Reports ◽

10.2466/pr0.1979.44.3.895 ◽

1979 ◽

Vol 44 (3) ◽

pp. 895-910 ◽

Cited By ~ 4

Author(s):

Ann H. Karmos ◽

Joseph S. Karmos

Keyword(s):

Construct Validity ◽

Social Desirability ◽

Discriminant Validity ◽

Emotional Adjustment ◽

Self Esteem ◽

Social And Emotional ◽

Convergent And Discriminant Validity ◽

Curvilinear Relationships ◽

Test Retest Reliability ◽

Minimal Evidence

This study investigated construct validity for a “nonverbal” measure of self-esteem, the Sliding Person Test (SPERT). Seven personality measures and an intelligence test were administered to 202 college students. A test-retest reliability coefficient of .82 was obtained ( N = 45). Correlations between scores on SPERT and social desirability, anxiety, and IQ indicated sufficiently low overlap with these variables. Minimal evidence of convergent and discriminant validity was established. Linear and curvilinear relationships between scores for SPERT and social and emotional adjustment, respectively, were contrary to expectations but similar to those of previous studies. Expected differences between students high and low in self-acceptance with large SPERT discrepancies support other literature which suggests that large self-ideal discrepancies are associated with better adjustment and lower anxiety for highly self-accepting people.

Download Full-text

Further Validation of a Chinese Version of the Obsessive-Compulsive Inventory-Revised

Behavioural and Cognitive Psychotherapy ◽

10.1017/s1352465812000379 ◽

2012 ◽

Vol 41 (2) ◽

pp. 249-254 ◽

Cited By ~ 7

Author(s):

Gregory S. Chasson ◽

Suqin Tang ◽

Bradley Gray ◽

Hongwei Sun ◽

Jianping Wang

Keyword(s):

Discriminant Validity ◽

Comparison Group ◽

Clinical Sample ◽

Reliability And Validity ◽

Obsessive Compulsive ◽

Compulsive Disorder ◽

Convergent And Discriminant Validity ◽

Validity Criterion ◽

Test Retest Reliability ◽

Cultural Components

Background: There has been an increased effort to understand the nature of obsessive-compulsive disorder (OCD) in non-Western cultures. In particular, growing research has examined OCD in China, but there are no comprehensive instruments that measure both OCD severity and heterogeneity for characterizing samples. Aims: A validated, comprehensive measure that could be used in China would provide researchers with a useful instrument for evaluating severity and heterogeneity of OCD in a non-Western culture, allowing researchers to better understand the universal and cultural components that play a role in the nature of OCD. Method: The current investigation presents data on the reliability and validity of a Mandarin translation of the Obsessive-Compulsive Inventory-Revised (CH-OCI) using both a student (n = 1950) and clinical sample (n = 50 patients with OCD; n = 50 patients with anxiety as a comparison group). Results: Results support the factor structure, convergent and discriminant validity, criterion-related validity, test-retest reliability, and internal consistency of the CH-OCI. Conclusions: Validation of the instrument permits researchers and clinicians to measure OCD presentation in Mandarin-speaking samples.

Download Full-text

Validating Appearance-Based Rejection Sensitivity and Fear of Negative Appearance Evaluation Scales in the Russian Sample

Counseling Psychology and Psychotherapy ◽

10.17759/cpp.2020280407 ◽

2020 ◽

Vol 28 (4) ◽

pp. 118-143

Author(s):

A.Yu. Razvaliaeva ◽

N.A. Polskaya

Keyword(s):

Body Image ◽

Body Dissatisfaction ◽

Discriminant Validity ◽

Positive Impact ◽

Rejection Sensitivity ◽

Drive For Thinness ◽

Convergent And Discriminant Validity ◽

Body Image Disturbances ◽

Good Internal Consistency ◽

Test Retest Reliability

We present the results of validating Fear of Negative Appearance Evaluation Scale (Lundgren et al., 2004) and Appearance-based Rejection Sensitivity Scale (Park, 2007) on the Russian sample. These scales operationalize factors of interpersonal vulnerability to body dissatisfaction as a result of internalizing the notions of the ideal body transmitted by parents, peers and mass media. The sample included 760 respondents aged 16—48, 687 female (Mage=24, Med=22, SD=6.75) and 73 male (Mage=23.2, Med=22, SD=5.58). Confirmatory factor analysis confirmed that either scale had a single latent factor, both showed good internal consistency (Cronbach’s α for FNAE — α=0.91; ARS — α=0.93) and test-retest reliability (for FNAE — rs=0.89; for ARS —0.93; p<0,001). FNAE showed age differences, reaching the highest scores in the youngest group (aged 16—20). Convergent and discriminant validity of the scales was confirmed; they were positively related to attachment-related anxiety and disturbances in body image and eating behavior, and correlated negatively with self-esteem. Both scales had a positive impact on body image disturbances and drive for thinness. Fear of Negative Appearance Evaluation Scale and Appearance-based Rejection Sensitivity Scale can be used in studies broadly related to body dissatisfaction.

Download Full-text

Multidimensional Assessment of Interoceptive Awareness: Psychometric Properties of the Portuguese Version

Perceptual and Motor Skills ◽

10.1177/0031512518813231 ◽

2018 ◽

Vol 126 (1) ◽

pp. 87-105 ◽

Cited By ~ 3

Author(s):

Joana Machorrinho ◽

Guida Veiga ◽

Jorge Fernandes ◽

Wolf Mehling ◽

José Marmeleira

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Discriminant Validity ◽

Self Report ◽

Interoceptive Awareness ◽

Portuguese Version ◽

Multidimensional Assessment ◽

Convergent And Discriminant Validity ◽

Acceptable Model ◽

Test Retest Reliability

Interoceptive awareness involves several mind–body dimensions and can be evaluated by self-report with the Multidimensional Assessment of Interoceptive Awareness (MAIA), which has been translated and validated in several countries and is being used in research and clinical contexts. This study systematically translated the MAIA with six additional items using a focus group and evaluated its psychometric properties in a respondent sample of 204 Portuguese university students (52% females; M = 21.3, SD = 3.9 years). Based on exploratory factor analysis, we refined the tool into a 33-item version and tested it in a separate sample ( n = 286; 63% females; M = 21.3, SD = 4.7 years). We then conducted confirmatory factor analysis and examined test–retest reliability and convergent and discriminant validity. We confirmed an acceptable model fit for this Portuguese version (MAIA-P) with 33 items and seven scales; it showed good construct validity and acceptable temporal reliability, The MAIA-P appears to be valuable for assessing self-reported interoceptive awareness in Portuguese healthy adults.

Download Full-text

NIH Toolbox Cognition Battery (CB): Validation of Executive Function Measures in Adults

Journal of the International Neuropsychological Society ◽

10.1017/s1355617714000472 ◽

2014 ◽

Vol 20 (6) ◽

pp. 620-629 ◽

Cited By ~ 65

Author(s):

Philip David Zelazo ◽

Jacob E. Anderson ◽

Jennifer Richler ◽

Kathleen Wallner-Allen ◽

Jennifer L. Beaumont ◽

...

Keyword(s):

Executive Function ◽

Discriminant Validity ◽

Flanker Task ◽

Dimensional Change ◽

Epidemiologic Studies ◽

Card Sort ◽

Convergent And Discriminant Validity ◽

Age Related ◽

Computer Based ◽

Test Retest Reliability

AbstractThis study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) executive function measures in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20–85 years), gender, education and ethnicity. The NIHTB-CB contains two computer-based instruments assessing executive function: the Dimensional Change Card Sort (a measure of cognitive flexibility) and a flanker task (a measure of inhibitory control and selective attention). Participants completed the NIHTB-CB, corresponding gold standard convergent and discriminant measures, and sociodemographic questionnaires. A subset of participants (N=89) was retested 7 to 21 days later. Results reveal excellent sensitivity to age-related changes during adulthood, excellent test–retest reliability, and adequate to good convergent and discriminant validity. The NIH Toolbox EF measures can be used effectively in epidemiologic and clinical studies. (JINS, 2014, 20, 1–10)

Download Full-text

Psychometric properties of the Chinese version of the TeamSTEPPS teamwork perceptions questionnaire to measure teamwork perceptions of Chinese residents: a cross-sectional study

BMJ Open ◽

10.1136/bmjopen-2020-039566 ◽

2020 ◽

Vol 10 (11) ◽

pp. e039566

Author(s):

Jinglou Qu ◽

Yaxin Zhu ◽

Liyuan Cui ◽

Libin Yang ◽

Yanni Lai ◽

...

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Discriminant Validity ◽

Chinese Language ◽

Cross Sectional Study ◽

Sectional Study ◽

Cross Sectional ◽

Convergent And Discriminant Validity ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectivesThe purpose of this research was to evaluate the psychometric properties of the TeamSTEPPS Teamwork Perception Questionnaire (T-TPQ) among the Chinese residents.DesignCross-sectional study.SettingA clinical hospital of the China Medical University in Liaoning Province, China.ParticipantsA total of 664 residents were enrolled in this research. The valid response rate was 83.0% (664 of 800 residents).Main outcome measuresInternal consistency and test–retest reliability were used to assess the reliability of the questionnaire. The construct validity of the Chinese T-TPQ was evaluated by confirmatory factor analysis. Furthermore, the concurrent, convergent and discriminant validity were analysed.ResultsCronbach’s α coefficient of the T-TPQ in Chinese language was 0.923. Except for the communication dimension (0.649), the Cronbach’s α coefficient of all dimensions were satisfactory. The T-TPQ and its five dimensions reported a good test–retest reliability (0.740–0.881, p<0.01). Moreover, the results of the confirmatory factor analysis demonstrated that the construct validity of the Chinese T-TPQ was satisfactory. All dimensions significantly correlated with the Hospital Survey on Patient Safety Culture (HSOPSC) teamwork within units dimension and the Safety Attitudes Questionnaire (SAQ) teamwork climate dimension (p<0.01), and the questionnaire showed satisfactory convergent and discriminant validity.ConclusionsThe T-TPQ in Chinese language demonstrated good psychometric characteristics and was a reliable and valid questionnaire to measure the Chinese health professionals’ perception of teamwork. Thus, the Chinese version of the T-TPQ could be applied in teamwork training programmes and medical education research.

Download Full-text

Pictorial Empathy Test (PET)

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000353 ◽

2018 ◽

Vol 34 (6) ◽

pp. 421-431 ◽

Cited By ~ 5

Author(s):

Marjaana Lindeman ◽

Iivo Koirikivi ◽

Jari Lipsanen

Keyword(s):

Factor Structure ◽

Discriminant Validity ◽

Affective Empathy ◽

Point Scale ◽

Brief Assessment ◽

Convergent And Discriminant Validity ◽

High Internal Consistency ◽

The Moment ◽

Test Retest Reliability ◽

Development And Validation

Abstract. Research on empathy has increased rapidly during the last decades but brief assessment methods are not easily available. The aim was to develop a test for affective empathic reactions which would be simple to translate into different languages, easy to use in a variety of research settings, and which would catch the empathic reactions at the moment they arise. We describe the development and validation of the Pictorial Empathy Test (PET) in three studies (Study 1, N = 91; Study 2, N = 2,789; and Study 3, N = 114). The PET includes seven photographs about distressed individuals and the participants are asked to rate on a 5-point scale how emotionally moving they find the photograph. The results indicated that the PET displayed a unitary factor structure and it had high internal consistency and good seven-month test-retest reliability. In addition, the results supported convergent and discriminant validity of the test. The results suggest that the PET is a useful addition to the prevailing methods for assessing affective empathy.

Download Full-text

Evaluation of the reliability and validity of computerized tests of attention

10.31234/osf.io/wq8u7 ◽

2021 ◽

Author(s):

Robert Langner ◽

Frank Scharnowski ◽

Silvio Ionta ◽

Carlos Ernesto Garrido Salmon ◽

Brian J. Piper ◽

...

Keyword(s):

Discriminant Validity ◽

Intraclass Correlation ◽

Temporal Stability ◽

Reliability And Validity ◽

Vigilance Task ◽

Continuous Performance Task ◽

Convergent And Discriminant Validity ◽

Basic And Applied Research ◽

Test Retest Reliability ◽

Psychomotor Vigilance

Different aspects of attention can be assessed through psychological tests, in order to identify stable individual or group differences as well as alterations after interventions. Aiming for a wide applicability of psychological assessments, Psychology Experiment Building Language (PEBL) is an open-source software system for designing and running computerized tasks that tax various attentional functions. Here, we evaluated the reliability and validity of several widely used computerized attention tasks as provided with the PEBL package, namely the Continuous Performance Task (CPT), the Switcher task, the Psychomotor Vigilance Task (PVT), the Mental Rotation task, and the Attentional Network Test. For all tasks, we evaluated test–retest reliability using the intraclass correlation coefficient (ICC), as well as internal consistency through within-test correlations and split-half ICC. Across tasks, response time scores showed adequate reliability, whereas scores of performance accuracy, variability, and deterioration over time did not. Stability across application sites was observed for the CPT and Switcher task, but substantial practice effects (i.e., a lack of temporal stability) was observed for all tasks except the PVT. We substantiate convergent and discriminant validity for several task scores using between-task correlations and provide further evidence for construct validity via associations of task scores with attentional and motivational assessments. The Switcher task did not show sufficient stability and validity for the evaluation of switching costs, therefore we propose that a longer practice period might be necessary for achieving sound psychometric properties for this task. We suggest that researchers interested in individual differences should be particularly cautious when including accuracy or variability scores in their assessment. Taken together, our results provide necessary and valuable information that may help design and interpret studies involving attention assessments in basic and applied research.

Download Full-text