scholarly journals A Preregistered Validation Study of Methods Measuring Analytic and Holistic Cognitive Styles: What do We Actually Measure and How Well?

2021 ◽  
Author(s):  
David Lacko ◽  
Tomáš Prošek ◽  
Jiří Čeněk ◽  
Michaela Helísková ◽  
Pavel Ugwitz ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Discriminant Validity ◽  
Cognitive Styles ◽  
Reaction Times ◽  
Self Report ◽  
Validity And Reliability ◽  
Traditional Research ◽  
Test Retest Reliability ◽  
Rod And Frame

Cognitive styles are commonly studied constructs in cognitive psychology. It can be argued that measurement of these styles in the past had significant shortcomings in validity and reliability. The theory of analytic and holistic cognitive styles followed from traditional research of cognitive styles and attempted to overcome these shortcomings. Unfortunately, the psychometric properties of its measurement methods in many cases were debatable or not reported. New statistical approaches, such as analysis of reaction times, have been reported in the recent literature but remain overlooked by current research on analytic and holistic cognitive styles. The aim of this pre-registered study was to verify the psychometric properties (i.e., factor structure, split-half reliability, test-retest reliability, discriminant validity with intelligence and personality, and divergent, concurrent and predictive validity) of several methods routinely applied in the field. We developed/adapted six methods, and selected several types frequently applied in cognitive style research: self-report questionnaires, methods based on rod-and-frame test principles, embedded figures, and methods based on hierarchical figures. The analysis was conducted on 392 Czech participants, with two data collection waves. The results indicate that the use of self-report questionnaires and methods based on the rod-and-frame principle may be unreliable, demonstrating unsatisfactory factor structure and no absence of association with intelligence. The use of embedded and hierarchical figures is recommended. Because the concurrent and divergent validity of the methods did not correspond with the original two-dimensional theory, we formulated a new three-level hierarchical model of analytic and holistic cognitive styles which better described our empirical findings.

scholarly journals Cross cultural adaptation and psychometric properties of the Bengali version of the Scale of Oral Health Outcomes for 5-year-old children (SOHO-5)

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Masuma Pervin Mishu ◽  
Richard G. Watt ◽  
Anja Heilmann ◽  
Georgios Tsakos
Keyword(s):  
Oral Health ◽  
Health Outcomes ◽  
Psychometric Properties ◽  
Discriminant Validity ◽  
Self Report ◽  
Face Validity ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Oral Health Outcomes

Abstract Background The oral health related quality of life (OHRQoL) of children in Bangladesh has not yet been measured, as there is no validated OHRQoL measure for that population. The aim of this study was to cross-culturally adapt the child self-report and parental proxy report versions of the Scale of Oral Health Outcomes for 5-year-old children (SOHO-5) into Bengali and test their psychometric properties: face validity, construct validity (convergent and discriminant validity) and reliability (internal consistency and test–retest reliability), among 5–9-year-old children and their parents in Bangladesh and assess associations between dental caries/sepsis and OHRQoL in this population. Methods The forward–backward translated Bengali SOHO-5 was piloted among 272 children and their parents to test its face validity. The questionnaire was administered to 788 children and their parents to evaluate its psychometric properties. Internal consistency of Bengali SOHO-5 was assessed using Cronbach’s alpha, and test–retest reliability was assessed using Kappa. Convergent and discriminant validity were assessed through nonparametric tests. The calculation of effect sizes and standard error of measurement facilitated the assessment of minimally important difference (MID) for SOHO-5. The associations of reporting an oral impact with caries and sepsis were assessed via logistic regression models. Results Both child self-report and parental proxy report questionnaires showed good face validity. Cronbach’s alpha scores were 0.79 and 0.87 for child and parental questionnaire, respectively. A weighted Kappa score of 0.85 demonstrated test–retest reliability of child questionnaire. SOHO-5 scores were significantly associated with subjective oral health outcomes and discriminated clearly between different caries severity and sepsis groups. These differences were considerably higher than the MID. After adjusting for child’s age, sex, setting, maternal education and family income, the odds of reporting an oral impact were 2.25 (95% CI 1.98–2.56) and 4.44 (95% CI 3.14–6.28) times higher for each additional tooth with caries and sepsis, respectively. Conclusion This study provided strong evidence supporting the validity and reliability of both versions of Bengali SOHO-5 as OHRQoL measures. Dental caries and sepsis were associated with poor OHRQoL in this population. The Bengali SOHO-5 is expected to be a useful outcome measure for research and clinical purposes in Bengali speaking child populations.

The Adapted Self-Report Delinquency Scale for Adolescents: Validity and Reliability Among Portuguese Youths

2018 ◽  
Vol 63 (6) ◽  
pp. 837-853
Author(s):  
Pedro Pechorro ◽  
Stephen Houghton ◽  
Mário R. Simões ◽  
Annemaree Carroll
Keyword(s):  
Juvenile Delinquency ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Self Report ◽  
Validity And Reliability ◽  
School Sample ◽  
Validity Criterion ◽  
Forensic Sample

Self-report delinquency scales have contributed greatly to the contemporary basis of our understanding of juvenile delinquency. Nevertheless, they have not been immune to criticism and further improvement and extensive measurement research is still necessary. The present study examined the psychometric properties of one such measure of self-reported delinquency, the Adapted Self-Report Delinquency Scale (ASRDS). The ASRDS was administered to a Portuguese sample of male youths ( N = 470, 12-20 years of age), subdivided into a forensic sample ( n = 217) and a school sample ( n = 253). The Portuguese version of the ASRDS demonstrated satisfactory psychometric properties, in terms of its factor structure, internal consistency, convergent validity, discriminant validity, criterion-related validity, and known-groups validity, thereby justifying its use among this population.

scholarly journals Development and Validity of the Questionnaire of Patients' Experiences in Postacute Outpatient Physical Therapy Settings

2015 ◽  
Vol 95 (5) ◽  
pp. 767-777 ◽  
Author(s):  
Francesc Medina-Mirapeix ◽  
María Elena del Baño-Aledo ◽  
Jacinto Javier Martínez-Payá ◽  
María Carmen Lillo-Navarro ◽  
Pilar Escolar-Reina
Keyword(s):  
Factor Structure ◽  
Health Care Quality ◽  
Discriminant Validity ◽  
Care Delivery ◽  
Intraclass Correlation ◽  
Care Quality ◽  
Validity And Reliability ◽  
Study Objective ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundPatient feedback surveys are increasingly seen as a key component of health care quality monitoring and improvement.ObjectiveThe study objective was to describe the development and initial psychometric evaluation of a fixed-length questionnaire about the experiences of patients receiving physical therapist treatment in postacute outpatient settings.DesignThis was an instrument development study with validity and reliability testing.MethodsA total of 465 participants attending 3 rehabilitation centers for musculoskeletal conditions completed the questionnaire. A cognitive pretest was applied to the draft version (n=94), and a revised version was evaluated for test-retest reliability (n=90). Analyses to evaluate variance and nonresponse rates for items, the factor structure of the questionnaire, and the metric properties of multi-item scales were conducted.ResultsExploratory factor analyses yielded evidence for a 7-factor structure of the questionnaire, with 3 factors that may be conceptually viewed as professionals' attitudes and behavior (providing information and education, sensitivity to patients' changes, and emotional support) and 4 factors that conceptually reflect organizational environment (duration of attendance, interruptions during care delivery, waiting times, and patient safety). Item-scale correlations ranged from .70 to .93. The percentage of scaling success was 100% for all of the scales. Cronbach alpha coefficients ranged from .70 to .87. Intraclass correlation coefficients ranged from .57 to .80 (median=.68).LimitationsGeneralization to other patients is not known.ConclusionsThe questionnaire has test-retest reliability, and the scales have internal consistency and convergent and discriminant validity. All of the scales are distinct and unidimensional.

The Child PTSD Symptom Scale: An Investigation of Its Psychometric Properties

2015 ◽  
Vol 32 (15) ◽  
pp. 2237-2256 ◽  
Author(s):  
Regan W. Stewart ◽  
Chad Ebesutani ◽  
Christopher F. Drescher ◽  
John Young
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Discriminant Validity ◽  
Ptsd Symptom ◽  
High Reliability ◽  
Self Report ◽  
Ptsd Symptoms ◽  
Symptom Scale ◽  
Structure Reliability ◽  
Child Ptsd

The current study addresses the need for accurate measurement of posttraumatic stress disorder (PTSD) symptoms in youth by investigating the psychometric properties of the Child PTSD Symptom Scale (CPSS). The factor structure, reliability, and concurrent and discriminant validity of the CPSS were investigated in a sample of 206 6th- to 12th-grade adolescents. Exploratory and confirmatory factor analysis supported a single-factor structure, which was contrary to the hypothesized three-factor structure. Scores comprising this one-factor structure were also associated with high reliability (α = .93), and tests of concurrent and discriminant validity were also strong. The implications of these findings are discussed, with particular emphasis on future directions for research on self-report measures for adolescent PTSD symptoms.

scholarly journals Multidimensional Assessment of Interoceptive Awareness: Psychometric Properties of the Portuguese Version

2018 ◽  
Vol 126 (1) ◽  
pp. 87-105 ◽  
Author(s):  
Joana Machorrinho ◽  
Guida Veiga ◽  
Jorge Fernandes ◽  
Wolf Mehling ◽  
José Marmeleira
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Discriminant Validity ◽  
Self Report ◽  
Interoceptive Awareness ◽  
Portuguese Version ◽  
Multidimensional Assessment ◽  
Convergent And Discriminant Validity ◽  
Acceptable Model ◽  
Test Retest Reliability

Interoceptive awareness involves several mind–body dimensions and can be evaluated by self-report with the Multidimensional Assessment of Interoceptive Awareness (MAIA), which has been translated and validated in several countries and is being used in research and clinical contexts. This study systematically translated the MAIA with six additional items using a focus group and evaluated its psychometric properties in a respondent sample of 204 Portuguese university students (52% females; M = 21.3, SD = 3.9 years). Based on exploratory factor analysis, we refined the tool into a 33-item version and tested it in a separate sample ( n = 286; 63% females; M = 21.3, SD = 4.7 years). We then conducted confirmatory factor analysis and examined test–retest reliability and convergent and discriminant validity. We confirmed an acceptable model fit for this Portuguese version (MAIA-P) with 33 items and seven scales; it showed good construct validity and acceptable temporal reliability, The MAIA-P appears to be valuable for assessing self-reported interoceptive awareness in Portuguese healthy adults.

scholarly journals Psychometric properties of sleep hygiene index in Indonesian adolescents

2020 ◽  
Author(s):  
Anggi Setyowatic ◽  
Min-Huey Chung ◽  
Ah Yusuf ◽  
Setya Haksama
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Junior High School ◽  
Convergent Validity ◽  
Sleep Hygiene ◽  
Validity And Reliability ◽  
Reliability Design ◽  
Test Retest Reliability ◽  
Design And Methods ◽  
Who Guideline

Background: Sleep is associated with some behavioral factors such as maladaptive, which tend to disrupt its normal mechanism, therefore, a tool is needed to measure maladaptive sleep hygiene. This study aims to assess the psychometric properties of sleep hygiene index (SHI), translation, factor structure, validity, and reliability. Design and Methods: Data were collected from 101 Indonesia adolescents in junior high school, with SHI-Indonesia translated based on WHO guideline. The obtained data were analyzed using varimax rotation, while the convergent validity was evaluated by calculating the correlation between the item and total score. In addition, the Cronbach’s alpha was computed to investigate internal consistency, and two-week interval test-retest was conducted to assess reliability. Results: SHI is a unidimensional factor structure with an excellent test-retest reliability of P<0.001 at 0.618, and a positive convergent validity correlation between each item and the total score. Conclusions: The SHI Bahasa translation is a reliable and valid tool to assess maladaptive sleep hygiene among Indonesia Adolescents.

scholarly journals Assessing Obsessive-compulsive Symptoms: The Portuguese Version of the Padua Inventory

2017 ◽  
Vol 41 (S1) ◽  
pp. S70-S70
Author(s):  
A. Galhardo ◽  
J. Pinto-Gouveia ◽  
M. Cunha ◽  
I. Massano-Cardoso
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Obsessive Compulsive ◽  
Retest Reliability ◽  
Obsessive Compulsive Symptoms ◽  
Portuguese Version ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

IntroductionSelf-report instruments are useful tools for the assessment of psychopathological symptoms such as obsessive-compulsive symptoms. The Padua Inventory (PI) is a measure that has been widely used in clinical and research settings and studied in several countries.ObjectivesThis study explores the psychometric properties and factor structure of the Portuguese version of the PI.MethodsTranslation and translation-back of the original version were executed. A total of 847 participants (468 women and 379 men) from the general population was recruited through a snowball procedure and completed the PI and other mental health measures. The data set was randomly split in order to conduct principal component analysis (PCA) and confirmatory factor (CFA) analysis in two different samples. Moreover, internal consistency, convergent and discriminant validity and test-retest reliability analyses were conducted.ResultsFrom the PCA analysis four factors emerged, comprising clusters of items related to doubting/impaired control over mental activities, contamination/washing/cleaning, checking and worries about losing control over motor behaviors. CFA results revealed that the model presented a poor fit to the data and indicated that the model would benefit from the establishment of correlations between pairs of error terms of items with identical contents. The PI exhibited excellent internal consistency, good test-retest reliability and good convergent and discriminant validity.ConclusionsThe PI Portuguese version showed a similar factor structure to the one presented in other studies and revealed good psychometric properties. Nevertheless, results from the CFA suggest that shortening the PI may be advantageous.Disclosure of interestThe authors have not supplied their declaration of competing interest.

scholarly journals Replicability of the Psychometric Properties of Trait-Levels Measures of Spontaneous and Deliberate Mind Wandering

2019 ◽  
Vol 35 (4) ◽  
pp. 459-468 ◽  
Author(s):  
Carlo Chiorri ◽  
Manila Vannucci
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Online Survey ◽  
Discriminant Validity ◽  
Mind Wandering ◽  
The Other ◽  
Self Report ◽  
Paper And Pencil ◽  
The Mind ◽  
Administration Methods

Abstract. Recent research on individual differences in mind wandering has shown that two different forms, spontaneous and deliberate, can be distinguished and measured with the Mind Wandering-Spontaneous (MW-S) and the Mind Wandering-Deliberate (MW-D) scales. In this study we tested whether the psychometric properties of Italian versions of these scales replicated across two common administration methods (paper-and-pencil and online survey). We also investigated their construct validity with respect to other self-report measures of MW and daydreaming, and measures of attentional control (AC). These measures were completed by 123 psychology students using the paper-and-pencil versions and by 165 online participants. The factor structure of the MW scales and their correlations with the other measures were replicated almost perfectly across administration methods. A confirmatory factor analysis (CFA) performed on data from 270 community participants further supported the replicability of the factor structure of the MW and AC scales. Albeit moderately correlated, the MW-S and the MW-D scales showed discriminant validity, since the former had significantly higher correlations with the other MW and AC measures, but not with daydreaming. These findings further supported the distinctiveness of the two forms of MW and suggested that in correlational studies the administration method is unlikely to affect results.

Validity and Reliability of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE)

GeroPsych ◽  
2019 ◽  
Vol 32 (3) ◽  
pp. 145-151
Author(s):  
Mahshid Foroughan ◽  
Zahra Jafari ◽  
Ida Ghaemmagham Farahani ◽  
Vahid Rashedi
Keyword(s):  
Psychometric Properties ◽  
Elderly Population ◽  
Formal Education ◽  
The Elderly ◽  
Cognitive State ◽  
Validity And Reliability ◽  
Internal Reliability ◽  
Dsm Iv ◽  
Test Retest Reliability ◽  
Farsi Version

Abstract. This study examines the psychometric properties of the IQCODE and its applicability in the Iranian elderly population. A group of 95 elderly patients with at least 4 years of formal education who fulfilled the criteria of DSM-IV-TR for dementia were examined by the MMSE and the AMTs. The Farsi version of the IQCODE was subsequently administered to their primary caregivers. Results showed a significant correlation ( p = .01) between the score of the questionnaire and the results of the MMSE ( r = −0.647) and AMTs ( r = −0.641). A high internal reliability of the questionnaire was confirmed by Cronbach’s alpha coefficient (α = 0.927) and test-retest reliability by correlation coefficient ( r = 0.81). This study found that the IQCODE has acceptable psychometric properties and can be used for evaluating the cognitive state in the elderly population of Iran.

Using the Rating Scale Model to Examine the Psychometric Properties of the Self-Efficacy Scale for Driver Competence

2011 ◽  
Vol 27 (3) ◽  
pp. 164-170 ◽  
Author(s):  
Anna Sundström
Keyword(s):  
Psychometric Properties ◽  
Self Efficacy ◽  
Rating Scale ◽  
Measurement Precision ◽  
The Self ◽  
Test Theory ◽  
Self Report ◽  
Scale Model ◽  
Validity And Reliability ◽  
Two Samples

This study evaluated the psychometric properties of a self-report scale for assessing perceived driver competence, labeled the Self-Efficacy Scale for Driver Competence (SSDC), using item response theory analyses. Two samples of Swedish driving-license examinees (n = 795; n = 714) completed two versions of the SSDC that were parallel in content. Prior work, using classical test theory analyses, has provided support for the validity and reliability of scores from the SSDC. This study investigated the measurement precision, item hierarchy, and differential functioning for males and females of the items in the SSDC as well as how the rating scale functions. The results confirmed the previous findings; that the SSDC demonstrates sound psychometric properties. In addition, the findings showed that measurement precision could be increased by adding items that tap higher self-efficacy levels. Moreover, the rating scale can be improved by reducing the number of categories or by providing each category with a label.

Sign in / Sign up

Export Citation Format

Share Document