One measure, one meaning: Multiple measures, clearer meaning

2002 ◽  
Vol 14 (3) ◽  
pp. 463-475 ◽  
Author(s):  
JEROME KAGAN ◽  
NANCY SNIDMAN ◽  
MARK MCMANIS ◽  
SUE WOODWARD ◽  
CHRISTINA HARDWAY

This paper tries to make three points. First, current constructs in personality and psychopathology are based on the restrictive evidence contained in self-reports. As a result, heterogeneous categories of individuals are assigned to the same category. Second, it is suggested that when different sources of evidence are included, theoretically distinct groups will be detected within the prior heterogeneous category. Third, the authors argue that physiological information has the potential to parse individuals with similar phenotypes on self-report data into distinct groups that reveal the temperamental origins of their phenotype.

Assessment ◽  
2019 ◽  
Vol 27 (7) ◽  
pp. 1604-1618 ◽  
Author(s):  
Judith M. Conijn ◽  
Niels Smits ◽  
Esther E. Hartman

In psychological assessment of children, it is pivotal to establish from what age on self-reports can complement or replace informant reports. We introduce a psychometric approach to estimate the minimum age for a child to produce self-report data that is of similar quality as informant data. The approach makes use of statistical validity indicators such as person-fit and long-string indices, and can be readily applied to data commonly collected in psychometric studies of child measures. We evaluate and illustrate the approach, using self-report and informant-report data of the PedsQL, a pediatric health-related quality of life measure, from 651 child–mother pairs. To evaluate the approach, we tested various hypotheses about the validity of the self-report data, using the [Formula: see text] person-fit index as the validity indicator and the mother informant-data as a benchmark for validity. Results showed that [Formula: see text] discriminated between self-reports of younger and older children, between self-reports of children that completed the PedsQL alone or with a parent, and between self-reports and informant reports. We conclude that the validity-index approach has good potential for future applications. Future research should further evaluate the approach for different types of questionnaires (e.g., personality inventories) and using different validity indices (e.g., response-bias indices).


1998 ◽  
Vol 83 (1) ◽  
pp. 316-318 ◽  
Author(s):  
Elisardo Becoña ◽  
Fernando L. Vazquez

In this study was evaluated the relationship between self-reported smoking rate and expired air carbon monoxide in 208 smokers who had attended a behavioral program for smoking cessation. A close relationship between carbon monoxide levels and self-reports was found at the end of treatment and in all follow-ups (6 and 12 mo.), around 100% concordance. Thus, support was found for the use of an expired air carbon monoxide measure as a valid and easy way of corroborating self-report data when required.


2020 ◽  
Author(s):  
Laura Boeschoten ◽  
Irene Ingeborg van Driel ◽  
Daniel L. Oberski ◽  
J. Loes Pouwels

Since the introduction of social media platforms, researchers have investigated how the use of such media affects adolescents’ well-being. Thus far, findings have been inconsistent. The aim of our interdisciplinary project is to provide a more thorough understanding of these inconsistencies by investigating who benefits from social media use, who does not and why it is beneficial for one yet harmful for another. In this presentation, we explain our approach to combining social scientific self-report data with the use of deep learning to analyze personal Instagram archives.


Assessment ◽  
2016 ◽  
Vol 25 (5) ◽  
pp. 543-556 ◽  
Author(s):  
Kibeom Lee ◽  
Michael C. Ashton

Psychometric properties of the 100-item English-language HEXACO Personality Inventory–Revised (HEXACO-PI-R) were examined using samples of online respondents ( N = 100,318 self-reports) and of undergraduate students ( N = 2,868 self- and observer reports). The results were as follows: First, the hierarchical structure of the HEXACO-100 was clearly supported in two principal components analyses: each of the six factors was defined by its constituent facets and each of the 25 facets was defined by its constituent items. Second, the HEXACO-100 factor scales showed fairly low intercorrelations, with only one pair of scales (Honesty–Humility and Agreeableness) having an absolute correlation above .20 in self-report data. Third, the factor and facet scales showed strong self/observer convergent correlations, which far exceeded the self/observer discriminant correlations.


2018 ◽  
Author(s):  
Michael Scharkow

The measurement of media exposure is essential to not only traditional audience research, but also media effects research which relies on accurate estimates of media exposure. Even in the age of digital trace data and passive audience measurement, the workhorse of basically all communication research is self-report data. In this paper, I present a meta-analysis of the reliability and temporal stability of media exposure self-reports. Results show that media self-reported exposure was moderately reliable and highly stable. The estimated reliability was lower in youth samples, while rank-order stability was very similar for a adults and adolescents. Moderation analyses showed that exposure to specific outlets yielded more reliable information in adult samples, while media-specific differences in reliability were only found in youth samples.


2016 ◽  
Vol 63 (4) ◽  
pp. 412-428 ◽  
Author(s):  
Amanda D. Emmert ◽  
Arna L. Carlock ◽  
Alan J. Lizotte ◽  
Marvin D. Krohn

Building on previous research, this article investigates whether discrepancies between official and self-reported measures of arrests as an adult can be predicted from such discrepancies as an adolescent. We use longitudinal data from the Rochester Youth Development Study to assess whether a pattern exists in adolescent and adult under- and over-reporting of arrests. We find consistency in under- and over-reporting throughout the adolescent–young adult life course. In other words, when respondents misreport the number of arrests they have experienced, they do so consistently regardless of age. This is reassuring for scholars using self-report data, as under- and over-reporting behaviors remain stable over this span of the life course. Finally, our models predicting discrepancies in official and self-reported arrests during the combined period of adolescence and young adulthood are both extremely strong. Our findings support the continued use of self-report measures as a valid indicator of delinquency.


2021 ◽  
Author(s):  
Philipp Schönegger ◽  
Steven Verheyen

Over the past decades, psychology and its cognate disciplines have undergone substantial reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has received comparatively little attention is incentivisation, i.e. the way that participants are rewarded and incentivised monetarily for their participation. While incentive-compatible designs are in use in disciplines like economics, the majority of studies in psychology and experimental philosophy are constructed such that individuals’ incentives to maximise their payoffs in many cases counteract their incentives to state their true preferences honestly. This is in part because the subject matter is often self-report data about subjective topics. One mechanism that allows for the introduction of an incentive-compatible design in such circumstances is the Bayesian Truth Serum (Prelec, 2004), which rewards participants based on how surprisingly common their answer are. Recently, Schoenegger (2021) applied this mechanism in the context of Likert-scale self-reports, finding that the introduction of this mechanism significantly altered response behaviour. In this registered report, we further investigate this mechanism by (i) replicating the original result and (ii) teasing out whether the effect may be explainable by an increase in expected earnings or the addition of a prediction task. We take this project to help introduce incentivisation mechanisms into fields where they were not widely used before.


2020 ◽  
Vol 6 (2) ◽  
pp. 65-70 ◽  
Author(s):  
Fabiola H Gerpott ◽  
Nale Lehmann-Willenbrock ◽  
Susanne Scheibe

Abstract Research on work and aging predominantly relies on self-report data to create new insights relevant to individuals, organizations, and society. Whereas surveys and interviews based on self-reports offer a valuable inward-directed perspective on individuals and their understanding of others, they can only provide limited knowledge on the behaviors of employees at different ages and in age-diverse settings. This is because what employees actually do is often considerably different from their survey-based reports of what they or others do. In this commentary, we challenge the field to move beyond a science of questionnaires by complementing survey research with behavioral data. First, this would allow scholars to identify when and how behaviors accurately translate into surveyed perceptions of behaviors. Second, such an approach can advance our understanding of the micro-dynamics occurring in age-diverse workforces that ultimately manifest in emerging phenomena (e.g., age-inclusive climate, psychological safety perceptions, or group affective tone). Lastly, studying concrete and specific behaviors also allows scholars to develop better interventions and provide meaningful recommendations for practice that differentiate actual from perceived behaviors.


2005 ◽  
Vol 35 (4) ◽  
pp. 941-965 ◽  
Author(s):  
Andrew Golub ◽  
Hilary James Liberty ◽  
Bruce D. Johnson

Measured trends in drug use can potentially reflect changes in drug use, changes in the accuracy of the measurement instrument, or both. This paper compares marijuana use trends from 1987 to 2001 using self-report and urinalysis data from arrestees interviewed at 23 sites served by the Arrestee Drug Abuse Monitoring (ADAM) Program. Overall, 60% of the variation in reported use reflected changes in detected use. Most notably, reported and detected use suggested different dynamics to the increase in marijuana use during the 1990s. The growth in detected use started later, increased more, and lasted longer. Several factors appear to have clearly contributed to this divergence between the measures: the percentage of marijuana users that disclosed their activity changed over time, the accuracy of ADAM's urinalysis test increased with time, and the percentage of infrequent users changed over time (urinalysis tests are less likely to detect infrequent users). The paper concludes with recommendations for the careful analysis of marijuana use trends using self-report data, biological data, or both. Trends in cocaine, crack, heroin, and methamphetamine are also considered.


Author(s):  
Leo L. Tasca

The Ministry of Transportation of Ontario conducted a pilot study to evaluate the effectiveness of a group education and information session for drivers aged 80 and over. Questionnaires on older drivers' self-awareness of risk were completed by 1,163 drivers aged 79 and over. The questionnaire asked several rudimentary questions about self-reported exposure and crash involvement. Answers to these questions are used to estimate the amount of driving and the frequency of crash involvement for very old drivers. The respondents' self-reports of the distance and days driven during the previous week and the number of crashes within the past 5 years are cross-classified by gender, age, season, examination center location, household size, self-reported medical condition, and self-reported medication use. The best predictors of self-reported distance driven during the previous week are gender, age, and the location of the driver examination center (the latter variable is a proxy for geographic location). The best predictors of self-reported crash involvement during the previous 5 years are the presence or absence of a self-reported medical condition and two variables used as proxies for the amount of driving. The results of a logistic regression analysis indicate that drivers reporting both a current medical condition and more driving exposure have a substantially higher crash risk. However, important limitations stem from the use of self-report data and the absence of data on the onset of a medical condition. These results, therefore, are tentative at best.


Sign in / Sign up

Export Citation Format

Share Document