scholarly journals Taking A Closer Look At The Bayesian Truth Serum: A Registered Report

2021 ◽  
Author(s):  
Philipp Schönegger ◽  
Steven Verheyen
Keyword(s):  
Self Report ◽  
Original Result ◽  
Incentive Compatible ◽  
The Past ◽  
Self Reports ◽  
Report Data ◽  
The Subject ◽  
Expected Earnings ◽  
Altered Response ◽  
Self Report Data

Over the past decades, psychology and its cognate disciplines have undergone substantial reform, ranging from advances in statistical methodology to significant changes in academic norms. One aspect of experimental design that has received comparatively little attention is incentivisation, i.e. the way that participants are rewarded and incentivised monetarily for their participation. While incentive-compatible designs are in use in disciplines like economics, the majority of studies in psychology and experimental philosophy are constructed such that individuals’ incentives to maximise their payoffs in many cases counteract their incentives to state their true preferences honestly. This is in part because the subject matter is often self-report data about subjective topics. One mechanism that allows for the introduction of an incentive-compatible design in such circumstances is the Bayesian Truth Serum (Prelec, 2004), which rewards participants based on how surprisingly common their answer are. Recently, Schoenegger (2021) applied this mechanism in the context of Likert-scale self-reports, finding that the introduction of this mechanism significantly altered response behaviour. In this registered report, we further investigate this mechanism by (i) replicating the original result and (ii) teasing out whether the effect may be explainable by an increase in expected earnings or the addition of a prediction task. We take this project to help introduce incentivisation mechanisms into fields where they were not widely used before.

scholarly journals Determining at What Age Children Provide Sound Self-Reports: An Illustration of the Validity-Index Approach

Assessment ◽  
2019 ◽  
Vol 27 (7) ◽  
pp. 1604-1618 ◽  
Author(s):  
Judith M. Conijn ◽  
Niels Smits ◽  
Esther E. Hartman
Keyword(s):  
Self Report ◽  
Future Research ◽  
Older Children ◽  
Person Fit ◽  
Validity Index ◽  
Index Approach ◽  
Validity Indices ◽  
Self Reports ◽  
Report Data ◽  
Self Report Data

In psychological assessment of children, it is pivotal to establish from what age on self-reports can complement or replace informant reports. We introduce a psychometric approach to estimate the minimum age for a child to produce self-report data that is of similar quality as informant data. The approach makes use of statistical validity indicators such as person-fit and long-string indices, and can be readily applied to data commonly collected in psychometric studies of child measures. We evaluate and illustrate the approach, using self-report and informant-report data of the PedsQL, a pediatric health-related quality of life measure, from 651 child–mother pairs. To evaluate the approach, we tested various hypotheses about the validity of the self-report data, using the [Formula: see text] person-fit index as the validity indicator and the mother informant-data as a benchmark for validity. Results showed that [Formula: see text] discriminated between self-reports of younger and older children, between self-reports of children that completed the PedsQL alone or with a parent, and between self-reports and informant reports. We conclude that the validity-index approach has good potential for future applications. Future research should further evaluate the approach for different types of questionnaires (e.g., personality inventories) and using different validity indices (e.g., response-bias indices).

scholarly journals Are survey measures of medical careutilisation misleading?

2001 ◽  
Vol 24 (3) ◽  
pp. 91 ◽  
Author(s):  
Ric Marshall ◽  
David Grayson ◽  
Anthony Jorm ◽  
Brian O'Toole
Keyword(s):  
Medical Care ◽  
Vietnam Veterans ◽  
Epidemiological Survey ◽  
National Health Survey ◽  
Self Report ◽  
Health Study ◽  
Veterans Health ◽  
The Past ◽  
Report Data ◽  
Self Report Data

found when estimates from self-report data from anepidemiolgical study were compared to actual cost data extracted from administrative records. Even though the fewsubjects who were actually provided with two or more services in the two-week self-report period substantially under-reportedtheir medical care consumption, a large net over-estimate of medical care consumption was produced by theself-report data. This finding has important implications for use of self-report data from surveys such as the AustralianBureau of Statistics (ABS) National Health Survey for estimating health service consumption.By combining epidemiological survey data from the Australian Vietnam Veterans Health Study (AVVHS), with dataon actual medical care for which the Health Insurance Commission (HIC) or the Department of Veterans' Affairs (DVA)paid benefits, we were able to directly compare self-reported medical care consumption with actual medical careutilisation. The comparison revealed that veterans' self-reports were a valid measure of relative medical careconsumption because those who reported care over the past two weeks were much more likely to have been recentconsumers than those who did not. This relationship became even stronger if the comparison of self-report was extendedto data on benefits paid beyond the two-week self-report period. However, the HIC and DVA data confirmed only 51%of veterans self-reporting medical care consumption during the past two weeks actually received a service.

One measure, one meaning: Multiple measures, clearer meaning

2002 ◽  
Vol 14 (3) ◽  
pp. 463-475 ◽  
Author(s):  
JEROME KAGAN ◽  
NANCY SNIDMAN ◽  
MARK MCMANIS ◽  
SUE WOODWARD ◽  
CHRISTINA HARDWAY
Keyword(s):  
Self Report ◽  
Multiple Measures ◽  
Self Reports ◽  
Physiological Information ◽  
Report Data ◽  
Self Report Data ◽  
Different Sources

This paper tries to make three points. First, current constructs in personality and psychopathology are based on the restrictive evidence contained in self-reports. As a result, heterogeneous categories of individuals are assigned to the same category. Second, it is suggested that when different sources of evidence are included, theoretically distinct groups will be detected within the prior heterogeneous category. Third, the authors argue that physiological information has the potential to parse individuals with similar phenotypes on self-report data into distinct groups that reveal the temperamental origins of their phenotype.

Self-Reported Smoking and Measurement of Expired Air Carbon Monoxide in a Clinical Treatment

1998 ◽  
Vol 83 (1) ◽  
pp. 316-318 ◽  
Author(s):  
Elisardo Becoña ◽  
Fernando L. Vazquez
Keyword(s):  
Carbon Monoxide ◽  
Self Report ◽  
Behavioral Program ◽  
End Of Treatment ◽  
Self Reports ◽  
Close Relationship ◽  
Report Data ◽  
Self Report Data ◽  
The Relationship ◽  
Expired Air

In this study was evaluated the relationship between self-reported smoking rate and expired air carbon monoxide in 208 smokers who had attended a behavioral program for smoking cessation. A close relationship between carbon monoxide levels and self-reports was found at the end of treatment and in all follow-ups (6 and 12 mo.), around 100% concordance. Thus, support was found for the use of an expired air carbon monoxide measure as a valid and easy way of corroborating self-report data when required.

scholarly journals Methods for the detection of carelessly invalid responses in survey data

2018 ◽  
Author(s):  
Paul G Curran
Keyword(s):  
Survey Data ◽  
Experimental Psychology ◽  
Self Report ◽  
New Techniques ◽  
The Past ◽  
Report Data ◽  
Survey Results ◽  
Self Report Data ◽  
Data Collections ◽  
Online Measures

Self-report data collections, particularly through online measures, are ubiquitous in both experimental and non- experimental psychology. Invalid data can be present in such data collections for a number of reasons. One reason is careless or insufficient effort (C/IE) responding. The past decade has seen a rise in research on techniques to detect and remove these data before normal analysis (Huang, Curran, Keeney, Poposki, & DeShon, 2012; Johnson, 2005; Meade & Craig, 2012). The rigorous use of these techniques is valuable tool for the removal of error that can impact survey results (Huang, Liu, & Bowling, 2015). This research has encompassed a number of sub-fields of psychology, and this paper aims to integrate different perspectives into a review and assessment of current tech- niques, an introduction of new techniques, and a generation of recommendations for practical use. Concerns about C/IE responding are a factor any time self-report data are collected, and all such researchers should be well-versed on methods to detect this pattern of response.

scholarly journals Instagram Use and the Well-Being of Adolescents: Using Deep Learning to Link Social Scientific Self-reports with Instagram Data Download Packages

2020 ◽  
Author(s):  
Laura Boeschoten ◽  
Irene Ingeborg van Driel ◽  
Daniel L. Oberski ◽  
J. Loes Pouwels
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
Well Being ◽  
Self Report ◽  
Interdisciplinary Project ◽  
Self Reports ◽  
Social Media Platforms ◽  
Report Data ◽  
Social Scientific ◽  
Self Report Data

Since the introduction of social media platforms, researchers have investigated how the use of such media affects adolescents’ well-being. Thus far, findings have been inconsistent. The aim of our interdisciplinary project is to provide a more thorough understanding of these inconsistencies by investigating who benefits from social media use, who does not and why it is beneficial for one yet harmful for another. In this presentation, we explain our approach to combining social scientific self-report data with the use of deep learning to analyze personal Instagram archives.

Evaluation of Simulation Outcomes

2020 ◽  
Vol 39 (1) ◽  
pp. 149-180
Author(s):  
Susan Prion ◽  
Katie Anne Haerling
Keyword(s):  
Nursing Education ◽  
Healthcare Professionals ◽  
Self Report ◽  
Future Research ◽  
The Past ◽  
Simulation Evaluation ◽  
Report Data ◽  
Self Report Data ◽  
And Training ◽  
Initial Focus

Simulation has been used in nursing education and training since Florence Nightingale's era. Over the past 20 years, simulation learning experiences (SLEs) have been used with increasing frequently to educate healthcare professionals, develop and increase the expertise of practicing professionals, and gain competency in key interprofessional skills. This chapter provides a brief overview of simulation evaluation history, beginning in the late 1990s, and the initial focus on learner self-report data. Using Kirkpatrick's Levels of Evaluation as an organizing model, four types of SLE evaluation are reviewed as well as suggestions for future research.

Psychometric Properties of the HEXACO-100

Assessment ◽  
2016 ◽  
Vol 25 (5) ◽  
pp. 543-556 ◽  
Author(s):  
Kibeom Lee ◽  
Michael C. Ashton
Keyword(s):  
Psychometric Properties ◽  
Undergraduate Students ◽  
English Language ◽  
The Self ◽  
Self Report ◽  
Self Reports ◽  
The Hierarchical Structure ◽  
Report Data ◽  
Absolute Correlation ◽  
Self Report Data

Psychometric properties of the 100-item English-language HEXACO Personality Inventory–Revised (HEXACO-PI-R) were examined using samples of online respondents ( N = 100,318 self-reports) and of undergraduate students ( N = 2,868 self- and observer reports). The results were as follows: First, the hierarchical structure of the HEXACO-100 was clearly supported in two principal components analyses: each of the six factors was defined by its constituent facets and each of the 25 facets was defined by its constituent items. Second, the HEXACO-100 factor scales showed fairly low intercorrelations, with only one pair of scales (Honesty–Humility and Agreeableness) having an absolute correlation above .20 in self-report data. Third, the factor and facet scales showed strong self/observer convergent correlations, which far exceeded the self/observer discriminant correlations.

Acquisition of Self-Control of a Novel Muscular Activity with EMG and Video Feedback

1989 ◽  
Vol 69 (1) ◽  
pp. 19-26 ◽  
Author(s):  
Seiji Koga
Keyword(s):  
Muscular Activity ◽  
The Self ◽  
Self Control ◽  
Self Report ◽  
Feedback Signal ◽  
Control Stage ◽  
Initial Stage ◽  
Report Data ◽  
The Subject ◽  
Self Report Data

To examine the acquisition of voluntary control of a novel muscular activity from the initial stage to the self-control stage, the m. auricularis posterior, which had generally degenerated and had nearly lost its function of drawing an auricle backward in the human body, was selected as a target muscle to be studied. One female undergraduate student who could not move her auricles intentionally was required to activate her left m. auricularis posterior and underwent rest, pretest, training, and posttest sessions once a day for five days. At the subject's request, the electromyograph (EMG) from her left m. auricularis posterior on an oscillograph was provided for her as the feedback signal on each training trial. The picture of her left ear on television was handled in the same way. The EMG measures indicated that the subject could learn to activate her left m. auricularis posterior differentially. The number of training trials on which the subject requested the feedback signals suggested that EMG feedback signal was more useful to her than the video and that the usefulness of the feedback signals varied as the training sessions advanced. It was also concluded from analysis of the self-report data that the acquisition process of self-control of a novel muscular activity could be divided into at least four stages.

Sign in / Sign up

Export Citation Format

Share Document