scholarly journals Reporting on one's behavior: a survey experiment on the nonvalidity of self-reported COVID-19 hygiene-relevant routine behaviors

2021 ◽  
pp. 1-18
Author(s):  
Pelle Guldborg Hansen ◽  
Erik Gahner Larsen ◽  
Caroline Drøgemüller Gundersen

Abstract Surveys based on self-reported hygiene-relevant routine behaviors have played a crucial role in policy responses to the COVID-19 pandemic. In this article, using anchoring to test validity in a randomized controlled survey experiment during the COVID-19 pandemic, we demonstrate that asking people to self-report on the frequency of routine behaviors are prone to significant measurement error and systematic bias. Specifically, we find that participants across age, gender, and political allegiance report higher (lower) frequencies of COVID-19-relevant behaviors when provided with a higher (lower) anchor. The results confirm that such self-reports should not be regarded as behavioral data and should primarily be used to inform policy decisions if better alternatives are not available. To this end, we discuss the use of anchoring as a validity test relative to self-reported behaviors as well as viable alternatives to self-reports when seeking to behaviorally inform policy decisions.

2019 ◽  
Vol 35 (4) ◽  
pp. 777-805 ◽  
Author(s):  
Simon Kühne ◽  
Martin Kroh ◽  
David Richter

Abstract Research comparing heterosexuals with bisexuals and homosexuals in economics and the social sciences typically relies on two strategies to identify sexual orientation in existing survey data of general populations. Probing respondents to self-report their sexual orientation is generally considered the preferred option. Since self-reports are unavailable in most large multidisciplinary surveys, often researchers infer sexual orientation from the gender-constellation of a respondent’s partnership instead. Based on German Socio-Economic Panel (SOEP) data, this article reviews both strategies empirically in the context of a household panel survey. The analysis shows that self-reported and partnership-inferred sexual orientation are not mutual substitutes, instead leading to substantively different conclusions about differences between heterosexuals and LGBs (Lesbian, Gays, and Bisexuals). The article discusses problems of non-coverage in partnership-inferred sexual orientation and also investigates measurement error in self-reported sexual orientation, finding notable mode and interviewer effects.


2019 ◽  
pp. 107755871985883
Author(s):  
Jennifer M. Mellor ◽  
Melissa McInerney ◽  
Lindsay M. Sabik

Previous studies show that survey-based reports of Medicaid participation are measured with error, but no prior study has examined measurement error in an important segment of the Medicaid population—low-income adults enrolled in Medicare. Using the Medicare Current Beneficiary Survey, we examine whether respondent self-reports of Medicaid enrollment match administrative records and present several key findings. First, among low-income Medicare beneficiaries, the false negative rate is 11.5% when the self-report is interpreted as full Medicaid and 3.7% when the self-report is interpreted as full or partial Medicaid. Second, the likelihood of a false negative report is systematically associated with respondent traits. Third, systematic measurement error results in biased coefficient estimates in models of Medicaid participation defined from self-reports, and the bias is more significant when the researcher interprets self-reports as full Medicaid coverage only. Researchers should use caution when interpreting survey reports as pertaining to full Medicaid coverage only.


2006 ◽  
Vol 37 (3) ◽  
pp. 131-139 ◽  
Author(s):  
Juliane Degner ◽  
Dirk Wentura ◽  
Klaus Rothermund

Abstract: We review research on response-latency based (“implicit”) measures of attitudes by examining what hopes and intentions researchers have associated with their usage. We identified the hopes of (1) gaining better measures of interindividual differences in attitudes as compared to self-report measures (quality hope); (2) better predicting behavior, or predicting other behaviors, as compared to self-reports (incremental validity hope); (3) linking social-cognitive theories more adequately to empirical research (theory-link hope). We argue that the third hope should be the starting point for using these measures. Any attempt to improve these measures should include the search for a small-scale theory that adequately explains the basic effects found with such a measure. To date, small-scale theories for different measures are not equally well developed.


2014 ◽  
Vol 30 (3) ◽  
pp. 231-237 ◽  
Author(s):  
Markus Quirin ◽  
Regina C. Bode

Self-report measures for the assessment of trait or state affect are typically biased by social desirability or self-delusion. The present work provides an overview of research using a recently developed measure of automatic activation of cognitive representation of affective experiences, the Implicit Positive and Negative Affect Test (IPANAT). In the IPANAT, participants judge the extent to which nonsense words from an alleged artificial language express a number of affective states or traits. The test demonstrates appropriate factorial validity and reliabilities. We review findings that support criterion validity and, additionally, present novel variants of this procedure for the assessment of the discrete emotions such as happiness, anger, sadness, and fear.


2019 ◽  
Author(s):  
Carl Pierre Jago ◽  
Karen R. Dobkins

To appeal to the opposite gender, previous research indicates that men emphasize their wealth, status, and ambition, whereas women emphasize their physical attractiveness. Such behavior seems surprising given previous surveys in which men and women reported these traits to be less important than others such as trustworthiness, intelligence, and warmth. We addressed one potential reason for any disconnect, which is that men’s and women’s beliefs about what the opposite gender prefers are misguided—according to the opposite genders’ self-reports. Using a new method, we asked participants to both self-report the traits they prefer in a romantic partner and to indicate what they imagine the opposite gender prefers. The results reveal striking discrepancies between what people report wanting in a potential partner and what the opposite gender imagines they want. Additionally, women appear to be better at imagining men’s preferences, and we discuss several reasons why this might be the case.


Author(s):  
Yu-Hsiang Wu ◽  
Elizabeth Stangl ◽  
Octav Chipara ◽  
Anna Gudjonsdottir ◽  
Jacob Oleson ◽  
...  

Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in-situ self-reports that describe respondents' current or recent experiences. Audiology literature comparing in-situ and retrospective self-reports is scarce. Purpose To compare the sensitivity of in-situ and retrospective self-reports in detecting the outcome difference between hearing aid technologies, and to determine the association between in-situ and retrospective self-reports. Research Design An observational study. Study Sample Thirty-nine older adults with hearing loss. Data Collection and Analysis The study was part of a larger clinical trial that compared the outcomes of a prototype hearing aid (denoted as HA1) and a commercially available device (HA2). In each trial condition, participants wore hearing aids for 4 weeks. Outcomes were measured using EMA and retrospective questionnaires. To ensure that the outcome data could be directly compared, the Glasgow Hearing Aid Benefit Profile was administered as an in-situ self-report (denoted as EMA-GHABP) and as a retrospective questionnaire (retro-GHABP). Linear mixed models were used to determine if the EMA- and retro-GHABP could detect the outcome difference between HA1 and HA2. Correlation analyses were used to examine the association between EMA- and retro-GHABP. Results For the EMA-GHABP, HA2 had significantly higher (better) scores than HA1 in the GHABP subscales of benefit, residual disability, and satisfaction (p = 0.029–0.0015). In contrast, the difference in the retro-GHABP score between HA1 and HA2 was significant only in the satisfaction subscale (p = 0.0004). The correlations between the EMA- and retro-GHABP were significant in all subscales (p = 0.0004 to <0.0001). The strength of the association ranged from weak to moderate (r = 0.28–0.58). Finally, the exit interview indicated that 29 participants (74.4%) preferred HA2 over HA1. Conclusion The study suggests that in-situ self-reports collected using EMA could have a higher sensitivity than retrospective questionnaires. Therefore, EMA is worth considering in clinical trials that aim to compare the outcomes of different hearing aid technologies. The weak to moderate association between in-situ and retrospective self-reports suggests that these two types of measures assess different aspects of hearing aid outcomes.


Author(s):  
Gomolemo Mahakwe ◽  
Ensa Johnson ◽  
Katarina Karlsson ◽  
Stefan Nilsson

Anxiety has been identified as one of the most severe and long-lasting symptoms experienced by hospitalized children with cancer. Self-reports are especially important for documenting emotional and abstract concepts, such as anxiety. Children may not always be able to communicate their symptoms due to language difficulties, a lack of developmental language skills, or the severity of their illness. Instruments with sufficient psychometric quality and pictorial support may address this communication challenge. The purpose of this review was to systematically search the published literature and identify validated and reliable self-report instruments available for children aged 5–18 years to use in the assessment of their anxiety to ensure they receive appropriate anxiety-relief intervention in hospital. What validated self-report instruments can children with cancer use to self-report anxiety in the hospital setting? Which of these instruments offer pictorial support? Eight instruments were identified, but most of the instruments lacked pictorial support. The Visual Analogue Scale (VAS) and Pediatric Quality of Life (PedsQL™) 3.0 Brain Tumor Module and Cancer Module proved to be useful in hospitalized children with cancer, as they provide pictorial support. It is recommended that faces or symbols be used along with the VAS, as pictures are easily understood by younger children. Future studies could include the adaptation of existing instruments in digital e-health tools.


2021 ◽  
Vol 11 (6) ◽  
pp. 818
Author(s):  
Yann Kerautret ◽  
Aymeric Guillot ◽  
Sébastien Daligault ◽  
Franck Di Rienzo

The present double-blinded, randomized controlled study sought to compare the effects of a full-body manual massage (MM) and a foam rolling (FR) intervention on subjective and objective indexes of performance and well-being. A total of 65 healthy individuals were randomly allocated to an FR, MM, or a control group who received a cognitively oriented relaxation routine. Self-report ratings of perceived anxiety, muscle relaxation, and muscle pain were used to index changes in affect and physical sensations. The sit-and-reach and toe-touch tests, as well as a mental calculation task, were used to index motor and cognitive performances, respectively. We also conducted resting-state electroencephalography and continuous skin conductance recordings before and after the experimental intervention. Both FR and MM groups exhibited neural synchronization of alpha and beta oscillations during the posttest. Skin conductance increased from the pretest to the posttest in the relaxation group, but decreased in the FR group. All interventions improved range of motion, although only the MM group outperformed the relaxation group for the toe-touch performance. MM was associated with reduced muscle pain and increased muscle relaxation. Reduced perceived anxiety after the intervention was observed in the FR group only. Overall, MM and FR both improved objective and subjective indexes of performance and well-being. Differences between the two massage interventions are discussed in relation to the effects of pressure stimulation on autonomic regulations and the proactive vs. retroactive nature of FR, compared to MM.


2021 ◽  
Vol 39 (28_suppl) ◽  
pp. 312-312
Author(s):  
Megan Mullins ◽  
Jasdeep Kler ◽  
Marissa Eastman ◽  
Mohammed Kabeto ◽  
Lauren P. Wallner ◽  
...  

312 Background: Population aging and improving cancer survival rates are resulting in a growing population of older cancer survivors in the United States (US). As a result, there is an increasing need for longitudinal, population-representative data for interdisciplinary cancer research among older adults. The US Health Retirement Study (HRS) is an ongoing population-representative cohort of US adults over age 50 that contains rich interview and biomarker data on health during aging. Interviews have collected self-reported cancer diagnoses since 1998, but these self-reports have not been validated. We compared first incident cancer diagnoses self-reported in HRS interviews against diagnostic claims from linked Medicare records. Methods: We examined the validity of first incident cancer diagnoses self-reported in biennial HRS interviews from 2000 through 2016 against ICD-9 and ICD-10 diagnostic claim records among 8,242 HRS participants aged ≥65 with 90% continuous enrollment in fee-for-service Medicare, using the claim records as the gold standard. We calculated the sensitivity, specificity, and k for first incident cancer diagnoses (all cancers combined, excluding non-melanoma skin cancer, and each of bladder, breast, colorectal/anal, uterine, kidney/renal, lung/bronchus, and prostate cancers) cumulatively over the follow-up, and at each biennial study interview. Results: Self-reports of first incident cancer diagnosis (agnostic of site) between 2000 and 2016 had 73.2% sensitivity and 96.2% specificity against Medicare claims (k = 0.73). For site-specific self-reports, sensitivities ranged from 44.7% (kidney) to 75.0% (breast), and specificities ranged from 99.2% (prostate) to 99.9% (bladder, uterine, and kidney). Results were similar in sensitivity analyses restricting to individuals with 100% continuous fee-for-service Medicare enrollment and when restricting to individuals with at least 24 months of Medicare enrollment. Conclusions: Self-reported cancer diagnoses in the HRS have reasonable validity for population-based research on cancer and aging across cancer types. Apart from breast cancer, cancer site specific analyses will greatly benefit from the improved validity of self-report with Medicare claim linkage.


Sign in / Sign up

Export Citation Format

Share Document