scholarly journals Impact of a Sequential Mixed Mode Strategy on Response Rates and Reporting Errors in a Sample of US Veterans who applied for Department of Veterans Affairs Disability Benefits for Posttraumatic Stress Disorder

2019 ◽  
Author(s):  
Maureen Murdoch ◽  
Alisha D Simon Baines ◽  
Melissa Partin ◽  
MIchael Davern ◽  
Timothy J Beebe
Keyword(s):  
Data Collection ◽  
Stress Disorder ◽  
Telephone Interview ◽  
Response Rate ◽  
Response Rates ◽  
Veterans Affairs ◽  
Department Of Veterans Affairs ◽  
Percentage Points ◽  
Unwanted Sexual Attention ◽  
The Military

Background: Sequential mixed-mode methods, where one data collection strategy in a sample is followed by a second strategy, are increasingly popular for improving survey response rates and reducing non-response bias. There is risk, however, that switching data collection modes will exacerbate non-response bias or introduce interactions between reporting errors and data collection mode. Objectives: To assess the impact of adding a telephone interview to a mailed questionnaire on: 1) overall response rate and estimates of the population’s attributes, 2) differences in participants’ attributes across modes, and 3) the concordance of responses across modes among those who responded to both modes. Methods: observational, cross-sectional survey of 4,918 nationally representative US Veterans who applied for Department of Veterans Affairs disability benefits for posttraumatic stress disorder (PTSD) between 1994 and 1998. Analyses were stratified by gender. Results: In men, the response rate increased from 65.6% to 80.2% after the telephone interview and in women, from 66.7% to 80.2% (ps < 0.001). There were no differences across modes for the percentage of men and women who said they worked any hours for pay, went out socially, participated in sports, or experienced combat (ps > 0.05). The percentage of men and women saying they were sick or unable to work was 40 percentage points higher in the telephone interview than on the mailed questionnaire (ps < 0.001). Comparing the telephone interview to mailed questionnaire, the percentage reporting unwanted sexual attention while in the military was 18.5 percentage points lower in the men and 9.7 percentage points lower in the women (ps < 0.001). Total population estimates for being sick or unable to work increased by 7.3-8.3 percentage points after the telephone interviews, unwanted sexual attention in the military lowered by 1.6-3.2 percentage points. Conclusions: Adding a second data collection mode substantially improved response rates but may have introduced reporting errors that affected our estimates of why Veterans did not work for pay and whether they experienced unwanted sexual attention in the military.

scholarly journals The Effects of a Between-Wave Incentive Experiment on Contact Update and Production Outcomes in a Panel Study

2013 ◽  
Vol 29 (2) ◽  
pp. 261-276 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Robert F. Schoeni ◽  
Mick P. Couper
Keyword(s):  
Data Collection ◽  
Overall Response Rate ◽  
Response Rate ◽  
Panel Study ◽  
Response Rates ◽  
Income Dynamics ◽  
Overall Response ◽  
Percentage Points ◽  
Contact Information ◽  
The U.S

Abstract Since 1969, families participating in the U.S. Panel Study of Income Dynamics (PSID) have been sent a mailing asking them to update or verify their contact information in order to keep track of their whereabouts between waves. Having updated contact information prior to data collection is associated with fewer call attempts, less tracking, and lower attrition. Based on these advantages, two experiments were designed to increase response rates to the between wave contact mailing. The first experiment implemented a new protocol that increased the overall response rate by 7-10 percentage points compared to the protocol in place for decades on the PSID. This article provides results from the second experiment which examines the basic utility of the between-wave mailing, investigates how incentives affect article cooperation to the update request and field effort, and attempts to identify an optimal incentive amount. Recommendations for the use of contact update strategies in panel studies are made.

Comparing face-to-face to web data collection: unit response and costs in a national health survey (Preprint)

2020 ◽  
Author(s):  
Elise Braekman ◽  
Stefaan Demarest ◽  
Rana Charafeddine ◽  
Sabine Drieskens ◽  
Finaba Berete ◽  
...  
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Response Rates ◽  
Demographic Characteristics ◽  
Unit Response ◽  
Cost Advantage ◽  
Web Data ◽  
Demographic Groups ◽  
Considerable Cost ◽  
The Difference

BACKGROUND Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness, implementation ease and the increased internet penetration. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes and hence may increase bias in the measured indicators. OBJECTIVE This research assesses the unit response and costs of a web versus F2F study. METHODS Alongside the F2F Belgian Health Interview Survey of 2018 (BHIS2018; n gross sample used: 7,698), a web survey (BHISWEB; n gross sample=6,183) is organized. Socio-demographic data on invited individuals is obtained from the national register and census linkages. Unit response rates considering the different sampling probabilities of both surveys are calculated. Logistic regression analyses examine the association between mode system (web vs. F2F) and socio-demographic characteristics on unit non-response. The costs per completed web questionnaire are compared with these for a completed F2F questionnaire. RESULTS The unit response rate is lower in BHISWEB (18.0%) versus BHIS2018 (43.1%). A lower web response is found among all socio-demographic groups, however, the difference is higher among people older than 65, low educated people, people with a non-Belgian nationality, people living alone and these living in Brussels Capital. Not the same socio-demographic characteristics are associated with non-response in both studies. Having another European (OR (95% CI): 1.60 (1.20-2.13)) or a non-European nationality (OR (95% CI): 2.57 (1.79-3.70)) (compared to having the Belgian nationality) and living in the Brussels Capital (95% CI): 1.72 (1.41-2.10)) or Walloon (OR (95% CI): 1.47 (1.15 - 1.87) region (compared to living in the Flemish region) is only in BHISWEB associated with a higher non-response. In BHIS2018 younger people (OR (95% CI): 1.31 (1.11-1.54)) are more likely to be non-respondent than older people, this was not found BHISWEB. In both studies, lower educated people have a higher change to be non-respondent, but this effect is more pronounced in BHISWEB (OR low vs. high education level (95% CI): Web 2.71 (2.21-3.39)); F2F 1.70 (1.48-1.95)). The BHISWEB study has a considerable cost advantage; the total cost per completed questionnaire is almost three times lower (€41) compared to the F2F data collection (€111). CONCLUSIONS The F2F unit response rate is generally higher, yet for certain groups the difference between web versus F2F is more limited. A considerable cost advantage of web collection is found. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize financial resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys while remaining to focus on increasing the F2F response rates for other groups. CLINICALTRIAL Studies approved by the Ethics Committee of the University hospital of Ghent

Omissions and Errors in the Institute of Medicine’s Report on Scientific Evidence of Treatment for Posttraumatic Stress Disorder

2009 ◽  
Vol 3 (1) ◽  
pp. 32-38
Author(s):  
Christopher W. Lee ◽  
Sarah Schubert
Keyword(s):  
Posttraumatic Stress Disorder ◽  
Posttraumatic Stress ◽  
Stress Disorder ◽  
Scientific Evidence ◽  
Veterans Affairs ◽  
Critical Examination ◽  
Institute Of Medicine ◽  
Department Of Veterans Affairs ◽  
Pharmacological Treatments ◽  
Meta Analyses

A recently released report by the Institute of Medicine (IOM, 2008) commissioned by the U.S. Department of Veterans Affairs examined the evidence for psychotherapeutic and pharmacological treatments for posttraumatic stress disorder (PTSD). It concluded that the evidence was inadequate to determine the efficacy of eye movement desensitization and reprocessing (EMDR) in the treatment of PTSD. However, a critical examination of the basis for this conclusion reveals errors in three areas. First, the findings of key studies that reported positive outcomes for EMDR were misrepresented; second, a number of positive studies were excluded without apparent justification; and, finally, the IOM report failed to consider additional readily available studies that also reported benefits for EMDR. These factors appear to explain why the conclusions of the IOM report are at odds with the numerous meta-analyses and practice guidelines of PTSD treatments issued by other scientific committees worldwide.

Sign in / Sign up

Export Citation Format

Share Document