Comparing face-to-face to web data collection: unit response and costs in a national health survey (Preprint)

2020 ◽  
Author(s):  
Elise Braekman ◽  
Stefaan Demarest ◽  
Rana Charafeddine ◽  
Sabine Drieskens ◽  
Finaba Berete ◽  
...  
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Response Rates ◽  
Demographic Characteristics ◽  
Unit Response ◽  
Cost Advantage ◽  
Web Data ◽  
Demographic Groups ◽  
Considerable Cost ◽  
The Difference

BACKGROUND Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness, implementation ease and the increased internet penetration. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes and hence may increase bias in the measured indicators. OBJECTIVE This research assesses the unit response and costs of a web versus F2F study. METHODS Alongside the F2F Belgian Health Interview Survey of 2018 (BHIS2018; n gross sample used: 7,698), a web survey (BHISWEB; n gross sample=6,183) is organized. Socio-demographic data on invited individuals is obtained from the national register and census linkages. Unit response rates considering the different sampling probabilities of both surveys are calculated. Logistic regression analyses examine the association between mode system (web vs. F2F) and socio-demographic characteristics on unit non-response. The costs per completed web questionnaire are compared with these for a completed F2F questionnaire. RESULTS The unit response rate is lower in BHISWEB (18.0%) versus BHIS2018 (43.1%). A lower web response is found among all socio-demographic groups, however, the difference is higher among people older than 65, low educated people, people with a non-Belgian nationality, people living alone and these living in Brussels Capital. Not the same socio-demographic characteristics are associated with non-response in both studies. Having another European (OR (95% CI): 1.60 (1.20-2.13)) or a non-European nationality (OR (95% CI): 2.57 (1.79-3.70)) (compared to having the Belgian nationality) and living in the Brussels Capital (95% CI): 1.72 (1.41-2.10)) or Walloon (OR (95% CI): 1.47 (1.15 - 1.87) region (compared to living in the Flemish region) is only in BHISWEB associated with a higher non-response. In BHIS2018 younger people (OR (95% CI): 1.31 (1.11-1.54)) are more likely to be non-respondent than older people, this was not found BHISWEB. In both studies, lower educated people have a higher change to be non-respondent, but this effect is more pronounced in BHISWEB (OR low vs. high education level (95% CI): Web 2.71 (2.21-3.39)); F2F 1.70 (1.48-1.95)). The BHISWEB study has a considerable cost advantage; the total cost per completed questionnaire is almost three times lower (€41) compared to the F2F data collection (€111). CONCLUSIONS The F2F unit response rate is generally higher, yet for certain groups the difference between web versus F2F is more limited. A considerable cost advantage of web collection is found. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize financial resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys while remaining to focus on increasing the F2F response rates for other groups. CLINICALTRIAL Studies approved by the Ethics Committee of the University hospital of Ghent

Response patterns in the Belgian health interview survey: web versus face-to-face mode

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
E Braekman ◽  
S Demarest ◽  
R Charafeddine ◽  
F Berete ◽  
S Drieskens ◽  
...  
Keyword(s):  
Response Rate ◽  
Response Rates ◽  
Unit Response ◽  
Response Patterns ◽  
Demographic Groups ◽  
Face To Face ◽  
Health Interview Survey ◽  
Health Interview ◽  
Interview Survey ◽  
The Impact

Abstract Background Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness and ease of implementation and the increased internet penetration rates. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes such as face-to-face (F2F) interviewing and hence may increase bias in the measured indicators. This research assesses the response patterns of a web versus F2F study. Methods A Belgian health interview survey by web (BHISWEB; net sample=1010) was organized parallel to the traditional F2F BHIS 2018 (BHIS2018; net sample=11611; subsample used in this study=2748). Socio-demographic data on invited individuals were obtained from the national register and census linkages. To address the high item-missingness on education level deriving from the census, multiple imputation (m = 20) was applied. Unit response rates considering the different sampling probabilities of both surveys were calculated. Logistic regression analyses examined the impact of mode (web vs. F2F) and interactions between mode and socio-demographic characteristics on unit response. Results The unit response rate was significantly lower in the BHISWEB (18.0% (95% CI: 17.0-19.1)) than in the BHIS2018 (43.1% (95% CI: 41.5-44.7)). A lower web versus F2F response rate was found among all socio-demographic groups, however, this lower web response was less pronounced among youngsters, people cohabiting with household members, higher educated people and native Belgians. Conclusions The F2F unit response rate was generally higher, yet for certain groups the difference between web versus F2F was smaller. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys (e.g. youngsters) while remaining to focus on increasing the F2F response rates for other groups. Key messages The advantages of web versus F2F interviewing come against its considerable lower unit response rate. Differences in unit non-response between web and F2F vary between socio-demographic groups.

scholarly journals The Effects of a Between-Wave Incentive Experiment on Contact Update and Production Outcomes in a Panel Study

2013 ◽  
Vol 29 (2) ◽  
pp. 261-276 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Robert F. Schoeni ◽  
Mick P. Couper
Keyword(s):  
Data Collection ◽  
Overall Response Rate ◽  
Response Rate ◽  
Panel Study ◽  
Response Rates ◽  
Income Dynamics ◽  
Overall Response ◽  
Percentage Points ◽  
Contact Information ◽  
The U.S

Abstract Since 1969, families participating in the U.S. Panel Study of Income Dynamics (PSID) have been sent a mailing asking them to update or verify their contact information in order to keep track of their whereabouts between waves. Having updated contact information prior to data collection is associated with fewer call attempts, less tracking, and lower attrition. Based on these advantages, two experiments were designed to increase response rates to the between wave contact mailing. The first experiment implemented a new protocol that increased the overall response rate by 7-10 percentage points compared to the protocol in place for decades on the PSID. This article provides results from the second experiment which examines the basic utility of the between-wave mailing, investigates how incentives affect article cooperation to the update request and field effort, and attempts to identify an optimal incentive amount. Recommendations for the use of contact update strategies in panel studies are made.

scholarly journals Real World Outcomes with VTD and Cybord Induction Treatment for Transplant Eligible Multiple Myeloma Patients in a Latin American Country. Retrospective Cohort Study from Gamm (Grupo Argentino de Mieloma Multiple)

Blood ◽  
2018 ◽  
Vol 132 (Supplement 1) ◽  
pp. 3301-3301
Author(s):  
Natalia Paola Schutz ◽  
Paola Ochoa ◽  
Patricio Duarte ◽  
Guillermina Remaggi ◽  
Sebastian Yantorno ◽  
...  
Keyword(s):  
Multiple Myeloma ◽  
Cohort Study ◽  
Adverse Events ◽  
Latin American ◽  
Research Funding ◽  
Response Rate ◽  
Response Rates ◽  
Induction Treatment ◽  
The Difference

Abstract Introduction: There are scarce data regarding treatment outcomes and toxicity in Latin American countries. Argentina is the second largest country in the region and the fourth most populated one. National Guidelines from the Argentinean Society of Hematology (SAH) recommends the use of bortezomib based triplets for induction treatment in transplant eligible newly diagnosed Multiple Myeloma patients. Objective: To compare response rates and adverse events after induction treatment with Cyclophosphamide Bortezomib and Dexamethasone (CyBorD) or Bortezomib Thalidomide and Dexamethasone (VTD) outside of clinical trials in a Latin American country. Methods: Retrospective multicentric cohort study. All centers participating in the Argentinean Multiple Myeloma Study Group (GAMM) were invited to participate in the study. Eligible patients were 75 years of age or younger, with a diagnosis of Multiple Myeloma according to the IMWG 2014 criteria, transplant eligible, treated with at least one cycle of CyBorD or VTD as induction therapy in the time period from December 2012 until December 2017. Main exclusion criteria were amyloidosis, plasma cell leukemia and previous neuropathy. Patients were identified from local registries at each center and included consecutively in the study database. Epidemiological and clinical data were obtained from medical records and collected in a standardized clinical report form. Patients were followed from diagnosis until death or lost to follow up. Response was evaluated according to IMWG Response Criteria 2016. Adverse events were graded by CTCAE 4.3. Comparisons of response rates were performed using a Chi2 test and differences in rates were expressed as proportions with 95% confidence intervals (CI). Crude odds ratios (OR) and OR adjusted by potential confounders were calculated using a logistic regression model. Kaplan Meier method was used to estimate progression free survival (PFS) and overall survival (OS). Stata 13 software was used. Results: A total of 322 patients from 15 centers in Argentina were included in the study. The median age at diagnosis was 57 years (range 26-74), 52% (167) of the patients were male, 18% (58) had renal failure, 28% (85) ISS 3 , 7% (22) extramedullary disease, and 14% (46) high risk cytogenetics. Median time of follow up was 34 months (IQR 21-58). CyBorD was the most common treatment, indicated as induction therapy in 74% (238) of the cases. The characteristics of the patients were similar in both groups except age and LDH levels. The median number of cycles was 5 (range 1-12). Bortezomib was administered once per week in 85% (272) of the patients and subcutaneously in 86% (276) with no differences between both treatment arms. The median cumulative cyclophosphamide dose per month was 1.5 g (IQR 1.5-2.4) and thalidomide dose per day was 100 mg. In the VTD arm, 72,62% (61) of the patients achieved at least very good partial response (VGPR) vs 53.36% (127) with CyBorD [OR of 2.31 (CI 1.35 - 3.99) p=0.002]. The difference in VGPR was 19.26% (CI 15 - 24). Complete response rate (CR) was 35.92% in patients treated with VTD vs 22.55% with CyBorD [OR of 1.87 (CI 1.04 - 3.35) p=0.03). The difference in CR was 13,37% (CI 9.6 -17.53). There was no difference in overall response rate (ORR) with 94.05% vs 91.18% (p=0.406). Adverse events were more common with VTD (69.05% vs 55.46% p=0.030), especially neuropathy grade 3 - 4 (7.14% vs 1.26% p=0.005) and thrombosis (13.10 % vs 3.36 % p=0.001). Deep venous thrombosis prophylaxis was inadequate in 20.24% of the patients. Hematologic adverse events were more common with CyBorD, especially thrombocytopenia (5.95% vs 16.39% p=0.017). Autologous stem cell transplantation (ASCT) was performed in 78% (249) of patients. There was 5% (17) stem cell mobilization failure, all in the CyBorD arm. Response rates after ASCT with VTD and CyBorD induction treatment were: 76.19 vs 73.11% VGPR (p=0.580) and 48.53% vs 40% CR (p=0.20). Maintenance treatment was indicated in 67.86% (57) and 65.13% (155) patients respectively (p=0.650). The PFS at 24 months was 83% (CI 71-90) with VTD vs 72% (CI 66-78) [(HR 0.92 (CI 0.59 - 1.42) p 0.715] and OS 96% (CI 87-99) vs 91% (86-94) respectively [(HR 1.2 (CI 0.62 - 2.32) p 0.587]. Conclusions: VTD has better CR and VGPR compared to CyBorD. Nevertheless, CyBorD continues to be the preferred induction regimen in Argentina based on safety profile. The optimal number of induction treatment cycles remains to be determined. Disclosures Schutz: Takeda: Honoraria, Research Funding; Sanofi Aventis: Research Funding; Roche: Research Funding; Glaxo: Research Funding; Janssen: Honoraria, Research Funding; Varifarma: Honoraria. Shanley:Brystol Myers Squibb: Consultancy, Honoraria; Takeda: Consultancy, Honoraria. Fantl:Janssen: Consultancy, Honoraria, Research Funding; Varifarma/Amgen: Consultancy, Honoraria; Takeda: Consultancy, Honoraria, Research Funding; Sanofi: Research Funding; Roche: Research Funding; Tecnofarma: Honoraria; BMS: Consultancy, Honoraria; Glaxo: Research Funding.

scholarly journals The Effects of Nonresponse and Sampling Omissions on Estimates on Various Topics in Federal Surveys: Telephone and IVR Surveys of Address-Based Samples

2020 ◽  
Vol 36 (3) ◽  
pp. 631-645
Author(s):  
Floyd J. Fowler ◽  
Philip Brenner ◽  
Anthony M. Roman ◽  
J. Lee Hargraves
Keyword(s):  
Data Collection ◽  
Interactive Voice Response ◽  
Response Rates ◽  
Demographic Characteristics ◽  
Telephone Surveys ◽  
Telephone Interviews ◽  
Survey Questions ◽  
Nonresponse Error ◽  
Collection Strategies ◽  
Voice Response

AbstractWith declining response rates and challenges of using RDD sampling for telephone surveys, collecting data from address-based samples has become more attractive. Two approaches are doing telephone interviews at telephone numbers matched to addresses and asking those at sampled addresses to call into an Interactive Voice Response (IVR) system to answer questions. This study used in-person interviewing to evaluate the effects of nonresponse and problems matching telephone numbers when telephone and IVR were used as the initial modes of data collection. The survey questions were selected from major US federal surveys covering a variety of topics. Both nonresponse and, for telephone, inability to find matches result in important nonresponse error for nearly half the measures across all topics, even after adjustments to fit the known demographic characteristics of the residents. Producing credible estimates requires using supplemental data collection strategies to reduce error from nonresponse.

scholarly journals Impact of a Sequential Mixed Mode Strategy on Response Rates and Reporting Errors in a Sample of US Veterans who applied for Department of Veterans Affairs Disability Benefits for Posttraumatic Stress Disorder

2019 ◽  
Author(s):  
Maureen Murdoch ◽  
Alisha D Simon Baines ◽  
Melissa Partin ◽  
MIchael Davern ◽  
Timothy J Beebe
Keyword(s):  
Data Collection ◽  
Stress Disorder ◽  
Telephone Interview ◽  
Response Rate ◽  
Response Rates ◽  
Veterans Affairs ◽  
Department Of Veterans Affairs ◽  
Percentage Points ◽  
Unwanted Sexual Attention ◽  
The Military

Background: Sequential mixed-mode methods, where one data collection strategy in a sample is followed by a second strategy, are increasingly popular for improving survey response rates and reducing non-response bias. There is risk, however, that switching data collection modes will exacerbate non-response bias or introduce interactions between reporting errors and data collection mode. Objectives: To assess the impact of adding a telephone interview to a mailed questionnaire on: 1) overall response rate and estimates of the population’s attributes, 2) differences in participants’ attributes across modes, and 3) the concordance of responses across modes among those who responded to both modes. Methods: observational, cross-sectional survey of 4,918 nationally representative US Veterans who applied for Department of Veterans Affairs disability benefits for posttraumatic stress disorder (PTSD) between 1994 and 1998. Analyses were stratified by gender. Results: In men, the response rate increased from 65.6% to 80.2% after the telephone interview and in women, from 66.7% to 80.2% (ps < 0.001). There were no differences across modes for the percentage of men and women who said they worked any hours for pay, went out socially, participated in sports, or experienced combat (ps > 0.05). The percentage of men and women saying they were sick or unable to work was 40 percentage points higher in the telephone interview than on the mailed questionnaire (ps < 0.001). Comparing the telephone interview to mailed questionnaire, the percentage reporting unwanted sexual attention while in the military was 18.5 percentage points lower in the men and 9.7 percentage points lower in the women (ps < 0.001). Total population estimates for being sick or unable to work increased by 7.3-8.3 percentage points after the telephone interviews, unwanted sexual attention in the military lowered by 1.6-3.2 percentage points. Conclusions: Adding a second data collection mode substantially improved response rates but may have introduced reporting errors that affected our estimates of why Veterans did not work for pay and whether they experienced unwanted sexual attention in the military.

scholarly journals Combining sources of information to increase survey response rates

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Miguel Guinalíu ◽  
Vidal Díaz de Rada
Keyword(s):  
Data Collection ◽  
Market Research ◽  
Response Rate ◽  
Response Rates ◽  
Sources Of Information ◽  
Content Type ◽  
Face To Face ◽  
Regression Techniques ◽  
Mixed Modes ◽  
Use Of Internet

Purpose The purpose of this paper is to show that mixed methods applied sequentially provide sufficient knowledge of topics under study. Design/methodology/approach This paper conducted an analysis of a real case using descriptive statistical and regression techniques. Findings The present study proposes the use of the so-called “sequential mixed-modes” in survey-based market research. This technique is based on the successive application of different information collection techniques (face-to-face, telephone and internet-based surveys); it offers four fundamental advantages: increased coverage rate; higher response rate; lower costs; and greater cooperation. Research limitations/implications In addition to the normal limitations associated with conclusions derived from case studies, the data collection was carried out in only one autonomous community (Spain) and focussed only on one theme. Practical implications Firstly, it was found that data collection through mixed sequential modes substantially increases response rates in online surveys. This is particularly important as, in recent years, data collection through the internet has become almost standard market research practice. Secondly, the sample that resulted from the joint use of the three data collection modes more accurately reflected the distinctive features of the universe under study. A third recommendation is that the use of internet-based self-administered surveys is especially promising with individuals with a higher level of education and among students. Originality/value The decrease in the response rate is one of the greatest challenges of survey-based market research, given its impact on sample representativeness. This paper addresses this problem and exposes the advantages of the sequential use of mixed modes in the collection of information.

scholarly journals Effects of Forced Responses and Question Display Styles on Web Survey Response Rates

2015 ◽  
Vol 4 (2) ◽  
pp. 54-62
Author(s):  
Chatpong Tangmanee ◽  
Phattharaphong Niruttinanon
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Empirical Work ◽  
Response Rates ◽  
Survey Response ◽  
Web Survey ◽  
Significant Difference ◽  
Forced Responses ◽  
Theoretical Insight ◽  
Insight Into

Researchers have increasingly adopted a web survey for data collection. Previous studies have examined factors leading to a web survey’s success. However, virtually no empirical work has examined the effects of the three levels of forced responses or the two styles of question items displayed on a web survey’s response rate. The current study attempted to fill this void. Using a quasi-experiment approach, we obtained 778 unique responses to six comparable web questionnaires of identical content. The analysis confirmed that (1) there were statistically significant differences across the surveys with the 100%-, 50%- and 0%-forced responses, and (2) there is not a significant difference between the response rates between surveys with scrolling and those with paging styles. In addition to extending the theoretical insight into factors contributing to a web survey’s response rate, the findings have offered recommendations to enhance the response rate in a web survey project.

scholarly journals Randomized Double-Blind Clinical Trial Comparing Safety and Efficacy of the Biosimilar BCD-021 with Reference Bevacizumab

2021 ◽  
Author(s):  
Daniil Stroyakovskiy ◽  
Natalya Fadeeva ◽  
Marina Matrosova ◽  
Konstantin Shelepen ◽  
Grigoriy Adamchuk ◽  
...  
Keyword(s):  
Clinical Trial ◽  
Overall Response Rate ◽  
Response Rate ◽  
Response Rates ◽  
Phase Iii ◽  
Occurrence Rate ◽  
Study Endpoint ◽  
Primary Study ◽  
Overall Response ◽  
The Difference

Abstract Background BCD-021 is a bevacizumab biosimilar which was shown to be equivalent to reference bevacizumab in a wide panel of physicochemical studies as well as preclinical studies in vitro and in vivo. International multicenter phase III clinical trial was conducted to compare efficacy and safety of BCD-021 and reference bevacizumab in combination with paclitaxel and carboplatin in a first-line treatment of inoperable or advanced non-squamous non-small-cell lung cancer (NSCLC). Methods Patients with no previous treatment for advanced non-squamous NSCLC were randomly assigned 3:2 to BCD-021 or reference bevacizumab and were treated with bevacizumab + paclitaxel + carboplatin. Therapy continued for 6 cycles (every 3 weeks), until progression of the disease or unbearable toxicity. The primary study endpoint was the overall response rate. The study goal was to prove the equivalent efficacy of BCD-021 and reference bevacizumab. Equivalence margins for 95% CI for the difference in the overall response rates were set at [-18%; 18%], for 90% CI for the ratio of overall response rate were set at [67%; 150%]. Results In total 357 patients were enrolled in the study, 212 in the BCD-021 group and 145 in the reference bevacizumab group. The ORR was 34.63% in the BCD-022 group and 33.82% in the reference bevacizumab group. Limits of 95% CI for the difference in overall response rates between the groups were [-9.47%; 11.09%]. Limits of 90% CI for the ratio of overall response rate between the groups were [79.6%; 131.73%]. For both approaches CI lied within predetermined equivalence margins. Profile of adverse events (AEs) was similar between the groups (any AEs were reported in 86.89% of patients in BCD-021 group and 89.05% of patients in reference group). No unexpected adverse reactions were reported throughout the study. No statistically significant differences regarding anti-drug antibody occurrence rate was found between BCD-022 (n = 4; 1.96%) and comparator (n = 5; 3.65%). Both drug products showed low occurrence rate and short life of anti-bevacizumab antibodies. Pharmacokinetics assessment after 1st and 6th study drug injection also demonstrated equivalent PK parameters by all outcome measures. Conclusions Thus, the results of this study demonstrated therapeutic equivalence of bevacizumab biosimilar BCD-021 and referent bevacizumab drug. Trial registration: The trial was registered with ClinicalTrials.gov (Study Number NCT01763645, date of registration 09/01/2013).

scholarly journals T237. PERSON-CENTERED PSYCHOSIS CARE –HOW INCREASING PERSON-CENTEREDNESS IN PSYCHOSIS INPATIENT CARE RELATE TO CARE CONSUMPTION AND WARD BURDEN

2020 ◽  
Vol 46 (Supplement_1) ◽  
pp. S323-S323
Author(s):  
Katarina Allerby ◽  
Anneli Goulding ◽  
Lilas Ali ◽  
Andreas Gremyr ◽  
Margda Waern
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Length Of Hospital Stay ◽  
Participatory Approach ◽  
Care Plan ◽  
Patient Needs ◽  
Centered Care ◽  
Ward Level ◽  
The Difference

Abstract Background Since person-centered care (PCC) is widely embraced and internationally considered to increase effectiveness and quality of complex health care today this study sets out to investigate its relation to ward level outcomes such as length of hospital stay (LoS), involuntary treatments and ward burden. An educational intervention for staff, using a participatory approach, was created to increase the person-centeredness of the care delivered at four inpatient psychosis wards. 6 conference days spread over a 6 months period with practical work at home wards in-between let participants receive information on, discuss and test the principles of PCC, such as acknowledge patients resources, preferences and experiences, working in partnership with patients to co-create the care plan, and documenting agreements. Methods Data for all patients receiving care at the inpatient services during data collection periods before (n = 416) and after (n = 375) the intervention, including LoS, length of involuntary stay (LoIS) as well as number of episodes involving restraints, seclusions and forced injections, were extracted from the clinic registry. During the same data collection periods one staff member per day and ward filled out a VAS rating (1 = no burden – 10 =highest imaginable burden) capturing experienced ward burden (n = 505, 60% response rate vs n = 465, 45% response rate). Mean or median of each variable was used for comparative analysis. Results A longer LoS was found after implementation (Md = 21.1, n = 416 vs Md = 26.2, n = 375), U = 85894, p = .014, r = .09. LoIS was shorter after implementation (Md = 10.6 vs Md = 6.6), the difference was however not significant U = 74263, p = .231. Analysis of data on involuntary treatments are underway and will be presented. Ward burden was rated significantly lower after implementation (M = 5.4, SD = 1.94 vs M = 4.5, SD = 2.08), t = 7.5 (968), p <.0005. Discussion Although study design prevents conclusions on cause and effect, the results indicate a beneficial development for perceived care burden after implementation of PCC. The increased LoS could be interpreted as a result of more thorough attention to patient needs. It could also be due to differences between groups in terms of severity of symptom and functional ability at admission.

scholarly journals A framework for exploring non-response patterns over time in health surveys

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Famke J. M. Mölenberg ◽  
Chris de Vries ◽  
Alex Burdorf ◽  
Frank J. van Lenthe
Keyword(s):  
Health Behaviour ◽  
Health Surveys ◽  
Response Rate ◽  
Health Behaviours ◽  
Response Rates ◽  
Response Patterns ◽  
Prevalence Estimates ◽  
Sociodemographic Determinants ◽  
The Difference ◽  
Over Time

Abstract Background Most health surveys have experienced a decline in response rates. A structured approach to evaluate whether a decreasing - and potentially more selective - response over time biased estimated trends in health behaviours is lacking. We developed a framework to explore the role of differential non-response over time. This framework was applied to a repeated cross-sectional survey in which the response rate gradually declined. Methods We used data from a survey conducted biannually between 1995 and 2017 in the city of Rotterdam, The Netherlands. Information on the sociodemographic determinants of age, sex, and ethnicity was available for respondents and non-respondents. The main outcome measures of prevalence of sport participation and watching TV were only available for respondents. The framework consisted of four steps: 1) investigating the sociodemographic determinants of responding to the survey and the difference in response over time between sociodemographic groups; 2) estimating variation in health behaviour over time; 3) comparing weighted and unweighted prevalence estimates of health behaviour over time; and 4) comparing associations between sociodemographic determinants and health behaviour over time. Results The overall response rate per survey declined from 47% in 1995 to 15% in 2017. The probability of responding was higher among older people, females, and those with a Western background. The response rate declined in all subgroups, and a faster decline was observed among younger persons and those with a non-Western ethnicity as compared to older persons and those with a Western ethnicity. Variation in health behaviours remained constant. Prevalence estimates and associations did not follow the changes in response over time. On the contrary, the difference in probability of participating in sport gradually decreased between males and females, while no differential change in the response rate was observed. Conclusions Providing insights on non-response patterns over time is essential to understand whether declines in response rates may have influenced estimated trends in health behaviours. The framework outlined in this study can be used for this purpose. In our example, in spite of a major decline in response rate, there was no evidence that the risk of non-response bias increased over time.

Sign in / Sign up

Export Citation Format

Share Document