scholarly journals A framework for exploring non-response patterns over time in health surveys

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Famke J. M. Mölenberg ◽  
Chris de Vries ◽  
Alex Burdorf ◽  
Frank J. van Lenthe
Keyword(s):  
Health Behaviour ◽  
Health Surveys ◽  
Response Rate ◽  
Health Behaviours ◽  
Response Rates ◽  
Response Patterns ◽  
Prevalence Estimates ◽  
Sociodemographic Determinants ◽  
The Difference ◽  
Over Time

Abstract Background Most health surveys have experienced a decline in response rates. A structured approach to evaluate whether a decreasing - and potentially more selective - response over time biased estimated trends in health behaviours is lacking. We developed a framework to explore the role of differential non-response over time. This framework was applied to a repeated cross-sectional survey in which the response rate gradually declined. Methods We used data from a survey conducted biannually between 1995 and 2017 in the city of Rotterdam, The Netherlands. Information on the sociodemographic determinants of age, sex, and ethnicity was available for respondents and non-respondents. The main outcome measures of prevalence of sport participation and watching TV were only available for respondents. The framework consisted of four steps: 1) investigating the sociodemographic determinants of responding to the survey and the difference in response over time between sociodemographic groups; 2) estimating variation in health behaviour over time; 3) comparing weighted and unweighted prevalence estimates of health behaviour over time; and 4) comparing associations between sociodemographic determinants and health behaviour over time. Results The overall response rate per survey declined from 47% in 1995 to 15% in 2017. The probability of responding was higher among older people, females, and those with a Western background. The response rate declined in all subgroups, and a faster decline was observed among younger persons and those with a non-Western ethnicity as compared to older persons and those with a Western ethnicity. Variation in health behaviours remained constant. Prevalence estimates and associations did not follow the changes in response over time. On the contrary, the difference in probability of participating in sport gradually decreased between males and females, while no differential change in the response rate was observed. Conclusions Providing insights on non-response patterns over time is essential to understand whether declines in response rates may have influenced estimated trends in health behaviours. The framework outlined in this study can be used for this purpose. In our example, in spite of a major decline in response rate, there was no evidence that the risk of non-response bias increased over time.

Comparing face-to-face to web data collection: unit response and costs in a national health survey (Preprint)

2020 ◽  
Author(s):  
Elise Braekman ◽  
Stefaan Demarest ◽  
Rana Charafeddine ◽  
Sabine Drieskens ◽  
Finaba Berete ◽  
...  
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Response Rates ◽  
Demographic Characteristics ◽  
Unit Response ◽  
Cost Advantage ◽  
Web Data ◽  
Demographic Groups ◽  
Considerable Cost ◽  
The Difference

BACKGROUND Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness, implementation ease and the increased internet penetration. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes and hence may increase bias in the measured indicators. OBJECTIVE This research assesses the unit response and costs of a web versus F2F study. METHODS Alongside the F2F Belgian Health Interview Survey of 2018 (BHIS2018; n gross sample used: 7,698), a web survey (BHISWEB; n gross sample=6,183) is organized. Socio-demographic data on invited individuals is obtained from the national register and census linkages. Unit response rates considering the different sampling probabilities of both surveys are calculated. Logistic regression analyses examine the association between mode system (web vs. F2F) and socio-demographic characteristics on unit non-response. The costs per completed web questionnaire are compared with these for a completed F2F questionnaire. RESULTS The unit response rate is lower in BHISWEB (18.0%) versus BHIS2018 (43.1%). A lower web response is found among all socio-demographic groups, however, the difference is higher among people older than 65, low educated people, people with a non-Belgian nationality, people living alone and these living in Brussels Capital. Not the same socio-demographic characteristics are associated with non-response in both studies. Having another European (OR (95% CI): 1.60 (1.20-2.13)) or a non-European nationality (OR (95% CI): 2.57 (1.79-3.70)) (compared to having the Belgian nationality) and living in the Brussels Capital (95% CI): 1.72 (1.41-2.10)) or Walloon (OR (95% CI): 1.47 (1.15 - 1.87) region (compared to living in the Flemish region) is only in BHISWEB associated with a higher non-response. In BHIS2018 younger people (OR (95% CI): 1.31 (1.11-1.54)) are more likely to be non-respondent than older people, this was not found BHISWEB. In both studies, lower educated people have a higher change to be non-respondent, but this effect is more pronounced in BHISWEB (OR low vs. high education level (95% CI): Web 2.71 (2.21-3.39)); F2F 1.70 (1.48-1.95)). The BHISWEB study has a considerable cost advantage; the total cost per completed questionnaire is almost three times lower (€41) compared to the F2F data collection (€111). CONCLUSIONS The F2F unit response rate is generally higher, yet for certain groups the difference between web versus F2F is more limited. A considerable cost advantage of web collection is found. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize financial resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys while remaining to focus on increasing the F2F response rates for other groups. CLINICALTRIAL Studies approved by the Ethics Committee of the University hospital of Ghent

scholarly journals External validity of prevalence estimates from the national maternity surveys in England: The impact of response rate

PLoS ONE ◽  
2020 ◽  
Vol 15 (11) ◽  
pp. e0242815
Author(s):  
Sian Harrison ◽  
Fiona Alderdice ◽  
Maria A. Quigley
Keyword(s):  
Preterm Birth ◽  
Caesarean Section ◽  
External Validity ◽  
Low Birthweight ◽  
Response Rate ◽  
Response Rates ◽  
Population Based ◽  
Breastfeeding Initiation ◽  
Prevalence Estimates ◽  
Survey Estimates

Background Prevalence estimates from surveys with low response rates are prone to non-response bias if respondents and non-respondents differ on the outcome of interest. This study assessed the external validity of prevalence estimates of selected maternity indicators from four national maternity surveys in England which had similar survey methodology but different response rates. Methods A secondary analysis was conducted using data from the national maternity surveys in 2006 (response rate = 63%), 2010 (response rate = 54%), 2014 (response rate = 47%) and 2018 (response rate = 29%). Unweighted and (for the 2014 and 2018 surveys) weighted survey prevalence estimates (with 95%CIs) of caesarean section, preterm birth, low birthweight and breastfeeding initiation were validated against population-based estimates from routine data. Results The external validity of the survey estimates varied across surveys and by indicator. For caesarean section, the 95%CIs for the unweighted survey estimates included the population-based estimates for all surveys. For preterm birth and low birthweight, the 95%CIs for the unweighted survey estimates did not include the population-based estimates for the 2006 and 2010 surveys (or the 2014 survey for preterm birth). For breastfeeding initiation, the 95%CIs for the unweighted survey estimates did not include the population-based estimates for any survey. For all indicators, the effect of weighting (on the 2014 and 2018 survey estimates) was mostly a shift towards the population-based estimates, yet the 95%CIs for the weighted survey estimates of breastfeeding initiation did not include the population-based estimates. Conclusion There were no clear differences in the external validity of prevalence estimates according to survey response rate suggesting that prevalence estimates may still be valid even when survey response rates are low. The survey estimates tended to become closer to the population-based estimates when weights were applied, yet the effect was insufficient for breastfeeding initiation estimates.

scholarly journals Real World Outcomes with VTD and Cybord Induction Treatment for Transplant Eligible Multiple Myeloma Patients in a Latin American Country. Retrospective Cohort Study from Gamm (Grupo Argentino de Mieloma Multiple)

Blood ◽  
2018 ◽  
Vol 132 (Supplement 1) ◽  
pp. 3301-3301
Author(s):  
Natalia Paola Schutz ◽  
Paola Ochoa ◽  
Patricio Duarte ◽  
Guillermina Remaggi ◽  
Sebastian Yantorno ◽  
...  
Keyword(s):  
Multiple Myeloma ◽  
Cohort Study ◽  
Adverse Events ◽  
Latin American ◽  
Research Funding ◽  
Response Rate ◽  
Response Rates ◽  
Induction Treatment ◽  
The Difference

Abstract Introduction: There are scarce data regarding treatment outcomes and toxicity in Latin American countries. Argentina is the second largest country in the region and the fourth most populated one. National Guidelines from the Argentinean Society of Hematology (SAH) recommends the use of bortezomib based triplets for induction treatment in transplant eligible newly diagnosed Multiple Myeloma patients. Objective: To compare response rates and adverse events after induction treatment with Cyclophosphamide Bortezomib and Dexamethasone (CyBorD) or Bortezomib Thalidomide and Dexamethasone (VTD) outside of clinical trials in a Latin American country. Methods: Retrospective multicentric cohort study. All centers participating in the Argentinean Multiple Myeloma Study Group (GAMM) were invited to participate in the study. Eligible patients were 75 years of age or younger, with a diagnosis of Multiple Myeloma according to the IMWG 2014 criteria, transplant eligible, treated with at least one cycle of CyBorD or VTD as induction therapy in the time period from December 2012 until December 2017. Main exclusion criteria were amyloidosis, plasma cell leukemia and previous neuropathy. Patients were identified from local registries at each center and included consecutively in the study database. Epidemiological and clinical data were obtained from medical records and collected in a standardized clinical report form. Patients were followed from diagnosis until death or lost to follow up. Response was evaluated according to IMWG Response Criteria 2016. Adverse events were graded by CTCAE 4.3. Comparisons of response rates were performed using a Chi2 test and differences in rates were expressed as proportions with 95% confidence intervals (CI). Crude odds ratios (OR) and OR adjusted by potential confounders were calculated using a logistic regression model. Kaplan Meier method was used to estimate progression free survival (PFS) and overall survival (OS). Stata 13 software was used. Results: A total of 322 patients from 15 centers in Argentina were included in the study. The median age at diagnosis was 57 years (range 26-74), 52% (167) of the patients were male, 18% (58) had renal failure, 28% (85) ISS 3 , 7% (22) extramedullary disease, and 14% (46) high risk cytogenetics. Median time of follow up was 34 months (IQR 21-58). CyBorD was the most common treatment, indicated as induction therapy in 74% (238) of the cases. The characteristics of the patients were similar in both groups except age and LDH levels. The median number of cycles was 5 (range 1-12). Bortezomib was administered once per week in 85% (272) of the patients and subcutaneously in 86% (276) with no differences between both treatment arms. The median cumulative cyclophosphamide dose per month was 1.5 g (IQR 1.5-2.4) and thalidomide dose per day was 100 mg. In the VTD arm, 72,62% (61) of the patients achieved at least very good partial response (VGPR) vs 53.36% (127) with CyBorD [OR of 2.31 (CI 1.35 - 3.99) p=0.002]. The difference in VGPR was 19.26% (CI 15 - 24). Complete response rate (CR) was 35.92% in patients treated with VTD vs 22.55% with CyBorD [OR of 1.87 (CI 1.04 - 3.35) p=0.03). The difference in CR was 13,37% (CI 9.6 -17.53). There was no difference in overall response rate (ORR) with 94.05% vs 91.18% (p=0.406). Adverse events were more common with VTD (69.05% vs 55.46% p=0.030), especially neuropathy grade 3 - 4 (7.14% vs 1.26% p=0.005) and thrombosis (13.10 % vs 3.36 % p=0.001). Deep venous thrombosis prophylaxis was inadequate in 20.24% of the patients. Hematologic adverse events were more common with CyBorD, especially thrombocytopenia (5.95% vs 16.39% p=0.017). Autologous stem cell transplantation (ASCT) was performed in 78% (249) of patients. There was 5% (17) stem cell mobilization failure, all in the CyBorD arm. Response rates after ASCT with VTD and CyBorD induction treatment were: 76.19 vs 73.11% VGPR (p=0.580) and 48.53% vs 40% CR (p=0.20). Maintenance treatment was indicated in 67.86% (57) and 65.13% (155) patients respectively (p=0.650). The PFS at 24 months was 83% (CI 71-90) with VTD vs 72% (CI 66-78) [(HR 0.92 (CI 0.59 - 1.42) p 0.715] and OS 96% (CI 87-99) vs 91% (86-94) respectively [(HR 1.2 (CI 0.62 - 2.32) p 0.587]. Conclusions: VTD has better CR and VGPR compared to CyBorD. Nevertheless, CyBorD continues to be the preferred induction regimen in Argentina based on safety profile. The optimal number of induction treatment cycles remains to be determined. Disclosures Schutz: Takeda: Honoraria, Research Funding; Sanofi Aventis: Research Funding; Roche: Research Funding; Glaxo: Research Funding; Janssen: Honoraria, Research Funding; Varifarma: Honoraria. Shanley:Brystol Myers Squibb: Consultancy, Honoraria; Takeda: Consultancy, Honoraria. Fantl:Janssen: Consultancy, Honoraria, Research Funding; Varifarma/Amgen: Consultancy, Honoraria; Takeda: Consultancy, Honoraria, Research Funding; Sanofi: Research Funding; Roche: Research Funding; Tecnofarma: Honoraria; BMS: Consultancy, Honoraria; Glaxo: Research Funding.

scholarly journals Do Physicians Prefer to Complete Online or Mail Surveys? Findings From a National Longitudinal Survey

2018 ◽  
Vol 42 (1) ◽  
pp. 41-70 ◽  
Author(s):  
Tamara Taylor ◽  
Anthony Scott
Keyword(s):  
Response Rate ◽  
Response Rates ◽  
Longitudinal Survey ◽  
Free Text ◽  
Response Patterns ◽  
Medical Specialist ◽  
Mail Surveys ◽  
Cast Doubt ◽  
Survey Designs ◽  
Mode Response

Survey response rates for physicians are falling generally, and surveys of physicians tend to have lower response rates than those of the general population. To maximize response, respondents are often given a choice of modes in which to respond. The aim of this article is to describe mode response patterns and identify factors related to physicians’ decisions to complete surveys online rather than by mail. The data are from the fifth annual wave of the Medicine in Australia: Balancing Employment and Life longitudinal survey of physicians, in which there was a 43.5% response rate (10,746/24,711) and 33.7% of respondents completed the survey online. Online completion was more likely when the physician had completed the survey online in the previous wave, was a general practitioner rather than other medical specialist or doctor-in-training, worked in a remote location, and was young and male. Free-text spontaneous comments from respondents indicated that mode choice was based on a combination of preference, previous experience, and feasibility. These results provide support for the use of mixed mode survey designs, which can accommodate doctors with different mode preferences and cast doubt over the possibility of tailoring mode based on respondent characteristics.

scholarly journals Response trends in a national random digit dial survey

2021 ◽  
Vol 1 (1) ◽  
pp. 21-32
Author(s):  
Robert Tortora
Keyword(s):  
Response Rate ◽  
Telephone Survey ◽  
Response Rates ◽  
Completion Rates ◽  
Random Digit ◽  
Random Digit Dial ◽  
Over Time

This paper reviews response trends over 24 consecutive quarters of a National Random Digit Dial telephone survey. Trends for response rates and refusal rates are studied as well as the components of response rate, namely, contact, cooperation and completion rates. In addition other rates, including answering machine, busy and no answer are studied. While refusal rates declined over the six year period, contact and cooperation rates significantly declined causing response rates to decline. Answering machine rates and busy rates also showed a significant increase over time. Finally, correlation’s among the variables of interest are presented. The response rate is negatively correlated with the busy rate, the answering machine rate and the no answer rate. Implications of the above trends are discussed.

Response patterns in the Belgian health interview survey: web versus face-to-face mode

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
E Braekman ◽  
S Demarest ◽  
R Charafeddine ◽  
F Berete ◽  
S Drieskens ◽  
...  
Keyword(s):  
Response Rate ◽  
Response Rates ◽  
Unit Response ◽  
Response Patterns ◽  
Demographic Groups ◽  
Face To Face ◽  
Health Interview Survey ◽  
Health Interview ◽  
Interview Survey ◽  
The Impact

Abstract Background Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness and ease of implementation and the increased internet penetration rates. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes such as face-to-face (F2F) interviewing and hence may increase bias in the measured indicators. This research assesses the response patterns of a web versus F2F study. Methods A Belgian health interview survey by web (BHISWEB; net sample=1010) was organized parallel to the traditional F2F BHIS 2018 (BHIS2018; net sample=11611; subsample used in this study=2748). Socio-demographic data on invited individuals were obtained from the national register and census linkages. To address the high item-missingness on education level deriving from the census, multiple imputation (m = 20) was applied. Unit response rates considering the different sampling probabilities of both surveys were calculated. Logistic regression analyses examined the impact of mode (web vs. F2F) and interactions between mode and socio-demographic characteristics on unit response. Results The unit response rate was significantly lower in the BHISWEB (18.0% (95% CI: 17.0-19.1)) than in the BHIS2018 (43.1% (95% CI: 41.5-44.7)). A lower web versus F2F response rate was found among all socio-demographic groups, however, this lower web response was less pronounced among youngsters, people cohabiting with household members, higher educated people and native Belgians. Conclusions The F2F unit response rate was generally higher, yet for certain groups the difference between web versus F2F was smaller. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys (e.g. youngsters) while remaining to focus on increasing the F2F response rates for other groups. Key messages The advantages of web versus F2F interviewing come against its considerable lower unit response rate. Differences in unit non-response between web and F2F vary between socio-demographic groups.

More on the Prediction of Mail Survey Response Rates

1982 ◽  
Vol 19 (2) ◽  
pp. 261-268 ◽  
Author(s):  
A. Parasuraman
Keyword(s):  
Additional Data ◽  
Response Rate ◽  
Mail Survey ◽  
Response Rates ◽  
Survey Response ◽  
Practical Approach ◽  
Specific Time ◽  
Generalized Model ◽  
Over Time

The author discusses some omissions in, and limitations of, recent efforts to model mail survey returns over time. Additional data are analyzed to develop a generalized model of response rate over time, and a practical approach is proposed for estimating mailing requirements for surveys that have specific time deadlines and response requirements.

scholarly journals Response Rates in National Panel Surveys

2012 ◽  
Vol 645 (1) ◽  
pp. 60-87 ◽  
Author(s):  
Robert F. Schoeni ◽  
Frank Stafford ◽  
Katherine A. Mcgonagle ◽  
Patricia Andreski
Keyword(s):  
United States ◽  
Response Rate ◽  
Response Rates ◽  
The United States ◽  
Cross Sectional ◽  
Panel Surveys ◽  
Longitudinal Surveys ◽  
The Past ◽  
Changes Over Time ◽  
Over Time

It has been well documented that response rates to cross-sectional surveys have declined over the past few decades. It is less clear whether response rates to longitudinal surveys have experienced similar changes over time. This article examines trends in response rates in several major, national longitudinal surveys in the United States and abroad. The authors find that for most of these surveys, the wave-to-wave response rate has not declined. This article also describes the various approaches that these surveys use to minimize attrition.

scholarly journals Longitudinal Health Behaviour Patterns Among Chinese Adults Aged ≥ 50 Years and Their Associations With Trajectories of Depressive Symptoms Over Time: A Latent Class Analysis

2020 ◽  
Author(s):  
Zeyun Feng ◽  
Thijs van den Broek ◽  
Jane Cramm ◽  
Anna Nieboer
Keyword(s):  
Depressive Symptoms ◽  
Health Behaviour ◽  
Social Participation ◽  
Latent Class ◽  
Health Behaviours ◽  
Physically Active ◽  
Longitudinal Patterns ◽  
Multiple Health Behaviours ◽  
Multiple Health ◽  
Over Time

Abstract Background Whether different longitudinal patterns of multiple health behaviours are associated with different trajectories of depressive symptoms is not well understood.Purpose To identify distinct longitudinal patterns of multiple health behaviours and their associations with trajectories of depressive symptoms among people aged ≥ 50 years in China.Methods We used longitudinal data from the Harmonized China Health and Retirement Longitudinal Study (three waves, 2010–2015; n = 8439). We performed latent class analyses to identify distinct patterns of multiple health behaviours at three timepoints. We estimated longitudinal random-effects models to predict differences in depressive symptoms trajectories by health behaviour class.Results The best-fitting model had five latent classes, all of which showed strong behavioural stability over time: 1) socially active, moderately physically active non-smokers (29.4%); 2) socially inactive, physically active non-smokers (22.3%); 3) socially and physically inactive non-smokers (17.9%); 4) socially inactive, moderately physically active smokers (14.6%); and (5) socially active, moderately physically active smokers (14.2%). All classes characterized by low social participation (classes 2–4) were associated with significantly higher predicted depressive symptom scores compared with the other classes (1 and 5). Conclusions Longitudinal behavioural patterns involving low probabilities of social participation were associated with more depressive symptoms. This overshadowing effect suggests that the damage caused by socially inactivity may render the effects of co-existing (un)healthy behaviours meaningless. The stability of the patterns of multiple health behaviours across survey waves suggests that interventions are needed earlier in life.

scholarly journals Comparing methods of performing geographically targeted rural health surveillance

2020 ◽  
Vol 17 (1) ◽  
Author(s):  
David C. Lee ◽  
Nancy A. McGraw ◽  
Kelly M. Doran ◽  
Amanda K. Mengotto ◽  
Sara L. Wiener ◽  
...  
Keyword(s):  
Rural Health ◽  
Rural Areas ◽  
Health Surveys ◽  
Response Rates ◽  
Health Surveillance ◽  
Rural Residents ◽  
Sullivan County ◽  
Prevalence Estimates ◽  
Convenience Sampling ◽  
Geographically Targeted

Abstract Background Worsening socioeconomic conditions in rural America have been fueling increases in chronic disease and poor health. The goal of this study was to identify cost-effective methods of deploying geographically targeted health surveys in rural areas, which often have limited resources. These health surveys were administered in New York’s rural Sullivan County, which has some of the poorest health outcomes in the entire state. Methods Comparisons were made for response rates, estimated costs, respondent demographics, and prevalence estimates of a brief health survey delivered by mail and phone using address-based sampling, and in-person using convenience sampling at a sub-county level in New York’s rural Sullivan County during 2017. Results Overall response rates were 27.0% by mail, 8.2% by phone, and 71.4% for convenience in-person surveys. Costs to perform phone surveys were substantially higher than mailed or convenience in-person surveys. All modalities had lower proportions of Hispanic respondents compared to Census estimates. Unadjusted and age-adjusted prevalence estimates were similar between mailed and in-person surveys, but not for phone surveys. Conclusions These findings are consistent with declining response rates of phone surveys, which obtained an inadequate sample of rural residents. Though in-person surveys had higher response rates, convenience sampling failed to obtain a geographically distributed sample of rural residents. Of modalities tested, mailed surveys provided the best opportunity to perform geographically targeted rural health surveillance.

Sign in / Sign up

Export Citation Format

Share Document