A mixed-mode approach to data collection: combining web and paper questionnaires to examine nurses’ attitudes to mental illness

227 Background: The objective of this work was to develop a reliable and valid survey measuring aspects of cancer care important to patients to be used in both inpatient and outpatient settings, and that allows comparisons of patient experiences across treatment centers and treatment modalities (medical oncology, radiation, surgery). Other objectives included testing various modes of data collection and developing a standardized sampling methodology based on ICD diagnosis and procedure codes. Methods: We conducted focus groups with patients who had received cancer treatment and with family members of cancer patients. We convened a panel of experts representing quality improvement, oncology, shared decision-making, patient safety, and patient advocacy to obtain feedback on the development of the survey. We interviewed stakeholder groups representing oncology associations to obtain feedback on focal provider, attribution and sampling. We then conducted a field test of the survey among six cancer centers around the country, conducted psychometric analyses, revised the survey, conducted a second field test among four community oncology practices in CA, re-analyzed the data, and finalized the survey. Results: Final survey content was determined using results of the formative research, psychometric analyses, and input from the CAHPS Consortium. The core survey includes 56 questions, 23 of which map to eight composites: Provider Communication, Enabling Patient Self-management, Team Available to Provide Information, Access to Care, Care Coordination, and Office Staff. Supplemental item sets include seven items assessing Shared Decision Making, four items measuring Keeping Patients Informed, and two additional Access to Care items. Mail-only, mail-telephone mixed-mode, and web-mail mixed-mode are recommended methods of data collection. The survey and all recruiting materials are available in English and Spanish. Conclusions: The CAHPS Cancer Care Survey is a rigorously developed, well-tested, reliable and valid survey of patient experiences with their cancer care. The survey and supporting materials are available free of charge on the CAHPS website (www.ahrq.gov/cahps).

Download Full-text

Becoming a PI: agency, persistence and some luck!

International Journal for Researcher Development ◽

10.1108/ijrd-12-2015-0033 ◽

2016 ◽

Vol 7 (2) ◽

pp. 106-122 ◽

Cited By ~ 12

Author(s):

Lynn McAlpine ◽

Gill Turner ◽

Sharon Saunders ◽

Natacha Wilson

Keyword(s):

Data Collection ◽

Mixed Mode ◽

Design Methodology ◽

Structured Interview ◽

Principal Investigator ◽

Narrative Approach ◽

Content Type ◽

National Perspective ◽

Insight Into ◽

Cross National

Purpose This paper aims to examine the experience of gaining research independence by becoming a principal investigator (PI) – an aspiration for many post-PhD researchers about whom little is known. It provides insight into this experience by using a qualitative narrative approach to document how 60 PIs from a range of disciplines in one European and two UK universities experienced working towards and achieving this significant goal. Design/methodology/approach Within the context of a semi-structured interview, individuals drew and elaborated a map representing the emotional high and low experiences of the journey from PhD graduation to first PI grant, and completed a biographic questionnaire. Findings Regardless of the length of the journey from PhD graduation to first PI grant, more than a third noted the role that luck played in getting the grant. Luck was also perceived to have an influence in other aspects of academic work. This influence made it even more important for these individuals to sustain a belief in themselves and be agentive and persistent in managing the challenges of the journey. Originality/value The study, unusual in its cross-national perspective, and its mixed mode data collection, offers a nuanced perspective on the interaction between agency and an environment where the “randomness factor” plays a role in success. The function of luck as a support for sustained agency and resilience is explored.

Download Full-text

Surveying End-of-Life Medical Decisions in France: Evaluation of an Innovative Mixed-Mode Data Collection Strategy

Interactive Journal of Medical Research ◽

10.2196/ijmr.3712 ◽

2016 ◽

Vol 5 (1) ◽

pp. e8

Author(s):

Stephane Legleye ◽

Sophie Pennec ◽

Alain Monnier ◽

Amandine Stephan ◽

Nicolas Brouard ◽

...

Keyword(s):

Data Collection ◽

End Of Life ◽

Mixed Mode ◽

Medical Decisions ◽

Data Collection Strategy

Download Full-text

Is the European Health Interview Survey online yet? Response and net sample composition of a web-based data collection

European Journal of Public Health ◽

10.1093/eurpub/ckz206 ◽

2019 ◽

Vol 30 (3) ◽

pp. 595-601 ◽

Cited By ~ 3

Author(s):

Elise Braekman ◽

Rana Charafeddine ◽

Stefaan Demarest ◽

Sabine Drieskens ◽

Jean Tafforeau ◽

...

Keyword(s):

Data Collection ◽

Mixed Mode ◽

Response Rate ◽

Web Based ◽

Health Interview Survey ◽

Health Interview ◽

Sample Composition ◽

Interview Survey ◽

European Health ◽

European Health Interview Survey

Abstract Background The European Health Interview Survey (EHIS) provides cross-national data on health status, health care and health determinants. So far, 10 of the 30 member states (MS) opted for web-based questionnaires within mixed-mode designs but none used it as the sole mode. In the context of future EHIS, the response rate and net sample composition of a web-only approach was tested. Methods A Belgian study with a target sample size of 1000 (age: 16–85) was organized using the EHIS wave 3 model questionnaire. The sample was selected according to a multistage, clustered sampling procedure with geographical stratification. Field substitution was applied; non-participating households were replaced by similar households regarding statistical sector, sex and age. There was one reminder letter and a €10 conditional incentive. Results Considering all substitutions, a 16% response rate was obtained after sending one reminder. Elderly, Brussels Capital inhabitants, people living without a partner and those with a non-Belgian nationality were less responding. By design, there were no differences between the initial and final net sample regarding substitution characteristics. Nevertheless, people living without a partner, non-Belgians and lower educated people remain underrepresented. Conclusion There was a low response rate, particularly for some population groups. The response rate was lower than those of MS using mixed-mode designs including web, especially these comprising interviewer-based approaches. Despite the long and complex questionnaire, there was a low break off rate. So far, web-only data collection is not an acceptable strategy for population-based health surveys but efforts to increase the response should be further explored.

Download Full-text

Modelling Mode Effects for a Panel Survey in Transition

Measurement Error in Longitudinal Data ◽

10.1093/oso/9780198859987.003.0004 ◽

2021 ◽

pp. 63-88

Author(s):

Paul P. Biemer ◽

Kathleen Mullan Harris ◽

Dan Liao ◽

Brian J. Burke ◽

Carolyn Tucker Halpern

Keyword(s):

Data Collection ◽

Data Quality ◽

Mixed Mode ◽

Good News ◽

Longitudinal Change ◽

Nonresponse Bias ◽

Two Phase ◽

Mode Effects ◽

Analytical Results ◽

Weighting Adjustments

Funding reductions combined with increasing data-collection costs required that Wave V of the USA’s National Longitudinal Study of Adolescent to Adult Health (Add Health) abandon its traditional approach of in-person interviewing and adopt a more cost-effective method. This approach used the mail/web mode in Phase 1 of data collection and in-person interviewing for a random sample of nonrespondents in Phase 2. In addition, to facilitate the comparison of modes, a small random subsample served as the control and received the traditional in-person interview. We show that concerns about reduced data quality as a result of the redesign effort were unfounded based on findings from an analysis of the survey data. In several important respects, the new two-phase, mixed-mode design outperformed the traditional design with greater measurement accuracy, improved weighting adjustments for mitigating the risk of nonresponse bias, reduced residual (or post-adjustment) nonresponse bias, and substantially reduced total-mean-squared error of the estimates. This good news was largely unexpected based upon the preponderance of literature suggesting data quality could be adversely affected by the transition to a mixed mode. The bad news is that the transition comes with a high risk of mode effects for comparing Wave V and prior wave estimates. Analytical results suggest that significant differences can occur in longitudinal change estimates about 60 % of the time purely as an artifact of the redesign. This begs the question: how, then, should a data analyst interpret significant findings in a longitudinal analysis in the presence of mode effects? This chapter presents the analytical results and attempts to address this question.

Download Full-text

Conference Notes - Prospects for Mixed-Mode Data Collection in Cross-National Surveys

International Journal of Market Research ◽

10.1177/147078530905100205 ◽

2009 ◽

Vol 51 (2) ◽

pp. 1-4

Author(s):

Gillian Eva ◽

Roger Jowell

Keyword(s):

Data Collection ◽

Research Methods ◽

Royal Society ◽

Mixed Mode ◽

National Surveys ◽

Cross National

This paper summarises the presentation by Gillian Eva and Roger Jowell on “Prospects for mixed-mode data collection in cross-national surveys” given at the IJMR Research Methods Forum: ‘Methods Matter: Interviewing and Beyond’, 25 November 2008, Royal Society, London.

Download Full-text

The DIAMONDS intervention to support self-management of type 2 diabetes in people with severe mental illness: study protocol for a single-group feasibility study

10.1101/2021.12.05.21267169 ◽

2021 ◽

Author(s):

Jennifer V E Brown ◽

Ramzi Ajjan ◽

Sarah Alderson ◽

Jan R Böhnke ◽

Claire Carswell ◽

...

Keyword(s):

Type 2 Diabetes ◽

Mental Illness ◽

Data Collection ◽

Severe Mental Illness ◽

Feasibility Study ◽

Controlled Trial ◽

Self Management ◽

Intervention Delivery ◽

Intervention Session

AbstractIntroductionThe DIAMONDS programme aims to evaluate a novel supported diabetes self-management intervention for people with severe mental illness (the “DIAMONDS intervention”). The purpose of this study is to test the feasibility of intervention delivery and data collection procedures to inform a definitive randomised controlled trial (RCT).MethodsAdults aged 18 years or over with a diagnosis of type 2 diabetes and severe mental illness (schizophrenia, schizoaffective disorder, or bipolar disorder) will be eligible for inclusion. Individuals with other types of diabetes or non-psychotic mental illness and those lacking capacity to consent will not be eligible. Participants will be recruited from NHS mental health trusts and general practices across the North of England. All participants will receive the DIAMONDS intervention: weekly one-to-one sessions with a trained facilitator (“DIAMONDS Coach”) to support goal setting, action planning, and diabetes education; ongoing self-management supported by a paper-based workbook and optional digital application (app); and monthly peer-support group sessions with other participants. The primary outcomes are: 1. Recruitment rate, measured as proportion of the recruitment target (N=30) achieved at 5 months from start of recruitment, 2. Attrition measured as the proportion of missing outcomes data at the end of the recruitment period (5 months from start of recruitment) for physiological and self-reported data items, 3. Intervention delivery rate recorded as the proportion of planned sessions delivered (measured by the number of completed intervention session logs per participant within 15 weeks of the first intervention session). Secondary outcomes include completeness of data collection at baseline and of process evaluation data at follow-up as well as the feasibility and acceptability of the intervention and of wearing a blinded continuous glucose monitoring device. An intervention fidelity framework will also be developed. Recruitment started in July 2021. The study was prospectively registered: ISRCTN15328700 (12th March 2021).DiscussionThe results of this feasibility study will inform the refinement of the content and delivery of the DIAMONDS intervention, as well as research procedures, including recruitment and data collection, in preparation for the main DIAMONDS RCT.

Download Full-text