Mixed methods data collection using simulated Google results: reflections on the methods of a point-of-selection behaviour study

Introduction. A multi-institutional, grant-funded project employed mixed methods to study 175 fourth-grade through graduate school students’ point-of-selection behaviour. The method features the use of simulated search engine results pages to facilitate data collection. Method. Student participants used simulated Google results pages to select resources for a hypothetical school project. Quantitative data on participants’ selection behaviour and qualitative data from their think-aloud protocols were collected. A questionnaire and interviews were used to collect data on participants’ backgrounds and online research experiences. Analysis. This paper reflects on the data collection methods and highlights opportunities for data analysis. The ability to analyse data both qualitatively and quantitatively increases the rigor and depth of findings. Results. The simulation created a realistic yet controlled environment that ensures the comparability of data within and across a wide range of educational stages. Combining data on participants’ behaviour, thoughts and characteristics provides a more complete picture of factors influencing online resource selection. Conclusions. Using simulated results pages in combination with multiple data collection methods enables analyses that create deeper knowledge of participants' information behaviour. Such a complicated research design requires extensive time, expertise and coordination to execute.

Download Full-text

Underreporting in HIV-Related High-Risk Behaviors: Comparing the Results of Multiple Data Collection Methods in a Behavioral Survey of Prisoners in Iran

The Prison Journal ◽

10.1177/0032885517753163 ◽

2018 ◽

Vol 98 (2) ◽

pp. 213-228 ◽

Cited By ~ 2

Author(s):

Ali Mirzazadeh ◽

Mostafa Shokoohi ◽

Soodabeh Navadeh ◽

Ahmad Danesh ◽

Jennifer P. Jain ◽

...

Keyword(s):

Data Collection ◽

Risk Behaviors ◽

Scale Up ◽

High Risk Behaviors ◽

Data Collection Methods ◽

Multiple Data ◽

Proxy Respondent ◽

Related Risk ◽

Comprehensive Picture ◽

Collection Methods

We explored the potential of using three indirect methods including crosswise, proxy respondent method, and network scale-up (NSU) in comparison with direct questioning in collecting sensitive and socially stigmatized HIV-related risk behavior information from Iranian prisoners. Participants reported more sexual contact in prison for their friends than they did for themselves. In men, NSU provided lower estimates than direct questioning, whereas in women NSU estimates were higher. Different data collection methods provide different estimates and collectively offer a more comprehensive picture of HIV-related risk behaviors in prisons.

Download Full-text

Epidemiology of constipation in adults: Why estimates of prevalence differ

Journal of Epidemiological Research ◽

10.5430/jer.v5n1p37 ◽

2019 ◽

Vol 5 (1) ◽

pp. 37

Author(s):

Barry Werth

Keyword(s):

Data Collection ◽

Older Adult ◽

Epidemiological Studies ◽

Community Dwelling ◽

Data Collection Methods ◽

Wide Range ◽

Prevalence Estimates ◽

Age Range ◽

The Impact ◽

Collection Methods

This review of over 80 articles published in the last 30 years shows that estimates of the prevalence of chronic constipation in community-dwelling adults varied widely from 2.4% to 39.6% in general adult populations and from 4% to 25.8% in older adult populations. Estimates of the prevalence of any constipation (including both chronic and sporadic constipation) also varied widely from 2.6% to 31.0% in general adult populations and from 4.4% to 44.5% in older adult populations. Apart from any country or regional differences, this wide range of estimated prevalence may be attributed to different definitions used for both chronic and any constipation as well as different data collection methods and sampling differences. Sampling issues include sample size, representativeness and age range of populations sampled. Further research is required to examine the impact of different definitions on prevalence estimates to help determine the best definitions for use in future epidemiological studies. If standard definitions can be universally agreed and used, along with appropriate sampling and data collection methods, more precise estimates of constipation prevalence should be attained. This would allow more meaningful comparisons between countries and may also provide the ability to pool results.

Download Full-text

A Systematic Review of State Vocational Rehabilitation Agency-Based Literature

Rehabilitation Research Policy and Education ◽

10.1891/2168-6653.31.4.352 ◽

2017 ◽

Vol 31 (4) ◽

pp. 352-371 ◽

Cited By ~ 1

Author(s):

Heike Boeltzig-Brown ◽

Allison R. Fleming ◽

Miriam Heyman ◽

Martha Gauthier ◽

Julisa Cully ◽

...

Keyword(s):

Systematic Review ◽

Data Collection ◽

Vocational Rehabilitation ◽

Future Research ◽

Program Outcomes ◽

Data Collection Methods ◽

Wide Range ◽

Rehabilitation Services Administration ◽

Rehabilitation Agency ◽

Collection Methods

Purpose:To conduct a systematic review (SR) of 550 studies produced between 1970 and 2008 that focus on programs and/or services provided by state vocational rehabilitation (VR) agencies believed to impact client and/or program outcomes.Method:Authors used a 5-step SR protocol to evaluate and summarize study content and outcomes, study design, and data collection methods.Results:Results indicate that the VR research base is highly varied in terms of the research focus with respect to programs and services, populations, and outcomes and that it spans across a wide range of research designs and data collection methods.Conclusions:The majority of the studies included in this review relied on administrative data, particularly Rehabilitation Services Administration data, and surveys. Only a small number of studies employed some type of experimental design, suggesting a lack of application of this type of research design. Implications and recommendations for future research are discussed.

Download Full-text

A Framework for Online Experimenter-Moderated Looking-Time Studies Assessing Infants’ Linguistic Knowledge

Frontiers in Psychology ◽

10.3389/fpsyg.2021.703839 ◽

2021 ◽

Vol 12 ◽

Author(s):

Desia Bacon ◽

Haley Weaver ◽

Jenny Saffran

Keyword(s):

Data Collection ◽

Eye Gaze ◽

Online Data ◽

Infant Research ◽

Data Collection Methods ◽

Timing Precision ◽

Wide Range ◽

Challenges And Opportunities ◽

Online Data Collection ◽

Collection Methods

Online data collection methods pose unique challenges and opportunities for infant researchers. Looking-time measures require relative timing precision to link eye-gaze behavior to stimulus presentation, particularly for tasks that require visual stimuli to be temporally linked to auditory stimuli, which may be disrupted when studies are delivered online. Concurrently, by widening potential geographic recruitment areas, online data collection may also provide an opportunity to diversify participant samples that are not possible given in-lab data collection. To date, there is limited information about these potential challenges and opportunities. In Study 1, twenty-one 23- to 26-month-olds participated in an experimenter-moderated looking-time paradigm that was administered via the video conferencing platform Zoom, attempting to recreate in-lab data collection using a looking-while-listening paradigm. Data collected virtually approximated results from in-lab samples of familiar word recognition, after minimal corrections to account for timing variability. We also found that the procedures were robust to a wide range of internet speeds, increasing the range of potential participants. However, despite the use of an online task, the participants in Study 1 were demographically unrepresentative, as typically observed with in-person studies in our geographic area. The potentially wider reach of online data collection methods presents an opportunity to recruit larger, more representative samples than those traditionally found in lab-based infant research, which is crucial for conducting generalizable human-subjects research. In Study 2, microtargeted Facebook advertisements for online studies were directed at two geographic locations that are comparable in population size but vary widely in demographic and socioeconomic factors. We successfully elicited sign-up responses from caregivers in neighborhoods that are far more diverse than the local University community in which we conduct our in-person studies. The current studies provide a framework for infancy researchers to conduct remote eye-gaze studies by identifying best practices for recruitment, design, and analysis. Moderated online data collection can provide considerable benefits to the diversification of infant research, with minimal impact on the timing precision and usability of the resultant data.

Download Full-text