Comprehension Testing of Product Safety Symbols: Lessons Learned

Author(s):  
Elaine C. Wisniewski ◽  
Judith J. Isaacson ◽  
Steven M. Hall

Standards and existing literature provide guidance regarding methodologies for symbol comprehension testing, but practical guidance for the practitioner conducting this type of testing is scarce. This paper shares observations and experiences gained over the course of multiple symbol testing projects. Specifically, the paper addresses pros and cons of written vs. oral questionnaire administration and resulting comprehension scores, sample size and the concept of “statistical equivalence” to ANSI Z535.3 criteria, various participant recruitment methods and interview locations, and the importance of explaining the context in which a symbol appears. The lessons learned and tips provided in this paper begin to fill the information gaps that practitioners encounter when making numerous design, methodological, and practical decisions required for safety symbol comprehension studies.

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Anne-Marie Turcotte-Tremblay ◽  
Idriss Ali Gali Gali ◽  
Valéry Ridde

Abstract Background COVID-19 has led to the adoption of unprecedented mitigation measures which could trigger many unintended consequences. These unintended consequences can be far-reaching and just as important as the intended ones. The World Health Organization identified the assessment of unintended consequences of COVID-19 mitigation measures as a top priority. Thus far, however, their systematic assessment has been neglected due to the inattention of researchers as well as the lack of training and practical tools. Main text Over six years our team has gained extensive experience conducting research on the unintended consequences of complex health interventions. Through a reflexive process, we developed insights that can be useful for researchers in this area. Our analysis is based on key literature and lessons learned reflexively in conducting multi-site and multi-method studies on unintended consequences. Here we present practical guidance for researchers wishing to assess the unintended consequences of COVID-19 mitigation measures. To ensure resource allocation, protocols should include research questions regarding unintended consequences at the outset. Social science theories and frameworks are available to help assess unintended consequences. To determine which changes are unintended, researchers must first understand the intervention theory. To facilitate data collection, researchers can begin by forecasting potential unintended consequences through literature reviews and discussions with stakeholders. Including desirable and neutral unintended consequences in the scope of study can help minimize the negative bias reported in the literature. Exploratory methods can be powerful tools to capture data on the unintended consequences that were unforeseen by researchers. We recommend researchers cast a wide net by inquiring about different aspects of the mitigation measures. Some unintended consequences may only be observable in subsequent years, so longitudinal approaches may be useful. An equity lens is necessary to assess how mitigation measures may unintentionally increase disparities. Finally, stakeholders can help validate the classification of consequences as intended or unintended. Conclusion Studying the unintended consequences of COVID-19 mitigation measures is not only possible but also necessary to assess their overall value. The practical guidance presented will help program planners and evaluators gain a more comprehensive understanding of unintended consequences to refine mitigation measures.


2021 ◽  
Author(s):  
Parvati Rose Perman-Howe ◽  
Emma L Davies ◽  
David R Foxcroft

Abstract Background Reducing the alcohol content of drinks has the potential to reduce alcohol consumption. Aims: (1) test the feasibility of a randomised controlled trial (RCT) to assess the effect of alcohol strength on alcohol consumption within licensed premises in the United Kingdom (UK), (2) provide data to estimate key parameters for a RCT. Methods Double-blind randomised controlled cross-over pilot trial based within four licensed premises in the UK. Participants (n=36) purchased and consumed ad libitum a 3.5% lager and a 4.8% lager during two separate study sessions. Descriptive statistics reported the efficacy and efficiency of the study processes, and the rates of licensed premises recruitment, and participant recruitment and attrition. Mean and the 95% confidence interval (CI) compared alcohol consumption between conditions. The mean, standard deviation (SD) and CI of UK units of alcohol consumed were used to calculate a sample size for a RCT. Responses to participant questionnaires and duration of participation in study sessions between conditions were analysed.Results Components of the study protocol were effective and efficient. The venue recruitment rate was less than anticipated. The participant recruitment rate was greater than anticipated. The rate of attrition was 23% and varied by less than 1% according to the arm of the trial. There was a reduction of alcohol consumed under the intervention conditions. Estimated mean difference, and 95% CI (UK units): -3.76 (-5.01 to -2.52).The sample size required for a RCT is 53. Participants did not find one lager more pleasant in taste: (on a scale of one to 10) -0.95 (-2.11 to 0.21). Participants found the reduced-strength lager less enjoyable: (on a scale of one to 10) -1.44 (-2.64 to -0.24) and they perceived themselves to be less intoxicated after consuming it: (on a scale of one to 10) -1.00 (-1.61 to -0.40).Conclusion A RCT is feasible with minor alterations to the study protocol and scoping work to establish different brands of alcohol that are more alike and more enjoyable than the products used in the pilot trial. Trial registration Registered in the American Economic Association (AEA) Randomised Controlled Trial (RCT) Registry as of 16 June 2017: https://www.socialscienceregistry.org/trials/2266. Unique identifying number: AEARCTR-0002266.


Author(s):  
Saliha Akhtar

Research has shown that clinical research continues to have difficulty recruiting participants. This problem is expected to increase as the number of clinical trials increases and as there continues to be more focus on complex diseases and treatments. Researchers have typically relied on traditional recruitment methods to recruit participants, which revolve around the physicians and their support staff having the primary role to locate and recruit these participants. However, with individuals using online platforms such as social media to retrieve information, this creates an opportunity for research site personnel to use it as a way to relay information on clinical trial opportunities. Studies that have used social media as a way to recruit participants are discussed. Furthermore, pros and cons of social media for recruitment, along with recommendations that future researchers should consider when deciding whether to implement this type of strategy in their clinical trials will be shared. In general, clinical trial recruitment strategies need to shift to an approach that is not only more targeted, but also has a larger reach. By evaluating the success of studies that have used social recruitment strategies so far, it is evident that future researchers can also achieve recruitment success through social media. Moreover, social media could be a promising new avenue for clinical trial recruitment that allows for a more positive experience for both investigative site personnel and potential participants.


Author(s):  
Susan D. Healy

In this chapter, in order to provide an understanding of the data on which the comparative analyses are based, I describe the methods that have been most commonly used to collect data on brain size. The key to the success of a comparative evolutionary analysis is sample size, the larger the better. To answer the question ‘why do some animals have big brains?’, brains have been measured directly in a variety of ways and brain size has also been inferred (in around half of the analyses) from skull volume. I describe the most commonly used methods briefly, along with the pros and cons of their use and interpretation.


2019 ◽  
Vol 31 (2) ◽  
pp. 171-177 ◽  
Author(s):  
Whitney A. Thurman ◽  
Tracie C. Harrison

Introduction: There are 46 million individuals living in rural America that require unique consideration for rural health research. Recruitment of research participants from disparity groups can be difficult as these groups can be hard-to-reach. In particular, strategies for reaching rural-dwelling Americans with disabilities are not well-documented. Furthermore, researchers sometimes underestimate the time and effort needed to recruit participants from hard-to-reach populations. The purpose of this article is to report the methods used to recruit 12 rural-dwelling adults with disabilities into a qualitative study. Method: The recruitment strategies discussed in this article were used in a grounded theory study. Results: Fifty percent of the sample in this study was recruited via a community gatekeeper, 33% responded to a classified advertisement, and 17% were recruited via the researchers’ professional networks. Discussion: Lessons learned yield insights as to effective recruitment methods for rural dwellers as well as other hard-to-reach populations.


2009 ◽  
Vol 13 (2) ◽  
pp. 352-360 ◽  
Author(s):  
Michele G. Shedlin ◽  
Carlos U. Decena ◽  
Thenral Mangadu ◽  
Angela Martinez

2015 ◽  
Vol 115 (5) ◽  
pp. 470-479 ◽  
Author(s):  
Onikia Brown ◽  
Virginia Quick ◽  
Sarah Colby ◽  
Geoffrey Greene ◽  
Tanya M. Horacek ◽  
...  

Purpose – Recruiting college students for research studies can be challenging. The purpose of this paper is to describe the lessons learned in the various recruitment strategies used for enrolling college students in a theory-based, tailored, and web-delivered health intervention at 13 US universities. Design/methodology/approach – The community-based participatory research (CBPR) model was used to develop a staged-tailored, web-based, randomized control trial, focussing on eating behavior, physical activity, and stress management. Participant feedback during baseline assessments was used to evaluate recruitment strategies. Findings – Findings from this feedback suggest that traditional recruitment strategies, such as newspaper ads and flyers, may not be the best approach for recruiting college students; instead, web-based efforts proved to be a better recruitment strategy. Research limitations/implications – This project included results from 13 US universities and thus may not be generalizable: more research is needed to determine successful recruitment methods for 18-24 years old college students. Originality/value – This paper lessens the gap regarding successful recruitment strategies for 18-24 years old college students.


Trials ◽  
2020 ◽  
Vol 21 (1) ◽  
Author(s):  
Mary Geda ◽  
◽  
Steven Z. George ◽  
Diana J. Burgess ◽  
Dylan V. Scarton ◽  
...  

Abstract Background The Pain Management Collaboratory (PMC) is a multi-site network of pragmatic clinical trials (PCTs) focused on nonpharmacological approaches to pain management, conducted in health care systems of the US Department of Defense (DoD) and Department of Veterans Affairs (VA) and co-funded by the National Institutes of Health (NIH). Concerns about potential research-site overlap prompted the PMC investigator community to consider strategies to avert this problem that could negatively affect recruitment and contaminate interventions and thus pose a threat to trial integrity. Methods We developed a two-step strategy to identify and remediate research-site overlap by obtaining detailed recruitment plans across all PMC PCTs that addressed eligibility criteria, recruitment methods, trial settings, and timeframes. The first, information-gathering phase consisted of a 2-month period for data collection from PIs, stakeholders, and ClinicalTrials.gov. The second, remediation phase consisted of a series of moderated conference calls over a 1-month time period to develop plans to address overlap. Remediation efforts focused on exclusion criteria and recruitment strategies, and they involved collaboration with sponsors and stakeholder groups such as the Military Treatment Facility Engagement Committee (MTFEC). The MTFEC is comprised of collaborating DoD and university-affiliated PIs, clinicians, and educators devoted to facilitating successful pragmatic trials in DoD settings. Results Of 61 recruitment sites for the 11 PMC PCTs, 17 (28%) overlapped. Four PCTs had five overlapping Military Treatment Facilities (MTFs), and eight PCTs had 12 overlapping VA Medical Centers (VAMCs). We developed three general strategies to avoid research-site overlap: (i) modify exclusion criteria, (ii) coordinate recruitment efforts, and/or (iii) replace or avoid any overlapping sites. Potential overlap from competing studies outside of the PMC was apparent at 26 sites, but we were not able to confirm them as true conflicts. Conclusion Proactive strategies can be used to resolve the issue of overlapping research sites in the PMC. These strategies, combined with open and impartial mediation approaches that include researchers, sponsors, and stakeholders, provide lessons learned from this large and complex pragmatic research effort.


Sign in / Sign up

Export Citation Format

Share Document