Identifying and Controlling Biases in Expert-Opinion Research: Guidelines for Variations of Delphi, Nominal Group Technique, and Focus Groups

2021 ◽  
Vol 37 (3) ◽  
pp. 04021015
Author(s):  
Siddharth Bhandari ◽  
Matthew R. Hallowell
2019 ◽  
Vol 18 ◽  
pp. 160940691986604 ◽  
Author(s):  
Jason Olsen

This article reaffirms the value and flexibility of the nominal group technique (NGT) when conducting qualitative focus groups (QFGs). In the project that will be discussed, the methods used expanded the application of the NGT into the realm of pan-disability (i.e., individuals with differing impairments) research. It provides requirements and recommendations for the full inclusion and participation of disabled people into projects where the pertinent source of qualitative data is obtained from QFGs. Furthermore, this article describes innovative additional steps to the NGT that are beneficial to researchers. This includes a method of evaluating the data that is often lost between the NGTs’ stages of initial and final rankings. These new methods ensure pertinent data are not overlooked.


2019 ◽  
Vol 4 (1) ◽  
pp. 238146831983792
Author(s):  
Camilla Somers ◽  
Susan Chimonas ◽  
Emma McIntosh ◽  
Anna Kaltenboeck ◽  
Andrew Briggs ◽  
...  

Background. Responding to rising oncology therapy costs, multiple value frameworks are emerging. However, input from economists in their design and conceptualization has been limited, and no existing framework has been developed using preference weightings as legitimate indicators of value. This article outlines use of the nominal group technique to identify valued treatment attributes (such as treatment inconvenience) and contextual considerations (such as current life expectancy) to inform the design of a discrete choice experiment to develop a preference weighted value framework for future decision makers. Methods. Three focus groups were conducted in 2017 with cancer patients, oncology physicians, and nurses. Using the nominal group technique, participants identified and prioritized cancer therapy treatment and delivery attributes as well as contextual issues considered when choosing treatment options. Results. Focus groups with patients ( n = 8), physicians ( n = 6), and nurses ( n = 10) identified 30 treatment attributes and contextual considerations. Therapy health gains was the first priority across all groups. Treatment burden/inconvenience to patients and their families and quality of evidence were prioritized treatment attributes alongside preferences for resource use and cost (to patients and society) attributes. The groups also demonstrated that contextual considerations when choosing treatment varied across the stakeholders. Patients prioritized existence of alternative treatments and oncologist/center reputation while nurses focused on administration harms, communication, and treatment innovation. The physicians did not prioritize any contextual issues in their top rankings. Conclusions. The study demonstrates that beyond health gains, there are treatment attributes and contextual considerations that are highly prioritized across stakeholder groups. These represent important candidates for inclusion in a discrete choice experiment seeking to provide weighted preferences for a value framework for oncology treatment that goes beyond health outcomes.


1970 ◽  
Vol 8 (1) ◽  
pp. 20-30
Author(s):  
R Sogarwal ◽  
D Bachani

Introduction: During the fi rst 2 years of the fi ve year plan of India’s National AIDS Control Programme Phase-III (NACP-III; 2007-12), various interactive consultative workshops were organized in collaboration with development partners with the objective of identifying priority areas for operational research and further development of research protocols adopting mentorship approach. Methodology: This article is an attempt to present the Nominal Group Technique (NGT) which was used to identify a set of fundable and practically feasible research priorities under NACP-III specifi cally focusing on Prevention of Parent to Child Transmission (PPTCT) and Pediatric HIV Care in India. The activity was undertaken with support of UNICEF in the year 2010. A total of 110 persons participated in the consultation clustering into 37, 36 and 37 members in Group A, B and C, respectively. The participants refl ected the mix of policy makers / decision makers (8), programme managers (12), implementers (36), subject experts / researchers (28), other stakeholders (16). Results: A total of nine highest priority research questions were identifi ed by all the groups in the assigned themes. The value of Kendall’s W coeffi cient of concordance was 0.68, which shows signifi cant agreement among raters on priority research questions (chi-square=16.35; p=0.03). Conclusion: Based on our experience, we can conclude that NGT was found to be an important tool for setting research priorities that is more democratic and transparent than the traditional methods. By applying various stages of the group sessions, participants can experience the rethinking process with reference information to enhance their judgment. The results of our experience may help programme managers / policy makers to plan similar and more improved method in other element of NACP as well as other health programmes. DOI: http://dx.doi.org/10.3126/saarctb.v8i1.5888 SAARCTB 2011; 8(1): 20-30


2010 ◽  
Vol 13 (2) ◽  
pp. 47-56 ◽  
Author(s):  
Matthew G. Kenney ◽  
Art Weinstein

Although it is well established in the academic literature that entrepreneurs share common traits, there has been limited research dedicated to evaluating psychographic profiles of the self-employed. Using the Nominal Group Technique, the authors gleaned insight from a panel of experts in an effort to segment the self-employed based on personality traits and the benefits they receive from an entrepreneurial career. The findings show that self-employed individuals can be classified into four distinct segments: Exemplars, Generals, Moms and Dads, and Altruists. Each group derives different benefits from self-employment. Understanding these benefits can greatly assist entrepreneurship educators and marketers of small business oriented products and services.


Circulation ◽  
2021 ◽  
Vol 144 (Suppl_2) ◽  
Author(s):  
Eithne Heffernan ◽  
Dylan Keegan ◽  
Jenny Mc Sharry ◽  
Tomas Barry ◽  
Andrew Murphy ◽  
...  

Introduction: Community First Response (CFR) is an important intervention for out-of-hospital cardiac arrest (OHCA) in many countries. CFR entails the mobilization of volunteers by the Emergency Medical Services (EMS) to respond to OHCAs in their vicinity. These volunteers include lay-people and professionals (e.g. physicians, fire-fighters). CFR can increase rates of cardiopulmonary resuscitation (CPR) or defibrillation performed prior to EMS arrival. However, its impact on additional outcomes (e.g. survival, cognitive function) requires further study. This research aimed to identify the most important CFR data to collect and analyze, as well as the most important uses of CFR data. Methods: This study used the Nominal Group Technique: a structured consensus process where key stakeholders develop a set of prioritized recommendations. There were 16 participants, including CFR volunteers, an OHCA survivor, researchers, clinicians, EMS personnel, and policy-makers. They completed an online survey to generate lists of the most important (1) CFR data to collect and analyze and (2) uses of CFR data. They then attended a virtual meeting where they discussed the survey results in groups before voting for their top ten priorities from each list. They also identified barriers to CFR data collection. Results: The top ten CFR data to collect and analyze included volunteer response time, interventions performed by volunteers, time of emergency, time of CPR initiation, individuals who performed CPR, and the mental and physical effects of being a volunteer. The top ten uses of CFR data included providing feedback to volunteers, increasing bystander participation in resuscitation, improving volunteer training, measuring CFR effectiveness, and encouraging inter-operability with the EMS. Barriers to data collection included time constraints, prioritization of patient care, and limited training. Conclusions: This study established priorities for the collection, analysis, and use of CFR data in consultation with key stakeholders. These findings have important implications for both CFR research and practice. In particular, they can be used to improve the efficiency, consistency, and utility of CFR data collection and to build evidence for this intervention.


Sign in / Sign up

Export Citation Format

Share Document