LO13: Development of a national, standardized simulation case template

Innovation Concept: A major barrier to the development of a national simulation case repository and multi-site simulation research is the lack of a standardized national case template. This issue was recently identified as a priority research topic for Canadian simulation based education (SBE) research in emergency medicine (EM). We partnered with the EM Simulation Education Researchers Collaborative (EM-SERC) to develop a national simulation template. Methods: The EM Sim Cases template was chosen as a starting point for the consensus process. We generated feedback on the template using a three-phase modified nominal group technique. Members of the EM-SERC mailing list were consulted, which included 20 EM simulation educators from every Canadian medical school except Northern Ontario School of Medicine and Memorial University. When comments conflicted, the sentiment with more comments in favour was incorporated. Curriculum, Tool or Material: In phase one we sought free-text feedback on the EM Sim Cases template via email. We received 65 comments from 11 respondents. An inductive thematic analysis identified four major themes (formatting, objectives, debriefing, and assessment tools). In phase two we sought free-text feedback on the revised template via email. A second thematic analysis on 40 comments from 12 respondents identified three broad themes (formatting, objectives, and debriefing). In phase three we sought feedback on the penultimate template via focus groups with simulation educators and technologists at multiple Canadian universities. This phase generated 98 specific comments which were grouped according to the section of the template being discussed and used to develop the final template (posted on emsimcases.com). Conclusion: We describe a national consensus-building process which resulted in a simulation case template endorsed by simulation educators from across Canada. This template has the potential to: 1. Reduce the replication of effort across sites by facilitating the sharing of simulation cases. 2. Enable national collaboration on the development of both simulation cases and curricula. 3. Facilitate multi centre simulation-based research by removing confounders related to the local adoption of an unfamiliar case template. This could improve the rigour and validity of these studies by reducing inter-site variability. 4. Increase the validity of any simulation scenarios developed for use in national high-stakes assessment.

Download Full-text

Research Priorities in Forensic Occupational Therapy

British Journal of Occupational Therapy ◽

10.1177/030802260306600203 ◽

2003 ◽

Vol 66 (2) ◽

pp. 55-64 ◽

Cited By ~ 25

Author(s):

Edward A S Duncan ◽

Karen Munro ◽

Margaret M Nicol

Keyword(s):

Occupational Therapy ◽

Outcome Measures ◽

Group Work ◽

Nominal Group Technique ◽

Research Priorities ◽

Occupational Therapists ◽

Assessment Tools ◽

Nominal Group ◽

Specific Research ◽

Effective Group

National research priorities have been developed and published by the College of Occupational Therapists (Ilott and White 2001). Such an exercise, however, cannot provide the specific research priorities of a particular area of practice. A questionnaire survey was undertaken to ascertain the specific research priorities of forensic occupational therapists. The survey had three parts: determining research priorities, examining outcome measures and exploring the use of protocol-driven group work. Three specific research priorities were clearly defined by part one of the survey: the development of appropriate outcome measures, the development of rigorous and effective group-work programmes and the development of effective risk assessment tools. The nominal group technique was used in order to triangulate the data. The survey also examined the participants' use of outcome measures: a high number of the participants (62%, 44/71) stated that they used outcome measures in practice. The participants' responses to the third aspect of the survey, regarding the use of protocol-driven groups, were more varied. The majority of the groups reported by the participants were ‘home grown’, with little research base underpinning their implementation. The methodological weaknesses of undertaking such a survey are examined. The paper concludes that having identified clinicians' priorities in forensic occupational therapy research, the challenge is how best to gather robust evidence for practice.

Download Full-text

THE ECONOMY OF THE BELGIAN REGIONS TESTED WITH MULTIMOORA

Journal of Business Economics and Management ◽

10.3846/jbem.2010.09 ◽

2010 ◽

Vol 11 (2) ◽

pp. 173-209 ◽

Cited By ~ 41

Author(s):

Willem Karel M. Brauers ◽

Romualdas Ginevičius

Keyword(s):

Delphi Method ◽

Nominal Group Technique ◽

Optimization Method ◽

Nominal Group ◽

Ratio Analysis ◽

Common Language ◽

Multi Objective Optimization ◽

Multi Objective ◽

Starting Point ◽

Definition Of

The definition of robustness in econometrics, the error term in a linear equation, was not only broadened, but in addition moved to the meaning of common language: from a cardinal to a qualitative one. At that moment the most robust Multi‐Objective Optimization Method has to fulfill seven essential conditions. In addition, considering all stakeholders involved, the choice of the objectives is non‐subjective with the assistance of the Ameliorated Nominal Group Technique and the Delphi method. Outside Normalization is not necessary by the use of a Full Multiplicative Form or of MOORA (Multi‐Objective Optimization by Ratio Analysis). This last one is composed of ratio analysis “senso stricto” and of the Reference Point Method with the previously obtained ratios as a starting point. Combining the three methods in MULTIMOORA a full guarantee for robustness in Multiple Objectives Optimization is offered. This interpretation is tested by an application to the Economy of the Belgian Regions. Santrauka Stiprumo apibrežimas ekonometrijoje, klaidos terminas linijineje lygtyje buvo ne tik išplestas, jo reikš‐me buvo perkelta i paprasta kalba, t. y. nuo kiekybines iki kokybines reikšmes. Šiuo metu stipriausi daugiatiksliai optimizavimo metodai turi atitikti septynias pagrindines salygas. Be to, turint omenyje visas suinteresuotas grupes, tikslu pasirinkimas yra objektyvus taikant patobulinta nominaliu grupiu ir Delphi metodus. Normalizavimas privalo būti taip pat objektyvus, tai imanoma padaryti naudojant dauginamaja MOORA (daugiatikslis optimizavimas remiantis santykio analize) metodo forma. Ji su‐sideda iš santykio analizes "senso strigto” ir atskaitos taško metodo su anksčiau gautu santykiu kaip pradžios tašku. Taigi sujungus tris metodus, kaip stiprumo garantas buvo pasiūlytas MULTIMOORA. Šis metodas yra išbandytas tiriant Belgijos regionu ekonomika.

Download Full-text

Educational strategies to enhance EBM teaching and learning in the workplace: a focus group study

BMJ evidence-based medicine ◽

10.1136/bmjebm-2020-111383 ◽

2021 ◽

pp. bmjebm-2020-111383

Author(s):

Lisanne Welink ◽

Esther de Groot ◽

Roger Damoiseaux ◽

Marie-Louise Bartelink

Keyword(s):

Focus Group ◽

Teaching And Learning ◽

Postgraduate Medical Education ◽

Nominal Group Technique ◽

Nominal Group ◽

Consensus Method ◽

Educational Strategies ◽

Focus Group Study ◽

Starting Point ◽

Learning Conversations

ObjectivesThis study aimed to gather and synthesise educational strategies that can improve teaching and learning of evidence-based medicine (EBM) in the workplace, and make them concrete by listing ideas for implementing these strategies. Insight into current workplace-based EBM teaching and learning in general practice was the starting point to generate these strategies and ideas.DesignExploratory, qualitative focus group study, applying the consensus method of the nominal group technique.SettingPostgraduate medical education; general practitioner (GP) specialty training at University Medical Centre Utrecht, the NetherlandsParticipants33 GPs and 17 GP trainees, divided in four focus groups. Using opportunistic sampling, participants were selected from the GP workplace because of their role as supervisor or trainee.Main outcomesAn overview of educational strategies and ideas on how to implement these strategies in the workplace, followed by the participants’ global ranking of the most useful ideas.ResultsThe supervisors and trainees generated a list of educational improvement strategies that can be applied in learning conversations, while observing each other’s consultations, and in (multidisciplinary) learning opportunities in the workplace. Table 1 presents the educational strategies and suggestions for implementing them. Ideas regarded as most useful include taking turns to conduct consultations and observing the other, holding a structured, in-depth discussion after observation, preparing and discussing articles found in relevant journals and on-the-spot searching for relevant evidence during learning conversations.ConclusionsParticipants provided an extensive list of educational strategies and ideas on how to implement EBM learning in daily practice. As a great deal of GP training takes place in clinical practice, supervisors and trainees could apply the suggested ideas to enhance EBM teaching and learning in the workplace.

Download Full-text

Barriers to implementing motivational interviewing in addiction treatment: A nominal group technique process evaluation

Implementation Research and Practice ◽

10.1177/26334895211018400 ◽

2021 ◽

Vol 2 ◽

pp. 263348952110184

Author(s):

Melissa R Hatch ◽

Kristine Carandang ◽

Joanna C Moullin ◽

Mark G Ehrhart ◽

Gregory A Aarons

Keyword(s):

Motivational Interviewing ◽

Process Evaluation ◽

Nominal Group Technique ◽

Implementation Strategies ◽

Implementation Process ◽

Nominal Group ◽

Management Level ◽

Implementation Program ◽

Ebp Implementation ◽

Staff Level

Background: The successful implementation of evidence-based practices (EBPs) in real-world settings requires an adaptive approach and ongoing process evaluation and tailoring. Although conducting a needs assessment during the preparation phase of implementation is beneficial, it is challenging to predict all barriers to EBP implementation that may arise over the course of implementation and sustainment. This article describes a process evaluation that identified emergent and persistent barriers that impacted the implementation of an EBP across multiple behavioral health organizations and clinics. Methods: This study was conducted during the first cohort of a cluster randomized controlled trial testing the effectiveness of the Leadership and Organizational Change for Implementation (LOCI) strategy to implement motivational interviewing (MI) in substance use disorder treatment agencies and clinics. We used a modified nominal group technique (NGT) in which clinic leaders identified barriers faced during the implementation process. Barriers were categorized, then ranked and rated according to leaders’ perceptions of each barrier’s influence on implementation. The barriers were then contextualized through individual qualitative interviews. Results: Fifteen barriers were identified, grouped into staff-level barriers, management-level barriers, and implementation program barriers. Time and resistance to MI were rated as the most influential staff-level barriers. Among management-level barriers, time was also rated highest, followed by turnover and external contractual constraints. The most influential implementation barrier was client apprehension of recording for fidelity assessment and feedback. Individual interviews supported these findings and provided suggested adaptations for future implementation efforts. Conclusion: EBP implementation is an ongoing process whereby implementation strategies must be proactively and strategically tailored to address emergent barriers. This research described a process evaluation that was used to identify 15 emergent and/or persistent barriers related to staff, management, and the implementation program. Using implementation strategies that can be tailored and/or adapted to such emergent barriers is critical to implementation effectiveness. Plain Language Summary Unforeseen barriers often arise during the course of implementation. Conducting evaluations during implementation allows for tailoring the implementation strategy. As part of a larger study using the Leadership and Organizational Change for Implementation (LOCI) strategy to implement motivational interviewing (MI), we collected data from the first cohort of LOCI clinic leaders to identify barriers to MI implementation that persisted despite advanced planning and to understand unanticipated barriers that arose during implementation. Leaders identified 15 barriers faced during the implementation process that fell into three categories: staff-level barriers, management-level barriers, and implementation program barriers. The leaders ranked time as the most influential barrier at both the staff and management levels. Staff apprehension, resistance to MI implementation, and staff turnover were also of significant concern to leaders. Future implementation efforts may benefit from conducting a similar process evaluation during the implementation phase.

Download Full-text

Photograph Based Evaluation of Consumer Expectation on Healthiness, Fullness, and Acceptance of Sandwiches as Convenience Food

Foods ◽

10.3390/foods10051102 ◽

2021 ◽

Vol 10 (5) ◽

pp. 1102

Author(s):

Purificación García-Segovia ◽

Mª Jesús Pagán-Moreno ◽

Amparo Tárrega ◽

Javier Martínez-Monzó

Keyword(s):

Interaction Effect ◽

Online Survey ◽

Age Groups ◽

Nominal Group Technique ◽

Nominal Group ◽

Visual Appearance ◽

Consumer Expectation ◽

Preference Mapping ◽

Consumer Experiences ◽

And Cluster Analysis

Sandwiches are the most common “casual-food” consumed by all age groups in Spain. Due to the importance of visual appearance to promote unplanned or impulse buying, foodservice and hospitality companies focus on improving the visual impression of their food menus to create an expectation that satisfies both sensory and hedonic consumer experiences. To provide a list of attributes about the visual appearance of sandwiches, 25 students were recruited from a university and were invited to participate in two nominal group technique (NGT) sessions. To understand whether a sandwiches’ appearance can influence the expectation of consumers, 259 participants completed an online survey specially designed from the results of the NGT sessions. Data were analyzed using conjoint, internal preference mapping and cluster analysis; the interaction effect by gender was also studied. The conjoint results indicate that visual perception about the filling (vegetal or pork based) plays the most key role overall in consumer expectation. When consumers choose vegetables as the filling, the consumers’ perceived sandwiches as healthier, but the pork filling was perceived as more attractive and satiating. Interaction effect by gender was observed in filling when females perceived pork filling as less healthy than vegetable. By acceptance, consumers were segmented into three groups. The first cluster (n = 80) selected the pork filling. The smaller group (cluster 3, n = 36) prioritized the vegetal filling, and the most numerous cluster 2 (n = 140) liked sandwiches with multigrain bread. These results may help companies to build tailor-made marketing strategies to satisfy consumer segments.

Download Full-text

Parent engagement in co-design of clinical trials: the PARENT trial

Trials ◽

10.1186/s13063-021-05305-6 ◽

2021 ◽

Vol 22 (1) ◽

Author(s):

Leigh M. Vanderloo ◽

Shelley M. Vanderhout ◽

Erika Tavares ◽

Jonathon Maguire ◽

Sharon Straus ◽

...

Keyword(s):

Focus Group ◽

Patient Engagement ◽

Parent Engagement ◽

Nominal Group Technique ◽

Nominal Group ◽

Future Research ◽

Potential Barriers ◽

Patient Engagement In Research ◽

Diverse Individual ◽

Parent Trial

AbstractEvidence generated from partnering with parents to design and conduct research together may be used to refine, adjust, and modify future research approaches. This study aimed to describe the initial approaches to parent engagement in the design of the PARENT trial as well as understand parent perspectives on the acceptability and relevance of the PARENT trial and potential barriers and facilitators to participation.Parents participating in the TARGet Kids! cohort were invited to participate in a focus group, called the PARENT panel, to co-design the PARENT trial. This focus group was conducted to capture diverse individual and collective parents’ experiences. Overall methodological approaches for the PARENT panel were informed by the CIHR Strategy for Patient Oriented Research (SPOR) guiding principles (mutual respect, co-building, inclusiveness, and support) for patient engagement in research, and facilitated through the Knowledge Translation Program in the Li Ka Shing Knowledge Institute at Unity Health Toronto. Using a Nominal Group Technique, the PARENT panel provided feedback on the feasibility, relevance, and acceptability of the proposed intervention. Findings from this work will be used to further refine, adjust, and modify the next iteration of the PARENT trial, which will also serve as an opportunity to discuss the efforts made by researchers to incorporate parent suggestions and what additional steps are required for improved patient engagement.

Download Full-text

A Mixed Methods Analysis of Parental Perspectives on Diagnosis and Prognosis of Neonatal Intensive Care Unit Graduates With Cerebral Palsy

Journal of Child Neurology ◽

10.1177/0883073820901412 ◽

2020 ◽

Vol 35 (5) ◽

pp. 336-343

Author(s):

Katherine Guttmann ◽

John Flibotte ◽

Sara B. DeMauro ◽

Holli Seitz

Keyword(s):

Intensive Care Unit ◽

Cerebral Palsy ◽

Content Analysis ◽

Intensive Care ◽

Neonatal Intensive Care Unit ◽

Thematic Analysis ◽

Neonatal Intensive Care ◽

Free Text ◽

Word Count ◽

Linguistic Inquiry

This study aimed to evaluate how parents of former neonatal intensive care unit patients with cerebral palsy perceive prognostic discussions following neuroimaging. Parent members of a cerebral palsy support network described memories of prognostic discussions after neuroimaging in the neonatal intensive care unit. We analyzed responses using Linguistic Inquiry and Word Count, manual content analysis, and thematic analysis. In 2015, a total of 463 parents met eligibility criteria and 266 provided free-text responses. Linguistic Inquiry and Word Count analysis showed that responses following neuroimaging contained negative emotion. The most common components identified through the content analysis included outcome, uncertainty, hope/hopelessness, and weakness in communication. Thematic analysis revealed 3 themes: (1) Information, (2) Communication, and (3) Impact. Parents of children with cerebral palsy report weakness in communication relating to prognosis, which persists in parents’ memories. Prospective work to develop interventions to improve communication between parents and providers in the neonatal intensive care unit is necessary.

Download Full-text

Prioritization Of Research Under National Aids Control Programme In India Using Nominal Group Technique

SAARC Journal of Tuberculosis Lung Diseases and HIV/AIDS ◽

10.3126/saarctb.v8i1.5888 ◽

1970 ◽

Vol 8 (1) ◽

pp. 20-30

Author(s):

R Sogarwal ◽

D Bachani

Keyword(s):

Nominal Group Technique ◽

Research Priorities ◽

Control Programme ◽

Pediatric Hiv ◽

Nominal Group ◽

Phase Iii ◽

Hiv Care ◽

Policy Makers ◽

Research Questions ◽

Group Technique

Introduction: During the fi rst 2 years of the fi ve year plan of India’s National AIDS Control Programme Phase-III (NACP-III; 2007-12), various interactive consultative workshops were organized in collaboration with development partners with the objective of identifying priority areas for operational research and further development of research protocols adopting mentorship approach. Methodology: This article is an attempt to present the Nominal Group Technique (NGT) which was used to identify a set of fundable and practically feasible research priorities under NACP-III specifi cally focusing on Prevention of Parent to Child Transmission (PPTCT) and Pediatric HIV Care in India. The activity was undertaken with support of UNICEF in the year 2010. A total of 110 persons participated in the consultation clustering into 37, 36 and 37 members in Group A, B and C, respectively. The participants refl ected the mix of policy makers / decision makers (8), programme managers (12), implementers (36), subject experts / researchers (28), other stakeholders (16). Results: A total of nine highest priority research questions were identifi ed by all the groups in the assigned themes. The value of Kendall’s W coeffi cient of concordance was 0.68, which shows signifi cant agreement among raters on priority research questions (chi-square=16.35; p=0.03). Conclusion: Based on our experience, we can conclude that NGT was found to be an important tool for setting research priorities that is more democratic and transparent than the traditional methods. By applying various stages of the group sessions, participants can experience the rethinking process with reference information to enhance their judgment. The results of our experience may help programme managers / policy makers to plan similar and more improved method in other element of NACP as well as other health programmes. DOI: http://dx.doi.org/10.3126/saarctb.v8i1.5888 SAARCTB 2011; 8(1): 20-30

Download Full-text

Psychographic segmentation of the self-employed: An exploratory study

New England Journal of Entrepreneurship ◽

10.1108/neje-13-02-2010-b004 ◽

2010 ◽

Vol 13 (2) ◽

pp. 47-56 ◽

Cited By ~ 3

Author(s):

Matthew G. Kenney ◽

Art Weinstein

Keyword(s):

Small Business ◽

Personality Traits ◽

Exploratory Study ◽

Nominal Group Technique ◽

The Self ◽

Nominal Group ◽

Academic Literature ◽

Self Employment ◽

Group Technique

Although it is well established in the academic literature that entrepreneurs share common traits, there has been limited research dedicated to evaluating psychographic profiles of the self-employed. Using the Nominal Group Technique, the authors gleaned insight from a panel of experts in an effort to segment the self-employed based on personality traits and the benefits they receive from an entrepreneurial career. The findings show that self-employed individuals can be classified into four distinct segments: Exemplars, Generals, Moms and Dads, and Altruists. Each group derives different benefits from self-employment. Understanding these benefits can greatly assist entrepreneurship educators and marketers of small business oriented products and services.

Download Full-text

How do they learn: types and characteristics of medical and healthcare student engagement in a simulation-based learning environment

BMC Medical Education ◽

10.1186/s12909-021-02858-7 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Yashuang Wang ◽

Yan Ji

Keyword(s):

Student Engagement ◽

Learning Environment ◽

Thematic Analysis ◽

Emotional Experience ◽

Deep Understanding ◽

Structured Interviews ◽

Healthcare Students ◽

Interactive Engagement ◽

Simulation Based ◽

Medical And Healthcare

Abstract Background Student engagement can predict successful learning outcomes and academic development. The expansion of simulation-based medical and healthcare education creates challenges for educators, as they must help students engage in a simulation-based learning environment. This research provides a reference for facilitators of simulation teaching and student learning in medical and health-related majors by providing a deep understanding of student engagement in a simulation-based learning environment. Methods We conducted semi-structured interviews with ten medical and healthcare students to explore their learning types and characteristics in a simulation-based learning environment. Thematic analysis was used to analyse the data. Results The interviews were thematically analysed to identify three types of student engagement in the simulation-based learning environment: reflective engagement, performance engagement, and interactive engagement. The analysis also identified eight sub-themes: active, persistent, and focused thinking engagement; self-directed-learning thinking engagement with the purpose of problem solving; active “voice” in class; strong emotional experience and disclosure; demonstration of professional leadership; interaction with realistic learning situations; support from teammates; and collegial facilitator-student interaction. Conclusions The student interview and thematic analysis methods can be used to study the richness of student engagement in simulation-based learning environments. This study finds that student engagement in a simulation-based learning environment is different from that in a traditional environment, as it places greater emphasis on performance engagement, which combines both thinking and physical engagement, as well as on interactive engagement as generated through interpersonal interactions. Therefore, we suggest expanding the learning space centring around “inquiry”, as it can help strengthen reflective communication and dialogue. It also facilitates imagination, stimulates empathy, and builds an interprofessional learning community. In this way, medical and healthcare students can learn through the two-way transmission of information and cultivate and reshape interpersonal relationships to improve engagement in a simulation-based learning environment.

Download Full-text