scholarly journals Feasibility and acceptability of living systematic reviews: results from a mixed-methods evaluation

2019 ◽  
Vol 8 (1) ◽  
Author(s):  
Tanya Millard ◽  
Anneliese Synnot ◽  
Julian Elliott ◽  
Sally Green ◽  
Steve McDonald ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Systematic Reviews ◽  
Evidence Synthesis ◽  
Scale Up ◽  
Structured Interviews ◽  
Policy And Practice ◽  
Team Members ◽  
Mixed Methods Evaluation ◽  
Long Run ◽  
Number Of Citations

Abstract Background Living systematic reviews (LSRs) offer an approach to keeping high-quality evidence synthesis continually up to date, so the most recent, relevant and reliable evidence can be used to inform policy and practice, resulting in improved quality of care and patient health outcomes. However, they require modifications to authoring and editorial processes and pose technical and publishing challenges. Several teams within Cochrane and the international Living Evidence Network have been piloting living systematic reviews. Methods We conducted a mixed-methods evaluation with participants involved in six LSRs (three Cochrane and three non-Cochrane). Up to three semi-structured interviews were conducted with 27 participants involved with one or more of the pilot LSRs. Interviews explored participants’ experiences contributing to the LSR, barriers and facilitators to their conduct and opportunities for future development. Pilot team members also completed monthly surveys capturing time for key tasks and the number of citations screened for each review. Results Across the pilot LSRs, search frequency was monthly to three-monthly, with some using tools such as machine learning and Cochrane Crowd to screen searches. Varied approaches were used to communicate updates to readers. The number of citations screened varied widely between the reviews, from three to 300 citations per month. The amount of time spent per month by the author team on each review also varied from 5 min to 32 h. Participants were enthusiastic to be involved in the LSR pilot. They highlighted the importance of a motivated and well-organised team; the value of technology enablers to improve workflow efficiencies; the need to establish reliable and efficient processes to sustain living reviews; and the potential for saving time and effort in the long run. Participants highlighted challenges with the current publication processes, managing ongoing workload and the lack of resources to support LSRs in the long term. Conclusions Findings to date support feasibility and acceptability of LSR production. There are challenges that need to be addressed for living systematic reviews to be sustainable and have maximum value. The findings from this study will be used in discussions with the Cochrane community, key decision makers and people more broadly concerned with LSRs to identify and develop priorities for scale-up.

scholarly journals External wine education and certification for restaurant service staff: a mixed-methods evaluation of training effectiveness

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Marissa Orlowski
Keyword(s):  
Mixed Methods ◽  
Training Group ◽  
Organizational Impact ◽  
Structured Interviews ◽  
Capital Theory ◽  
Content Type ◽  
Mixed Methods Evaluation ◽  
Service Staff ◽  
Within Subjects ◽  
Trainee Reactions

PurposeThe purpose of this mixed-methods explanatory sequential study was to assess the effects of an external wine education and certification program on trainee reactions, learning, transfer and financial results.Design/methodology/approachThe quantitative phase was a mixed experimental design in which the training intervention was between-subjects and time was within-subjects. The sample comprises 91 employees (NTraining = 43; NControl = 48) from 12 units of a fine dining restaurant group. The qualitative phase, comprised of semi-structured interviews with training group participants (N = 12), was implemented after the experiment.FindingsTraining group participants reported high scores for attitude toward training content, instructional satisfaction and transfer motivation. Financial metrics, tracked up to 60 days post-training, demonstrated the wine education program was effective in increasing wine knowledge but not wine sales. Four themes emerged from the qualitative data: sense of accomplishment, enhanced guest interaction, tips and gratuities and defeat. Integrated findings revealed increased wine knowledge led to personal financial impact (increased tips) rather than organizational impact.Originality/valueThis research builds on existing training literature and human capital theory by examining external training programs. Further, the use of a mixed-methods design and integration of the quantitative and qualitative findings offers a previously unidentified explanation for why wine training, although effective in facilitating positive reactions and learning, fails to result in transfer behaviors which generate increased wine sales.

scholarly journals Fostering humanism: a mixed methods evaluation of the Footprints Project in critical care

BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e029810 ◽  
Author(s):  
Neala Hoad ◽  
Marilyn Swinton ◽  
Alyson Takaoka ◽  
Benjamin Tam ◽  
Melissa Shears ◽  
...  
Keyword(s):  
Critical Care ◽  
Mixed Methods ◽  
Personal Information ◽  
Qualitative Content Analysis ◽  
Care Practice ◽  
Structured Interviews ◽  
Community Culture ◽  
Patient Centred Care ◽  
Clinical Encounters ◽  
Mixed Methods Evaluation

ObjectivesThe objectives of this mixed-methods study were to assess the uptake, sustainability and influence of the Footprints Project.SettingTwenty-two-bed university-affiliated ICU in Hamilton, Canada.ParticipantsICU patients admitted and their families, as well as clinicians.InterventionsWe developed a personalised patient Footprints Form and Whiteboard to facilitate holistic, patient-centred care, to inform clinical encounters, and to create deeper connections among patients, families and clinicians.Outcome measuresWe conducted 3 audits to examine uptake and sustainability. We conducted semi-structured interviews with 10 clinicians, and held 5 focus groups with 25 clinicians; and we interviewed 5 patients and 13 family representatives of 5 patients who survived and 5 who died in the ICU. Transcripts were analysed using qualitative content analysis.ResultsThe Footprints Project facilitated holistic, patient-centred care by setting the stage for patient and family experience, motivating the patient and humanising the patient for clinicians. Through informing clinical encounters, Footprints helped clinicians initiate more personal conversations, foster deeper connections and guide treatment. Professional practice influences included more focused attention on the patient, enhanced interdisciplinary communication and changes in community culture. Initially used in 15.8% of patients (audit A), uptake increased to 51.4% in audit B, and was sustained at 57.8% in audit C.ConclusionsBy sharing valuable personal information about patients before and beyond their illness on individualised whiteboards at each bedside, the Footprints Project fosters humanism in critical care practice.

Intimate Partner Violence and Work: A Scoping Review of Published Research

2019 ◽  
pp. 152483801988174
Author(s):  
Jennifer C. D. MacGregor ◽  
Casey L. Oliver ◽  
Barbara J. MacQuarrie ◽  
C. Nadine Wathen
Keyword(s):  
Intimate Partner Violence ◽  
Scoping Review ◽  
Partner Violence ◽  
Evidence Synthesis ◽  
Intimate Partner ◽  
Policy And Practice ◽  
Related Factors ◽  
Cross Sectional ◽  
Team Members ◽  
Work Related

Increasingly, intimate partner violence (IPV) is recognized as having important impacts on work. The purpose of this scoping review is to describe the nature and extent of research on IPV and workers, the workplace, and/or employment. Using multiple search strategies, including searches conducted by a professional librarian from database inception to May 2018, 2,306 unique articles were retrieved and independently screened for eligibility by two team members. A total of 235 articles met predefined inclusion criteria, which were that articles must: (1) report findings of a research study, (2) be published in a peer-reviewed journal, and (3) be focused on IPV and the workplace, workers, and/or employment. The most common topics examined were the relationship between IPV and employment, IPV- and work-related factors, and the impacts of IPV on work. Most articles were quantitative and cross-sectional and focused on the abuse of women by men. Major research gaps include evaluations of interventions to address IPV and work and research focused on the experiences and needs of perpetrators and gender and sexual minorities. Further evidence synthesis is recommended in several areas and implications for policy and practice are discussed.

scholarly journals The Use of Mixed Methods Evaluation for Effective Program Scale up

2012 ◽  
Vol 26 (S1) ◽  
Author(s):  
Erica Lyn Phillips ◽  
David Pelletier ◽  
Suzanne Gervais ◽  
Rebecca Stoltzfus ◽  
Sera Young ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Scale Up ◽  
Mixed Methods Evaluation ◽  
Effective Program

scholarly journals A Mixed Methods Evaluation of a 4-week Geriatrics Curriculum in Strengthening Knowledge and Comfort Among Orthopaedic Surgery Residents

2020 ◽  
Author(s):  
Adrian Chan ◽  
Victoria Chuen ◽  
Andrew Perrella ◽  
Guillaume Limfat ◽  
Karen Ng ◽  
...  
Keyword(s):  
Older Adults ◽  
Mixed Methods ◽  
Orthopaedic Surgery ◽  
Clinical Decision Making ◽  
Geriatric Medicine ◽  
Clinical Decision ◽  
Structured Interviews ◽  
University Of Toronto ◽  
Mixed Methods Evaluation ◽  
The University

Abstract Background: In 2016, the University of Toronto Faculty of Medicine implemented a 4-week “Orthogeriatrics” rotation for orthopaedic surgery residents. We sought to assess the rotation’s impact on trainees’ knowledge, attitudes, and behaviours toward caring for older adults, and explore areas for improvement.Methods: We used a mixed methods concurrent triangulation design. The Geriatrics Clinical Decision-Making Assessment (GCDMA) and Geriatric Attitudes Scale (GAS) compared knowledge, attitudes, and behaviours between trainees who were or were not exposed to the curriculum. Rotation evaluations and semi-structured interviews with trainees and key informants explored learning experiences and the curriculum’s impact on resident physician growth and development in geriatric competencies.Results: Among trainees who completed the GCDMA (n=19), those exposed to the rotation scored higher in knowledge compared to the unexposed cohort (14.4±2.1 vs. 11.3±2.0, p<0.01). The following themes emerged from the qualitative analysis of 29 stakeholders: Increased awareness and comfort regarding geriatric medicine competencies, appreciation of the value of orthogeriatric collaboration, and suggestions for curriculum improvement. Conclusion: These results suggest that the Orthogeriatrics curriculum strengthens knowledge, behaviour, and comfort towards caring for older adults. Our study aims to inform further curriculum development and facilitate dissemination of geriatric education in surgical training programs across Canada and the world.

scholarly journals Human resources and curricula content for early child development implementation: multicountry mixed methods evaluation

BMJ Open ◽  
2020 ◽  
Vol 10 (4) ◽  
pp. e032134
Author(s):  
Maya Kohli-Lynch ◽  
Victoria Ponce Hardy ◽  
Raquel Bernal Salazar ◽  
Sunil S Bhopal ◽  
Alexandra Brentani ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Child Development ◽  
Human Resources ◽  
Scale Up ◽  
Early Child Development ◽  
Middle Income ◽  
The Sustainable Development ◽  
Early Child ◽  
Mixed Methods Evaluation ◽  
Training And Supervision

ObjectiveThe WHO recommends responsive caregiving and early learning (RCEL) interventions to improve early child development (ECD), and to achieve the Sustainable Development Goals’ vision of a world where all children thrive. Implementation of RCEL programmes in low and middle-income countries (LMIC) requires evidence to inform decisions about human resources and curricula content. We aimed to describe human resources and curricula content for implementation of RCEL projects across diverse LMICs, using data from the Grand Challenges Canada Saving Brains ECD portfolio.SettingWe evaluated 32 RCEL projects across 17 LMICs on four continents.ParticipantsOverall, 2165 workers delivered ECD interventions to 25 909 families.InterventionProjects were either stand-alone RCEL or RCEL combined with health and nutrition, and/or safety and security.Primary and secondary outcomesWe undertook a mixed methods evaluation of RCEL projects within the Saving Brains portfolio. Quantitative data were collected through standardised reporting tools. Qualitative data were collected from ECD experts and stakeholders and analysed using thematic content analysis, informed by literature review.ResultsMajor themes regarding human resources included: worker characteristics, incentivisation, retention, training and supervision, and regarding curricula content: flexible adaptation of content and delivery, fidelity, and intervention duration and dosage. Lack of an agreed standard ECD package contributed to project heterogeneity. Incorporation of ECD into existing services may facilitate scale-up but overburdened workers plus potential reductions in service quality remain challenging. Supportive training and supervision, inducement, worker retention, dosage and delivery modality emerged as key implementation decisions.ConclusionsThis mixed methods evaluation of a multicountry ECD portfolio identified themes for consideration by policymakers and programme leaders relevant to RCEL implementation in diverse LMICs. Larger studies, which also examine impact, including high-quality process and costing evaluations with comparable data, are required to further inform decisions for implementation of RCEL projects at national and regional scales.

scholarly journals Protocol for a mixed-methods evaluation of a massive open online course on real world evidence

BMJ Open ◽  
2018 ◽  
Vol 8 (8) ◽  
pp. e025188 ◽  
Author(s):  
Edward Meinert ◽  
Abrar Alturkistani ◽  
David Brindley ◽  
Alison Carter ◽  
Glenn Wells ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Data Science ◽  
Online Courses ◽  
Course Delivery ◽  
Structured Interviews ◽  
Massive Open Online ◽  
Mixed Methods Evaluation ◽  
Real World Evidence ◽  
Study Participants ◽  
The Impact

IntroductionIncreasing number of Massive Open Online Courses (MOOCs) are being used to train learners at scale in various healthcare-related skills. However, many challenges in course delivery require further understanding, for example, factors exploring the reasons for high MOOC dropout rates, recorded low social interaction between learners and the lack of understanding of the impact of a course facilitators’ presence in course engagement. There is a need to generate further evidence to explore these detriments to MOOC course delivery to enable enhanced course learning design. The proposed mixed-methods evaluation of the MOOC was determined based on the MOOC’s aims and objectives and the methodological approaches used to evaluate this type of a course. The MOOC evaluation will help appraise the effectiveness of the MOOC in delivering its intended objectives. This protocol aims to describe the design of a study evaluating learners knowledge, skills and attitudes in a MOOCs about data science for healthcare.Methods and analysisStudy participants will be recruited from learners who have registered for the MOOC. On registration, learners will be given an opportunity to opt into the study and complete informed consent. Following completion of the course, study participants will be contacted to complete semistructured interviews. Interviews will be transcribed and coded using thematic analysis, with data analysed using two evaluation models: (1) the reach, effectiveness, adoption, implementation, maintenance framework and the (2) Kirkpatrick model drawing data from pre and post-course surveys and post-MOOC semi-structured interviews. The primary goal of the evaluation is to appraise participants' knowledge, skills and attitude after taking the MOOC.Ethics and disseminationEthics approval for this study was obtained from Imperial College London through the Education Ethics Review Process (EERP) (EERP1617-030). A summary of the research findings will be reported through a peer-reviewed journal and will be presented at an international conference.

scholarly journals A mixed methods evaluation of a 4-week geriatrics curriculum in strengthening knowledge and comfort among orthopaedic surgery residents

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Adrian C H Chan ◽  
Victoria Chuen ◽  
Andrew Perrella ◽  
Guillaume Limfat ◽  
Karen Ng ◽  
...  
Keyword(s):  
Older Adults ◽  
Mixed Methods ◽  
Orthopaedic Surgery ◽  
Clinical Decision Making ◽  
Geriatric Medicine ◽  
Clinical Decision ◽  
Structured Interviews ◽  
University Of Toronto ◽  
Mixed Methods Evaluation ◽  
The University

Abstract Background In 2014, the University of Toronto Faculty of Medicine implemented a 4-week “Orthogeriatrics” rotation for orthopaedic surgery residents. We sought to assess the rotation’s impact on trainees’ knowledge, attitudes, and behaviours toward caring for older adults, and explore areas for improvement. Methods We used a mixed methods concurrent triangulation design. The Geriatrics Clinical Decision-Making Assessment (GCDMA) and Geriatric Attitudes Scale (GAS) compared knowledge, attitudes, and behaviours between trainees who were or were not exposed to the curriculum. Rotation evaluations and semi-structured interviews with trainees and key informants explored learning experiences and the curriculum’s impact on resident physician growth and development in geriatric competencies. Results Among trainees who completed the GCDMA (n = 19), those exposed to the rotation scored higher in knowledge compared to the unexposed cohort (14.4 ± 2.1 vs. 11.3 ± 2.0, p < 0.01). The following themes emerged from the qualitative analysis of 29 stakeholders: Increased awareness and comfort regarding geriatric medicine competencies, appreciation of the value of orthogeriatric collaboration, and suggestions for curriculum improvement. Conclusions These results suggest that the Orthogeriatrics curriculum strengthens knowledge, behaviour, and comfort towards caring for older adults. Our study aims to inform further curriculum development and facilitate dissemination of geriatric education in surgical training programs across Canada and the world.

scholarly journals A retrospective mixed-methods evaluation of a national ORS and zinc scale-up program in Uganda between 2011 and 2016

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Felix Lam ◽  
Damien Kirchhoffer ◽  
Dennis Mike Buluma ◽  
Lorraine Kabunga ◽  
Patricia N Wamala-Mucheri ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Scale Up ◽  
Mixed Methods Evaluation
Sign in / Sign up

Export Citation Format

Share Document