Using theory of change to assess impact of knowledge translation initiatives

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
C Howarth ◽  
S Neil-Sztramko
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Program Evaluation ◽  
Health Professionals ◽  
Informed Decision ◽  
Evaluation Framework ◽  
Theory Of Change ◽  
Informed Decision Making ◽  
High Quality ◽  
Public Health Professionals

Abstract Issue The National Collaborating Centre for Methods and Tools (NCCMT) offers high quality supports to public health professionals on evidence-informed decision making (EIDM). We developed a theory of change evaluation framework to guide evaluations of our programs and services to ensure that the NCCMT's resources and training continue to be high quality and meet the needs of public health professionals globally. Description of the Problem Our objective was to develop an evaluation framework that illustrates our reach, quality, and impact. The NCCMT contracted an external program evaluation expert to assist in developing a revised framework to better capture these aspects. An inductive approach was used to identify evaluation themes through internal document review, and a review of applicable program evaluation literature. Results A revised evaluation framework, influenced by theory of change, was developed and is being implemented at the NCCMT. The theory of change visualizes how the NCCMT influences EIDM and public health practice through four stages that progress from creation of products and services, to knowledge and awareness, to engagement and capacity development, and finally to policy and practice changes embedded within organizational structures. Specific outcome indicators include: public health professionals' confidence, knowledge, and skills; improved public health programs; organizational support for evidence-informed decision making; and workforce engagement and competence. Lessons This innovative evaluation framework informed by a theory of change resulted in significant streamlining of the centre's evaluation activities, and has provided clearer direction with respect to the purpose of evaluation, as well as enhanced ability to capture the centre's reach, quality and impact. The lessons of the importance of using theory of change to underpin evaluation activities can be applied to other public health organizations globally. Key messages Applying an evaluation framework supports effective and efficient programming. The evaluation framework demonstrates the NCCMT’s impact and reach in public health.

scholarly journals The National Collaborating Centre for Methods and Tools: Supporting evidence-informed decision making

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
C Howarth ◽  
S Neil-Sztramko ◽  
M Dobbins
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Health Professionals ◽  
Well Being ◽  
Informed Decision ◽  
Rapid Review ◽  
Informed Decision Making ◽  
High Quality ◽  
Public Health Professionals ◽  
The World

Abstract Background Public health continuously evolves to address an uncertain future, and public health professionals must effectively and efficiently adapt to changes. Evidence-informed decision making (EIDM) is one way to adapt to change. The National Collaborating Centre for Methods and Tools (NCCMT) provides high quality resources, training and mentorship to support the EIDM process through both in-person and distance-based formats. Freely accessible resources including online training opportunities can help public health professionals globally put evidence into practice and be ready to respond to change. Objectives The NCCMT's work is driven by the belief that everyone deserves optimal health and well-being and this can be achieved by using the best available evidence in practice. Our training and education resources include thirteen online learning modules, an EIDM skills assessment, video series, a rapid review guidebook and regular webinars, amongst others. These resources are self-paced and they can be accessed when and where it is most convenient for public health professionals. Results The NCCMT's resources are highly accessed, with over 320, 000 visits to the NCCMT website from around the world from April 2018-March 2019. There were also over 42,000 downloads of knowledge products in the same time period. The NCCMT's resources have been integrated into public health organizations and curriculum in public health postsecondary programs in Canada. We are continuously evolving by engaging our users. We will be launching an updated version of our Learning Centre in April 2020. Conclusions The NCCMT houses useful resources for all public health professionals to learn about finding, understanding, and using evidence. Public health professionals from around the world have used the NCCMT's educational resources to put evidence into practice. The NCCMT is committed to working with global organizations to support them to achieve their EIDM goals. Key messages The NCCMT supports public health professionals to use the best available evidence in practice. The NCCMT offers high quality resources, training and mentorship to public health professionals.

Assessing the Electronic Evidence System Needs of Canadian Public Health Professionals: A Cross-Sectional Study (Preprint)

2020 ◽  
Author(s):  
Bandna Dhaliwal ◽  
Sarah E Neil-Sztramko ◽  
Nikita Boston-Fisher ◽  
David L Buckeridge ◽  
Maureen Dobbins
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Health Professionals ◽  
Scientific Evidence ◽  
Informed Decision ◽  
Local Context ◽  
Host Institution ◽  
Informed Decision Making ◽  
Electronic Evidence ◽  
Public Health Professionals

BACKGROUND True evidence-informed decision making in public health relies on incorporating evidence from a number of sources in addition to traditional scientific evidence. Lack of access to these types of data, as well as ease of use and interpretability of scientific evidence contribute to limited uptake of evidence-informed decision making in practice. An electronic evidence system that includes multiple sources of evidence and potentially novel computational processing approaches or artificial intelligence holds promise as a solution to overcoming barriers to evidence-informed decision making in public health. OBJECTIVE To understand the needs and preferences for an electronic evidence system among public health professionals in Canada. METHODS An invitation to participate in an anonymous online survey was distributed via listservs of two Canadian public health organizations. Eligible participants were English or French speaking individuals currently working in public health. The survey contained both multiple choice and open-ended questions about needs and preferences relevant to an electronic evidence system. Quantitative responses were analyzed to explore differences by public health role. Inductive and deductive analysis methods were used to code and interpret the qualitative data. Ethics review was not required by the host institution. RESULTS Respondents (n = 371) were heterogeneous, spanning organizations, positions, and areas of practice within public health. Nearly all (98.0%) respondents indicated that an electronic evidence system would support their work. Respondents had high preferences for local contextual data, research and intervention evidence, and information about human and financial resources. Qualitative analyses identified a number of concerns, needs, and suggestions for development of such a system. Concerns ranged from personal use of such a system, to the ability of their organization to use such a system. Identified needs spanned the different sources of evidence including local context, research and intervention evidence, and resources and tools. Additional suggestions were identified to improve system usability. CONCLUSIONS Canadian public health professionals have positive perceptions towards an electronic evidence system that would bring together evidence from the local context, scientific research, and resources. Elements were also identified to increase the usability of an electronic evidence system.

Pornography and Human Trafficking

2021 ◽  
pp. 179-186
Author(s):  
Emily F. Rothman
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Human Trafficking ◽  
Health Problem ◽  
Health Professionals ◽  
Sex Workers ◽  
Public Health Problem ◽  
Informed Decision Making ◽  
Public Health Professionals ◽  
Definition Of

Human trafficking is an insidious public health problem that may be worsened by the constant demand for new pornography, but sex workers’ rights—including the rights of pornography performers—are not always served by anti-trafficking efforts. This chapter provides a definition of human trafficking, reviews three main arguments about how pornography may influence human trafficking, and encourages public health professionals to value anecdotal information from both sex workers’ rights advocates and human trafficking survivors to move toward better science and evidence-informed decision-making.

scholarly journals Generic Cost-Effectiveness Models: A Proof of Concept of a Tool for Informed Decision-Making for Public Health Precision Medicine

2018 ◽  
Vol 21 (5-6) ◽  
pp. 217-227 ◽  
Author(s):  
Susan R. Snyder ◽  
Jing Hao ◽  
Larisa H. Cavallari ◽  
Zhi Geng ◽  
Amanda Elsey ◽  
...  
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Cost Effectiveness ◽  
Precision Medicine ◽  
Informed Decision ◽  
Informed Decision Making ◽  
Proof Of Concept

Chemical mixtures from a public health perspective: the importance of research for informed decision making

Toxicology ◽  
1995 ◽  
Vol 105 (2-3) ◽  
pp. 429-441 ◽  
Author(s):  
Ken Sexton ◽  
Barbara D. Beck ◽  
Eula Bingham ◽  
Joseph D. Brain ◽  
David M. DeMarini ◽  
...  
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Informed Decision ◽  
Informed Decision Making ◽  
Chemical Mixtures ◽  
Public Health Perspective

scholarly journals Cochrane update: building capacity in evidence-informed decision-making to improve public health

2013 ◽  
Vol 35 (4) ◽  
pp. 624-627 ◽  
Author(s):  
Tahna L. Pettman ◽  
Rebecca Armstrong ◽  
Kirsty Jones ◽  
Elizabeth Waters ◽  
Jodie Doyle
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Informed Decision ◽  
Informed Decision Making ◽  
Building Capacity

scholarly journals Participation in the National Collaborating Centre for Methods and Tools’ Knowledge Broker Mentoring Program: a public health inspector perspective

2021 ◽  
Vol 64 (1) ◽  
pp. 14-16
Author(s):  
Andrea Powers ◽  
T. Pelletier ◽  
R. Ray ◽  
A. Reynolds ◽  
C. Howarth ◽  
...  
Keyword(s):  
Public Health ◽  
Decision Making ◽  
Informed Decision ◽  
Knowledge Broker ◽  
Rapid Review ◽  
Practice Research ◽  
Mentoring Program ◽  
Informed Decision Making ◽  
Successful Completion ◽  
Time Commitment

Although evidence-informed decision making is an important part of the field of public health inspection, finding the time to stay informed of current research can be a challenge amidst day-to-day job expectations. This article will explore how two Public Health Inspectors (PHIs) from Ottawa Public Health, a municipal public health unit in Ontario, incorporated evidence-informed decision making (EIDM) into their work. They built their EIDM skills through participating in the 18-month Knowledge Broker (KB) Mentoring Program offered by the National Collaborating Centre for Methods and Tools. The program required a substantial time commitment, including nine in-person workshop days and dedicated hours to practice research appraisal skills and to complete a rapid review. The inspectors were approved and supported to spend the necessary time; however, they still found it difficult to designate hours for learning while balancing their frontline inspection workload. This article will share observations about the PHI’s involvement, including benefits and challenges as well as factors that facilitated their successful completion of the KB Mentoring Program.

Sign in / Sign up

Export Citation Format

Share Document