scholarly journals Does knowledge brokering facilitate evidence-based policy? A review of existing knowledge and an agenda for future research

2020 ◽  
Vol 48 (2) ◽  
pp. 335-353 ◽  
Author(s):  
Eleanor MacKillop ◽  
Sarah Quarmby ◽  
James Downe

The claim that evidence-based policy (EBP) produces better outcomes has gained increasing support over the last three decades. Knowledge brokering (KB) is seen as a way to achieve improved policymaking and governments worldwide are investing significant resources in KB initiatives. It is therefore important to understand the range of these activities and to investigate whether and how they facilitate EBP. This article critically reviews the extant literature on KB. It identifies six important limitations: the existence of multiple definitions of KB; a lack of theory-based empirical analysis; a neglect of knowledge brokering organisations; insufficient research on KB in social policy; limited analysis of impact and effectiveness; and a lack of attention to the role played by politics. The paper proposes an agenda for future research that bridges disciplinary boundaries in order to address these gaps and contribute new insights into the politics of evidence use.

Author(s):  
Dan Horsfall ◽  
John Hudson

This concluding chapter highlights key arguments from across the book in order to set out an integrated agenda for future research. Theoretically rooted analyses must be at the core of such an agenda. The inter-pollination/cross-fertilisation of ideas from many disciplines is important in developing an understanding of the complex and multi-faceted ways in which competition is influencing welfare states. However, while theory is central to this agenda, it must also be rooted in detailed empirical analysis. In looking to transcend the competition state/welfare state dichotomy, this interplay between theory and evidence is key, and where theoretically rooted social policy analysts can add particular value to current debates.


2021 ◽  
Author(s):  
◽  
Iris Anne Hutchinson

<p>Many social policy problems are recognised as complex and intractable, and hence necessitate analysts' having the capability to address them. Epistemological influences embedded in approaches to policy can impose constraints on the natural capacity and capability that people have to make sense out of particular experiences of complexity in the course of policy analysis work. Within the dominant policy approach adopted by policy analysts under the rubric of evidence-based policy, such complexity capability eschews any explicit role for opinion. However, the application of Q methodology by Michel van Eeten among others in a specific case of policy deliberation in the Netherlands, which had proven resistant to the standard, evidence-based policy analysis, shows that there could be a role for what is otherwise overlooked. Accordingly, this thesis examines the proposition that opinion indeed may play an important role in policymaking in complex and intractable situations. Q methodology is an established research methodology for acquiring and developing knowledge from a subjective standpoint. It has a growing record of successful application to public policy controversies, where solutions were made possible because opinion - and its everyday experiential rationality - were made available. Q methodology is also seen, however, as a marginal methodology. There has been insufficient explanation of why the application of Q methodology could make a positive difference to policy problems of a complex and intractable kind. The two research questions focus on the efficacy of Q methodology. Q methodology could make a difference in an adjunctive sense. It meets a policy need, namely to make opinion available as a complement to other evidence knowledge and thus adds to understanding of problems and solutions while remaining firmly within the prevailing evidence-based policy epistemology. Alternatively, Q methodology could make a difference of a transformative kind. It opens up a new epistemological space for doing policy analysis work with the power to create substantial policy-analytic change. To address these questions, the thesis develops an argument that establishes the linkages between pragmatism, complexity thinking and Q methodology and, in so doing, provides a path for understanding the role and place of opinion in policy making contexts. It proceeds through several stages which together make an epistemological argument for the efficacy of Q methodology. First, the nature of the policy problem is explicated as one of the separation of opinion from knowledge. Secondly, the thesis turns to a counter argument drawing on Peirce's pragmatism and his attention to abduction. In the next stage, dominant practice ideas about the capability needed to address complexity are critically examined, which shows that opinion is not valued in that practice. The success of van Eeten's work leads to a detailed examination of complexity in the policy context, and the claim that opinion is less problematical than are the overall epistemological choices made in policy analysis. Focusing on those epistemological choices, the argument draws together, in a fresh look, the thinking entailed in Q methodology in respect of its abductive logic and its theory of knowledge. Q methodology is shown to be a kind of science that allows objective fact to be approached from a subjective standpoint under experimental conditions. Finally, therefore, Q methodology is shown to open up an epistemological space quite unlike others. This makes the practice described as "reading complexity" in a real-world policy application possible.</p>


Author(s):  
R. Kathryn McHugh ◽  
David H. Barlow

This chapter provides an overview of the current status of clinician training including a description of training procedures, a brief review of the extant literature on the efficacy/effectiveness of training, and a discussion of novel approaches and future research directions in the area of evidence-based psychological interventions.


Author(s):  
Dylan L. Yingling ◽  
Daniel J. Mallinson

Background: Though evidence-based policy (EBP) has attracted considerable attention from the public, academics, and governments, prior studies have revealed little about how political parties, institutions, and policy context shape the adoption and implementation of these policies in the American states.Aims and objectives: Develop objective criteria for measuring these policies, as well as a hierarchy which describes the features that make some policies more advanced. This paper presents the first comprehensive study on EBP in the American states.Methods: Using assessments by the Pew and MacArthur foundations to measure EBP in the states for four topics: criminal justice, juvenile justice, behavioural health, and child welfare. Assess the relationship between EBP use and state political and institutional factors.Results: Democratic governors, Republican legislatures, state innovativeness are significant predictors of EBP engagement.Discussion and conclusions: This research makes a substantial contribution to the study of EBP and opens new avenues for future research on the political, cultural, and institutional factors that influence EBP adoption and implementation. In an era of extreme partisanship, our study finds that EBP is a policy niche where actors and institutions across political parties use research evidence to inform effective and efficient policies in ways that maximise the electoral incentives that such policies can offer.


2021 ◽  
Author(s):  
◽  
Iris Anne Hutchinson

<p>Many social policy problems are recognised as complex and intractable, and hence necessitate analysts' having the capability to address them. Epistemological influences embedded in approaches to policy can impose constraints on the natural capacity and capability that people have to make sense out of particular experiences of complexity in the course of policy analysis work. Within the dominant policy approach adopted by policy analysts under the rubric of evidence-based policy, such complexity capability eschews any explicit role for opinion. However, the application of Q methodology by Michel van Eeten among others in a specific case of policy deliberation in the Netherlands, which had proven resistant to the standard, evidence-based policy analysis, shows that there could be a role for what is otherwise overlooked. Accordingly, this thesis examines the proposition that opinion indeed may play an important role in policymaking in complex and intractable situations. Q methodology is an established research methodology for acquiring and developing knowledge from a subjective standpoint. It has a growing record of successful application to public policy controversies, where solutions were made possible because opinion - and its everyday experiential rationality - were made available. Q methodology is also seen, however, as a marginal methodology. There has been insufficient explanation of why the application of Q methodology could make a positive difference to policy problems of a complex and intractable kind. The two research questions focus on the efficacy of Q methodology. Q methodology could make a difference in an adjunctive sense. It meets a policy need, namely to make opinion available as a complement to other evidence knowledge and thus adds to understanding of problems and solutions while remaining firmly within the prevailing evidence-based policy epistemology. Alternatively, Q methodology could make a difference of a transformative kind. It opens up a new epistemological space for doing policy analysis work with the power to create substantial policy-analytic change. To address these questions, the thesis develops an argument that establishes the linkages between pragmatism, complexity thinking and Q methodology and, in so doing, provides a path for understanding the role and place of opinion in policy making contexts. It proceeds through several stages which together make an epistemological argument for the efficacy of Q methodology. First, the nature of the policy problem is explicated as one of the separation of opinion from knowledge. Secondly, the thesis turns to a counter argument drawing on Peirce's pragmatism and his attention to abduction. In the next stage, dominant practice ideas about the capability needed to address complexity are critically examined, which shows that opinion is not valued in that practice. The success of van Eeten's work leads to a detailed examination of complexity in the policy context, and the claim that opinion is less problematical than are the overall epistemological choices made in policy analysis. Focusing on those epistemological choices, the argument draws together, in a fresh look, the thinking entailed in Q methodology in respect of its abductive logic and its theory of knowledge. Q methodology is shown to be a kind of science that allows objective fact to be approached from a subjective standpoint under experimental conditions. Finally, therefore, Q methodology is shown to open up an epistemological space quite unlike others. This makes the practice described as "reading complexity" in a real-world policy application possible.</p>


2021 ◽  
Author(s):  
Nicholas Huntington

<p><b>The idea that there should be a link between systematically structured knowledge and the policies pursued by governments is not new. Its pre-20th century roots include attempts to establish a ‘science of society’ by social reformers of the 18th and 19th centuries, aspects of the emergence of the modern state system and, arguably, stretch back to classical philosophy and religious scholarship. Since the late 1990s, however, it has assumed special prominence as a global movement that encourages jurisdictions to explicitly incorporate the language of evidence in their understanding and definitions of good policy. While this agenda goes by a number of names, the most common is ‘evidence-based policy’ (EBP). </b></p> <p>This evidentiary turn in policy has generated an extensive body of associated scholarship, involving a diverse range of theoretical positions, critiques, and debates. However, such literature has largely concentrated on macro- and meso-level system issues: structures for knowledge uptake and transfer, principles for using evidence, and underlying conceptual debates. Far less well-explored – and almost entirely absent in relation to Aotearoa New Zealand – are the experiences and perspectives of the practitioners working in policy development. This gap is especially glaring if policy work is treated not as a process of problem-solving, but rather as a humanistic and socially situated practice. Treating practitioners as active and interested participants in the creation of policy means treating them as the ultimate determinants of how evidence manifests in, and influences the outputs of, policy work. Similarly, through their work policy officials create and adopt formal and informal evidentiary definitions, accepted standards, and relevant weightings. It is through applying these social constructs that ‘information’ is transformed into ‘evidence’. While such practices are constrained by the environments within which they work, it is ultimately the practitioner who locates, analyses, and incorporates evidence within policy work. </p> <p>In this thesis, I use the concept of interpretive repertoires from discursive psychology as frameworks to explore how those involved in policy work engage with the idea of evidence-based policy. These repertoires are symbolic sets of meanings, characterisations, and relationships that people can use as resources for engaging with phenomena. Just as a musician’s repertoire represents a set of pre-existing pieces that they can perform, an interpretive repertoire is a pre-existing conceptual framework that a person can use to interpret (or establish the meaning of) ideas, actions, or settings and link them to each other in a coherent way. I approach this topic from an interpretive and critical perspective, taking policies as the results of a fundamentally social process shaped by the interaction of different values, interests, and cultural assumptions. The research has involved in-depth interviews with senior officials in the field of skills policy, including advisors and analysts, managers overseeing teams of such officials, and officials focused on developing and generating evidence for policy. I analysed interview texts to identify repertoires operating across three domains: repertoires of practice (what it means to work as a policy official), repertoires of context (what influences the environment in which officials work), and repertoires of evidence (the role of evidence in policy work). </p> <p>I identified three main repertoires each of practice and context, and five main repertoires of evidence. I also found that individual repertoires clustered across domains to produce three interpretive stances toward evidence-based policy work. The Evaluative stance is characterised by valorising diversity, debate, and judgement; the Scientific stance values rigour, truth-seeking, and consistency; and the Pragmatic stance emphasises utility, compromise, and sustainability. Each stance integrates practitioners’ constructions of the work they do, the context for that work, and the purpose of evidence into a coherent framework of meaning that supports them to engage with the abstract concept of evidence-based policy. </p> <p>This work contributes primarily to two key literatures. Firstly, the thesis adds to a relatively small but growing body of empirical research into evidence use in policy work environments. It makes a particularly novel contribution here by situating evidence use as a type of social process, and focusing on deep exploration of practitioner ‘voice’ as a way of analysing this process. Secondly, the research makes a methodological contribution to the analysis of policy work by demonstrating the value of using concepts from discursive psychology as a way of exploring the position of practitioners within the policy environment. Through discussion of the repertoires and stances I identified in practitioners’ interviews, I present a more nuanced picture of approaches towards evidence amongst policy practitioners in Aotearoa New Zealand.</p>


2021 ◽  
Author(s):  
Nicholas Huntington

<p><b>The idea that there should be a link between systematically structured knowledge and the policies pursued by governments is not new. Its pre-20th century roots include attempts to establish a ‘science of society’ by social reformers of the 18th and 19th centuries, aspects of the emergence of the modern state system and, arguably, stretch back to classical philosophy and religious scholarship. Since the late 1990s, however, it has assumed special prominence as a global movement that encourages jurisdictions to explicitly incorporate the language of evidence in their understanding and definitions of good policy. While this agenda goes by a number of names, the most common is ‘evidence-based policy’ (EBP). </b></p> <p>This evidentiary turn in policy has generated an extensive body of associated scholarship, involving a diverse range of theoretical positions, critiques, and debates. However, such literature has largely concentrated on macro- and meso-level system issues: structures for knowledge uptake and transfer, principles for using evidence, and underlying conceptual debates. Far less well-explored – and almost entirely absent in relation to Aotearoa New Zealand – are the experiences and perspectives of the practitioners working in policy development. This gap is especially glaring if policy work is treated not as a process of problem-solving, but rather as a humanistic and socially situated practice. Treating practitioners as active and interested participants in the creation of policy means treating them as the ultimate determinants of how evidence manifests in, and influences the outputs of, policy work. Similarly, through their work policy officials create and adopt formal and informal evidentiary definitions, accepted standards, and relevant weightings. It is through applying these social constructs that ‘information’ is transformed into ‘evidence’. While such practices are constrained by the environments within which they work, it is ultimately the practitioner who locates, analyses, and incorporates evidence within policy work. </p> <p>In this thesis, I use the concept of interpretive repertoires from discursive psychology as frameworks to explore how those involved in policy work engage with the idea of evidence-based policy. These repertoires are symbolic sets of meanings, characterisations, and relationships that people can use as resources for engaging with phenomena. Just as a musician’s repertoire represents a set of pre-existing pieces that they can perform, an interpretive repertoire is a pre-existing conceptual framework that a person can use to interpret (or establish the meaning of) ideas, actions, or settings and link them to each other in a coherent way. I approach this topic from an interpretive and critical perspective, taking policies as the results of a fundamentally social process shaped by the interaction of different values, interests, and cultural assumptions. The research has involved in-depth interviews with senior officials in the field of skills policy, including advisors and analysts, managers overseeing teams of such officials, and officials focused on developing and generating evidence for policy. I analysed interview texts to identify repertoires operating across three domains: repertoires of practice (what it means to work as a policy official), repertoires of context (what influences the environment in which officials work), and repertoires of evidence (the role of evidence in policy work). </p> <p>I identified three main repertoires each of practice and context, and five main repertoires of evidence. I also found that individual repertoires clustered across domains to produce three interpretive stances toward evidence-based policy work. The Evaluative stance is characterised by valorising diversity, debate, and judgement; the Scientific stance values rigour, truth-seeking, and consistency; and the Pragmatic stance emphasises utility, compromise, and sustainability. Each stance integrates practitioners’ constructions of the work they do, the context for that work, and the purpose of evidence into a coherent framework of meaning that supports them to engage with the abstract concept of evidence-based policy. </p> <p>This work contributes primarily to two key literatures. Firstly, the thesis adds to a relatively small but growing body of empirical research into evidence use in policy work environments. It makes a particularly novel contribution here by situating evidence use as a type of social process, and focusing on deep exploration of practitioner ‘voice’ as a way of analysing this process. Secondly, the research makes a methodological contribution to the analysis of policy work by demonstrating the value of using concepts from discursive psychology as a way of exploring the position of practitioners within the policy environment. Through discussion of the repertoires and stances I identified in practitioners’ interviews, I present a more nuanced picture of approaches towards evidence amongst policy practitioners in Aotearoa New Zealand.</p>


2015 ◽  
Vol 3 (1) ◽  
Author(s):  
Gemma Paine Cronin ◽  
Mastoera Sadan

This paper outlines a 2011 study commissioned by the Presidency’s Programme to Support Pro-Poor Policy Development (PSPPD) which promotes evidence-based policy making (EBPM) in South Africa. EBPM refers to norms, initiatives and methods aimed at improving evidence-based policy in countries from which South Africa traditionally borrows public service reforms, particularly the UK and Canada. The study provides a descriptive snapshot of attitudes to evidence-use in policy making. All 54 senior government officials interviewed felt that evidence-use is too limited to ensure relevant, effective policy responses. This includes policies on which complex results depend and those with long-term and high-resource implications. Although all respondents regarded EBPM as self-evidently desirable, there were different views on practical application. Examples provided suggest that, where evidence was used, it was very often related to a borrowed international policy without a prior evidencedrivenanalysis of successes and failures or its relevance and feasibility in terms of local issuesand context. Policy makers generally know they should be making optimal use of availableevidence, but highlighted systemic barriers beyond the influence of individual managersto resolve. The study suggests that improved use of evidence throughout the policy cycle,particularly in analysing problems and needs, is a requirement for learning through evidencebased policy development. It suggests that political and administrative leadership will need to agree on norms, ways of dealing with the barriers to effective use of evidence and on the role of each throughout the policy cycle in ensuring appropriate evidence is available and used.


Author(s):  
Jon Baron

This article provides a brief history of evidence-based policy, which it defines as encompassing (1) the application of rigorous research methods, particularly randomized controlled trials (RCTs), to build credible evidence about “what works” to improve the human condition; and (2) the use of such evidence to focus public and private resources on effective interventions. Evidence-based policy emerged first in medicine after World War II, and has made tremendous contributions to human health. In social policy, a few RCTs were conducted before 1980, but the number grew rapidly in U.S. welfare and employment programs during the 1980s and 1990s and had an important impact on government policy. Since 2000, evidence-based policy has seen a major expansion in other social policy areas, including education and international development assistance. A recent milestone is the U.S. enactment of “tiered evidence” social programs in which rigorous evidence is the defining principle in awarding government funding for interventions.


Sign in / Sign up

Export Citation Format

Share Document