scholarly journals Reading Complexity in Social Policy Contexts:  The Value of Q Methodology

2021 ◽  
Author(s):  
◽  
Iris Anne Hutchinson

<p>Many social policy problems are recognised as complex and intractable, and hence necessitate analysts' having the capability to address them. Epistemological influences embedded in approaches to policy can impose constraints on the natural capacity and capability that people have to make sense out of particular experiences of complexity in the course of policy analysis work. Within the dominant policy approach adopted by policy analysts under the rubric of evidence-based policy, such complexity capability eschews any explicit role for opinion. However, the application of Q methodology by Michel van Eeten among others in a specific case of policy deliberation in the Netherlands, which had proven resistant to the standard, evidence-based policy analysis, shows that there could be a role for what is otherwise overlooked. Accordingly, this thesis examines the proposition that opinion indeed may play an important role in policymaking in complex and intractable situations. Q methodology is an established research methodology for acquiring and developing knowledge from a subjective standpoint. It has a growing record of successful application to public policy controversies, where solutions were made possible because opinion - and its everyday experiential rationality - were made available. Q methodology is also seen, however, as a marginal methodology. There has been insufficient explanation of why the application of Q methodology could make a positive difference to policy problems of a complex and intractable kind. The two research questions focus on the efficacy of Q methodology. Q methodology could make a difference in an adjunctive sense. It meets a policy need, namely to make opinion available as a complement to other evidence knowledge and thus adds to understanding of problems and solutions while remaining firmly within the prevailing evidence-based policy epistemology. Alternatively, Q methodology could make a difference of a transformative kind. It opens up a new epistemological space for doing policy analysis work with the power to create substantial policy-analytic change. To address these questions, the thesis develops an argument that establishes the linkages between pragmatism, complexity thinking and Q methodology and, in so doing, provides a path for understanding the role and place of opinion in policy making contexts. It proceeds through several stages which together make an epistemological argument for the efficacy of Q methodology. First, the nature of the policy problem is explicated as one of the separation of opinion from knowledge. Secondly, the thesis turns to a counter argument drawing on Peirce's pragmatism and his attention to abduction. In the next stage, dominant practice ideas about the capability needed to address complexity are critically examined, which shows that opinion is not valued in that practice. The success of van Eeten's work leads to a detailed examination of complexity in the policy context, and the claim that opinion is less problematical than are the overall epistemological choices made in policy analysis. Focusing on those epistemological choices, the argument draws together, in a fresh look, the thinking entailed in Q methodology in respect of its abductive logic and its theory of knowledge. Q methodology is shown to be a kind of science that allows objective fact to be approached from a subjective standpoint under experimental conditions. Finally, therefore, Q methodology is shown to open up an epistemological space quite unlike others. This makes the practice described as "reading complexity" in a real-world policy application possible.</p>

2021 ◽  
Author(s):  
◽  
Iris Anne Hutchinson

<p>Many social policy problems are recognised as complex and intractable, and hence necessitate analysts' having the capability to address them. Epistemological influences embedded in approaches to policy can impose constraints on the natural capacity and capability that people have to make sense out of particular experiences of complexity in the course of policy analysis work. Within the dominant policy approach adopted by policy analysts under the rubric of evidence-based policy, such complexity capability eschews any explicit role for opinion. However, the application of Q methodology by Michel van Eeten among others in a specific case of policy deliberation in the Netherlands, which had proven resistant to the standard, evidence-based policy analysis, shows that there could be a role for what is otherwise overlooked. Accordingly, this thesis examines the proposition that opinion indeed may play an important role in policymaking in complex and intractable situations. Q methodology is an established research methodology for acquiring and developing knowledge from a subjective standpoint. It has a growing record of successful application to public policy controversies, where solutions were made possible because opinion - and its everyday experiential rationality - were made available. Q methodology is also seen, however, as a marginal methodology. There has been insufficient explanation of why the application of Q methodology could make a positive difference to policy problems of a complex and intractable kind. The two research questions focus on the efficacy of Q methodology. Q methodology could make a difference in an adjunctive sense. It meets a policy need, namely to make opinion available as a complement to other evidence knowledge and thus adds to understanding of problems and solutions while remaining firmly within the prevailing evidence-based policy epistemology. Alternatively, Q methodology could make a difference of a transformative kind. It opens up a new epistemological space for doing policy analysis work with the power to create substantial policy-analytic change. To address these questions, the thesis develops an argument that establishes the linkages between pragmatism, complexity thinking and Q methodology and, in so doing, provides a path for understanding the role and place of opinion in policy making contexts. It proceeds through several stages which together make an epistemological argument for the efficacy of Q methodology. First, the nature of the policy problem is explicated as one of the separation of opinion from knowledge. Secondly, the thesis turns to a counter argument drawing on Peirce's pragmatism and his attention to abduction. In the next stage, dominant practice ideas about the capability needed to address complexity are critically examined, which shows that opinion is not valued in that practice. The success of van Eeten's work leads to a detailed examination of complexity in the policy context, and the claim that opinion is less problematical than are the overall epistemological choices made in policy analysis. Focusing on those epistemological choices, the argument draws together, in a fresh look, the thinking entailed in Q methodology in respect of its abductive logic and its theory of knowledge. Q methodology is shown to be a kind of science that allows objective fact to be approached from a subjective standpoint under experimental conditions. Finally, therefore, Q methodology is shown to open up an epistemological space quite unlike others. This makes the practice described as "reading complexity" in a real-world policy application possible.</p>


2019 ◽  
Vol 63 (3) ◽  
pp. 369-386
Author(s):  
Magdalena Martinez

Policy actors and coalitions use narratives to frame higher education policy problems and solutions. In this article, I illustrate how I employed narrative policy analysis (NPA) in practice to demonstrate how state policy actors and coalitions created policy storylines that offered social orientation, reassurance, or guidance for a stubborn higher education policy problem in one state. I begin the article with a review of NPA, followed by a discussion of the methods and tools that guided my analysis and scholars interested in NPA can employ. Next, I provide a brief overview of the policy problem context followed by a detailed description and examples of analysis for policy artifacts and the construction of policy storylines.


2011 ◽  
Vol 32 (4) ◽  
pp. 518-546 ◽  
Author(s):  
Ray Pawson ◽  
Geoff Wong ◽  
Lesley Owen

The authors present a case study examining the potential for policies to be “evidence-based.” To what extent is it possible to say that a decision to implement a complex social intervention is warranted on the basis of available empirical data? The case chosen is whether there is sufficient evidence to justify banning smoking in cars carrying children. The numerous assumptions underpinning such legislation are elicited, the weight and validity of evidence for each is appraised, and a mixed picture emerges. Certain propositions seem well supported; others are not yet proven and possibly unknowable. The authors argue that this is the standard predicament of evidence-based policy. Evidence does not come in finite chunks offering certainty and security to policy decisions. Rather, evidence-based policy is an accumulative process in which the data pursue but never quite capture unfolding policy problems. The whole point is the steady conversion of “unknowns” to “knowns.”


2020 ◽  
Vol 48 (2) ◽  
pp. 335-353 ◽  
Author(s):  
Eleanor MacKillop ◽  
Sarah Quarmby ◽  
James Downe

The claim that evidence-based policy (EBP) produces better outcomes has gained increasing support over the last three decades. Knowledge brokering (KB) is seen as a way to achieve improved policymaking and governments worldwide are investing significant resources in KB initiatives. It is therefore important to understand the range of these activities and to investigate whether and how they facilitate EBP. This article critically reviews the extant literature on KB. It identifies six important limitations: the existence of multiple definitions of KB; a lack of theory-based empirical analysis; a neglect of knowledge brokering organisations; insufficient research on KB in social policy; limited analysis of impact and effectiveness; and a lack of attention to the role played by politics. The paper proposes an agenda for future research that bridges disciplinary boundaries in order to address these gaps and contribute new insights into the politics of evidence use.


2018 ◽  
Author(s):  
Fernando Hoces de la Guardia ◽  
Sean Grant ◽  
Edward Miguel

AbstractThe evidence-based policy movement promotes the use of empirical evidence to inform policy decision-making. While several social science disciplines are undergoing a “credibility revolution” focused on openness and replication, policy analysis has yet to systematically embrace transparency and reproducibility. We argue that policy analysis should adopt the open research practices increasingly espoused in related disciplines to advance the credibility of evidence-based policymaking. We first discuss the importance of evidence-based policy in an era of increasing disagreement about facts, analysis, and expertise. We present a novel framework for “open” policy analysis (OPA) and how to achieve it, focusing on examples of recent policy analyses that have incorporated open research practices such as transparent reporting, open data, and code sharing. We conclude with recommendations on how key stakeholders in evidence-based policy can make OPA the norm and thus safeguard trust in using empirical evidence to inform important public policy decisions.


Sign in / Sign up

Export Citation Format

Share Document