scholarly journals Dynamic meta-analysis: a method of using global evidence for local decision making

Author(s):  
Gorm E. Shackelford ◽  
Philip A. Martin ◽  
Amelia S. C. Hood ◽  
Alec P. Christie ◽  
Elena Kulinskaya ◽  
...  

AbstractMeta-analysis is often used to make generalizations across all available evidence at the global scale. But how can these global generalizations be used for evidence-based decision making at the local scale, if only the local evidence is perceived to be relevant to a local decision? We show how an interactive method of meta-analysis — dynamic meta-analysis — can be used to assess the local relevance of global evidence. We developed Metadataset (www.metadataset.com) as an example of dynamic meta-analysis. Using Metadataset, we show how evidence can be filtered and weighted, and results can be recalculated, using dynamic methods of subgroup analysis, meta-regression, and recalibration. With an example from agroecology, we show how dynamic meta-analysis could lead to different conclusions for different subsets of the global evidence. Dynamic meta-analysis could also lead to a rebalancing of power and responsibility in evidence synthesis, since evidence users would be able to make decisions that are typically made by systematic reviewers — decisions about which studies to include (e.g., critical appraisal) and how to handle missing or poorly reported data (e.g., sensitivity analysis). We suggest that dynamic meta-analysis could be scaled up and used for subject-wide evidence synthesis in several scientific disciplines (e.g., agroecology and conservation biology). However, the metadata that are used to filter and weight the evidence would need to be standardized within disciplines.

BMC Biology ◽  
2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Gorm E. Shackelford ◽  
Philip A. Martin ◽  
Amelia S. C. Hood ◽  
Alec P. Christie ◽  
Elena Kulinskaya ◽  
...  

Abstract Background Meta-analysis is often used to make generalisations across all available evidence at the global scale. But how can these global generalisations be used for evidence-based decision making at the local scale, if the global evidence is not perceived to be relevant to local decisions? We show how an interactive method of meta-analysis—dynamic meta-analysis—can be used to assess the local relevance of global evidence. Results We developed Metadataset (www.metadataset.com) as a proof-of-concept for dynamic meta-analysis. Using Metadataset, we show how evidence can be filtered and weighted, and results can be recalculated, using dynamic methods of subgroup analysis, meta-regression, and recalibration. With an example from agroecology, we show how dynamic meta-analysis could lead to different conclusions for different subsets of the global evidence. Dynamic meta-analysis could also lead to a rebalancing of power and responsibility in evidence synthesis, since evidence users would be able to make decisions that are typically made by systematic reviewers—decisions about which studies to include (e.g. critical appraisal) and how to handle missing or poorly reported data (e.g. sensitivity analysis). Conclusions In this study, we show how dynamic meta-analysis can meet an important challenge in evidence-based decision making—the challenge of using global evidence for local decisions. We suggest that dynamic meta-analysis can be used for subject-wide evidence synthesis in several scientific disciplines, including agroecology and conservation biology. Future studies should develop standardised classification systems for the metadata that are used to filter and weight the evidence. Future studies should also develop standardised software packages, so that researchers can efficiently publish dynamic versions of their meta-analyses and keep them up-to-date as living systematic reviews. Metadataset is a proof-of-concept for this type of software, and it is open source. Future studies should improve the user experience, scale the software architecture, agree on standards for data and metadata storage and processing, and develop protocols for responsible evidence use.


2021 ◽  
pp. 232949652110288
Author(s):  
Meaghan Stiman

In theory, participatory democracies are thought to empower citizens in local decision-making processes. However, in practice, community voice is rarely representative, and even in cases of equal representation, citizens are often disempowered through bureaucratic processes. Drawing on the case of a firearm discharge debate from a rural county’s municipal meetings in Virginia, I extend research about how power operates in participatory settings. Partisan political ideology fueled the debate amongst constituents in expected ways, wherein citizens engaged collectivist and individualist frames to sway the county municipal board ( Celinska 2007 ). However, it was a third frame that ultimately explains the ordinance’s repeal: the bureaucratic frame, an ideological orientation to participatory processes that defers decision-making to disembodied abstract rules and procedures. This frame derives its power from its depoliticization potential, allowing bureaucrats to evade contentious political debates. Whoever is best able to wield this frame not only depoliticizes the debate to gain rationalized legitimacy but can do so in such a way to favor a partisan agenda. This study advances gun research and participatory democracy research by analyzing how the bureaucratic frame, which veils partisanship, offers an alternative political possibility for elected officials, community leaders, and citizens to adjudicate partisan debates.


Health Policy ◽  
2008 ◽  
Vol 87 (3) ◽  
pp. 342-349 ◽  
Author(s):  
Anke Richter ◽  
Katherine A. Hicks ◽  
Stephanie R. Earnshaw ◽  
Amanda A. Honeycutt

2013 ◽  
Vol 8 (1) ◽  
pp. 71-94
Author(s):  
Rolv Lyngstad

The point of departure of this article is contemporary changes in the relationship between national and local decision making in the Norwegian political system. The last decades’ centralization tendencies seem to be challenged by a “new” emphasis on local discretion, and the article discusses how this will affect social work in municipalities. The changes are contested and controversial and allude to questions such as how much discretion should be given to local decision makers in the name of local democracy, and how much difference should be accepted in the name of diversity? The article argues that professional social work must be context-specific, meaning that in a wide sense local knowledge is a prerequisite for good social work. Devolution and local political and professional discretion are necessary in many cases, but not sufficient in themselves as conditions for success. Professional social workers will encounter a lot of difficult dilemmas arousing from issues related to the equality/liberty debate and the diversity/difference/equality debate in social work discourses. In order to approach these dilemmas, more of a focus on local deliberation and place shaping, in combination with a social work focus on democratic professionalism, is necessary. If this is done successfully, devolution and a recapturing of local discretion and decision-making power will empower clients as well as professionals. Thus, current changes in the relationship between different levels of decision making will enlarge the possibilities for professional social work in the municipalities.


2014 ◽  
Vol 136 (6) ◽  
Author(s):  
Zhenghui Sha ◽  
Jitesh H. Panchal

Research in systems engineering and design is increasingly focused on complex sociotechnical systems whose structures are not directly controlled by the designers, but evolve endogenously as a result of decisions and behaviors of self-directed entities. Examples of such systems include smart electric grids, Internet, smart transportation networks, and open source product development communities. To influence the structure and performance of such systems, it is crucial to understand the local decisions that result in observed system structures. This paper presents three approaches to estimate the local behaviors and preferences in complex evolutionary systems, modeled as networks, from its structure at different time steps. The first approach is based on the generalized preferential attachment model of network evolution. In the second approach, statistical regression-based models are used to estimate the local decision-making behaviors from consecutive snapshots of the system structure. In the third approach, the entities are modeled as rational decision-making agents who make linking decisions based on the maximization of their payoffs. Within the decision-centric framework, the multinomial logit choice model is adopted to estimate the preferences of decision-making nodes. The approaches are illustrated and compared using an example of the autonomous system (AS) level Internet. The approaches are generally applicable to a variety of complex systems that can be modeled as networks. The insights gained are expected to direct researchers in choosing the most applicable estimation approach to get the node-level behaviors in the context of different scenarios.


Sign in / Sign up

Export Citation Format

Share Document