Interaction of Theory and Practice to Assess External Validity

2016 ◽  
Vol 41 (5) ◽  
pp. 436-471 ◽  
Author(s):  
Laura C. Leviton ◽  
Mathew D. Trujillo

Background: Variations in local context bedevil the assessment of external validity: the ability to generalize about effects of treatments. For evaluation, the challenges of assessing external validity are intimately tied to the translation and spread of evidence-based interventions. This makes external validity a question for decision makers, who need to determine whether to endorse, fund, or adopt interventions that were found to be effective and how to ensure high quality once they spread. Objective: To present the rationale for using theory to assess external validity and the value of more systematic interaction of theory and practice. Methods: We review advances in external validity, program theory, practitioner expertise, and local adaptation. Examples are provided for program theory, its adaptation to diverse contexts, and generalizing to contexts that have not yet been studied. The often critical role of practitioner experience is illustrated in these examples. Work is described that the Robert Wood Johnson Foundation is supporting to study treatment variation and context more systematically. Results: Researchers and developers generally see a limited range of contexts in which the intervention is implemented. Individual practitioners see a different and often a wider range of contexts, albeit not a systematic sample. Organized and taken together, however, practitioner experiences can inform external validity by challenging the developers and researchers to consider a wider range of contexts. Researchers have developed a variety of ways to adapt interventions in light of such challenges. Conclusions: In systematic programs of inquiry, as opposed to individual studies, the problems of context can be better addressed. Evaluators have advocated an interaction of theory and practice for many years, but the process can be made more systematic and useful. Systematic interaction can set priorities for assessment of external validity by examining the prevalence and importance of context features and treatment variations. Practitioner interaction with researchers and developers can assist in sharpening program theory, reducing uncertainty about treatment variations that are consistent or inconsistent with the theory, inductively ruling out the ones that are harmful or irrelevant, and helping set priorities for more rigorous study of context and treatment variation.

2017 ◽  
Vol 38 (1) ◽  
pp. 371-391 ◽  
Author(s):  
Laura C. Leviton

Public health researchers and practitioners are calling for greater focus on external validity, the ability to generalize findings of evidence-based interventions (EBIs) beyond the limited number of studies testing effectiveness. For public health, the goal is applicability: to translate, disseminate, and implement EBIs for an impact on population health. This article is a review of methods and how they might be combined to better assess external validity. The methods include (a) better description of EBIs and their contexts; (b) combining of statistical tools and logic to draw inferences about study samples; (c) sharper definition of the theory behind the intervention and core intervention components; and (d) more systematic consultation of practitioners. For population impact, studies should focus on context features that are likely to be both important (based on program theory) and frequently encountered by practitioners. Mixed-method programs of research will allow public health to expand causal generalizations.


2011 ◽  
Vol 1 (2) ◽  
pp. 36
Author(s):  
Wan Shakizah Noor Wan Mohd Noor ◽  
Zulkiflee Daud ◽  
Mohd Faizal Mohd Isa

ABSTRACT Many best practice models exist that describe successful approaches to reward management which influence by the cultural, legal, organizational and administrative challenges in Islamic world. Thus, the decision in setting and designing reward programs in raising productivity through human effort has always been controversial. Studies that were undertaken in numerous countries have shown varying degrees of success of such practices. Even though there is a substantial amount of foreign literature on this subject, there is a paucity of information concerning the extent of such application in Malaysia. As Malaysia is a predominantly Muslim country, Islam, through national culture influences organizations. This paper is an attempt to provide further insights into the theory and practice of reward management in the local context as Malaysia is implementing Islam Hadhari’s principles in the country. The study adopts a qualitative approach. A tentative research model is developed first, based on an extensive literature review. The qualitative field study then is carried out to explore the perceptions of reward management in the Malaysian private organizations from the Islamic perspective.  Twelve Malaysian private organizations of various sizes are studied via interviews with key personnel. The paper will also contribute theoretically and practically by providing direction and suggestions in designing and implementing the reward programs for the private organizations in the Malaysian environment. KEYWORDS:                        Reward management, Islam Hadhari, Culture


2016 ◽  
Vol 4 (4) ◽  
pp. 553-575 ◽  
Author(s):  
Ming Chen ◽  
Jingyu Liu ◽  
Panpan Duan ◽  
Mulin Li ◽  
Wen Liu

Abstract Bioactive small molecules that are produced by living organisms, often referred to as natural products (NPs), historically play a critical role in the context of both medicinal chemistry and chemical biology. How nature creates these chemical entities with stunning structural complexity and diversity using a limited range of simple substrates has not been fully understood. Focusing on two types of NPs that share a highly evolvable ‘template’-biosynthetic logic, we here provide specific examples to highlight the conceptual and technological leaps in NP biosynthesis and witness the area of progress since the beginning of the twenty-first century. The biosynthesis of polyketides, non-ribosomal peptides and their hybrids that share an assembly-line enzymology of modular multifunctional proteins exemplifies an extended ‘central dogma’ that correlates the genotype of catalysts with the chemotype of products; in parallel, post-translational modifications of ribosomally synthesized peptides involve a number of unusual biochemical mechanisms for molecular maturation. Understanding the biosynthetic processes of these templated NPs would largely facilitate the design, development and utilization of compatible biosynthetic machineries to address the challenge that often arises from structural complexity to the accessibility and efficiency of current chemical synthesis.


1998 ◽  
Vol 30 (4) ◽  
pp. 631-646 ◽  
Author(s):  
P McDermott

The antagonism of neoliberalism to local intervention raises questions over the future of planning theory and practice. Recent reviews suggest planning's response to regulatory reform has been to become more flexible, although this may simply reflect nothing more than instrumental pragmatism. Drawing on regulation theory in this paper I review the reforms which have taken place in New Zealand since 1984, when New Zealand moved sharply from a form of regulation described as ‘peripheral Fordism’. Planning after Fordism risks being confined to mediating environmental relations, despite the likelihood of far-reaching social conflict and economic contradictions in the emergent form of capitalism. Two choices face planning in New Zealand; adapt to the mandate of environmental management or extend planning to confront other (social and economic) challenges in the emergent form of capitalism. The second alternative requires planners to adopt a more active and critical role than has been evident to date.


2021 ◽  
Vol 2 (1) ◽  
Author(s):  
Debra Jackson ◽  
A. S. M. Shahabuddin ◽  
Alyssa B. Sharkey ◽  
Karin Källander ◽  
Maria Muñiz ◽  
...  

AbstractUNICEF operates in 190 countries and territories, where it advocates for the protection of children’s rights and helps meet children’s basic needs to reach their full potential. Embedded implementation research (IR) is an approach to health systems strengthening in which (a) generation and use of research is led by decision-makers and implementers; (b) local context, priorities, and system complexity are taken into account; and (c) research is an integrated and systematic part of decision-making and implementation. By addressing research questions of direct relevance to programs, embedded IR increases the likelihood of evidence-informed policies and programs, with the ultimate goal of improving child health and nutrition.This paper presents UNICEF’s embedded IR approach, describes its application to challenges and lessons learned, and considers implications for future work.From 2015, UNICEF has collaborated with global development partners (e.g. WHO, USAID), governments and research institutions to conduct embedded IR studies in over 25 high burden countries. These studies focused on a variety of programs, including immunization, prevention of mother-to-child transmission of HIV, birth registration, nutrition, and newborn and child health services in emergency settings. The studies also used a variety of methods, including quantitative, qualitative and mixed-methods.UNICEF has found that this systematically embedding research in programs to identify implementation barriers can address concerns of implementers in country programs and support action to improve implementation. In addition, it can be used to test innovations, in particular applicability of approaches for introduction and scaling of programs across different contexts (e.g., geographic, political, physical environment, social, economic, etc.). UNICEF aims to generate evidence as to what implementation strategies will lead to more effective programs and better outcomes for children, accounting for local context and complexity, and as prioritized by local service providers. The adaptation of implementation research theory and practice within a large, multi-sectoral program has shown positive results in UNICEF-supported programs for children and taking them to scale.


2020 ◽  
pp. 004728752096986 ◽  
Author(s):  
Dimitrios Stylidis

Although previous research has widely acknowledged the critical role residents play in tourism, limited evidence exists on the impact their interactions with tourists have on tourists’ own image formulation and intention to return/recommend the destination to others. Grounded in the mere exposure and contact theories, this research offers insights into tourists’ destination image formation in light of their interactions with local residents and tourism employees at a destination. Two independent studies were conducted in 2019 to establish the soundness of the model; a preliminary one in the city of Kavala (n = 353) and a follow-up study on the island of Thasos (n = 397), both located in Greece. Findings suggest that interaction between the two parties positively affect cognitive, affective, and conative image, predicting 64% (study 1) and 54% (study 2) of the latter’s variance. Implications to theory and practice along with recommendations for future research are provided.


2021 ◽  
pp. 1-20
Author(s):  
Daniela Potenza

Abstract Bertolt Brecht is generally regarded as the most influential and politically engaged left-wing playwright of the Twentieth century. Traces of his theory and practice are to be found around the world, including in the works of important Egyptian playwrights of the sixties such as Yūsuf Idrīs, Naǧīb Surūr and Alfred Faraǧ. Brecht’s work and ideas did permeate the theory and practice of the three Egyptian playwrights, though even if they all shared a commitment to social issues, critics agree that the Egyptians ignored the philosophical essence of Brecht’s devices or did not have a clear ideological grounding – thus concluding that their understanding of Brecht was partial. Through a study of epic aspects of Alfred Faraǧ’s theatre, this article aims instead to highlight the transformations operated by the playwright to mould epic theatre to fit his own ideology, his aesthetic and the local context in the logic of tamṣīr (Egyptianisation).


Technology and energy sources monitoring: control, efficiency, and optimization - belong to theory and practice of monitoring. Continuous supervising, diagnosing, managing, controlling, compensating, documenting; a process of acquiring and transferring streams of information (usually source information) about the analysed object, process, and relations between the same and the environment that can be used to realize the postulated state depending on needs and knowledge available – it is sciences and practice of monitoring. The self sciences of monitoring is a specific type of social practice aimed at adequate understanding of the reality in order to control and use it with a limited range of consequences and responsibilities. In the most general terms, the purpose of each filed of science (art) is to transform the reality into an image (virtualization). Music was the oldest language; painting was the oldest writing system. A language is a constant work of mind. It is not a creation (ergon), but rather an action (energeia – activity). Nobody thinks, as regards a given word, exactly the same as another person. Understanding is at the same time misunderstanding. A theory cannot be produced out of the results of observations, it must be invented. A theory does not have to be true, but it should encourage thinking.


Sign in / Sign up

Export Citation Format

Share Document