Evaluation Use Theory, Practice, and Future Research: Reflections on the Alkin and King AJE Series

2020 ◽  
Vol 41 (4) ◽  
pp. 581-602
Author(s):  
Michael Quinn Patton
Keyword(s):  
Theory Development ◽  
Operational Definition ◽  
Future Research ◽  
Complex Dynamic ◽  
Evaluation Use ◽  
Research On Evaluation ◽  
Complex Dynamic Systems ◽  
Definition Of ◽  
Context Specific ◽  
Future Theory

Marvin Alkin and Jean King published three AJE articles on evaluation use over four years, a coherent and comprehensive series covering the historical development of evaluation use, definitions and factors associated with use and misuse, and theories of evaluation use and influence, concluding with assessment of the first 50 years of use research. They conclude with recommendations for future theory development and research on evaluation. I draw a different set of conclusions and pathway forward. Where they seek a common universal operational definition of evaluation use, I propose treating use as a thick sensitizing concept that invites diversity of context-specific meanings. Where they find evaluation use theory inadequate, I argue that it is sufficient for its purpose. Where they seek more development of evaluation-specific utilization theory, I propose drawing on more established and validated theories from social sciences to explain and illuminate evaluation use as occurring in complex dynamic systems.

scholarly journals An Integrative Definition and Framework to Study Gossip

2020 ◽  
Author(s):  
Terence Daniel Dores Cruz ◽  
Annika Nieper ◽  
Martina Testori ◽  
Elena Martinescu ◽  
Bianca Beersma
Keyword(s):  
Multidimensional Scaling ◽  
Social Life ◽  
Theory Development ◽  
Building Blocks ◽  
Future Research ◽  
The Social ◽  
Definition Of ◽  
Future Theory ◽  
Conceptual Confusion

The omnipresence of workplace gossip makes understanding gossip processes imperative to grasp social life in organizations. Although gossip research has recently experienced an upsurge across the social sciences, findings regarding the consequences of gossip are conflicting. A potential reason is that gossip is conceptualized in myriad different manners in the scientific literature, causing conceptual confusion and rendering theoretical integration impossible. In order to resolve this, we systematically reviewed 6114 scientific articles on gossip and identified 324 papers that define gossip. From the definitions we extracted two essential characteristics of gossip on which there seems to be good agreement within the literature, namely (1) that gossip is communication between humans involving a sender, receiver, and target, and (2) that the target is absent or unaware of the communicated content. These formed the basis of a broad, integrative definition of gossip: a sender communicating to a receiver about a target who is absent or unaware of the content. Furthermore, our review revealed that some definitions discuss characteristics on which there is less agreement: gossip valence (from negative to neutral to positive) and formality (from informal to intermediate to formal). We propose incorporating these characteristics in a multidimensional scaling framework that can guide future research. Our broad, integrative definition of gossip and the multidimensional scaling framework provide the building blocks for a systematic, integrated knowledge base on the role of gossip in human social life, which can foster future theory development and hypothesis testing, and thereby ultimately help organizations to manage gossip.

scholarly journals An Integrative Definition and Framework to Study Gossip

2021 ◽  
pp. 105960112199288
Author(s):  
Terence D. Dores Cruz ◽  
Annika S. Nieper ◽  
Martina Testori ◽  
Elena Martinescu ◽  
Bianca Beersma
Keyword(s):  
Social Life ◽  
Theory Development ◽  
Building Blocks ◽  
Future Research ◽  
Dimensional Scaling ◽  
The Social ◽  
Definition Of ◽  
Future Theory ◽  
Conceptual Confusion

The omnipresence of workplace gossip makes understanding gossip processes imperative to understand social life in organizations. Although gossip research has recently increased across the social sciences, gossip is conceptualized in disparate ways in the scientific literature. This conceptual confusion impedes theoretical integration and providing practical advice. To resolve this, we systematically reviewed 6114 scientific articles on gossip and identified 324 articles that define gossip. From these definitions, we extracted two essential characteristics of gossip on which there seems to be agreement within the literature, namely, (1) that gossip is communication between humans involving a sender, a receiver, and a target, and (2) that the target is absent or unaware of the communicated content. These two characteristics formed the basis of a broad, integrative definition of gossip: a sender communicating to a receiver about a target who is absent or unaware of the content. Furthermore, some definitions include characteristics on which there is less agreement: gossip valence (from negative to neutral to positive) and formality (from informal to intermediate to formal). We incorporate these characteristics in a dimensional scaling framework that can guide future research. Our broad, integrative definition of gossip and the dimensional scaling framework provide the building blocks for a systematic, integrated knowledge base on the role of gossip in human social life in general as well as in organizations. This can foster future theory development and hypothesis testing, ultimately helping organizations to manage gossip.

scholarly journals Assessment of Course-Based Undergraduate Research Experiences: A Meeting Report

2014 ◽  
Vol 13 (1) ◽  
pp. 29-40 ◽  
Author(s):  
Lisa Corwin Auchincloss ◽  
Sandra L. Laursen ◽  
Janet L. Branchaw ◽  
Kevin Eagan ◽  
Mark Graham ◽  
...  
Keyword(s):  
Undergraduate Research ◽  
Biology Education ◽  
Operational Definition ◽  
Future Research ◽  
Meeting Report ◽  
Research Experience ◽  
Research Experiences ◽  
Undergraduate Research Experiences ◽  
Foundation Program ◽  
Definition Of

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a “research experience”; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.

scholarly journals An Integrative Literature Review on the Nomenclature and Definition of Dementia at a Young Age

2021 ◽  
pp. 1-26
Author(s):  
Dennis van de Veen ◽  
Christian Bakker ◽  
Kirsten Peetoom ◽  
Yolande Pijnenburg ◽  
Janne M. Papma ◽  
...  
Keyword(s):  
Symptom Onset ◽  
Operational Definition ◽  
Young Age ◽  
Future Research ◽  
International Consensus ◽  
Young Onset ◽  
Age Related ◽  
Young Onset Dementia ◽  
Age Limits ◽  
Definition Of

Background: There has been growing interest in young people living with dementia. Future research requires consensus on the terminology and operational definition of this group. Objective: The purpose of this integrative review was to explore and include all operational definitions used to define dementia at a young age. Methods: On August 14, 2020, the PubMed, Embase, Cinahl, and PsycInfo databases were searched for empirical and theoretical literature using Google. Various terms to describe and define ‘dementia’ and ‘at a young age’ were used to collect literature concerning terminology; age-related aspects, including cut-off ages and criteria; and etiologies of dementia at a young age. Results: The search yielded 6,891 empirical and 4,660 theoretical publications, resulting in the inclusion of 89 publications, including 36 publications containing an explicit discussion and 53 publications as confirmation. ‘Young-onset dementia’ was the most commonly used term of seven identified terms, in the last two decades. The age of 65 years at symptom onset was used most frequently when considering a total of six upper age limits and four criteria to define a cut-off age. Eight lower age limits and an option for subdivision based on age were included. We identified 251 different etiologies and 27 categories of etiologies. Conclusion: Despite relative consensus on the term young-onset dementia and an age at symptom onset being used as a cut-off criterion, much is still unclear concerning possible etiologies of dementia at a young age. In the current study, controversies were detected for discussion in an international consensus study.

Complex dynamic systems in students of interpreting training

2018 ◽  
Vol 13 (2) ◽  
pp. 185-207 ◽  
Author(s):  
Yanping Dong
Keyword(s):  
Dynamic Systems ◽  
Empirical Data ◽  
Self Organization ◽  
Future Research ◽  
Dynamic Systems Theory ◽  
Complex Dynamic ◽  
Initial State ◽  
Cognitive Changes ◽  
Complex Dynamic Systems ◽  
Contradictory Data

Abstract Students of interpreting training may go through drastic cognitive changes, but current empirical findings are disparate and isolated. To integrate these findings and to obtain a better understanding of interpreting training, the present article tries to reinterpret students of interpreting training as complex dynamic systems. Relying primarily on longitudinal empirical data from several existing studies, the article illustrates how the initial state of some key parameters influences the progress of the systems, how the parameters themselves evolve, and how interpreting competence develops as a result of self-organization. The hope is that a metatheoretical framework such as Dynamic Systems Theory will allow specific findings and particularistic models for interpreting training to be integrated. Moreover, this approach may allow false dichotomies in the field to be overcome and seemingly contradictory data in empirical reports to be better understood, thereby providing guidelines for future research.

Usability: Adoption, Measurement, Value

2020 ◽  
pp. 001872081989509
Author(s):  
Janine D. Mator ◽  
William E. Lehman ◽  
Wyatt McManus ◽  
Sarah Powers ◽  
Lauren Tiller ◽  
...  
Keyword(s):  
Human Factors ◽  
Theory Development ◽  
Data Interpretation ◽  
Future Research ◽  
Domain Specific ◽  
Training Materials ◽  
Aging Populations ◽  
Usability Research ◽  
Future Theory ◽  
Insight Into

Objective We searched for the application of usability in the literature with a focus on adoption, measurements employed, and demonstrated value. Five human factors domains served as a platform for our reflection, which included the last 20 years. Background As usability studies continue to accumulate, there has been only a little past reflection on usability and contributions across a variety of applications. Our research provides a background for general usability, and we target specific usability research subareas within transportation, aging populations, autistic populations, telehealth, and cybersecurity. Method “Usability” research was explored across five different domains within human factors. The goal was not to perform an exhaustive review but, rather, sample usability practices within several specific subareas. We focused on answering three questions: How was usability adopted? How was it measured? How was it framed in terms of value? Conclusion We found that usability is very domain specific. Usability benchmarking studies and empirical standards are rare. The value associated with improving usability ranged widely—from monetary benefits to saving lives. Thus, researchers are motivated to further improve usability practices. A number of data collection and interpretation challenges still call for solutions. Application Findings offer insight into the development of usability, as applied across a variety of subdomains. Our reflection ought to inform future theory development efforts. We are concerned about the lack of established benchmarks, which can help ground data interpretation. Future research should address this gap in the literature. We note that our findings can be used to develop better training materials for future usability researchers.

scholarly journals Systematic Analysis of the Current Academic Research on Social Media Marketing

2017 ◽  
Vol 64 (s1) ◽  
pp. 15-27 ◽  
Author(s):  
Martin Klepek
Keyword(s):  
Social Media ◽  
Academic Research ◽  
Theory Development ◽  
Research Field ◽  
Future Research ◽  
Systematic Analysis ◽  
Technical Ability ◽  
The Social ◽  
Communication Habits ◽  
Future Theory

Abstract With the advent of social media where customers have the technical ability to upload own content the change occurred in some of the communication habits online. This world of constant communication is a challenge for businesses as well researchers. Academic research in this area is bringing valuable insights into people attitudes and behaviour on the social media. What is the current situation and where the research field is heading is a question of high importance. This study uses the systematic approach to reviewing the literature and to show the development of publications produced at Czech universities. Although the results show an increasing number of studies, Czech research is lagging behind other similar countries. Compared with the best countries, it is lagging behind in the number of quotations per article. On the basis of these analyses, suggestions for future research that can help to promote future theory development are proposed.

Revisiting MMORPGs in Support of Learning

2019 ◽  
pp. 187-214
Author(s):  
Bodi Anderson
Keyword(s):  
Empirical Studies ◽  
Role Playing ◽  
Operational Definition ◽  
Future Research ◽  
Educational Benefits ◽  
Role Playing Games ◽  
Player Game ◽  
Recent Trends ◽  
Definition Of ◽  
Education Psychology

This enhanced chapter revisits a previous literature analysis of research on the potential educational benefits of the use of massive multiplayer online role playing games (MMORPG) by considering both changes in the medium itself and recent trends in research. Initially, a working operational definition of MMORPGs in education is considered in light of research to date with a focus on how MMORPGs differ from most video games in terms of types of player-game interaction, levels of player-player interaction, and environments in which interaction occurs. Next considering previous and current theoretical and empirical studies on MMORPGs from a variety of disciplines, including education, psychology, and linguistics, a conceptual framework for the use of MMORPGs in support of learning is created. Finally, an overview of current research trends in MMORPGs is provided, concluding with suggestions concerning future research of the use of MMORPGs in support of learning.

Theoretical Constructs and Relationships in Information Systems Research

2010 ◽  
pp. 1-17 ◽  
Author(s):  
Brent Furneaux ◽  
Michael Wade
Keyword(s):  
Information Systems ◽  
Theory Development ◽  
Future Research ◽  
Broad Perspective ◽  
Systems Research ◽  
Information Systems Research ◽  
Cumulative Learning ◽  
Future Theory ◽  
Time Information ◽  
Over Time

Constructs and the relationships between them are widely considered to be central to theory development and testing. Over time, information systems (IS) researchers have identified and explored an extensive set of relationships amongst a broad range of constructs. The result of these initiatives is a body of literature that can be considered to represent the cumulative learning of the discipline. Based on the premise that this cumulative learning is capable of providing valuable guidance to future theory development, the authors present a review and analysis of a large sample of empirical research published in two leading IS journals. The objective of this endeavor is to offer a broad perspective on the nature of the constructs and relationships explored in IS research and to develop a nomological network of the most salient relationships that can then serve to guide future research and to lend support to new and existing theory.

scholarly journals Role Ambiguity in Sport Teams

2003 ◽  
Vol 25 (4) ◽  
pp. 534-550 ◽  
Author(s):  
Mark A. Eys ◽  
Albert V. Carron ◽  
Mark R. Beauchamp ◽  
Steven R. Bray
Keyword(s):  
Role Ambiguity ◽  
A Priori ◽  
Operational Definition ◽  
General Purpose ◽  
Future Research ◽  
First Year ◽  
Individual Level ◽  
Sport Teams ◽  
Definition Of ◽  
The Individual

The general purpose of the present study was to examine the nature of role ambiguity in sport teams and to explore the construct validity of the operational definition of role ambiguity developed by Beauchamp, Bray, Eys, and Carron (2002). Role ambiguity was operationalized as a multidimensional construct (Scope of Responsibilities, Behavioral Responsibilities, Evaluation of Performance, and Consequences of Not Fulfilling Responsibilities) that occurs in two contexts, offense and defense. Consistent with the a priori hypothesis, perceptions of role ambiguity exhibited some degree of within-group consistency and group-level variability, but most of the variance in role ambiguity was seen at the individual level. Also, perceptions of role ambiguity decreased from early to late season. Finally, veteran athletes experienced less role ambiguity than first-year athletes at the beginning of the season, but not at the end. Implications of the findings and suggestions for future research are discussed.

Sign in / Sign up

Export Citation Format

Share Document