scholarly journals Balancing Rigor, Replication, and Relevance: A Case for Multiple-Cohort, Longitudinal Experiments

AERA Open ◽  
2019 ◽  
Vol 5 (3) ◽  
pp. 233285841987625 ◽  
Author(s):  
David Blazar ◽  
Matthew A. Kraft

Over the past 15 years, the education research community has advocated for rigorous research designs that support causal inferences, for research that provides more generalizable results across settings, and for the value of research-practice partnerships that inform the design of local programs and policies. We propose the multi-cohort, longitudinal experiment (MCLE) as one approach to balancing these three, sometimes competing goals in a single study. We describe our application of an MCLE design to evaluate a teacher coaching program, where we find that changes in program features related to personnel, content, and duration coincided with substantial differences in effectiveness across three cohorts of the experiment. Our analyses and corresponding recommendations can help researchers weigh the benefits and trade-offs of the MCLE design.

2000 ◽  
Vol 31 (1) ◽  
pp. 2-4
Author(s):  
Judith T. Sowder

The beginning of a new year as well as the threshold of a new century and a new millennium seem appropriate times to take stock of where we have been and where we are going as a mathematics education research community. We have accomplished a great deal in the past half century of our existence, and I for one look forward to reading the forthcoming book on the history of mathematics education, edited by Jeremy Kilpatrick and George Stanic. That book will review for us our progress thus far, but what are the challenges we now face? This question will be addressed in various ways at various gatherings in the coming year, and new agendas will result from those discussions.


2019 ◽  
Author(s):  
Brian A. Nosek ◽  
Lucy Ofiesh ◽  
Fielding Grasty ◽  
Nicole Pfeiffer ◽  
David Thomas Mellor ◽  
...  

The Center for Open Science (COS) will create an ECR Data Resource Hub to facilitate rigorous and reproducible research practices such as data sharing and study registration. The Hub will integrate training materials, infrastructure, community engagement, and innovation in research to advance rigorous research skills and behavior across the STEM education research community. The Hub will foster innovation in open and reproducible research practices for the breadth of research activities in education including experimental, observational, longitudinal, and qualitative methods. Finally, the Hub will connect the STEM education research community with neighboring communities to leverage shared insights and knowledge building.


1973 ◽  
Vol 4 (4) ◽  
pp. 243-250
Author(s):  
John G. Harvey ◽  
Thomas A. Romberg

This overview will relate the three papers that follow to the past, the current, and the projected research related to the learning and teaching of mathematics and conducted under the auspices of the University of Wisconsin Research and Development Center for Cognitive Learning. Regular readers of JRME are already aware that several Center studies have been reported here. (Fennema, 1972; King, 1973; Romberg & Gilbert, 1972; Romberg & Shepler, 1973; Shepler, 1970; Sowder, 1971; and Steffe, 1970). No doubt in the future other Center studies will be reported in JRME, since it is a natural dissemination point for communicating selected results to the mathematics education research community.


2006 ◽  
Vol 50 (4) ◽  
pp. 203-214 ◽  
Author(s):  
Timothy A. Judge ◽  
Erin Fluegge Woolf ◽  
Charlice Hurst ◽  
Beth Livingston

Charismatische und transformationale Führung: Ein Überblick und eine Agenda für zukünftige Forschungsarbeiten Abstract. Of all the leadership theories in organizational research, charismatic/transformational leadership has captured scholars' interest most over the past decade. This article reviews what has been learned about the antecedents of charismatic and transformational leadership, their effects on individual and collective outcomes across cultures, and moderators of those effects. We conclude with a set of recommendations for moving this field of study forward, including a call for more rigorous research designs that provide greater insight into the process of transformational leadership (i.e., causal direction and mediating mechanisms), further conceptual clarifications, and further integration with other schools of leadership thought.


2020 ◽  
Vol 46 (1) ◽  
pp. 315-334 ◽  
Author(s):  
Cynthia Feliciano

Over the past two decades, a growing body of research has focused on immigrant selectivity and its effects on immigrant health, immigrant labor market outcomes, and children of immigrants’ educational outcomes. This review provides a theoretical overview of immigrant selectivity and its effects, and critically examines research on the effects of immigrant selectivity. Existing research suggests that positive immigrant selectivity helps explain paradoxical patterns of success among immigrants and their children in health, the labor market, and education. However, future research is needed that uses more rigorous research designs and measures, links immigrant selectivity and outcomes across domains, identifies the mechanisms through which immigrant selectivity matters, and considers different types of immigrant selectivity. I conclude by highlighting promising new studies along these lines and argue that immigrant selectivity is a central part of the process through which immigration contributes to inequality.


2018 ◽  
Vol 8 (4) ◽  
pp. 158 ◽  
Author(s):  
Joel Mejia ◽  
Renata Revelo ◽  
Idalis Villanueva ◽  
Janice Mejia

The field of engineering education has adapted different theoretical frameworks from a wide range of disciplines to explore issues of education, diversity, and inclusion among others. The number of theoretical frameworks that explore these issues using a critical perspective has been increasing in the past few years. In this review of the literature, we present an analysis that draws from Freire’s principles of critical andragogy and pedagogy. Using a set of inclusion criteria, we selected 33 research articles that used critical theoretical frameworks as part of our systematic review of the literature. We argue that critical theoretical frameworks are necessary to develop anti-deficit approaches to engineering education research. We show how engineering education research could frame questions and guide research designs using critical theoretical frameworks for the purpose of liberation.


Author(s):  
Lennart E. Nacke

This chapter presents the physiological metrics used in Games User Research (GUR). Aimed at GUR professionals in the games industry, it explains what methods are available to researchers to measure biometric data while subjects are engaged in play. It sets out when it is appropriate to use biometric measures in GUR projects, the kind of data generated, and the differing ways it can be analysed. The chapter also discusses the trade-offs required when interpreting physiological data, and will help games researchers to make informed decisions about which research questions can benefit from biometric methodologies. As the equipment needed to collect biometric data becomes more sophisticated as well as cheaper, physiological testing of players during a game’s development will become more common. At the same time, Games User Researchers will become more discriminating in its use. Where in the past professionals in the games industry have used biometric testing to generate quick, actionable feedback about player responses to elements of a game, and have been less concerned with the scientific robustness of their methodology, as GUR develops a new breed of games industry professionals are attempting to deploy good academic practice in their researches.


Author(s):  
Jeasik Cho

This book provides the qualitative research community with some insight on how to evaluate the quality of qualitative research. This topic has gained little attention during the past few decades. We, qualitative researchers, read journal articles, serve on masters’ and doctoral committees, and also make decisions on whether conference proposals, manuscripts, or large-scale grant proposals should be accepted or rejected. It is assumed that various perspectives or criteria, depending on various paradigms, theories, or fields of discipline, have been used in assessing the quality of qualitative research. Nonetheless, until now, no textbook has been specifically devoted to exploring theories, practices, and reflections associated with the evaluation of qualitative research. This book constructs a typology of evaluating qualitative research, examines actual information from websites and qualitative journal editors, and reflects on some challenges that are currently encountered by the qualitative research community. Many different kinds of journals’ review guidelines and available assessment tools are collected and analyzed. Consequently, core criteria that stand out among these evaluation tools are presented. Readers are invited to join the author to confidently proclaim: “Fortunately, there are commonly agreed, bold standards for evaluating the goodness of qualitative research in the academic research community. These standards are a part of what is generally called ‘scientific research.’ ”


Symmetry ◽  
2020 ◽  
Vol 13 (1) ◽  
pp. 9
Author(s):  
John H. Graham

Best practices in studies of developmental instability, as measured by fluctuating asymmetry, have developed over the past 60 years. Unfortunately, they are haphazardly applied in many of the papers submitted for review. Most often, research designs suffer from lack of randomization, inadequate replication, poor attention to size scaling, lack of attention to measurement error, and unrecognized mixtures of additive and multiplicative errors. Here, I summarize a set of best practices, especially in studies that examine the effects of environmental stress on fluctuating asymmetry.


Sign in / Sign up

Export Citation Format

Share Document