Quality criteria for design research: Evidence and commitments

2006 ◽  
pp. 119-130

2017 ◽  
Vol 102 (1) ◽  
pp. 37-61 ◽  
Author(s):  
Beng Huat See

With the push for evidence-informed policy and practice, schools and policy makers are now increasingly encouraged and supported to use and enagage with research evidence. This means that consumers of research will now need to be discerning in judging the quality of research evidence that will inform their decisions. This paper evaluates the quality of evidence behind some well-known education programmes using examples from previous reviews of over 5,000 studies on a range of topics. It shows that much of the evidence is weak, and fundamental flaws in research are not uncommon. This is a serious problem if teaching practices and important policy decisions are made based on such flawed evidence. Lives may be damaged and opportunities missed. The aim of this paper is to show how widespread this problem is and to suggest ways by which the quality of education research may be improved. For example, funders of research and research bodies need to insist on quality research and fund only those that meet the minimum quality criteria. Journal editors and reviewers need to be cognizant of fundamental flaws in research and reject such submissions. One way to do this is to encourage submission of the research design and research protocol prior to acceptance, so acceptance or rejection is based on the design and not on the outcomes. This helps prevent publication bias and biased reporting. Individual researchers can improve quality by making it their moral responsibility to be truthful and transparent.



2020 ◽  
Vol 29 (2) ◽  
pp. 688-704
Author(s):  
Katrina Fulcher-Rood ◽  
Anny Castilla-Earls ◽  
Jeff Higginbotham

Purpose The current investigation is a follow-up from a previous study examining child language diagnostic decision making in school-based speech-language pathologists (SLPs). The purpose of this study was to examine the SLPs' perspectives regarding the use of evidence-based practice (EBP) in their clinical work. Method Semistructured phone interviews were conducted with 25 school-based SLPs who previously participated in an earlier study by Fulcher-Rood et al. 2018). SLPs were asked questions regarding their definition of EBP, the value of research evidence, contexts in which they implement scientific literature in clinical practice, and the barriers to implementing EBP. Results SLPs' definitions of EBP differed from current definitions, in that SLPs only included the use of research findings. SLPs seem to discuss EBP as it relates to treatment and not assessment. Reported barriers to EBP implementation were insufficient time, limited funding, and restrictions from their employment setting. SLPs found it difficult to translate research findings to clinical practice. SLPs implemented external research evidence when they did not have enough clinical expertise regarding a specific client or when they needed scientific evidence to support a strategy they used. Conclusions SLPs appear to use EBP for specific reasons and not for every clinical decision they make. In addition, SLPs rely on EBP for treatment decisions and not for assessment decisions. Educational systems potentially present other challenges that need to be considered for EBP implementation. Considerations for implementation science and the research-to-practice gap are discussed.



2014 ◽  
Vol 19 (4) ◽  
pp. 227-236 ◽  
Author(s):  
Arnold B. Bakker

This article presents an overview of the literature on daily fluctuations in work engagement. Daily work engagement is a state of vigor, dedication, and absorption that is predictive of important organizational outcomes, including job performance. After briefly discussing enduring work engagement, the advantages of diary research are discussed, as well as the concept and measurement of daily work engagement. The research evidence shows that fluctuations in work engagement are a function of the changes in daily job and personal resources. Particularly on the days that employees have access to many resources, they are able to cope well with their daily job demands (e.g., work pressure, negative events), and likely interpret these demands as challenges. Furthermore, the literature review shows that on the days employees have sufficient levels of job control, they proactively try to optimize their work environment in order to stay engaged. This proactive behavior is called job crafting and predicts momentary and daily work engagement. An important additional finding is that daily engagement has a reciprocal relationship with daily recovery. On the days employees recover well, they feel more engaged; and engagement during the day is predictive of subsequent recovery. Finding the daily balance between engagement while at work and detachment while at home seems the key to enduring work engagement.











2011 ◽  
Author(s):  
Roger N. Reeb ◽  
Susan F. Folger ◽  
Anne L. Steel ◽  
Sara E. Mason ◽  
Laura E. Stayton ◽  
...  


Sign in / Sign up

Export Citation Format

Share Document