A Preliminary Investigation of the Empirical Validity of Study Quality Appraisal

2016 ◽  
Vol 50 (1) ◽  
pp. 14-22 ◽  
Author(s):  
Bryan G. Cook ◽  
Danielle N. Dupuis ◽  
Asha K. Jitendra

When classifying the evidence base of practices, special education scholars typically appraise study quality to identify and exclude from consideration in their reviews unacceptable-quality studies that are likely biased and might bias review findings if included. However, study quality appraisals used in the process of identifying evidence-based practices for students with learning and other disabilities have not been empirically validated (e.g., studies classified as unacceptable quality shown to have different, and presumably more biased, effects than high-quality studies). Using Gersten et al.’s (2005) approach for appraising the quality of group experimental studies in special education, we examined whether (a) studies classified as unacceptable quality and high quality had meaningfully different effects and (b) unacceptable-quality studies were more likely to have outlying effects than high-quality studies among 36 group experimental studies that investigated the effectiveness of instructional practices for students with learning disabilities. Our preliminary analyses found that the effects of unacceptable-quality studies were not meaningfully different from the effects of high-quality studies. We discuss implications of these findings and call for more research to be conducted in this area.

2021 ◽  
pp. 074193252110634
Author(s):  
Gena Nelson ◽  
Sara Cothren Cook ◽  
Kary Zarate ◽  
Sarah R. Powell ◽  
Daniel M. Maggin ◽  
...  

It is crucial that special education teachers are equipped with the knowledge and skills necessary to improve outcomes for students with disabilities. Despite federal legislation and efforts of the field to identify and disseminate evidence-based practices for students with disabilities, it is uncertain whether all special education teachers provide instruction based on the best available research. To better prepare special education teachers, McLeskey et al. proposed 22 high-leverage practices (HLPs). We conducted this systematic review of meta-analyses to provide an initial investigation of the experimental evidence reporting on the effectiveness of the HLPs for students with, or at risk for, a disability. Results indicated the largest amount of evidence from meta-analyses related to intensive instruction, explicit instruction, and social skills, with few meta-analyses reporting on collaboration and assessment. The results highlighted disproportional evidence according to disability categories. Implications for future research, practice, and teacher education are discussed.


2015 ◽  
Vol 22 (2) ◽  
pp. 165-173 ◽  
Author(s):  
Jihua Chen ◽  
Teresa Chen-Keat ◽  
Mehdi Hojjati ◽  
AJ Vallee ◽  
Marc-Andre Octeau ◽  
...  

AbstractDeveloping reliable processes is one of the key elements in producing high-quality composite components using an automated fiber placement (AFP) process. In this study, both simulation and experimental studies were carried out to investigate fiber steering and cut/restart under different processing parameters, such as layup rate and compaction pressure, during the AFP process. First, fiber paths were designed using curved fiber axes with different radii. Fiber placement trials were then conducted to investigate the quality of the steered fiber paths. Furthermore, a series of sinusoidal fiber paths were fiber placed and investigated. Moreover, a six-ply laminate with cut-outs in it was manufactured in the cut/restart trials. The accuracy of the fiber cut/restart was compared at different layup rates for both one- and bi-directional layups. Experimental results show that it was possible to layup steered fiber paths with small radii of curvature (minimum 114 mm) designed for this study when the proper process condition was used. It was observed from the cut/restart trials that the quality of tow cut was independent of layup speed; however, the accuracy of tow restart was related to the layup speed. The faster the layup speed, the less accurate was the tow restart.


Author(s):  
Sergii Karnaukh

The purpose of this work is to study the known method of division of pipes by introducing a figure knife and the development of promising designs of equipment for division of pipes into measured workpieces. Based on the analysis of the actuating crank-slider mechanisms used in the equipment for division of pipes into measured workpieces, promising schemes of short-connecting rod mechanisms have been discovered that provide a local pipe section along the perimeter. The developed design of the device for dividing pipes into dimensional workpieces by the eccentric twisting method, which contains a wedge-joint mechanism in combination with a compact circular actuator, also allows to reduce energy and power costs for separation, reduce the consequences of instantaneous unloading of equipment and ensure high quality workpieces. A mathematical model of the proposed equipment was developed and the modeling of the cutting process was carried out using the DEFORM-3D software package. The analysis of the results obtained showed that in the extreme positions of the knives, jamming of the knives is possible. To eliminate jamming, it is necessary that the knives do not reach the extreme position. The adequacy of the mathematical model is confirmed by experimental studies. The error of the calculated and measured values of the torque on the cutting knife does not exceed 10%. This is due to the need for a more correct accounting of friction on the contact surfaces of the equipment. Cut tubular blanks have high geometric accuracy and high quality of the cut surface.


Author(s):  
Sebastian Jugl ◽  
Aimalohi Okpeku ◽  
Brianna Costales ◽  
Earl Morris ◽  
Golnoosh Alipour-Harris ◽  
...  

Background: Medical cannabis is available to patients by physician order in two-thirds of the United States (U.S.) as of 2020, but remains classified as an illicit substance by federal law. States that permit medical cannabis ordered by a physician typically require a diagnosed medical condition that is considered qualifying by respective state law. Objectives: To identify and map the most recently (2016-2019) published clinical and scientific literature across approved conditions for medical cannabis, and to evaluate the quality of identified recent systematic reviews. Methods: Literature search was conducted from five databases (PubMed, Embase, Web of Science, Cochrane, and ClinicalTrials.gov), with expansion and update from the National Academies of Sciences, Engineering, and Medicine’s (NASEM) comprehensive evidence review through 2016 of the health effects of cannabis on several conditions. Following consultation with experts and stakeholders, 11 conditions were identified for evidence evaluation: amyotrophic lateral sclerosis (ALS), autism, cancer, chronic pain, Crohn’s disease, epilepsy, glaucoma, HIV/AIDS, multiple sclerosis (MS), Parkinson’s disease, and posttraumatic stress disorder (PTSD). The following exclusion criteria were imposed: preclinical focus, non-English language, abstracts only, editorials/commentary, case studies/series, and non-U.S. study setting. Data extracted from studies included: study design type, outcome, intervention, sample size, study setting, and reported effect size. Studies classified as systematic reviews with or without meta-analysis were graded using the AMSTAR-2 tool by two raters to evaluate the quality of evidence, with additional raters to resolve cases of evidence grade disagreement. Results: A total of 438 studies were included after screening. Five completed randomized controlled trials (RCTs) were identified, and an additional 11 trials were ongoing, and 1 terminated. Cancer, chronic pain, and epilepsy were the most researched topic areas, representing more than two-thirds of all reviewed studies. The quality of evidence assessment for each condition suggests that few high-quality systematic reviews are available for most conditions, with the exceptions of MS, epilepsy, and chronic pain. In those areas, findings on chronic pain are mostly in alignment with the previous literature, suggesting that cannabis or cannabinoids are potentially beneficial in treating chronic neuropathic pain. In epilepsy, findings suggest that cannabidiol is potentially effective in reducing seizures in pediatric patients with drug-resistant Dravet and Lennox-Gastaut syndromes. In MS, recent high-quality systematic reviews did not include new RCTs, and are therefore not substantially expanding the evidence base. In sum, the most recent clinical evidence suggests that for most of the conditions assessed, we identified few studies of substantial rigor and quality to contribute to the evidence base. However, there are some conditions for which significant evidence suggests that select dosage forms and routes of administration likely have favorable risk-benefit ratios (i.e., epilepsy and chronic pain), with the higher quality of evidence for epilepsy driven by FDA-approved formulations for cannabis-based seizure treatments. Conclusion: The body of evidence for medical cannabis requires more rigorous evaluation before consideration as a treatment option for many conditions and evidence necessary to inform policy and treatment guidelines is currently insufficient for many conditions.


2018 ◽  
Author(s):  
Cleo Protogerou ◽  
Martin S Hagger

In this Opinion article, we argue that assessment of study quality is an important practice to promote greater precision, transparency, and evaluation of research in psychology. However, no quality appraisal tools have been developed by psychologists, for psychological research. Given the prominence of survey research in psychology, the development of appropriate means to assess the quality of survey research would yield considerable benefits to researchers conducting, and data analysts evaluating, survey research. To illustrate the longstanding problems resulting from the absence of a fit-for-purpose tool and the application of a variety of quality appraisal strategies, we provide examples from a brief summary of quality assessments from meta-analyses of psychological survey research. We conclude that a fit-for-purpose quality appraisal tool for survey studies in psychology is needed.


2013 ◽  
pp. 539-562
Author(s):  
Therese Cumming ◽  
Cathi Draper Rodríguez ◽  
Iva Strnadová

Special educators globally are adopting mobile technologies such as the iPad for use in classrooms for everything from textbook replacement to assistive technology. Despite the devices’ large potential for individualizing teaching, learning, and communication, these are relatively new technologies, and the evidence base to support their use as teaching and learning tools in special education is scarce. This chapter discusses a theoretical framework and several methods that can be used to support the use of iPads to assist students with disabilities. It also details the potential uses of iPads and their corresponding applications for students in special education.


2014 ◽  
Vol 10 (2) ◽  
pp. 363-375 ◽  
Author(s):  
Sandra Mattar ◽  
Eric B. Vogel

The efficacy of evidence-based practices with underprivileged groups and non-Western cultures has been a subject of controversy in the trauma psychology and disaster mental health literature. There has been a debate as to whether evidence based assessments and interventions work equally well for diverse populations. Resolving this controversy has been difficult in part because of the methodological challenges involved in the study of cultural mediation of psychological phenomena. The authors argue that adding qualitative research to the evidence base supporting trauma treatments, as a matter of standard practice, can fill this need. Qualitative research can provide a rigorous research basis for the identification of cultural factors to be accounted for in quantitative outcome studies, as well as a rigorous means of understanding the real-world meaning of quantitative outcome findings. This would address Evidence-based practices (EBP) advocates’ concerns about the unscientific nature of the multicultural literature’s critique, and multiculturalism advocate’s concerns about the lack of contextualism in EBP outcome studies of trauma treatments.


2017 ◽  
Vol 265 ◽  
pp. 755-761 ◽  
Author(s):  
A.K. Tingaev ◽  
M.A. Ivanov ◽  
A.M. Ulanov

We have investigated a possibility of obtaining high-quality welded joints after oxygen and plasma cutting of steel С355 without removing the heat-affected zone (HAZ), in which the changes in chemical, phase and structural compositions are observed. Numerical and experimental studies of the effect of heat input of MAG and Submerged Arc welding on the quality of welded joints are performed. In particular, it was found that when the heat input of welding is at least 6.5 kJ/cm, the metal of HAZ of the edges after cutting is heated during the welding to temperatures above Ас3, which leads to its full recrystallization. When the heat input of welding is at least 10 kJ/cm, the edges after cutting are completely melted and become a part of the welding seam metal. The presence of extensive areas of melting and recrystallization of the edges in the welding process contributes to obtaining high-quality welded joints without removing the HAZ of the edges after cutting. To verify the results of numerical studies, experimental tests of control welded joints were conducted, which showed that the values of bending angle and impact toughness of the welding seam metal and heat affected zone are significantly above the regulatory requirements to quality of welded joints, and not less than the same requirements for steel С355. The obtained results confirm the possibility of revising domestic regulatory requirements for the steel constructions production in terms of the preparation of edges for welding using technologies of thermal cutting without subsequent machining.


Author(s):  
Sergii Bilan

The chapter analyzes modern methods for constructing pseudo-random number generators based on cellular automata. Also analyzes the influence of neighborhood forms on the evolution of the functioning of cellular automata, as well as on the quality of the formation of pseudo-random bit sequences. Based on the use of various forms of the neighborhood for the XOR function, the quality of generators was analyzed using graphical tests and NIST tests. As a result of experimental studies, the optimal dimension of cellular automata and the number of heterogeneous cells were determined, which make it possible to obtain a high-quality pseudo-random bit sequence. The obtained results allowed to formulate a method for constructing high-quality pseudo-random number generators based on cellular automata, as well as to determine the necessary initial conditions for generators. The proposed generators allow to increase the length of the repetition period of a pseudo-random bit sequence.


Sign in / Sign up

Export Citation Format

Share Document