scholarly journals Meta-Analysis in Higher Education: An Illustrative Example Using Hierarchical Linear Modeling

2010 ◽  
Vol 52 (3) ◽  
pp. 215-244 ◽  
Author(s):  
Nida Denson ◽  
Michael H. Seltzer
2011 ◽  
Vol 44 (3) ◽  
pp. 283-295 ◽  
Author(s):  
Loan Tran ◽  
Tori Sanchez ◽  
Brenda Arellano ◽  
H. Lee Swanson

This article synthesizes the literature comparing at-risk children designated as responders and low responders to interventions in reading. The central question addressed in this review is whether individual differences in reading-related skills at pretest predict responders at posttest across a variety of interventions and sets of criteria for determining responding and low responding. A total of 13 studies met criteria for the meta-analysis, yielding 107 weighted effect sizes (ESs) at posttest ( M = .76, SE = .03, 95% confidence interval [CI] =.71, .81) and 108 weighted ESs at pretest ( M = 1.02, SE = .03, CI = 1.02, 1.13). The results showed that the magnitude of ES between responders and low responders increased from pretest to posttest on measures of reading (e.g., real word identification = 1.06 vs. 1.53, word attack = 1.10 vs. 1.28, and passage comprehension, 0.45 vs. 1.43). Hierarchical linear modeling indicated that overall posttest ESs were significantly moderated by pretest scores as well as the type of measure administered, whereas no significant moderating effects were found for number of weeks of intervention, length of sessions, number of sessions, type of intervention (one-to-one vs. small group instruction), and criteria for defining responders (cutoff, scores, discrepancy, benchmark). Overall, the synthesis suggested that regardless of type of treatment and identification criteria, response-to-intervention (RTI) conditions were not effective in mitigating learner characteristics related to pretest conditions.


Author(s):  
Engin Karadag ◽  
Ahmet Su ◽  
Hatice Ergin-Kocaturk

AbstractCOVID-19 pandemic triggered distance education in higher education. Decisions such as isolation, social distancing and quarantine made by countries unexpectedly and suddenly forced face-to-face education to change to distance education within days. All academics around the world had to move online overnight. All the educational and academic activities in higher education (courses, exams, meetings, etc.) had to be conducted online in a few days. Based on these changes, this study aimed to analyze the relationships among student, faculty (adaptations of faculty members to distance education) and institutional (distance learning capacities of the universities) variables that affected satisfaction of the students related to distance education in higher education institutions in Turkey during COVID-19 pandemic using hierarchical linear modeling (HLM). The study group included 14,962 students and 3631 academics from 30 universities. The results showed that universities with higher distance education capacities got higher satisfaction scores. HLM analysis showed that 43% of the variation in satisfaction scores resulted from universities. The second HLM analysis showed that 44% of the overall satisfaction score variance of the students could be explained by the factors of university features (Level 2: distance education capacity and acceptance and use of distance education systems of faculty members). Thus, it was determined that 44% of the university factor calculated as 43% in Model 1 (which is calculated within students’ general satisfaction scores) resulted from the distance education capacity and the acceptance and use of distance education systems of faculty members. The findings of this study provide insights to improve distance education by stakeholders of higher education institutions.


Author(s):  
Roar Abalos Callaman ◽  
Estela Corro Itaas

Over the years, there have been several studies exploring the factors affecting mathematics achievement. However, no study, specifically in the Mindanao context has attempted to summarize or illustrate the model for these sets of studies. This study aims to analyze the overall effect size of the factors on the student’s achievement in mathematics. The causal-comparative research design was utilized to synthesize the existing research about the student-related, teacher-related, and school-related factors that have -greatly influenced students’ mathematics achievement. Through the use of a multi-stage sampling design, 200 existing studies were funneled down to 50 with 158 effect sizes which met the inclusion criteria coming from the different colleges and universities in Mindanao. To determine the significant factors be included in the model that significantly influence students’ achievement, Hierarchical Linear Modeling (HLM) was utilized. The findings revealed that the overall effect sizes have a small effect on mathematics achievement. On the other hand, mathematical skills, attitude, and self-efficacy are found to be the predictors of students’ mathematical achievement. Further, it was concluded that the type of school where the student is studying could cause significant variation in the effect sizes. It is recommended that educational institutions may review regularly the curriculum addressing the disparity of achievement between public and private schools. Also, teachers may utilize varied teaching strategies so that students would develop interest and positive learning attitudes towards mathematics.


2012 ◽  
Vol 37 (2) ◽  
pp. 55-77 ◽  
Author(s):  
Nicholas A. Gage ◽  
Timothy J. Lewis ◽  
Janine P. Stichter

Of the myriad practices currently utilized for students with disabilities, particularly students with or at risk for emotional and/or behavioral disorder (EBD), functional behavior assessment (FBA) is a practice with an emerging solid research base. However, the FBA research base relies on single-subject design (SSD) and synthesis has relied on literature review or analyses using nonparametric effect size calculations. This study was designed to examine the omnibus effect that FBA-based interventions have on problem behaviors for students with or at risk for EBD in schools using a hierarchical linear modeling meta-analytic approach to SSD synthesis. Based on a sample of 69 FBA studies, 146 subjects, and 206 outcome graphs, results indicated that, overall, FBA-based interventions reduced problem behavior by an average of 70.5% and that the procedure was effective across all student characteristics. Differences of effectiveness were evident between functional analysis and descriptive assessment procedures. Findings of this study suggest that FBA-based interventions for students with or at risk for EBD are an effective approach for the reduction of problem behaviors.


2021 ◽  
pp. 014544552110021
Author(s):  
Mariola Moeyaert ◽  
Panpan Yang ◽  
Xinyun Xu ◽  
Esther Kim

Hierarchical linear modeling (HLM) has been recommended as a meta-analytic technique for the quantitative synthesis of single-case experimental design (SCED) studies. The HLM approach is flexible and can model a variety of different SCED data complexities, such as intervention heterogeneity. A major advantage of using HLM is that participant and-or study characteristics can be incorporated in the model in an attempt to explain intervention heterogeneity. The inclusion of moderators in the context of meta-analysis of SCED studies did not yet receive attention and is in need of methodological research. Prior to extending methodological work validating the hierarchical linear model including moderators at the different levels, an overview of characteristics of moderators typically encountered in the field is needed. This will inform design conditions to be embedded in future methodological studies and ensure that these conditions are realistic and representative for the field of SCED meta-analyses. This study presents the results of systematic review of SCED meta-analyses, with the particular focus on moderator characteristic. The initial search yielded a total of 910 articles and book chapters. After excluding duplicate studies and non peer-reviewed studies, 658 unique peer-reviewed studies were maintained and screened by two independent researchers. Sixty articles met the inclusion criteria and were eligible for data retrieval. The results of the analysis of moderator characteristics retrieved from these 60 meta-analyses are presented. The first part of the results section contains an overview of moderator characteristics per moderator level (within-participant level, participant level, and study level), including the types of moderators, the ratio of the number of moderators relative to the number of units at that level, the measurement scale, and the degree of missing data. The second part of the results section focuses on the metric used to quantify moderator effectiveness and the analysis approach. Based on the results of the systematic review, recommendations are given for conditions to be included in future methodological work.


2009 ◽  
Vol 79 (4) ◽  
pp. 1362-1390 ◽  
Author(s):  
H. Lee Swanson ◽  
Ching-Ju Hsieh

This article synthesizes the experimental literature that compares the academic, cognitive, and behavioral performance of adults with reading disabilities to those of average-achieving adult readers. The central question posed by this review is to what extent and in what manner do adults with reading disabilities differ from adults without reading disabilities on measures assumed to relate to overall reading competence. In all, 52 studies met criteria for a meta-analysis, yielding 776 effect sizes (ESs) with an overall a weighted ES of 0.72 ( SD = 0.54). Moderate to high ESs in favor of adults without reading disabilities emerged on measures of cognition (naming speed [ M = 0.96], phonological processing [ M = 0..87], verbal memory [ M = 0.62]) and achievement (word attack [ M = 1.33], math [ M = 0.75], vocabulary [ M = 0.71], spelling [ M = 1.57], and writing [ M = 0.72]). Hierarchical linear modeling indicated that verbal IQ, vocabulary, math, spelling, and specific cognitive process measures (naming speed, phonological processing, and verbal memory) significantly moderated overall group ES differences. Significantly larger ESs emerged for studies with relatively higher IQ scores when compared to studies with IQ and reading scores in the same low range. Overall, the results support the notion that reading achievement and cognitive deficits in adults with reading disabilities are persistent across age.


2019 ◽  
Vol 18 (2) ◽  
pp. 106-111
Author(s):  
Fong-Yi Lai ◽  
Szu-Chi Lu ◽  
Cheng-Chen Lin ◽  
Yu-Chin Lee

Abstract. The present study proposed that, unlike prior leader–member exchange (LMX) research which often implicitly assumed that each leader develops equal-quality relationships with their supervisors (leader’s LMX; LLX), every leader develops different relationships with their supervisors and, in turn, receive different amounts of resources. Moreover, these differentiated relationships with superiors will influence how leader–member relationship quality affects team members’ voice and creativity. We adopted a multi-temporal (three wave) and multi-source (leaders and employees) research design. Hypotheses were tested on a sample of 227 bank employees working in 52 departments. Results of the hierarchical linear modeling (HLM) analysis showed that LLX moderates the relationship between LMX and team members’ voice behavior and creative performance. Strengths, limitations, practical implications, and directions for future research are discussed.


Sign in / Sign up

Export Citation Format

Share Document