Design and Analysis of Experimental Research II

Author(s):  
Peter Miksza ◽  
Kenneth Elpus

This chapter introduces the reader to more possibilities for thinking about causal questions and for laying the foundational concepts necessary for conducting data analyses that correspond to more complex experimental designs. The discussion of experimental design types presented in chapter 8 is expanded to include within-subjects designs, factorial designs, mixed designs, and designs for multivariate outcomes. Prototypical examples of each design type are presented along with the typical analysis tools used for testing the associated experimental hypotheses. Hypothetical examples of research designs that are suitable for illustrating analyses with repeated-measures ANOVA, factorial or multiway ANOVA, and MANOVA (multivariate analysis of variance).

2015 ◽  
Vol 31 (2) ◽  
pp. 545 ◽  
Author(s):  
Elena Escolano-Pérez ◽  
Angel Blanco-Villaseñor

<p>The study of change in repeated measures studies or longitudinal studies (cross-sectional and/or cross-sequential) is of considerable interest in the field of developmental psychology. Qualitative and quantitative measures of interindividual and intraindividual variability can be used to capture changes in cognitive development.</p><p>In the present study, through an empirical analysis of infant cognitive development, we investigate whether or not longitudinal (cross-sectional/cross-sequential) research designs can be used interchangeably with univariate or multivariate data analysis techniques. Methodologically, longitudinal data can be processed by univariate or multivariate analysis. However, the results and their interpretation may be different, even when the necessary statistical requirements are performed. Current statistical programs incorporate techniques to test for the presence of significant differences in data, regardless of whether these are evaluated by univariate or multivariate analysis.</p>The results of this study, conducted in infants studied at three time points (18, 21 and 24 months), show that both intraindividual and interindividual variability can be detected by repeated measures analyses.


2019 ◽  
Vol 10 (3) ◽  
pp. e72-77
Author(s):  
Sandra Monteiro ◽  
Ted Xenodemetropoulos

Background: The Resident Practice Audit in Gastroenterology (RPAGE) captures assessments of knowledge, professionalism, and technical skills, in real time. This brief report describes this innovative instrument and aspects of its utility. Methods: Assessment data on colonoscopy, endoscopy, and sigmoidoscopy procedures in 2016 were submitted to a repeated measures ANOVA with six within subjects’ assessments and one between subjects’ factor of year of specialization to evaluate construct validity. The validity hypothesis tested was that more experienced residents would be rated higher than less experienced residents. Reliability was assessed using Cronbach’s alpha. Results: The proportion of completed assessments was relatively low (9 to 22%). Overall reliability was high (α >0.8). There was evidence of validity as global ratings indicated higher competence for senior residents at colonoscopy (1.6) and upper endoscopy (1.4) than for more junior residents (1.9 and 2.1 respectively). These differences were significant for both colonoscopy, (F (1, 282) = 14.8, p <0.001) and endoscopy, F (1, 136) = 56.9, p <0.001. Conclusion: These findings suggest RPAGE is an acceptable electronic log of practice data, but may not be acceptable for workplace based assessment. A key next step will be to evaluate how information collected through RPAGE can help inform resident competency committees. 


1995 ◽  
Vol 9 (2) ◽  
pp. 188-200 ◽  
Author(s):  
Noam Eyal ◽  
Michael Bar-Eli ◽  
Gershon Tenenbaum ◽  
Joan S. Pie

The aim of this study was to examine whether outcome expectations can be generalized from one defined task to other tasks. A deception paradigm was employed in which outcome expectations were manipulated. High, low, or medium expectations toward performing five tasks, which gradually increased in complexity and shared a common skill, were manipulated. Ninety adult males were randomly assigned to manipulation groups. A within-subjects repeated measures ANOVA indicated that those manipulated by medium expectations showed elevated perceptions of outcome expectations. Their performance, however, was superior only in the two tasks most similar in complexity to the initial task. On the less similar tasks, the differences among the groups were insignificant. A generalization effect can therefore be demonstrated on outcome expectations and performance to a certain degree of task complexity. Implications of the superior performance of participants manipulated to produce medium outcome expectations are discussed.


2019 ◽  
Vol 70 (4) ◽  
pp. 273-282
Author(s):  
Andrea Grus ◽  
Ivana Hromatko

AbstractChronic smokers often claim that smoking improves their cognitive abilities, such as concentration. However, scientific evidence to support this claim is scarce. Previous studies gave inconclusive results, and some of them had significant methodological flaws. Therefore, the aim of this study was to test whether smoking a single cigarette affects performance across several cognitive domains. It included a group of 22 occasional smokers aged 19–29 years. Attention, working memory, and visuospatial reasoning were assessed using a within-subjects design with a control setting. There were two separate testing sessions two days apart. Half the group started with experimental and the other half with control setting. In the experimental setting, the participants completed the first block of tasks, smoked one cigarette (with a nicotine yield of 0.5 mg), and then completed the second block of tasks. In the control setting, the procedure was the same, except that the participants had a glass of water instead of a cigarette. Repeated measures ANOVA showed no significant effects of cigarette smoking on either reaction time rates or accuracy on any of the three cognitive domains. These results suggest that, at least among young, occasional smokers, smoking does not affect cognition and the claims of its improvement are probably a result of some sort of cognitive bias.


1996 ◽  
Vol 10 (4) ◽  
pp. 446-462 ◽  
Author(s):  
Joanne MacLean ◽  
Dorothy Zakrajsek

Evaluating coaching performance based on the use of job-specific assessment criteria has been particularly problematic for college athletic departments. The purpose of this study was to assess the importance attached to six dimensions of criteria rated by administrators (n = 87) and coaches (n = 532) in the Canadian Interuniversity Athletic Union. The six dimensions were team products, personal products, direct task behaviors, indirect task behaviors, administrative maintenance behaviors, and public relation behaviors. The results of Multivariate Analysis of Variance (MÁNOVA) and repeated measures ANOVA showed that, in general, administrators and coaches held similar beliefs about the criteria important for coaching evaluation, but they had some differences in the order of importance of the dimensions. Both groups rated direct task behaviors—that is, the specific abilities or skills used directly in the day-today practice of coaching—as the most important dimension of grouped evaluation criteria.


Methodology ◽  
2012 ◽  
Vol 8 (1) ◽  
pp. 23-38 ◽  
Author(s):  
Manuel C. Voelkle ◽  
Patrick E. McKnight

The use of latent curve models (LCMs) has increased almost exponentially during the last decade. Oftentimes, researchers regard LCM as a “new” method to analyze change with little attention paid to the fact that the technique was originally introduced as an “alternative to standard repeated measures ANOVA and first-order auto-regressive methods” (Meredith & Tisak, 1990, p. 107). In the first part of the paper, this close relationship is reviewed, and it is demonstrated how “traditional” methods, such as the repeated measures ANOVA, and MANOVA, can be formulated as LCMs. Given that latent curve modeling is essentially a large-sample technique, compared to “traditional” finite-sample approaches, the second part of the paper addresses the question to what degree the more flexible LCMs can actually replace some of the older tests by means of a Monte-Carlo simulation. In addition, a structural equation modeling alternative to Mauchly’s (1940) test of sphericity is explored. Although “traditional” methods may be expressed as special cases of more general LCMs, we found the equivalence holds only asymptotically. For practical purposes, however, no approach always outperformed the other alternatives in terms of power and type I error, so the best method to be used depends on the situation. We provide detailed recommendations of when to use which method.


Author(s):  
SCOTT CLIFFORD ◽  
GEOFFREY SHEAGLEY ◽  
SPENCER PISTON

The use of survey experiments has surged in political science. The most common design is the between-subjects design in which the outcome is only measured posttreatment. This design relies heavily on recruiting a large number of subjects to precisely estimate treatment effects. Alternative designs that involve repeated measurements of the dependent variable promise greater precision, but they are rarely used out of fears that these designs will yield different results than a standard design (e.g., due to consistency pressures). Across six studies, we assess this conventional wisdom by testing experimental designs against each other. Contrary to common fears, repeated measures designs tend to yield the same results as more common designs while substantially increasing precision. These designs also offer new insights into treatment effect size and heterogeneity. We conclude by encouraging researchers to adopt repeated measures designs and providing guidelines for when and how to use them.


Author(s):  
Colton Haight ◽  
Sandra Moritz ◽  
Tanis Walch

AbstractThe relationships among the time of imagery use on performance and self-efficacy in college baseball players during a hitting task was examined. Participants (n=24) were randomly assigned to one of three imagery conditions: (a) before practice, (b) during practice, (c) after practice. A one-shot MG-M imagery intervention was used. Results from a 3 (imagery group) ×2 (pretest and posttest) repeated measures ANOVA showed only a significant time by imagery group interaction for self-efficacy (F (2, 21)=4.67, p<0.05). These findings suggest that imagery had a stronger psychological effect than physical effect.


2021 ◽  
Vol 11 (4) ◽  
pp. 162
Author(s):  
Boram No ◽  
Naya Choi

Factors of graphomotor skills may serve as indicators to determine a writer’s handwriting proficiency or acclimation to different writing surface textures. This study examines differences in children’s graphomotor skills based on types of writing medium and gender. Participants were 97 six-year-old Korean preschool children who had not received formal writing training prior to the study. Writing tasks were completed on a tablet screen and paper. Writing samples were analyzed using the Eye and Pen software to investigate spatial, temporal, and pressure exertion exhibited during the writing tasks. A repeated measures ANOVA revealed differences in graphomotor skills such as print size, writing speed, and writing pressure. Writing on a tablet screen decreased clarity of writing; print size and speed increased as the stylus slides across the tablet surface with relatively less friction, thereby decreasing the exertion of writing pressure. Analysis of writing differences according to gender indicated that boys generated larger print sizes than girls. Results suggest that while simple writing tasks may be feasible on the tablet screen, providing children with a larger writing medium and encouraging larger print sizes for writing practice, especially for boys, may be beneficial in the development of graphomotor skills among young learners.


Sign in / Sign up

Export Citation Format

Share Document