Is There a (Dis-)Fluency Effect in Learning With Handwritten Instructional Texts? Evidence From Three Studies

The disfluency effect postulates that intentionally inserted desirable difficulties can have a beneficial effect on learning. Nevertheless, there is an ongoing discussion about the emergence of this effect since studies could not replicate this effect or even found opposite effects. To clarify boundary effects of the disfluency effect and to investigate potential social effects of disfluency operationalized through handwritten material, three studies (N1 = 97; N2 = 102; N3 = 103) were carried out. In all three experiments, instructional texts were manipulated in terms of disfluency (computerized font vs. handwritten font). Learning outcomes and cognitive load were measured in all experiments. Furthermore, metacognitive variables (Experiment 2 and 3) and social presence (Experiment 3) were measured. Results were ambiguous, indicating that element interactivity (complexity or connectedness of information within the learning material) of the learning material is a boundary condition that determines the effects of disfluency. When element interactivity is low, disfluency had a positive effect on learning outcomes and germane processes. When element interactivity increases, disfluency had negative impacts on learning efficiency (Experiment 2 and 3) and extraneous load (Experiment 3). In contrast to common explanations of the disfluency effect, a disfluent font had no metacognitive benefits. Social processes did not influence learning with disfluent material as well.

ACHIEVEMENT GOALS AND EXTRANEOUS LOAD PREDICT GERMANE LOAD: THE MEDIATING EFFECTS OF ACHIEVEMENT EMOTIONS

Purpose – Achievement emotions have been shown to mediate the association between achievement goals and learning performance, but no research to date has tested whether there is a similar process in predicting germane cognitive load. Based on the control-value theory of academic emotions (Pekrun, 2006), the present study tested a model to determine whether goal orientation and extraneous load were mediated by achievement emotions in predicting germane load. Methodology – This survey study involved 487 voluntary university students (N = 487; 61% women; ages 17-23) who were enrolled in a statistics class and these study participants were selected using the cluster random sampling technique. They responded to three adapted scales which were translated into Bahasa Indonesia. The scales were, namely the Achievement Goal Questionnaire (AGQ), Achievement Emotions Questionnaire (AEQ), and Cognitive Load Questionnaire. Data were collected 20 minutes before the statistics class ended and the data was then analyzed using bootstraped bias corrected (CI = 95%; N=5000) in Structural Equation Modelling (SEM). Findings – The results of the structural equation modeling indicated that a mastery-approach goal was associated with higher germane load through higher enjoyment and lower anxiety, and a performance-avoidant goal was associated with lower germane load through higher anxiety. Moreover, extraneous load was negatively associated with germane load through enjoyment, but was positively associated with germane load through anxiety. Significance – These findings have implications in educational settings: for most students with a mastery-approach goal, and enjoyable activities are helpful, as with those that increase cognitive performance in processing learning information. The present research is the first study to show that achievement goals are linked to the capacity to process learning-relevant information, in part due to the emotions the student experiences in the learning environment.

Comparing Two Subjective Rating Scales Assessing Cognitive Load During Technology-Enhanced STEM Laboratory Courses

Cognitive load theory is considered universally applicable to all kinds of learning scenarios. However, instead of a universal method for measuring cognitive load that suits different learning contexts or target groups, there is a great variety of assessment approaches. Particularly common are subjective rating scales, which even allow for measuring the three assumed types of cognitive load in a differentiated way. Although these scales have been proven to be effective for various learning tasks, they might not be an optimal fit for the learning demands of specific complex environments such as technology-enhanced STEM laboratory courses. The aim of this research was therefore to examine and compare the existing rating scales in terms of validity for this learning context and to identify options for adaptation, if necessary. For the present study, the two most common subjective rating scales that are known to differentiate between load types (the cognitive load scale by Leppink et al. and the naïve rating scale by Klepsch et al.) were slightly adapted to the context of learning through structured hands-on experimentation where elements such as measurement data, experimental setups, and experimental tasks affect knowledge acquisition. N = 95 engineering students performed six experiments examining basic electric circuits where they had to explore fundamental relationships between physical quantities based on the observed data. Immediately after the experimentation, the students answered both adapted scales. Various indicators of validity, which considered the scales’ internal structure and their relation to variables such as group allocation as participants were randomly assigned to two conditions with a contrasting spatial arrangement of the measurement data, were analyzed. For the given dataset, the intended three-factorial structure could not be confirmed, and most of the a priori-defined subscales showed insufficient internal consistency. A multitrait–multimethod analysis suggests convergent and discriminant evidence between the scales which could not be confirmed sufficiently. The two contrasted experimental conditions were expected to result in different ratings for the extraneous load, which was solely detected by one adapted scale. As a further step, two new scales were assembled based on the overall item pool and the given dataset. They revealed a three-factorial structure in accordance with the three types of load and seemed to be promising new tools, although their subscales for extraneous load still suffer from low reliability scores.

The Relationship between Attention and Extraneous Load

There has been a call in recent years for an integration of cognitive load theory into instructed second language acquisition practices to assist language learners by taking advantage of theories on human cognitive architecture. This paper seeks to move the conversation on how this integration might be achieved by presenting findings from survey data conducted with learners enrolled online courses at a cyber-university in South Korea (n = 68). Findings show a statistically significant positive relationship between distraction and extraneous load. These results are used to postulate a model for explaining the how the effects of extraneous load on attention can be integrated into second language learning theory. Pedagogic implications of this are the value of explicitly signaling key vocabulary and grammar, ensure spatial and temporal considerations are made when using multimodal instruction, and placing learners at the center of decisions on the blend of media they experience in instruction.

Subjective Measure of Cognitive Load Depends on Participants’ Content Knowledge Level

Cognitive load theory (CLT) posits the classic view that cognitive load (CL) has three-components: intrinsic, extraneous and germane. Prior research has shown that subjective ratings are valid measures of different CL subtypes. To a lesser degree, how the validity of these subjective ratings depends on learner characteristics has not been studied. In this research, we explored the extent to which the validity of a specific set of subjective measures depends upon learners’ prior knowledge. Specifically, we developed an eight-item survey to measure the three aforementioned subtypes of CL perceived by participants in a testing environment. In the first experiment (N = 45) participants categorized the eight items into different groups based on similarity of themes. Most of the participants sorted the items consistent with a threefold construct of the CLT. Interviews with a subgroup (N = 13) of participants provided verbal evidence corroborating their understanding of the items that was consistent with the classic view of the CLT. In the second experiment (N = 139) participants completed the survey twice after taking a conceptual test in a pre/post setting. A principal component analysis (PCA) revealed a two-component structure for the survey when the content knowledge level of the participants was initially lower, but a three-component structure when the content knowledge of the participants was improved to a higher level. The results seem to suggest that low prior knowledge participants failed to differentiate the items targeting the intrinsic load from those measuring the extraneous load. In the third experiment (N = 40) participants completed the CL survey after taking a test consisting of problems imposing different levels of intrinsic and extraneous load. The results reveals that how participants rated on the CL survey was consistent with how each CL subtype was manipulated. Thus, the CL survey developed is decently effective measuring different types of CL. We suggest instructors to use this instrument after participants have established certain level of relevant knowledge.

Collaborative note-taking affects cognitive load: the interplay of completeness and interaction

Studies showing improved learning performances for students who take notes collaboratively have speculated that sharing this task among group members may reduce the extraneous cognitive burden placed on each member. Therefore, a study (n = 171) was conducted in the context of a flipped scientific writing course to examine the effects of collaborative note-taking on student’s levels of cognitive load. Students in the course were divided into two groups, with members of the treatment group being directed to take collaborative notes in a shared online document and members of the control group receiving no such instructions. The study also measured the level of collaboration the collaborative note-takers engaged in, as well as the level of completeness of the notes that they produced. The results showed that, firstly, the treatment group reported higher levels of both germane and extraneous cognitive load compared to those of the control group, meaning that collaborative note-takers experienced higher levels of understanding of course content as well as increased confusion. Secondly, the level of collaboration was positively and significantly correlated with levels of germane load (understanding), but not with extraneous load (confusion). Thirdly, no correlation was found between completeness of notes and cognitive load. Accordingly, the authors suggest that collaborative note-taking is worthwhile, as the gains to students’ understanding of course content outweigh the disadvantages of increased confusion.

The Validation and Further Development of the Multidimensional Cognitive Load Scale for Physical and Online Lectures (MCLS-POL)

Cognitive load theory (CLT) has been widely used to help understand the process of learning and to design teaching interventions. The Cognitive Load Scale (CLS) developed by Leppink and colleagues has emerged as one of the most validated and widely used self-report measures of intrinsic load (IL), extraneous load (EL), and germane load (GL). In this paper we investigated an expansion of the CLS by using a multidimensional conceptualization of the EL construct that is relevant for physical and online teaching environments. The Multidimensional Cognitive Load Scale for Physical and Online Lectures (MCLS-POL) goes beyond the CLS's operationalization of EL by expanding the EL component which originally included factors related to instructions/explanations with sub-dimensions including EL stemming from noises, and EL stemming from both media and devices within the environment. Through three studies, we investigated the reliability, and internal and external validity of the MCLS-POL using the Partial Credit Model, Confirmatory Factor Analysis, and differences between students either attending a lecture physically or online (Study 2 and 3). The results of Study 1 (N = 250) provide initial evidence for the validity and reliability of the MCLS-POL within a higher education sample, but also highlighted several potential improvements which could be made to the measure. These changes were made before re-evaluating the validity and reliability of the measure in a new sample of higher education psychology students (N = 140, Study 2), and psychological testing students (N = 119, Study 3). Together the studies provide evidence for a multidimensional conceptualization cognitive load and provide evidence of the validity, reliability, and sensitivity of the MCLS-POL and provide suggestions for future research directions.

Knowledge map: a creative visual path to library guides and resources

Purpose This paper aims to indicate that library guides seem to be unfamiliar to most students or not easy to find or use. Some improvements have been made by embedding the guides in the learning management system or promoting the guides in formal library instructional classes. Are there other ways to promote or improve the use of library guides? The author proposes an exploratory visual solution to minimize this gap between library users and library guides. Design/methodology/approach Guided by the cognitive load theory, the proposed solution is a knowledge map created with Freeplane. The proposal is illustrated by comparing a sample knowledge map with its content source, a subject guide in LibGuides, via three browsing paths in locating a recommended database for a particular course on the sample subject guide website. Findings The knowledge map can display contents in different ways and provide a simple and visual layout with direct access to the library resources, which may help lessen users’ intrinsic cognitive load, minimize extraneous load or promote germane load. The map can also be beneficial to librarians for preparing teaching materials or guides management. Practical implications The proposed solution can be implemented with Freeplane based on existing library guides or created from scratch. Originality/value The proposed solution addresses a gap in the library field, where the use of knowledge maps for library services is overlooked.

Decorative animations impair recall and are a source of extraneous cognitive load

Working memory is critical for learning but has a limited capacity for processing new information in real time. Cognitive load theory is an evidence-based approach to education that seeks to minimize the extraneous (unnecessary) load on working memory to avoid overloading it. The “seductive details effect” postulates that extraneous load can come from instructional design materials that attract interest but are unrelated to, and impair, learning. Presentation packages, such as Microsoft PowerPoint, have built-in decorative animated “GIFs” that are designed to make presentations more visually appealing. The aim of the study was to investigate the effect of such “decorative” animations on learning and working memory performance. We found that students were less able to recall content presented in the presence of a decorative but relevant animation compared with a still image. This effect was found with two different topics (human physiology and enzyme kinetics). Compared with still images, students also found it harder to remember animations themselves, and the self-reported mental workload required to remember them was higher. These results show that decorative animations are seductive details and are thus a source of extraneous cognitive load.