“I know it when I see it”: employing reflective practice for assessment and feedback of reflective writing in a makerspace classroom

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ofer Chen ◽  
Yoav Bergner

Purpose In reflective writing, students are encouraged to examine their own setbacks and progress. With a shortage of guidance in how to provide feedback to students on this type of writing, teachers are often left to figure it out on the job. The central hypothesis in this paper is that the lens of reflective practice can help focus teacher efforts and ultimately improve both feedback and instruction. The purpose of this paper is not to produce a universal prescription for assessing reflective writing but rather a protocol for teacher reflective practice that can apply to challenging grading and feedback-giving situations. Design/methodology/approach Student assessment is a chance for teachers to learn about their students’ abilities and challenges and to provide feedback for improvement. Assessment and grading sessions can also become opportunities for teachers to examine their own instructional and assessment practices. This self-examination process, a cornerstone of reflective practice (Schön, 1984), is challenging, but it may be especially valuable when guidelines for feedback and assessment are hard to come by. Such may be said to be the case in student-centered learning environments such as school Fablabs and makerspaces, where stated goals commonly include cultivating learner self-regulation and resilience. These hard-to-measure constructs are typically assessed through analysis of student reflective journals. This in-depth case study uses mixed-methods to examine how a semester-long intervention affected the grading, feedback and instructional practices of a teacher in a hands-on design classroom. The intervention involved 10 grade-aloud sessions using a computer-based rubric tool (Gradescope) and a culminating card-sorting task. The lens of reflective practice was applied to understanding the teacher’s development of their own reflective capabilities. Findings During the intervention, the participating teacher grappled with grading and feedback-giving dilemmas which led to clarifications of assessment objectives; changes to instruction; and improved feedback-giving practices, many of which persisted after the intervention. The teacher perceived the intervention as adding both rigor and productive “soul-searching” to their professional practice. Lasting changes in feedback behaviors included a comprehensive rubric and an increase in the frequency, specificity and depth of feedback given to student written work. Originality/value Significant prior efforts have been directed separately at the use of reflective practice for teachers, in general, and on the feedback and grading of student process journals. This work combines these lines of inquiry in the reflective classroom assessment protocol, a novel on-the-job professional development opportunity that fosters reflective practice in times of assessment to improve instructional and feedback practices.

2017 ◽  
Vol 6 (3) ◽  
pp. 233-248 ◽  
Author(s):  
Sydney Enock Msonde ◽  
Charles Enock Msonde

Purpose There have been ideological variations in the understanding of student-centered learning (SCL), culminating in varied practices of SCL across the world. The purpose of this paper is to explore the impact of learning study on teachers’ appropriation of the conditions for learning in SCL lessons. Design/methodology/approach Three secondary school mathematics teachers in Tanzania formed a learning study group, guided by the theory of variation, to share their experience of how to engage learners in experiencing critical aspects of the object of learning. In-depth interviews, records of teachers’ lesson preparation meetings, and students’ tests were tools used to collect data. All of the qualitative data were analyzed using a phenomenographic variation framework and coding strategies. Moreover, a paired sample t-test was used to analyze the students’ pre- and post-test results. Findings The results show that teachers were able to identify critical aspects of two objects of learning for mathematics and create conditions for engaging learners in experiencing those aspects sequentially and simultaneously. There was strong evidence that the theory of variation as a framework helps teachers to learn effective ways of creating conditions for students to appropriate features of the objects of learning for mathematics as well as developing a new SCL pedagogical framework. Originality/value This study suggests that using learning study guided by the theory of variation supports teachers’ appropriation of the conditions for student learning within an SCL framework.


Author(s):  
Mohamed Yassine Zarouk ◽  
Eugénio Olivera ◽  
Paula Peres ◽  
Mohamed Khaldi

Student-centered learning approaches such as project-based learning and flipped classroom stress the active role of the learner by applying knowledge rather than absorbing knowledge, and preparing higher education students for professional development. Student-centered learning environments are more effective when students regulate their learning and learn autonomously. There-fore, the purpose of this study is to examine the impact of a proposed ap-proach of flipped project-based learning on various facets of students' self-regulated learning, including motivational beliefs and learning strategies in higher education. A flipped project-based learning environment was designed and developed to improve students’ self-regulated learning skills. In this regard, multiple case studies were conducted according to a pretest-posttest quasi-experiment design to investigate the effectiveness of the proposed approach by four groups of students from different disciplines. The study employed a mixed-method research approach for data collection. Overall, the results re-vealed that the flipped project-based learning approach significantly enhanced students’ self-regulated learning skills. It was found that the approach fostered the students’ self-regulation performance among different groups across dif-ferent disciplines and levels. Moreover, participants also claimed that the approach was useful and ef-fective. The findings indicated that students who actively engaged within flipped PBL activities demonstrated increases in cognitive and metacognitive functioning both individually and collaboratively. This study contributes to an advance in the understanding of how the development of SRL can be inte-grated into a flipped project-based learning environment in higher education.


2019 ◽  
Vol 11 (4) ◽  
pp. 863-875
Author(s):  
Bobby Hoffman

Purpose The purpose of this paper is to examine the influence of peer-assessment training as a catalyst to enhance student assessment knowledge and the ability to effectively evaluate reflective journal writing assignments when using the online peer assessment (PA) tool Expertiza. Design/methodology/approach Over a two-year period, end-of-unit assessment test scores and reflective writing samples from a peer-assessment participation group were compared to a no peer-assessment control group. Analysis of covariance was used to control for existing writing skill and ongoing feedback on writing samples. Findings No significant increases were observed in student assessment knowledge when participating in peer-assessment training. Comparison of matched participant samples revealed that after controlling for existing writing skill, students participating in PA graded reflective writing assignments significantly lower than instructor-graded assessments from students not afforded peer-assessment participation. Research limitations/implications No distinction was made on the relative influence of giving or receiving PA influenced performance on the outcome measures. Second, students making multiple revisions based on feedback were not analyzed. Third, the Expertiza system does not control for the number of reviews performed, thus differential weighting of assessment outcomes may be realized unless all students submit and perform the same number of assessments. Finally, in absence of any qualitative analysis as to what factors students consider when grading writing samples, it is unknown as to how individual difference factors or adherence to scoring rubrics may have influenced the obtained results. Practical implications Students may be reticent evaluating peers or utilize grading criteria beyond the mandatory evaluation rubrics. Clear distinctions should be provided to students indicating how instructional content aligns with skills needed to conduct assessment. Training that addresses the theoretical and transactional components of PA are important, but teachers should recognize that when developing assessment skills learners undergo a developmental catharsis related to building trust and establishing a secure and comfortable identity as an assessor. Peer review systems should quantify the relative contribution of each reviewer through the measurement of frequency, timeliness and accuracy of the feedback, compared with instructor standards/evaluations. Originality/value This paper reduces the gap in the literature concerning how PA evolves over time and identifies factors related to the etiology of the peer-review process. In addition, the paper reveals new information regarding the calibration between instructor and peer evaluations.


2019 ◽  
Vol 47 (4) ◽  
pp. 461-475
Author(s):  
Irene Korber ◽  
Jodi Shepherd

Purpose The purpose of this paper is to outline the concept and creation of choose-your-own-adventure flip-books for use in teaching information literacy in higher education. Design/methodology/approach This is a conceptual paper that examines how to use choose-your-own-adventure style flip-books to teach knowledge practices from the Framework for Information Literacy for Higher Education. Using constructivist theory and active learning methods, the authors discuss how flip-books offer a hands-on learning strategy to build on students’ knowledge and experiences while promoting learner-centered interactions. Findings As academic libraries evolve from teaching bibliographic instruction via lecture to information literacy through student-centered learning, activities such as the one discussed in this paper provide a way for librarians to better engage with students. Creating curriculum based on educational theory and learner-centered approaches is necessary for librarians to use to optimize classroom time. Practical implications This paper provides a practical and pragmatic evaluation of how to incorporate narrative flip-books into information literacy instruction, providing an additional instructional tool for information literacy practitioners. Originality/value The choose-your-own-adventure story narrative has been used as a learning tool through all levels of education, including in university settings, but there is a lack of research on their use in information literacy instruction. This paper provides insight on how this teaching method and teaching tool can be used by librarians in the information literacy classroom.


Author(s):  
Julia L. Feldman ◽  
Antonio L. Freitas

Abstract. The study of the conflict-adaptation effect, in which encountering information-processing conflict attenuates the disruptive influence of information-processing conflicts encountered subsequently, is a burgeoning area of research. The present study investigated associations among performance measures on a Stroop-trajectory task (measuring Stroop interference and conflict adaptation), on a Wisconsin Card Sorting Task (WCST; measuring cognitive flexibility), and on self-reported measures of self-regulation (including impulsivity and tenacity). We found significant reliability of the conflict-adaptation effects across a two-week period, for response-time and accuracy. Variability in conflict adaptation was not associated significantly with any indicators of performance on the WCST or with most of the self-reported self-regulation measures. There was substantial covariance between Stroop interference for accuracy and conflict adaptation for accuracy. The lack of evidence of covariance across distinct aspects of cognitive control (conflict adaptation, WCST performance, self-reported self-control) may reflect the operation of relatively independent component processes.


2016 ◽  
pp. 155-180
Author(s):  
Victoria C. Coyle ◽  
Dianna L. Newman ◽  
Kenneth A. Connor

Research from the learning sciences provides evidence that students engaged in collaborative learning in authentic activities are better able to retain and transfer knowledge to alternate contexts leading educators to reexamine the role of the lecture as a dominant instructional method. The use of alternate classroom structures to create student-centered learning environments is appropriate in STEM education. This chapter presents the development of a flipped classroom in a higher education STEM course, and describes the iterative process and subsequent structure of the course over several years. Considerations when implementing a flipped model of instruction are: the degree of self-regulation required of students, methods of assessment and the relationship between online information and authentic activities that students participate in during class. Recommendations for future research directions are discussed.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Louisa Rosenheck ◽  
Grace C. Lin ◽  
Rashi Nigam ◽  
Prasanth Nori ◽  
Yoon Jeon Kim

Purpose When using embedded, student-centered assessment tools for maker education, understanding the characteristics of a body of evidence can help teachers guide the assessment process. This study aims to examine assessment artifacts from a makerspace program and present a set of qualities that emerged, which researchers and maker educators can use to evaluate the quality of evidence before interpreting it and making claims about student learning. Design/methodology/approach This study used the interpretive analysis approach to identify salient qualities in a body of evidence of maker learning. Data sources included student assessment artifacts, researchers’ analytic memos, notes on the coding and analysis process, background stories and field observations. Findings The study found that the assessment artifacts generated by students aligned with the maker-related target skills. A set of qualities was produced that can be used to describe the strength of a body of evidence and help determine whether it is appropriate to be used in the meaning making phase. Practical implications The qualities identified in this study can be directly incorporated into the embedded assessment toolkit to provide feedback on the strength of evidence for learning in makerspaces. Originality/value Assessment methods for maker education are nascent, and ways to describe the quality of a student-generated body of evidence have not yet been established. This study applies existing knowledge of embedded assessment and reflective practice toward the creation of a new way of assessing skills that are difficult to measure.


2018 ◽  
Vol 10 (4) ◽  
pp. 514-533 ◽  
Author(s):  
Saed Sabah ◽  
Xiangyun Du

Purpose Although student-centered learning (SCL) has been encouraged for decades in higher education, to what level instructors are practicing SCL strategies remains in question. The purpose of this paper is to investigate a university faculty’s understanding and perceptions of SCL, along with current instructional practices in Qatar. Design/methodology/approach A mixed-method research design was employed including quantitative data from a survey of faculty reporting their current instructional practices and qualitative data on how these instructors define SCL and perceive their current practices via interviews with 12 instructors. Participants of the study are mainly from science, technology, engineering and mathematics (STEM) field. Findings Study results show that these instructors have rather inclusive definitions of SCL, which range from lectures to student interactions via problem-based teamwork. However, a gap between the instructors’ perceptions and their actual practices was identified. Although student activities are generally perceived as effective teaching strategies, the interactions observed were mainly in the form of student–content or student-teacher, while student–student interactions were limited. Prevailing assessment methods are summative, while formative assessment is rarely practiced. Faculty attributed this lack of alignment between how SCL could and should be practiced and the reality to external factors, including students’ lack of maturity and motivation due to the Middle Eastern culture, and institutional constraints such as class time and size. Research limitations/implications The study is limited in a few ways. First regarding methodological justification the data methods chosen in this study were mainly focused on the faculty’s self-reporting. Second the limited number of participants restricts this study’s generalizability because the survey was administered in a volunteer-based manner and the limited number of interview participants makes it difficult to establish clear patterns. Third, researching faculty members raises concerns in the given context wherein extensive faculty assessments are regularly conducted. Practical implications A list of recommendations is provided here as inspiration for institutional support and faculty development activities. First, faculty need deep understanding of SCL through experiences as learners so that they can become true believers and implementers. Second, autonomy is needed for faculty to adopt appropriate assessment methods that are aligned with their pedagogical objectives and delivery methods. Input on how faculty can adapt instructional innovation to tailor it to the local context is very important for its long-term effectiveness (Hora and Ferrare, 2014). Third, an inclusive approach to faculty evaluation by encouraging faculty from STEM backgrounds to be engaged in research on their instructional practice will not only sustain the practice of innovative pedagogy but will also enrich the research profiles of STEM faculty and their institutes. Social implications The faculty’s understanding and perceptions of implementing student-centered approaches were closely linked to their prior experiences – experiencing SCL as a learner may better shape the understanding and guide the practice of SCL as an instructor. Originality/value SCL is not a new topic; however, the reality of its practice is constrained to certain social and cultural contexts. This study contributes with original and valuable insights into the gap between ideology and reality in implementation of SCL in a Middle Eastern context.


Author(s):  
Victoria C. Coyle ◽  
Dianna L. Newman ◽  
Kenneth A. Connor

Research from the learning sciences provides evidence that students engaged in collaborative learning in authentic activities are better able to retain and transfer knowledge to alternate contexts leading educators to reexamine the role of the lecture as a dominant instructional method. The use of alternate classroom structures to create student-centered learning environments is appropriate in STEM education. This chapter presents the development of a flipped classroom in a higher education STEM course, and describes the iterative process and subsequent structure of the course over several years. Considerations when implementing a flipped model of instruction are: the degree of self-regulation required of students, methods of assessment and the relationship between online information and authentic activities that students participate in during class. Recommendations for future research directions are discussed.


Sign in / Sign up

Export Citation Format

Share Document