scholarly journals Does Assessment of Self-Regulated Learning and Metacognition in Surgical Residents Provide Insight to Performance on High Stakes Standardized Examinations? A Pilot Study

2015 ◽  
Vol 2 (8) ◽  
Author(s):  
Jack Contessa
2020 ◽  
Author(s):  
Raquel Medina ◽  
Daniel David Álamo-Arce ◽  
Felipe Rodríguez de Castro ◽  
Dario Cecilio Fernandez ◽  
John Sandars ◽  
...  

Abstract Background Students require feedback on their self-regulated learning (SRL) processes to improve the performance of clinical examinations. The key SRL processes used by students can be identified by SRL-micro-analysis but, this method has not been previously applied to physiotherapy students. The aim of this pilot study was to test a research design that might allow the evaluation of the potential usefulness of SRL microanalysis for the identification of key SRL processes used by physiotherapy students during the performance of a clinical examination skill.. The objectives of the pilot study were: 1) to evaluate whether SRL-microanalysis could identify differences in the use of SRL processes between successful and unsuccessful students; 2) to evaluate the reliability of SRL microanalysis ratings produced by different assessors.Methods SRL-microanalysis was used with second year physiotherapy students of a Spanish university (n= 26) as they performed a goniometric task. The task required students to obtain a goniometric measurement of the shoulder joint of a peer. Two assessors evaluated student performance and conducted the SRL- microanalysis with all students. An analysis of inter-rater reliability was performed to evaluate the degree of agreement between assessors. Results The SRL-microanalysis revealed differences in the use of key SRL processes between successful (n= 15: 57.0%) and unsuccessful performers (n= 11: 43.0%): The differences were particularly evident in strategic planning and self-monitoring skills. There was good inter-rater reliability for scoring of strategic planning (k=0.792), self-monitoring (k=0.946) and self-evaluation (k=0.846).Conclusion The use of SRL microanalysis characterized the key SRL processes of physiotherapy students performing a clinical skill with reliability between the assessors. This pilot study supports the potential usefulness of SRL-microanalysis for the identification of key SRL processes in physiotherapy education. Therefore, this study paves the way to the development of a full study, with a larger number of students and more diverse clinical tasks, to evaluate the SRL processes in successful and unsuccessful students.


2020 ◽  
Author(s):  
Raquel Irina Medina-Ramírez ◽  
Daniel David Álamo-Arce ◽  
Felipe Rodríguez-Castro ◽  
Dario Cecilio-Fernandes ◽  
John Sandars ◽  
...  

Abstract Background Students require feedback on their self-regulated learning (SRL) processes to improve the performance of clinical examinations. The key SRL processes used by students can be identified by SRL-micro-analysis but, this method has not been previously applied to physiotherapy students. The aim of this pilot study was to test a research design that might allow the evaluation of the potential usefulness of SRL microanalysis for the identification of key SRL processes used by physiotherapy students during the performance of a clinical examination skill. The objectives of the pilot study were: 1) to evaluate whether SRL-microanalysis could identify differences in the use of SRL processes between successful and unsuccessful students; 2) to evaluate the reliability of SRL microanalysis ratings produced by different assessors.Methods SRL-microanalysis was used with second year physiotherapy students of a Spanish university (n= 26) as they performed a goniometric task. The task required students to obtain a goniometric measurement of the shoulder joint of a peer. Two assessors evaluated student performance and conducted the SRL- microanalysis with all students. An analysis of inter-rater reliability was performed to evaluate the degree of agreement between assessors. Results The SRL-microanalysis revealed differences in the use of key SRL processes between successful (n= 15: 57.0%) and unsuccessful performers (n= 11: 43.0%): The differences were particularly evident in strategic planning and self-monitoring skills. There was good inter-rater reliability for scoring of strategic planning (k=0.792), self-monitoring (k=0.946) and self-evaluation (k=0.846).Conclusion The use of SRL microanalysis characterized the key SRL processes of physiotherapy students performing a clinical skill with reliability between the assessors. This pilot study supports the potential usefulness of SRL-microanalysis for the identification of key SRL processes in physiotherapy education. Therefore, this study paves the way to the development of a full study, with a larger number of students and more diverse clinical tasks, to evaluate the SRL processes in successful and unsuccessful students.


2019 ◽  
Vol 25 (2) ◽  
pp. 441-456 ◽  
Author(s):  
Suzanne Schut ◽  
Jan van Tartwijk ◽  
Erik Driessen ◽  
Cees van der Vleuten ◽  
Sylvia Heeneman

Abstract Low-stakes assessments are theorised to stimulate and support self-regulated learning. They are feedback-, not decision-oriented, and should hold little consequences to a learner based on their performance. The use of low-stakes assessment as a learning opportunity requires an environment in which continuous improvement is encouraged. This may be hindered by learners’ perceptions of assessment as high-stakes. Teachers play a key role in learners’ assessment perceptions. By investigating assessment perceptions through an interpersonal theory-based perspective of teacher–learner relationships, we aim to better understand the mechanisms explaining the relationship between assessment and learning within medical education. First, twenty-six purposefully selected learners, ranging from undergraduates to postgraduates in five different settings of programmatic assessment, were interviewed about their assessment task perception. Next, we conducted a focussed analysis using sensitising concepts from interpersonal theory to elucidate the influence of the teacher–learner relationship on learners’ assessment perceptions. The study showed a strong relation between learners’ perceptions of the teacher–learner relationship and their assessment task perception. Two important sources for the perception of teachers’ agency emerged from the data: positional agency and expert agency. Together with teacher’s communion level, both types of teachers’ agency are important for understanding learners’ assessment perceptions. High levels of teacher communion had a positive impact on the perception of assessment for learning, in particular in relations in which teachers’ agency was less dominantly exercised. When teachers exercised these sources of agency dominantly, learners felt inferior to their teachers, which could hinder the learning opportunity. To utilise the learning potential of low-stakes assessment, teachers are required to stimulate learner agency in safe and trusting assessment relationships, while carefully considering the influence of their own agency on learners’ assessment perceptions. Interpersonal theory offers a useful lens for understanding assessment relationships. The Interpersonal Circumplex provides opportunities for faculty development that help teachers develop positive and productive relationships with learners in which the potential of low-stakes assessments for self-regulated learning is realised.


2018 ◽  
Vol 10 (4) ◽  
pp. 95 ◽  
Author(s):  
Sophia C. Weissgerber ◽  
Marc-André Reinhard

Whether or not test-anxious students leverage the power of testing as potent learning tool is unclear. In a pilot study we investigated the relation of test anxiety to the utilization of testing activities and academic performance in self-regulated learning. We hypothesized that increased cognitive test anxiety would relate to less self-reported use of self-testing in favor of repetition strategies, and thus relate in turn to lower self-reported exam grades. To examine this idea, we created a scale contrasting self-testing and repetition strategies, which showed sufficient preliminary reliability and validity. The findings support our notion with respect to the cognitive interference component of test anxiety: More interference was associated with less self-testing, and the link of interference with exam grades was fully mediated by the reported degree of self-testing. Although our findings are preliminary and limited in generalizability due to small sample size and lack of factor analysis of the created scale, the results hint at one potential reason why test-anxious students may underperform. Consequently, educators might motivate their test-anxious students to rely more on effective study approaches.


2018 ◽  
Vol 34 (3) ◽  
pp. 193-205 ◽  
Author(s):  
Julia Steinbach ◽  
Heidrun Stoeger

Abstract. We describe the development and validation of an instrument for measuring the affective component of primary school teachers’ attitudes towards self-regulated learning. The questionnaire assesses the affective component towards those cognitive and metacognitive strategies that are especially effective in primary school. In a first study (n = 230), the factor structure was verified via an exploratory factor analysis. A confirmatory factor analysis with data from a second study (n = 400) indicated that the theoretical factor structure is appropriate. A comparison with four alternative models identified the theoretically derived factor structure as the most appropriate. Concurrent validity was demonstrated by correlations with a scale that measures the degree to which teachers create learning environments that enable students to self-regulate their learning. Retrospective validity was demonstrated by correlations with a scale that measures teachers’ experiences with self-regulated learning. In a third study (n = 47), the scale’s concurrent validity was tested with scales measuring teachers’ evaluation of the desirability of different aspects of self-regulated learning in class. Additionally, predictive validity was demonstrated via a binary logistic regression, with teachers attitudes as predictor on their registration for a workshop on self-regulated learning and their willingness to implement a seven-week training program on self-regulated learning.


Sign in / Sign up

Export Citation Format

Share Document