10506 Background: Proliferating knowledge domains have prompted medical schools to reconsider how best to facilitate multidisciplinary learning. Concept maps promote knowledge retention and integration; however, the feasibility and utility of integrating concept maps into a medical student oncology curriculum as a learning and assessment tool have not previously been described. Methods: In 2015-2016, all 152 second-year University of California, San Francisco (UCSF) medical students in a hematology/oncology course produced a concept map about a single cancer type over four weeks. Two of three graders independently scored each map using a standard rubric. We used linear regression to calculate the Pearson correlation coefficient between graders and between concept map scores and preclinical examination scores, USMLE Step 1 scores, and clerkship grades. We sent course evaluations to 50 randomly selected students (as is typical in the UCSF curriculum) and performed an inductive content analysis of open-ended comments about concept mapping. Results: We graded all 152 concept maps. Inter-rater reliability was excellent ( r = 0.95 or greater between the graders). Concept map scores did not correlate with preclinical or clinical performance. 43 of 50 students (86%) rated the helpfulness of concept mapping on a 5-point agreement scale (1=strongly disagree; 5=strongly agree). The median rating was 3, and the mean (SD) rating was 2.81 (1.44). 22 of 50 (44%) students submitted comments about concept mapping. Some (9 of 22) found concept mapping useful, expressing themes such as “learning the material better” and delving into the “details.” Others (7 of 22) did not, expressing themes such as preferring “other study methods” and feeling that concept mapping was “busy work” or “stressful.” Conclusions: Integrating concept maps into a medical student oncology curriculum was feasible, and we demonstrated reliability evidence as an assessment tool. Future studies should explore whether integrating concept maps earlier in medical school, producing multiple concept maps over time with training and feedback, or developing concept maps collaboratively may increase utility as a learning and assessment tool.
Exploring Concept Mapping as a Diagnostic and Predictive Assessment Tool in Pre-Service EFL Teacher Education
