The TPACK framework provides researchers with a robust framework for conducting research on technology integration in authentic environments, i.e., intact classrooms engaged in standards-aligned instruction. Researchers who wish to identify the value added by a promising technology-supported instructional strategy will need to assess student learning outcomes in these environments; unfortunately, collecting valid and reliable data on student learning in classroom research is extremely difficult. To date, few studies using TPACK in K-12 classrooms have included student learning outcomes in their research questions, and researchers are therefore left without models to guide their development, implementation, and analysis of assessments. This chapter draws upon the literature and our own research and assessment experiences in technology-integrated, standards-aligned classroom instruction to give examples and advice to researchers as they develop, analyze, and write up their observations of student learning outcomes. In particular, we focus on standard items, specifically multiple choice items, as an accepted (if limited) method for assessing student understanding. We seek to fill an existing gap in the literature between assessment advice for educational psychologists (who typically work outside of classroom settings) and advice given to teachers (who have lower thresholds for issues such as validity and reliability). Classroom researchers will benefit from this advice to develop, validate, and apply their own objective assessments. We focus on the content areas of science and social studies, but this advice can be applied to others as well.
Evidence for the Feedback Role of Performance Measurement Systems