Abstract. Skilful collaborative problem-solving is becoming increasingly important in various life areas. However, researchers are still seeking ways to assess and foster this skill in individuals. In this study, we developed a computer-assisted assessment for collaborative behavior (COLBAS) following the experiment-based assessment of behavior approach (objective personality tests; Cattell, 1958 ). The instrument captures participants’ collaborative behavior in problem-solving tasks using the MicroDYN approach while participants work collaboratively with a computer-agent. COLBAS can thereby assess problem-solving and collaborative behavior expressed through communication acts. To investigate its validity, we administered COLBAS to 483 German seventh graders along with MicroDYN as a measure of individual problem-solving skills and questions regarding the motivation to collaborate. A latent confirmatory factor analysis suggested a five-dimensional construct with two problem-solving dimensions (knowledge acquisition and knowledge application) and three collaboration dimensions (questioning, asserting, and requesting). The results showed that extending MicroDYN to include collaborative aspects did not considerably change the measurement of problem-solving. Finally, students who were more motivated to collaborate interacted more with the computer-agent but also obtained worse problem-solving results.
Towards a Framework to Scaffold Problem-solving Skills in Learning Computer Programming