Drawing on Design to Improve Evaluation of Computer Supported Collaborative Learning

This chapter addresses theoretical frameworks for the evaluation of computer-supported learning environments. It outlines the characteristics and obstacles this evaluation must face with regard to projects that design learning experiences, stressing the notion that human-computer interaction is imbedded in social context that is complex and dynamic. The authors examine how scenario-based design and program theory can contribute to the design and evaluation of computer-supported collaborative learning (CSCL) and present a case study in which both approaches are applied. Based on the revealed complementary frameworks, a compelling approach is drafted that combines both of them. Our goal is to make CSCL designers more aware of the benefits of evaluative thinking in their work and to introduce two tangible approaches to evaluation that, when implemented as a design step, can strengthen CSCL initiatives.

Thinking Out of a Bowl of Spaghetti

Online learning programs have been expanding at exponential rates. To help encourage the development of learning communities within these environments, practitioners and scholars are advocating more collaborative learning approaches. Yet, many students express reservations about learning in small groups, particularly online. In this chapter, we explore more deeply the nature of student ambivalence about online collaborative learning. Weaving the findings of case studies of online groups with research and theory in collaborative learning and group dynamics, we argue that students hold on to highly subjective and individualistic understandings of teaching and learning. These perspectives manifest themselves in their overall approach to group inquiry and decision making. To embrace a more interdependent and intersubjective perspective requires a paradigm shift among members with regard to teaching and learning, and a working through of the powerful emotional dynamics associated with group development. We conclude with suggestions for designing and facilitating online environments that addresses these issues.

Supporting Collaborative Project Teams Using Computer-Based Technologies

This chapter considers computer-supported collaborative learning within the context of a technology-supported project-based subject offered to advanced-level students in a postgraduate education program. The subject was the focus of a qualitative case study investigation that revealed how student teams worked together on an authentic project task and the role online tools play in supporting their collaboration. This chapter discusses the research and conceptual literature that informed the design of the learning environment, the nature of the research study and the relevant findings, and some of the practical implications for teachers and designers in selecting online tools to support collaborative learning.

Online Collaborative Learning in Mathematics

This chapter discusses why computer supported collaborative learning (CSCL) environments have been unsuccessful in facilitating knowledge building in mathematics. It identifies two of the major reasons why this is so and suggests these issues could be overcome by the inclusion of model-eliciting mathematical problems and comprehension modeling tools within CSCL environments. Theoretical frameworks to inform the design of these two types of artifacts are presented. The authors argue that such innovations in the design of CSCL environments are necessary for students to achieve in mathematics the kind of sustained, progressive knowledge building that can now be found in other subject areas.

Reflection and Intellectual Amplification in Online Communities of Collaborative Learning

An alternative theoretical framework for analyzing and designing computer-supported collaborative learning environments is introduced. Bateson’s theory (1973) is used as a starting point for considering in what sense the specific dialogical conditions and qualities of virtual environments may support learning. We need more stringent analytical approaches of research that relate communicative qualities of virtual contexts to qualities of the collaborative knowledge-building process. This approach suggests that new didactic and instructional methods, addressing the learner’s communicative awareness at a meta-level, need to be developed in order to fully utilize the interactive and reflective potential of online collaborative learning. A deeper understanding of the reflective nature of the online environment and its potential for enhancing intellectual amplification will give rise to the birth of new and more innovative designs of online collaborative learning.

Collaborative or Cooperative Learning?

With many educational institutions now making use of the Internet for the delivery of courses, many educators are showing interest in non-standard methodologies for teaching and learning — methodologies such as the use of online group collaborative or cooperative work. It is clearly beneficial for educators keen to introduce group learning into a tertiary environment to first familiarize themselves with the existing literature. However, much of the literature conflates the two terms, hence implementation methods and research results are hard to assess. This chapter attempts to clearly distinguish the two terms “collaborative” and “cooperative” so that they can be used appropriately and unambiguously, briefly describes the advantages and shortcomings of each, and concludes with some remarks as to the application of such methods in an online environment.

Supporting Distributed Problem-Based Learning

In this chapter we discuss possibilities and shortcomings of Internet usage for distributed problem-based learning. Several problems with the use of computer-mediated communication for collaborative learning online are identified. In our approaches we use data that is automatically tracked during computer-mediated communication and extract relevant information for feedback purposes. Partly automatically, partly manually prepared the feedback is a rich resource for learners to manage their own collaboration process as well as subsequent problem-solving processes. In a synchronous and an asynchronous distributed problem-based learning environment, we show how we applied this methodology to support learners’ motivation and problem solving. Analyses show encouraging benefits of our approach in overcoming common problems with computer-mediated communication.

Methods for Analyzing Collaboration in Online Communications

With many educational institutions now making use of the Internet for the delivery of courses, many educators are showing interest in non-standard methodologies for teaching and learning — methodologies such as the use of online group collaborative or cooperative work. It is clearly beneficial for educators keen to introduce group learning into a tertiary environment to first familiarize themselves with the existing literature. However, much of the literature conflates the two terms, hence implementation methods and research results are hard to assess. This chapter attempts to clearly distinguish the two terms “collaborative” and “cooperative” so that they can be used appropriately and unambiguously, briefly describes the advantages and shortcomings of each, and concludes with some remarks as to the application of such methods in an online environment.

Computer-Mediated Learning Groups

With the increased availability of computers and Internet technologies, computer-mediated learning environments are on the rise in both higher education and corporate sectors of society. At the same time there has been an increased awareness among educators and researchers of the importance of human interaction in the learning process. Computer-mediated groupwork is an instructional strategy that combines online technologies with human interaction. This chapter defines computer-mediated learning groups and outlines critical differences between learning groups and work groups. The chapter further explores benefits and challenges associated with using groupwork in online learning environments. Case examples and research related to (1) creating the groups, (2) structuring group activities, and (3) facilitating group interactions are provided.

Moderating Learner-Centered E-Learning

In response to the changes taking place in collaborative online learning environments, this chapter discusses how the simultaneous emergence of collaborative technologies and the learner-centered movement impacts the role of the online instructor. As part of this review, research related to online moderation and facilitation of learning is summarized. It is suggested that online instructors need to facilitate student generation and sharing of information, while assuming the role of learning coach or mentor to provide needed leadership and guidance. Finally, ten key benefits and implications of e-learning, as well as ten potential problems and solutions, are summarized to assist e-learning decision makers and instructors. Among the benefits include the permanence of the online text, the availability of online mentors, and the fostering of student idea generation. Some consistent online learning problems include learner confusion, lack of justification of student reasoning, and difficulties in grading online content. Instructors are provided with guidelines on how to take advantage of the benefits while limiting or overcoming the problems.