Eye-Gaze and Facial Expressions as Feedback Signals in Educational Interactions
In this chapter, the authors explore possibilities to use novel face and gaze tracking technology in educational applications, especially in interactive teaching agents for second language learning. They focus on non-verbal feedback that provides information about how well the speaker has understood the presented information, and how well the interaction is progressing. Such feedback is important in interactive applications in general, and in educational systems, it is effectively used to construct a shared context in which learning can take place: the teacher can use feedback signals to tailor the presentation appropriate for the student. This chapter surveys previous work, relevant technology, and future prospects for such multimodal interactive systems. It also sketches future educational systems which encourage the students to learn foreign languages in a natural and inclusive manner, via participating in interaction using natural communication strategies.