A PERCEPTUALLY-BASED THEORY OF MIND FOR AGENT INTERACTION INITIATION
We endow agents with the capability to open interactions based on their perception of the gaze and direction of attention of others in a virtual environment. The capability is geared towards the earliest part of interaction initiation, where agents may be at some distance from each other and may not initially have knowledge of each other's presence. An important idea in our work is that the start of interaction be initiated in a graceful manner involving exchanges of subtle cues before overt interaction commitments are made. Synthetic vision, attention and memory are used to implement the perceptually-based agent theory of mind. Theory of Mind is used to infer information about the intention of the other to interact based on their eye, head and body directions, locomotion and greeting gestures. An agent's interaction behavior is therefore driven not only by its interaction goal, but also by its theory of the goal of the other based on perception. We have implemented this system and used it to automate and evaluate social interaction behaviors between humans and agents in a virtual environment.