Speech Driven Interaction in Mobile Multimodality

This chapter introduces a possible architecture for building mobile multimodal applications and our experiences in this domain. Mobile devices are becoming increasingly powerful and sophisticated and their use more and more diffused; the need for new and complex services has consequently amplified. New generation mobile applications must be able to manage convenient inputs and outputs modes to make the dialog natural, intuitive, and user centric. Simultaneous use of complementary communication channels (multimodality), such as voice, keyboard, stylus, leads to a more complicated input processing system but it’s a way to simplify the interaction. A speech driven interaction between user and service delivery systems may be the ideal solution for the development of ubiquitous and context aware applications: besides being a very instinctive and convenient way to express complex questions, speech is also the best option when eyes and hands are busy.