A Multimodal Mobile B2B Dialogue Interface on the iPhone

Daniel Porta, Daniel Sonntag, Robert Neßelrath

In: Proceedings of the 4th Workshop on Speech in Mobile and Pervasive Environments. Workshop on Speech in Mobile and Pervasive Environments (SIMPE-09) befindet sich in conjunction with MobileHCI '09 September 15 Bonn Germany 2009.


In this paper, we describe a mobile Business-to-Business (B2B) interaction system. The mobile device supports users in accessing a service platform. A multimodal dialogue system allows a business expert to intuitively search and browse for services in a real-world production pipeline. We implemented a distributed client-server dialogue application for natural language speech input and speech output generation. On the mobile device, we implemented a multimodal client application which comprises of a GUI for touch gestures and a three-dimensional visualization. The client is linked to an ontology-based dialogue platform and fully leverages the device`s interaction capabilities in order to provide intuitive access to the service platform while on the go.


texo_short_simpe.pdf (pdf, 457 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence