Publication
Modelling Spatio-Temporal Comprehension in Situated Human-Robot Dialogue as Reasoning about Intentions and Plans
Geert-Jan Kruijff; M. Brenner
In: Proceedings of the Symposium on Intentions in Intelligent Systems. Symposium on Intentions in Intelligent Systems, Stanford University, Palo Alto, CA, USA, AAAI, 3/2007.
Abstract
The article presents a cross-modal approach to modeling spatio-temporal comprehension in situated dialogue. The article proposes an approach for representing spatiotemporal-causal structure at the level of linguistically conveyed meaning, adopting the notion of event nucleus presented. In the approach, basic tense, aspect and modality can be captured, as well as aspectual coercion, and temporal sequencing. The article then discusses how the incremental construction of such linguistic representations can be combined with continuous action planning. Through cross-modal integration of action planning representations into linguistic processing, the article explores how action planning can prime selectional attention in utterance comprehension by disambiguating linguistic analyses on the basis of plan availability, and by raising expectations what action(s) may be talked about next. Furthermore, planning can complement linguistic analyses with information about spatiotemporal-causal structure established in planning inferences. This makes such inferences available for future referencing in the discourse context, yet lessening the load on dialogue comprehension for having to establish them.