Publication
Look What I Made It Do - The ModelIT Method for Manually Modeling Nonverbal Behavior of Socially Interactive Agents
Anna Lea Reinwarth; Tanja Schneeberger; Fabrizio Nunnari; Patrick Gebhard; Uwe Altmann; Janet Weßler
In: Companion Publication of the 25th International Conference on Multimodal Interaction. Generation and Evaluation of Non-verbal Behaviour for Embodied Agents Workshop (GENEA-2023), located at 25th ACM International Conference on Multimodal Interaction, October 9-13, Paris, France, ICMI '23 Companion, ISBN 9798400703218, Association for Computing Machinery, 10/2023.
Abstract
Nonverbal behavior of socially interactive agents (SIAs) is often automatically generated and identical across all users. This approach, though economic, might have counterproductive effects when designing applications for diverse and vulnerable populations. Also, it might negatively impact research validity and diminish the effectiveness of SIA-based interventions. This paper presents arguments for and proposes a method to model nonverbal behavior in SIAs. The ModelIT method enables researchers to ground the modelling of nonverbal behavior in psychological theories. It aims at establishing a standardized and replicable method that promotes open science practices and facilitates the creation of tailored SIAs. It is a step towards barrier-free and accessible SIA applications across diverse populations. The necessity, guidelines, and limitations of the ModelIT method are thoroughly addressed.