Publikation
Questions and answers: Important steps to let AI chatbots answer questions in the museum
Stefan Schaffer; Aaron Ruß; Mino Lee Sasse; Louise Schubotz; Oliver Gustke
In: Proceedings of the 10th EAI International Conference: ArtsIT, Interactivity & Game Creation. EAI International Conference: ArtsIT, Interactivity & Game Creation (ArtsIT-2021), Artificial Intelligence in Art and Culture, December 2-3, Karlsruhe, Germany, EAI Conference series, Springer International Publishing, 2021.
Zusammenfassung
In this paper, we describe our work within the research project “CHIM – Chatbot in the Museum”. CHIM is an AI-based chatbot prototype that enables conversational interaction using text and speech input: visitors can ask questions about certain artworks and receive answers in multimodal formats (text, audio, image, video). The application will be tested in the Städel Museum, Frankfurt/Main, Germany. To develop a proper Natural Language Understanding module, we adapted an existing categorization approach, gathered visitor questions, and structured them into twelve distinct content types. The preliminary results suggest that our approach to subdivide the previously overloaded content type meaning into further categories was successful, leading to a more balanced distribution of the data. We further describe the Natural Language Processing mechanisms employed here; these follow a multi-tiered approach using techniques like Rasa, BERT, and cosine-similarity to generate answers with different degrees of effort. Future steps are the implementation of dialog management, the refinement of the NLP strategies by integrating additional answers for selected exhibits, and the implementation of the final layout and interaction design. We are planning to test and evaluate the CHIM prototype on site in the Städel Museum in late 2021.