Publication
LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanations
Qianli Wang; Tatiana Anikina; Nils Feldhus; Josef van Genabith; Leonhard Hennig; Sebastian Möller
In: Su Lin Blodgett; Amanda Cercas Curry; Sunipa Dev; Michael Madaio; Ani Nenkova; Diyi Yang; Ziang Xiao (Hrsg.). Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP). NAACL Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP-2024), located at North American Chapter of the Association for Computational Linguistics (NAACL), Mexico City, Mexico, Association for Computational Linguistics. 2024.
Abstract
Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding (Slack et al., 2023; Shen et al., 2023), as one-off explanations may fall short in providing sufficient information to the user. Current solutions for dialogue-based explanations, however, often require external tools and modules and are not easily transferable to tasks they were not designed for. With LLMCheckup, we present an easily accessible tool that allows users to chat with any state-of-the-art large language model (LLM) about its behavior. We enable LLMs to generate explanations and perform user intent recognition without fine-tuning, by connecting them with a broad spectrum of Explainable AI (XAI) methods, including white-box explainability tools such as feature attributions, and self-explanations (e.g., for rationale generation). LLM-based (self-)explanations are presented as an interactive dialogue that supports follow-up questions and generates suggestions. LLMCheckup provides tutorials for operations available in the system, catering to individuals with varying levels of expertise in XAI and supporting multiple input modalities. We introduce a new parsing strategy that substantially enhances the user intent recognition accuracy of the LLM. Finally, we showcase LLMCheckup for the tasks of fact checking and commonsense question answering.