Publication
Evaluating Dimensions of AI Transparency: A Comparative Study of Standards, Guidelines and the EU AI Act
Sergio Genovesi; Martin Haimerl; Iris Merget; Samantha Morgaine Prange; Otto Obert; Susanna Wolf; Jens Ziehn
In: Rebekka Görge; Elena Haedecke; Maximilian Poretschkin; Anna Schmitz (Hrsg.). Symposium on Scaling AI Assessments (SAIA 2024). Symposium on Scaling AI Assessments (SAIA-2024), September 30 - October 1, Cologne, Germany, Pages 10:1-10:17, Open Access Series in Informatics (OASICS), Vol. 126, ISBN ISSN 2190-6807, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 1/2025.
Abstract
Transparency is considered a key property with respect to the implementation of trustworthy artificial intelligence (AI). It is also addressed in various documents concerned with the standardization and regulation of AI systems. However, this body of literature lacks a standardized, widely-accepted definition of transparency, which would be crucial for the implementation of upcoming legislation for AI like the AI Act of the European Union (EU). The main objective of this paper is to systematically analyze similarities and differences in the definitions and requirements for AI transparency. For this purpose, we define main criteria reflecting important dimensions of transparency. According to these criteria, we analyzed a set of relevant documents in AI standardization and regulation, and compared the outcomes. Almost all documents included requirements for transparency, including explainability as an associated concept. However, the details of the requirements differed considerably, e.g., regarding pieces of information to be provided, target audiences, or use cases with respect to the development of AI systems. Additionally, the definitions and requirements often remain vague. In summary, we demonstrate that there is a substantial need for clarification and standardization regarding a consistent implementation of AI transparency. The method presented in our paper can serve as a basis for future steps in the standardization of transparency requirements, in particular with respect to upcoming regulations like the European AI Act.