Skip to main content Skip to main navigation

Project | HAI-x

Duration:
Hybrid AI explainer

Hybrid AI explainer

More and more industry, business and science applications employ multiple AI techniques and AI workflows to solve complex problems and automate as well as optimise complex processes and decision-making. To establish trust in such hybrid, or staged, AI systems, the combined result of the entire system must be explained to the human user. Although individual AI algorithms may be explainable independently, integrated hybrid systems usually lack this ability. However, for Trustworthy AI systems, explainability is one of the ethical principles to which these systems should adhere during their development, implementation, and deployment (AI HLEG, 2019). An example for such a hybrid AI is the planning of weed harvesting operations in aquatic environments, which is the scenario chosen to develop the proposed Hybrid AI explainer (HAI-x) methodology. Here, different AI methods are applied to different sub-tasks to create a plan for conducting the harvesting operation in an optimal way. These kinds of planning and operation tasks occur often in environmental sciences, where mobile field operations need to be optimised in a way that areas of interest must be fully covered whilst avoiding restricted areas. Other examples of this class of problems are the mapping of harmful algae bloom, mapping of submerged groundwater discharges, and the path-planning of sensors surveys of unmanned aerial vehicles. These problems usually require the identification of both, the areas of interest and the area of avoidance, i.e., restricted areas. Both can change over time and therefore must be identified dynamically. For practical applications, such as the weed harvesting example, not only an optimal plan is required by human decision makers but also an explanation of the plan and the underlying machine learning model(s) to enable trust. Thus, the proposed project develops the Hybrid AI explainer (HAI-x) to shed light in ‘black box’ hybrid AI systems.

The system will be developed on two levels:

  1. A lab-based scenario to perform rapid testing of sensors, algorithms, and design concepts;
  2. On a vehicle provided by boat manufacturer BERKY GmbH for data collection, field tests, and evaluation.

Although development is taking place on a concrete example, HAI-x is intended to be a transferrable technology to other hybrid AI systems used in similar scenarios. For example, potential application areas include maintenance of water bodies and waterways, mission planning and mission logistics, such as in litter and waste clean-up operations.

Publications:

  • El-Mihoub, T.A., El Gadi, H., Nolle, L., Stahl, F.: On object detection and explain- ability with sonar imagery. In: 2024 IEEE 2nd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA) (2024)
  • Nolle, Lars, Frederic Stahl, and Tarek El-Mihoub. "On Explanations for Hybrid Artificial Intelligence." International Conference on Innovative Techniques and Applications of Artificial Intelligence. Cham: Springer Nature Switzerland, 2023.

Partners

BERKY GmbH (Haren, Germany), Stadt Hannover (Germany)

Publications about the project

  1. On Object Detection and Explainability with Sonar Imagery

    Tarek Elmihoub; Abdulhakim El Gadi Gadi; Lars Nolle; Frederic Theodor Stahl

    In: 2024 IEEE 4th International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA). IEEE International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA-2024), May 19-21, Tripoli, Libyan Arab Jamahiriya, Pages 1-8, ISBN 979-8-3503-7263-2, IEEE Xplore, New Jersey,…
  2. On Explanations for Hybrid Artificial Intelligence

    Lars Nolle; Frederic Theodor Stahl; Tarek Elmihoub

    In: Max Bramer; Frederic Theodor Stahl (Hrsg.). Artificial Intelligence XL - 43rd SGAI International Conference on Artificial Intelligence, AI 2023. SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence (AI-2023), December 12-14, Cambridge, United Kingdom, Pages 3-15, Lecture Notes in Computer Science (LNCS), Vol. 14381, Springer Nature Switzerland AG,…

Sponsors

BMBF - Federal Ministry of Education and Research

01|W23003

BMBF - Federal Ministry of Education and Research