Skip to main content Skip to main navigation
Headerbild Competence Center AI in Construction

AI in Construction (AIC)

AI for the complete construction process and building lifecycle


Current Situation – Construction

The sector of building design, construction, renovation and facility management is one of the slowest in adoption of digitalization and automation technologies, even though there is a significant potential for time and cost savings, material saving, reuse and optimization and energy reduction.  Due to the small profit margins and high percentage of small SMEs operating in the field, research and innovation in the field advance very slowly.   At the same time, construction is one of the most challenging and risky activities from a human worker health perspective, making the sector unattractive to the workforce. 

Potential of AI

Portrait Jason Rambach

"AI in Construction through Digital Twins, 3D Reasoning, Process Optimization, Robotics and Wearables is a challenging field full of potential to make the sector more efficient, sustainable and safer for workers. Let us explore together!"

Dr.-Ing. Jason Rambach, Head of the Competence Center AI in Construction (AIC) at DFKI

AI is already taking its first steps in the field and can contribute to a variety of applications related to the built environment. Computer Vision techniques can be used to transform unstructured 3D scans into building models (Scan-to-BIM) and enrich building digital twins with semantic information on building parts, materials and condition information. Their analysis with AI reasoning methods on 3D data can provide information for construction progress tracking and deviations, task planning and logistics optimization or renovation requirements. Multimodal AI approaches can reason over combined building data such as documentation, building models, technical reports and product passports to provide improvement suggestions for design and material selection, process execution and energy saving.

Meanwhile, robots equipped with perception sensors and reasoning capabilities can be used to perform autonomous inspections for scanning and damage detection or even take over or collaborate with humans on challenging and unsafe tasks involving handling of heavy materials or demolition tasks. Intelligent wearable devices such as exoskeletons and XR-devices can enhance worker capabilities, guide them in task execution and training and monitor their condition. 
 

Challenges

In order for AI to deliver on this potential for construction, there are significant challenges that researchers need to address. Construction sites are extremely challenging and dynamic environments for perception where existing AI foundation models fail to perform and labeled data for training is scarce. The complexity of tasks and multidisciplinary involvement make the collection expert knowledge for advancing AI systems difficult. The variety of construction tasks make task-specific robotic devices not viable, indicating a need for multi-purpose construction robots that can be adapted to the task at hand on the fly. Meanwhile, acceptance of new technologies from industry representatives and management requires additional effort.

Competence Center

To address these challenges effectively, the DFKI competence center AIC - AI in Construction brings together the complementary competences on AI in construction topics from several 10 DFKI research departments from 7 different locations – (AV) Augmented Vision, (SDS) Smart Data and Knowledge Services, (RIC) Robotics Innovation Center, (MAP) Marine Perception, (CAS) Cooperative and Autonomous Systems, IWI (Institute for Information Systems), (EBLS) Experience-based Learning Systems, (DSA) Data Science and its Applications, (SAIROL) Systems AI for Robot Learning and (SAINT) Foundations of Systems AI. The competence center is led by Dr. Jason Rambach (AV) with experience in coordinating large AI in Construction projects (Horizon Europe project HumanTech) and currently serving as coordinator for the EuRobotics topic group Construction. 

Key Persons and Competences

NameResearch DepartmentExpertise
Dr. Jason RambachAV3D Scene Understanding and Multimodal Reasoning, Scan-to-BIM, Robot Perception
Marcel MagerAVDissemination and Exploitation
Prof. Dr. Peter FettkeIWIProcess Mining, Process Simulation, Process Prediction, Process Modeling, Digital Twins
Dr. Lisa GrewenigEBLSProcess Flexibility, Experience-Based Design, Case-Based Reasoning, Hybrid AI
Dr. Daniel KühnRICRobotics, Locomotion, System Design
Dr. Alexandra PehlkenMAPCritical raw materials, Digital Twin, Design for Environment
Stanislav FrolovSDSGenerative Models for Visual Data
Christoph TiebenCASOutdoor Robotics, Navigation, Localization, Multi-Modal Sensor Fusion
Dr. Darko ObradovicDSAMultimodal Building Documents, Agentic Workflows
Dr. Joao Müller CarvalhoSAIROLRobot Learning, Machine Learning, Robot Learning in Construction

Selected Projects:

HumanTech

ShieldBoT 

KIMBA

Contact

Dr. Jason Rambach

Marcel Mager

DFKI Research Department 
Augmented Vision
Trippstadter Str. 122
67663 Kaiserslautern

Projects

  1. Project "ArKoS"

    Architecture of collaborative business processes across organizational boundaries
  2. Project "BauVOGrid"

    Grid-based platform for virtual organizations in the construction industry
  3. Project "HumanTech"

    Digital Twins, Wearables and Robotics for construction
  1. Project "KIMBA"

    Demolition waste segmentation and particle size distribution estimation
  2. © RPTU | Unit of Real Estate Studies

    Project "ML-BAU-DOK+"

    Building data extraction from tables, text documents, and plans
  3. Project "ShieldBoT"

    Inspection and construction robots for thermal shielding