Publication
A Multi-Sensor Approach for Digital Twins of Manual Assembly and Commissioning
Adrian Rebmann; Sönke Knoch; Andreas Emrich; Peter Fettke; Peter Loos
In: George-Christopher Vosniakos; Marcello Pellicciari; Panorios Benardos; Angelos Markopoulos (Hrsg.). 30th International Conference on Flexible Automation and Intelligent Manufacturing. International Conference on Flexible Automation and Intelligent Manufacturing (FAIM-2021), June 15-18, Athens, Greece, Pages 549-556, Procedia Manufacturing, Vol. 51, Elsevier, 2020.
Abstract
Digital twins enable better control and provide a better understanding of automated manufacturing environments. However, some parts of produc- tion processes are not fully covered, as they are still carried out manually. In this paper, we present an approach for monitoring manual parts of an assembly and commissioning process efficiently. We combine scenery classification with an inventory control system based on high-precision scales. We use a head-mounted mixed-reality display to acquire images of the process context and to provide assistance to the worker. Hence, heterogeneous sensor information is combined to capture human activities and object interactions to create an accurate digital representation of actual process behavior. Additionally, sensor information is selected dynamically based on the context. The system was implemented and tested in a laboratory environment. For production environments, this provides a starting point to close a significant gap regarding digital twins in semi-automated manufacturing processes and enables context-aware worker assistance.