Combining Embedded Computation and Image Tracking for Composing Tangible Augmented Reality

Tim Düwel, Nico Herbig, Denise Kahl, Antonio Krüger

In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA-2020) April 25-30 Honolulu HI United States CHI '20 ISBN 9781450368193 Association for Computing Machinery New York, NY, USA 4/2020.


This work proposes a combination of embedded computation and marker tracking to provide more robust augmentations for composed objects in Tangible Augmented Reality. By integrating conductive elements into the tangibles’ sides, communication between embedded microprocessors is enabled, such that a connected composition can be computed without relying on any marker tracking information. Consequently, the virtual counterparts of the tangibles can be aligned, and this virtual composition can be attached to a single marker as a whole, increasing the tracking robustness towards occlusions and perspective distortions. A technical evaluation shows that this approach provides more robust augmentations if a tangible block in a composition is occluded by at least 50% or perspectively distorted by at least 40 to 50 degrees, depending on the block’s size. Additionally, a test with users relying on the use case of a couch configuration tool shows promising results regarding usability and user experience.

Weitere Links

TAROC.pdf (pdf, 13 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence