Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data

Publikation

Onorina Kovalenko, Vladislav Golyanik, Muhammad Jameel Nawaz Malik, Ahmed Elhayek, Didier Stricker

In: Sensors - Open Access Journal (Sensors) 19 20 Seite 4603 MDPI 10/2019.

Abstrakt

Recovery of articulated 3D structure from 2D observations is a challenging computer vision problem with many applications. Current learning-based approaches achieve state-of-the-art accuracy on public benchmarks but are restricted to specific types of objects and motions covered by the training datasets. Model-based approaches do not rely on training data but show lower accuracy on these datasets. In this paper, we introduce a model-based method called Structure from Articulated Motion (SfAM), which can recover multiple object and motion types without training on extensive data collections. At the same time, it performs on par with learning-based state-of-the-art approaches on public benchmarks and outperforms previous non-rigid structure from motion (NRSfM) methods. SfAM is built upon a general-purpose NRSfM technique while integrating a soft spatio-temporal constraint on the bone lengths. We use alternating optimization strategy to recover optimal geometry (i.e., bone proportions) together with 3D joint positions by enforcing the bone lengths consistency over a series of frames. SfAM is highly robust to noisy 2D annotations, generalizes to arbitrary objects and does not rely on training data, which is shown in extensive experiments on public benchmarks and real video sequences. We believe that it brings a new perspective on the domain of monocular 3D recovery of articulated structures, including human motion capture.

Projekte

VIDETE - Generierung von Vorwissen mit Hilfe lernender Systeme zur 4D-Analyse komplexer Szenen

Weitere Links

https://www.mdpi.com/1424-8220/19/20/4603

sensors-19-04603.pdf (pdf, 2 MB )

Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data

Abstrakt

Projekte

Weitere Links

Folgen Sie uns auf:

Herausgeber

Newsletter

Standorte