xiao_jing_2004_3 - Non-Rigid Shape and Motion Recovery:...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
Non-Rigid Shape and Motion Recovery: Degenerate Deformations Jing Xiao Takeo Kanade The Robotics Institute Carnegie Mellon University Pittsburgh, PA 15213 { jxiao, tk } @cs.cmu.edu Abstract This paper studies the problem of 3 D non-rigid shape and motion recovery from a monocular video sequence, under the degenerate deformations. The shape of a deformable object is regarded as a linear combination of certain shape bases. When the bases are non-degenerate, i.e. of full rank 3 , a closed-form solution exists by enforcing linear con- straints on both the camera rotation and the shape bases [18]. In practice, degenerate deformations occur often, i.e. some bases are of rank 1 or 2 . For example, cars moving or pedestrians walking independently on a straight road refer to rank- 1 deformations of the scene. This paper quantita- tively shows that, when the shape is composed of only rank- 3 and rank- 1 bases, i.e. the 3 D points either are static or independently move along straight lines, the linear rotation and basis constraints are suf±cient to achieve a unique solu- tion. When the shape bases contain rank- 2 ones, imposing only the linear constraints results in an ambiguous solution space. In such cases, we propose an alternating linear ap- proach that imposes the positive semi-de±nite constraint to determine the desired solution in the solution space. The performance of the approach is evaluated quantitatively on synthetic data and qualitatively on real videos. 1. Introduction Recovery of 3 D shape and motion from a monocular video sequence is an important task for applications like human computer interaction and robot navigation. The decades of work has led to signiFcant successes on this problem. When the scene is static, reliable systems exist for 3 D reconstruc- tion of the scene structure. In reality, many scenes are dy- namic and non-rigid: expressive faces, cars moving beside buildings, etc. Such scenes often deform with a class of basis structures. ±or example, the shape of a face can be regarded as a weighted sum of some shape bases, which correspond to various facial expressions [3]. Bregler and his colleagues [5] Frst introduced the basis representation to the problem of non-rigid structure from motion. Using this representation, in [18], we presented two sets of linear metric constraints, orthonormality constraints on camera rotations ( rotation constraints ) and uniqueness constraints on shape bases ( basis constraints ). We proved that, when the shape deformation is non-degenerate, i.e. all bases are of full rank 3 , enforcing the linear constraints leads to a closed-form solution [18]. In practice, many scenes deform with degenerate bases of rank 1 or 2 . Such bases limit the shape to deform only in a 2 D plane. ±or instance, if a scene contains pedestrians walking indepen- dently along straight lines, the bases referring to those rank- 1 translations are degenerate. A simple illustration of rank- 3 , 2 , and 1 bases is shown in ±igure 1. Under degenerate deformations, enforcing the linear metric constraints is not necessarily sufFcient to determine a unique solution.
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 2
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 06/13/2011 for the course CAP 6412 taught by Professor Staff during the Spring '08 term at University of Central Florida.

Page1 / 8

xiao_jing_2004_3 - Non-Rigid Shape and Motion Recovery:...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online