Pighin98 - Synthesizing Realistic Facial Expressions from...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
Synthesizing Realistic Facial Expressions from Photographs Fr´ed´eric Pighin Jamie Hecker Dani Lischinski Richard Szeliski David H. Salesin University of Washington The Hebrew University Microsoft Research Abstract We present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creat- ing smooth transitions between different facial expressions by mor- phing between these different models. Starting from several uncali- brated views of a human subject, we employ a user-assisted tech- nique to recover the camera poses corresponding to the views as well as the 3D coordinates of a sparse set of chosen locations on the subject’s face. A scattered data interpolation technique is then used to deform a generic face mesh to fit the particular geometry of the subject’s face. Having recovered the camera poses and the facial ge- ometry, we extract from the input images one or more texture maps for the model. This process is repeated for several facial expressions of a particular subject. To generate transitions between these facial expressions we use 3D shape morphing between the corresponding face models, while at the same time blending the corresponding tex- tures. Using our technique, we have been able to generate highly re- alistic face models and natural looking animations. CR Categories: I.2.10 [Artificial Intelligence]: Vision and Scene Under- standing — Modeling and recovery of physical attributes; I.3.7 [Computer Graphics]: Three-Dimensional Graphics — Animation; I.3.7 [Computer Graphics]: Three-Dimensional Graphics — Color, shading, shadowing and texture. Additional Keywords: facial modeling, facial expression generation, facial animation, photogrammetry, morphing, view-dependent texture-mapping 1 Introduction There is no landscape that we know as well as the human face. The twenty-five-odd square inches containing the fea- tures is the most intimately scrutinized piece of territory in existence, examined constantly, and carefully, with far more than an intellectual interest. Every detail of the nose, eyes, and mouth, every regularity in proportion, every vari- ation from one individual to the next, are matters about which we are all authorities. — Gary Faigin [14], from The Artist’s Complete Guide to Facial Expression Realistic facial synthesis is one of the most fundamental problems in computer graphics — and one of the most difficult. Indeed, attempts to model and animate realistic human faces date back to the early 70’s [34], with many dozens of research papers published since. The applications of facial animation include such diverse fields as character animation for films and advertising, computer games [19], video teleconferencing [7], user-interface agents and avatars [44], and facial surgery planning [23, 45]. Yet no perfectly realistic facial animation has ever been generated by computer: no “facial anima- tion Turing test” has ever been passed.
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 2
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 06/13/2011 for the course CAP 6412 taught by Professor Staff during the Spring '08 term at University of Central Florida.

Page1 / 10

Pighin98 - Synthesizing Realistic Facial Expressions from...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online