1. This paper presents a complete integrated system for live facial puppetry that enables high resolution real-time facial expression tracking with transfer to another person’s face. (Abstract)
2. The current methods for facial performance capture are complex, rely heavily on manual assistance, and are often accompanied by long turn-around times.
3. A low-cost active stereo scanner is used to capture dense 3D data and texture of an actor’s face. A generic template mesh is fitted to the facial reconstruction, and is trained on the actor’s expression sequences. A model built from these sequences can then be used for live expression transfer. (Paraphrased from website abstract, not paper extract)
4a. After extensive offline preprocessing, re-targeting of facial expressions from a tracked actor to a different face can be achieved in real time; even with a single rigid post of the target face. Demonstrated for a wide breadth of expressions and facial motions.
4b. Can be used in movies or video games to allow actors to control facial expressions in real time, or to allow directors to quickly see previews of shots.
5. Web page with videos: http://www.vision.ee.ethz.ch/~weiset/publications/sca2009