Events

Alex Wan-chun Ma, Ko-Yun Lui, Chun-Fa Chang, Chuan-Chang Wang, Paul Debevec: “A Framework for Locally Retargeting and Rendering Facial Performance”

May 28, 2011 | Chengdu, China

Speaker: Alex Wan-chun Ma, Ko-Yun Lui, Chun-Fa Chang, Chuan-Chang Wang, Paul Debevec
Host: The 24th International Conference on Computer Animation and Social Agents (CASA 2011)

We present a facial motion retargeting method that enables the control of a blendshape rig according to marker-based motion capture data. The main purpose of the proposed technique is to allow a blendshape rig to create facial expressions, which conforms best to the current motion capture input, regardless the underlying blendshape poses. In other words, even though all of the blendshape poses may comprise symmetrical facial expressions only, our method is still able to create asymmetrical expressions without physically splitting any of them into more local blendshape poses. An automatic segmentation technique based on the analysis of facial motion is introduced to create facial regions for local retargeting. We also show that it is possible to blend normal maps for rendering in the same framework. Rendering with the blended normal map significantly improves surface appearance and details.