Internships

279 – Programmer, Authoring Novel Facial Performances for Digital Characters

Project Name
Authoring Novel Facial Performances for Digital Characters

Project Description
Authoring realistic digital characters for interactive applications is becoming a practical possibility leveraging numerous technologies developed at ICT. For example, Digital Ira was developed in collaboration with industry that resulted in a photo-real, real-time digital character driven using facial performance capture. An unanswered question is how to author novel performances for an existing character, without requiring additional performances from the original actor. Also, can we further automate the authoring of difficult areas around the eyelids and lip contours, which presently require artistic attention? We identify three avenues of research to address these questions: 1) Research towards authoring novel facial animations for digital characters; 2) Research towards automatic synthesis of the character’s appearance, in accordance with novel performances (including animated reflectance maps and geometric details); 3) Research towards improved automation in authoring eye movement, eyelid animation, and lip contour animation, especially during speech.

Job Description
Candidate will focus on how to author novel performances for an existing character, without requiring additional performances from the original actor. Also, research will focus on how to further automate the authoring of difficult areas around the eyelids and lip contours, which presently require artistic attention. Additional focus on authoring novel facial animations for digital characters, automatic synthesis of the character’s appearance, in accordance with novel performances and towards improved automation in authoring eye movement, eyelid animation, and lip contour animation.

Preferred Skills

  • C++, OpenGL, GPU programming
  • Experience with computer vision techniques: multi-camera stereo, optical flow, facial feature, detection, bilinear morphable models, texture synthesis, markov random fields
  • Operating System: Windows

Apply now.

Go back to the summer research program list.