Back to my home page.

Hyper mask - projecting a talking head onto a real object

Tatsuo Yotsukura, Shigeo Morishima, Frank Nielsen, Kim Binsted and Claudio S. Pinhanez

Watch videos of hypermask: video 1 (3.5 MB) video 2 (2.5 MB)

HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we upt a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley
Key words: Talking heads, Homography, Neural networks, Computerized theatrical performances, Lip-synchronization.
Download the PDF paper here © Springer-Verlag (appeared in The Visual Computer)(407 Kb, 10 pages, 12 figures).
The original publication is available at SpringerLink.  
DOI: 10.1007/s003710100140  
Download the PDF paper of the Siggraph sketch here © ACM Siggraph 1999 (30 KB, 4 pages, 1 figure)
The original publication is available at ACM.

Bibtex entry:

  author = {Tatsuo Yotsukura and Frank Nielsen and Kim Binsted and Shigeo Morishima and Claudio S. Pinhanez},
  title  = {{Hypermask: Talking Head Projected onto Real Object}},
  year   = {2002},
  pages  = {111-120},
  journal = {The Visual Computer},
  volume = {18}, 
  number = {2},
  doi = {}

 author = {Claudio Pinhanez and Frank Nielsen and Kim Binsted},
 title = {Projecting computer graphics on moving surfaces: a simple calibration and tracking method},
 booktitle = {ACM SIGGRAPH 99 Conference abstracts and applications},
 year = {1999},
 isbn = {1-58113-103-8},
 pages = {266},
 location = {Los Angeles, California, United States},
 doi = {},
 publisher = {ACM Press}

Kim Binsted Shigeo Morishima

Frank Nielsen Claudio Pinhanez

Tatsuo Yotsukura


Our team T-shirt designed by Kim:

© Copyright notice.
Last updated, 2003.