Shadow Theatre: Discovering Human Motion from a Sequence of Silhouettes

Shadow Theatre: Discovering Human Motion
from a Sequence of Silhouettes

Jungdam Won1    Jehee Lee1


1 Seoul National University   



From a sequence of 2D silhouette images, our shadow theatre system generates animated characters, of which projection on the screen matches well with the target shapes. Our approach is applicable to various shapes such as an elephant (yellow), a rabbit (green), a car (red), and a violin (blue).
 
Abstract  

Shadow theatre is a genre of performance art in which the actors are only visible as shadows projected on the screen. The goal of this study is to generate animated characters, the shadows of which match a sequence of target silhouettes. This poses several challenges. The motion of multiple characters are carefully coordinated to form a target silhouette on the screen, and each character's pose should be stable, balanced, and plausible. The resulting character animation should be smooth and coherent spatially and temporally. We formulate the problem as nonlinear constrained optimization with objectives, which were designed to generate plausible human motions. Our optimization algorithm was primarily inspired by the heuristic strategies of professional shadow theatre actors. Their know-how was studied and then incorporated into our optimization formulation. We demonstrate the effectiveness of our approach with a variety of target silhouettes and 3D fabrication of the results.


Publication    

Jungdam Won, Jehee Lee,
Shadow Theatre: Discovering Human Motion from a Sequence of Silhouettes,
ACM Transactions on Graphics (SIGGRAPH 2016).

Download Paper (28.7 MB)


Presentation    




Demo video

Download Video(Main) (192 MB)     Download Video(Supplemental) (57.3 MB)