Choreographing amateur performers using video examples

ABSTRACT

We often imagine what it would be like to perform like a professional dancer or an action star. However, because our physical skills are insufficient, the resulting performance is poor. To make it appear to be much better, we have developed a method for quickly and easily choreographing an amateur performer in a video utilizing a video example of a professional performance. Our method allows the amateur performance to be edited by transferring the timing and poses of the professional performance.

References

1. Beier, T., and Neely, S. 1992. Feature-based image metamorphosis. In Proc. of SIGGRAPH '92, 35--42.
2. Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. In ACM SIGGRAPH 2005 Papers, 1134--1141.
3. Jain, A., Thormählen, T., Seidel, H.-P., and Theobalt, C. 2010. Moviereshape: Tracking and reshaping of humans in videos. In ACM Trans. Graph. 29, 5.
4. Rao, C., Gritai, A., Shah, M., and Syeda-Mahmood, T. 2003. View-invariant alignment and matching of video sequences. In Proc. of ICCV 2003, 939--945.
5. Sand, P., and Teller, S. 2006. Particle video: Long-range motion estimation using point trajectories. In Proc. of CVPR 2006, 2195--2202.
6. Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In ACM SIGGRAPH 2004 Papers, 315--321.
7. Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H.-P., Kautz, J., and Theobalt, C. 2011. Video-based characters: creating new human performances from a multi-view video database. In ACM SIGGRAPH 2011 papers, 32:1--32:10.
8. Zach, C., Pock, T., and Bischof, H. 2007. A duality based approach for realtime tv-l1 optical flow. In DAGM-Symposium, 214--223.