Generating and ranking diverse multi-character interactions

Abstract

In many application areas, such as animation for pre-visualizing movie sequences and choreography for dance or other types of performance, only a high-level description of the desired scene is provided as input, either written or verbal. Such sparsity, however, lends itself well to the creative process, as the choreographer, animator or director can be given more choice and control of the final scene. Animating scenes with multi-character interactions can be a particularly complex process, as there are many different constraints to enforce and actions to synchronize. Our novel 'generate-and-rank' approach rapidly and semi-automatically generates data-driven multi-character interaction scenes from high-level graphical descriptions composed of simple clauses and phrases. From a database of captured motions, we generate a multitude of plausible candidate scenes. We then efficiently and intelligently rank these scenes in order to recommend a small but high-quality and diverse selection to the user. This set can then be refined by re-ranking or by generating alternatives to specific interactions. While our approach is applicable to any scenes that depict multi-character interactions, we demonstrate its efficacy for choreographing fighting scenes and evaluate it in terms of performance and the diversity and coverage of the results.

References

1. Agrawal, S., Shen, S., and van de Panne, M. 2013. Diverse motion variations for physics-based character animation. In Proceedings of the 2013 ACM SIGGRAPH/Eurographics Symposium on Computer Animation.
2. Al Borno, M., de Lasa, M., and Hertzmann, A. 2013. Trajectory optimization for full-body movements with complex contacts. IEEE Trans. Visualization and Computer Graphics 19, 8, 1405--1414.
3. Arikan, O., Forsyth, D. A., and O'Brien, J. F. 2003. Motion synthesis from annotations. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3, 402--408.
4. Brin, S., and Page, L. 1998. The anatomy of a large-scale hypertextual web search engine. Computer Networks 30, 1--7, 107--117.
5. Calvert, T. W., and Mah, S. H. 1996. Choreographers as animators: Systems to support composition of dance. In Interactive Computer Animation, Prentice-Hall, N. Magnenat-Thalmann and D. Thalmann, Eds., 100--126.
6. Cassell, J., Vilhjálmsson, H. H., and Bickmore, T. 2001. Beat: The behavior expression animation toolkit. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 477--486.
7. Choi, M. G., Kim, M., Hyun, K., and Lee, J. 2011. Deformable motion: Squeezing into cluttered environments. Computer Graphics Forum (Eurographics 2011) 30, 2, 445--453.
8. Funge, J., Tu, X., and Terzopoulos, D. 1999. Cognitive modeling: Knowledge, reasoning and planning for intelligent characters. In Proceedings of SIGGRAPH '1999, 29--38.
9. Ha, S., McCann, J., Liu, K., and Popovic, J. 2013. Physics storyboards. Computer Graphics Forum (Eurographics 2013) 32, 133142.
10. Ho, E. S. L., Komura, T., And Tai, C.-L. 2010. Spatial relationship preserving character motion adaptation. ACM Transactions on Graphics (SIGGRAPH 2010) 29, 4.
11. Hoyet, L., McDonnell, R., and O'Sullivan, C. 2012. Push it real: Perceiving causality in virtual interactions. ACM Transactions on Graphics (SIGGRAPH 2012) 31, 4.
12. Hyun, K., Kim, M., Hwang, Y., and Lee, J. 2013. Tiling motion patches. IEEE Transations on Visualization and Computer Graphics 19, 11, 1923--1934.
13. Jain, S., and Liu, C. K. 2009. Interactive synthesis of human-object interaction. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 47--53.
14. Jing, Y., and Baluja, S. 2008. VisualRank: Applying pagerank to large-scale image search. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 1877--1890.
15. Kim, M., Hyun, K., Kim, J., and Lee, J. 2009. Synchronized multi-character motion editing. ACM Transactions on Graphics (SIGGRAPH 2009) 28, 3, 1--9.
16. Kim, M., Hwang, Y., Hyun, K., and Lee, J. 2012. Tiling motion patches. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 117--126.
17. Lee, J., Chai, J., Reitsma, P., Hodgins, J., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. ACM Transactions on Graphics (SIGGRAPH 2002) 21, 3, 491--500.
18. Lee, K. H., Choi, M. G., and Lee, J. 2006. Motion patches: building blocks for virtual environments annotated with motion data. ACM Transactions on Graphics (SIGGRAPH 2006) 26, 3.
19. Levine, S., Krähenbühl, P., Thrun, S., and Koltun, V. 2010. Gesture controllers. ACM Transactions on Graphics (SIGGRAPH 2010) 29, 4.
20. Levine, S., Lee, Y., Koltun, V., and Popović, Z. 2011. Space-time planning with parameterized locomotion controllers. ACM Transactions on Graphics 30, 3.
21. Liu, L., Yin, K., van de Panne, M., Shao, T., and Xu, W. 2010. Sampling-based contact-rich motion control. ACM Trans. Graph. 29, 4.
22. Lo, W.-Y., and Zwicker, M. 2008. Real-time planning for parameterized human motion. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 29--38.
23. Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., and Shieber, S. 1997. Design galleries: A general approach to setting parameters for computer graphics and animation. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, 389--400.
24. Mei, Q., Guo, J., and Radev, D. 2010. DivRank: The interplay of prestige and diversity in information networks. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1009--1018.
25. Mordatch, I., Todorov, E., and Popović, Z. 2012. Discovery of complex behaviors through contact-invariant optimization. ACM Trans. Graph. 31, 4.
26. Müller, M., and Röder, T. 2006. Motion templates for automatic classification and retrieval of motion capture data. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 137--146.
27. Neff, M., Kipp, M., Albrecht, I., and Seidel, H.-P. 2008. Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transations on Graphics 27, 1.
28. Pedica, C., and Vilhjálmsson, H. H. 2010. Spontaneous avatar behavior for human territoriality. Appl. Artif. Intell. (IVA Special Issue) 24, 6, 575--593.
29. Perlin, K., and Goldberg, A. 1996. Improv: A system for scripting interactive actors in virtual worlds. In Proceedings of SIGGRAPH 1996, 205--216.
30. Safonova, A., and Hodgins, J. K. 2007. Construction and optimal search of interpolated motion graphs. ACM Transactions on Graphics (Siggraph 2007).
31. Shum, H. P. H., Komura, T., Shiraishi, M., and Yamazaki, S. 2008. Interaction patches for multi-character animation. ACM Transactions on Graphics (SIGGRAPH ASIA 2008) 27, 5.
32. Shum, H. P. H., Komura, T., and Yamazaki, S. 2010. Simulating multiple character interactions with collaborative and adversarial goals. IEEE Transactions on Visualization and Computer Graphics, 99.
33. Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A., and Bregler, C. 2004. Speaking with hands: Creating animated conversational characters from recordings of human performance. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3, 506--513.
34. Twigg, C. D., and James, D. L. 2007. Many-worlds browsing for control of multibody dynamics. ACM Transactions on Graphics (SIGGRAPH 2007) 26, 3.
35. Wampler, K., Andersen, E., Herbst, E., Lee, Y., and Popović, Z. 2010. Character animation in two-player adversarial games. ACM Transactions on Graphics 29, 3.
36. Ye, Y., and Liu, C. K. 2012. Synthesis of detailed hand manipulations using contact sampling. ACM Transactions on Graphics (SIGGRAPH 2012) 31, 4, 41:1--41:10.
37. Yersin, B., Maïm, J., Pettré, J., and Thalmann, D. 2009. Crowd patches: populating large-scale virtual environments for real-time applications. In Proceedings of symposium on Interactive 3D graphics and games, 207--214.
38. Yu, Q., and Terzopoulos, D. 2007. A decision network framework for the behavioral animation of virtual humans. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 119--128.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation