Abstract
Inspired by how humans learn dynamic motor skills through a progressive process of coaching and practices, we introduce an intuitive and interactive framework for developing dynamic controllers. The user only needs to provide a primitive initial controller and high-level, human-readable instructions as if s/he is coaching a human trainee, while the character has the ability to interpret the abstract instructions, accumulate the knowledge from the coach, and improve its skill iteratively. We introduce “control rigs” as an intermediate layer of control module to facilitate the mapping between high-level instructions and low-level control variables. Control rigs also utilize the human coach's knowledge to reduce the search space for control optimization. In addition, we develop a new sampling-based optimization method, Covariance Matrix Adaptation with Classification (CMA-C), to efficiently compute-control rig parameters. Based on the observation of human ability to “learn from failure”, CMA-C utilizes the failed simulation trials to approximate an infeasible region in the space of control rig parameters, resulting a faster convergence for the CMA optimization. We demonstrate the design process of complex dynamic controllers using our framework, including precision jumps, turnaround jumps, monkey vaults, drop-and-rolls, and wall-backflips.
Supplemental Material
Available for Download
Supplemental movie and image files for, Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques
- M. A. Borno, M. De Lasa, and A. Hertzmann. 2013. Trajectory optimization for full-body movements with complex contacts. IEEE Trans. Vis. Comput. Graph. 19, 8, 1405--1414. Google ScholarDigital Library
- S. Coros, P. Beaudoin, and M. Van De Panne. 2010. Generalized biped walking control. ACM Trans. Graph. 29, 130:1--130:9. Google ScholarDigital Library
- S. Coros, A. Karpathy, B. Jones, L. Reveret, and M. Van De Panne. 2011. Locomotion skills for simulated quadrupeds. ACM Trans. Graph. 30, 4. Google ScholarDigital Library
- M. Da Silva, F. Durand, and J. Popovic. 2009. Linear bellman combination for control of character animation. ACM Trans. Graph 28, 3. Google ScholarDigital Library
- P. Faloutsos, M. Van De Panne, and D. Terzopoulos. 2001. Composable controllers for physics-based character animation. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'01). 251--260. Google ScholarDigital Library
- A. C. Fang and N. S. Pollard. 2003. Efficient synthesis of physically valid human motion. ACM Trans. Graph. 22, 3, 417--426. Google ScholarDigital Library
- S. Ha, Y. Ye, and C. K. Liu. 2012. Falling and landing motion control for character animation. ACM Trans. Graph 31, 6, 155. Google ScholarDigital Library
- N. Hansen and S. Kern. 2004. Evaluating the cma evolution strategy on multimodal test functions. In Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN'04). Lecture Notes in Computer Science, vol. 3242, Springer, 282--291.Google ScholarCross Ref
- J. K. Hodgins, W. L. Wooten, D. C. Brogan, and J. F. O'Brien. 1995. Animating human athletics. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'95). 71--78. Google ScholarDigital Library
- M. D. Lasa, I. Mordatch, and A. Hertzmann. 2010. Feature-based locomotion controllers. ACM Trans. Graph. 29, 4. Google ScholarDigital Library
- Y. Lee, S. Kim, and J. Lee. 2010. Data-driven biped control. ACM Trans. Graph. 29, 4. Google ScholarDigital Library
- C. K. Liu, and Z. Popovic. 2002. Synthesis of complex dynamic character motion from simple animations. ACM Trans. Graph. 21, 3. Google ScholarDigital Library
- L. Liu, K. Yin, M. Van De Panne, and B. Guo. 2012. Terrain runner: Control, parameterization, composition, and planning for highly dynamic motions. ACM Trans. Graph 31, 6. Google ScholarDigital Library
- L. Liu, K. Yin, M. Van De Panne, T. Shao, and W. Xu. 2010. Sampling-based contact-rich motion control. ACM Trans. Graph 29, 4. Google ScholarDigital Library
- I. Mordatch, M. De Lasa, and A. Hertzmann. 2010. Robust physics-based locomotion using low-dimensional planning. ACM Trans. Graph. 29, 71:1--71:8. Google ScholarDigital Library
- U. Muico, J. Popovic, and Z. Popovic. 2011. Composite control of physically simulated characters. ACM Trans. Graph 30, 3. Google ScholarDigital Library
- Z. Popovic, and A. Witkin. 1999. Physically based motion transformation. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'99). 11--20. Google ScholarDigital Library
- Rtql8. 2012. http://bitbucket.org/karenliu/rtql8.Google Scholar
- A. Safonova, J. K. Hodgins, and N. S. Pollard. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Trans. Graph. 23, 3, 514--521. Google ScholarDigital Library
- K. W. Sok, M. Kim, and J. Lee. 2007. Simulating biped behaviors from human motion data. ACM Trans. Graph 26, 3. Google ScholarDigital Library
- C. Sunada, D. Argaez, S. Dubowsky, and C. Mavroidis. 1994. A coordinated jacobian transpose control for mobile multi-limbed robotic systems. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'94). 1910--1915.Google Scholar
- J. M. Wang, D. J. Fleet, and A. Hertzmann. 2009. Optimizing walking controllers. ACM Trans. Graph 28, 5. Google ScholarDigital Library
- J. M. Wang, D. J. Fleet, and A. Hertzmann. 2010. Optimizing walking controllers for uncertain inputs and environments. ACM Trans. Graph 29, 4. Google ScholarDigital Library
- J. M. Wang, S. R. Hammer, S. L. Delp, and V. Koltun. 2012. Optimizing locomotion controllers using biologically-based actuators and objectives. ACM Trans. Graph 31, 4. Google ScholarDigital Library
- W. L. Wooten. 1998. Simulation of leaping, tumbling, landing, and balancing humans. https://smartech.gatech.edu/bitstream/handle/1853/3466/98-21.pdf. Google ScholarDigital Library
- J.-C. Wu and Z. Popovic. 2010. Terrain-adaptive bipedal locomotion control. ACM Trans. Graph. 29, 72:1--72:10. Google ScholarDigital Library
- K. Yin, S. Coros, P. Beaudoin, and M. Van De Panne. 2008. Continuation methods for adapting simulated skills. ACM Trans. Graph 27, 3. Google ScholarDigital Library
- K. Yin, K. Loken, and M. Van De Panne. 2007. Simbicon: Simple biped locomotion control. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
Index Terms
- Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques
Recommendations
How to build a human: practical physics-based character animation
DigiPro '16: Proceedings of the 2016 Symposium on Digital ProductionWe present state-of-the-art character animation techniques for generating realistic anatomical motion of muscles, fat, and skin. Physics-based character animation uses computational resources in lieu of exhaustive artist effort to produce physically ...
Physics-Based Character Animation for AR Applications
ISUVR '10: Proceedings of the 2010 International Symposium on Ubiquitous Virtual RealityPhysics-based approach for character animation has advantages in interactive AR applications in that the approach can create realistic character motions that are responsive to non-predefined environment and user inputs. In this paper, we introduce two ...
Dynamic sprites: artistic authoring of interactive animations
Traditional methods for creating dynamic objects and characters from static drawings involve careful tweaking of animation curves and/or simulation parameters. Sprite sheets offer a more drawing-centric solution, but they do not encode timing ...
Comments