Interaction capture and synthesis

ABSTRACT

Modifying motion capture to satisfy the constraints of new animation is difficult when contact is involved, and a critical problem for animation of hands. The compliance with which a character makes contact also reveals important aspects of the movement's purpose. We present a new technique called interaction capture, for capturing these contact phenomena. We capture contact forces at the same time as motion, at a high rate, and use both to estimate a nominal reference trajectory and joint compliance. Unlike traditional methods, our method estimates joint compliance without the need for motorized perturbation devices. New interactions can then be synthesized by physically based simulation. We describe a novel position-based linear complementarity problem formulation that includes friction, breaking contact, and the compliant coupling between contacts at different fingers. The technique is validated using data from previous work and our own perturbation-based estimates.

References

1. Anitescu, M., and Potra, F. A. 2002. A time-stepping method for stiff multibody dynamics with contact and friction. International J. Numer. Methods Engineering 55, 753--784.
2. Baraff, D. 1994. Fast contact force computation for nonpenetrating rigid bodies. In Proceedings of SIGGRAPH '94, ACM Press, A. Glassner, Ed., Computer Graphics Proceedings, Annual Conference Series, 23--34.
3. Bizzi, E., Hogan, N., Mussa-Ivaldi, F. A., and Giszter, A. 1992. Does the nervous system use equilibrium-point control to guide single and multiple joint movements? Behavioral and Brain Sciences 15, 603--613.
4. Burdet, E., Osu, R., Franklin, D. W., Milner, T. E., and Kawato, M. 2001. The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature 414 (November), 446--449.
5. Catmull, E. 1972. A system for computer generated movies. In Proceedings of the ACM Annual Conference, 422--431.
6. Delp, S., and Loan, J. 2000. A computational framework for simulating and analyzing human and animal movement. Computing in Science and Engineering (September).
7. El Koura, G., and Singh, K. 2003. Handrix: Animating the human hand. In ACM SIGGRAPH Symposium on Computer Animation, 110--119.
8. Feldman, A. G. 1986. Once more on the equilibrium-point hypothesis (lambda model) for motor control. Journal of Motor Behavior 18, 1 (March), 17--54.
9. Gleicher, M. 1998. Retargetting motion to new characters. In SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, 33--42.
10. Gomi, H., and Kawato, M. 1997. Human arm stiffness and equilibrium-point trajectory during multi-joint movement. Biological Cybernetics 76, 163--171.
11. Hajian, A. Z., and Howe, R. D. 1997. Identification of the mechanical impedance at the human finger tip. Journal of biomechanical engineering 119, 1, 109--114.
12. Hasser, C. J., and Cutkosky, M. R. 2002. System identificaiton of the human hand grasping a haptic knob. In Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems (HAPTICS'02).
13. Hodgins, J. K., and Pollard, N. S. 1997. Adapting simulated behaviors for new characters. In SIGGRAPH '97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques, 153--162.
14. Hogan, N. 1984. Adaptive control of mechanical impedance by coactivation of antagonist muscles. IEEE Transactions on Automatic Control AC-29, 8, 681--690.
15. Ikemoto, L., Arikan, O., and Forsyth, D. A. 2006. Knowing when to put your foot down. In SI3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games, ACM Press, New York, NY, USA, 49--53.
16. Johansson, R. S. 1996. Sensory and memory information in the control of dextrous manipulation. Kluwer Academic, 205--260.
17. Johansson, R. S. 1998. Sensory input and control of grip. In Novartis Foundation Symposium, vol. 218, 45--63.
18. Kuchenbecker, K. J., Park, J. G., and Niemeyer, G. 2003. Characterizing the human wrist for improved haptic interaction. In Proc. ASME Int. Mechanical Engineering Congress and Exposition, vol. 2.
19. Kurihara, T., and Miyata, N. 2004. Modeling deformable human hands from medical images. In ACM SIGGRAPH Symposium on Computer Animation, 357--365.
20. Liu, C. K., Hertzmann, A., and Popovic, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. Graph. 24, 3, 1071--1081.
21. Lotstedt, P. 1981. Coulomb friction in two-dimensional rigid-body systems. In Zeitschrift fur Angewandte Mathematik und Mechanik, 605--615.
22. Miller, A. T., and Christensen, H. I. 2003. Implementation of multi-rigid-body dynamics within a robotic grasping simulator. In IEEE International Conference on Robotics and Automation, vol. 2, 2262--2268.
23. Milner, T. E., and Franklin, D. W. 1998. Characterization of multijoint finger stiffness: dependence on finger posture and force direction. IEEE Transactions on Biomedical Engineering 45, 11 (November), 1363--1375.
24. Murty, K. G. 1988. Linear Complementarity, Linear and Nonlinear Programming. Heldermann Verlag, Berlin.
25. Neff, M., and Fiume, E. 2002. Modeling tension and relaxation for computer animation. In SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, 81--88.
26. Pauly, M., Pai, D. K., and Guibas, L. J. 2004. Quasi-rigid objects in contact. In SCA '04: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM Press, New York, NY, USA, 109--119.
27. Pollard, N. S., and Zordan, V. B. 2005. Physically based grasping control from example. In SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM Press, New York, NY, USA, 311--318.
28. Popovic, Z., and Witkin, A. 1999. Physically based motion transformation. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 11--20.
29. Rancourt, D., and Hogan, N. 2001. Stability in force-production tasks. Journal of Motor Behavior 33, 2, 193--204.
30. Shapiro, A., Pighin, F., and Faloutsos, P. 2003. Hybrid control for interactive character animation. In PG '03: Proceedings of the 11th Pacific Conference on Computer Graphics and Applications, IEEE Computer Society, 455.
31. Stewart, D. E., and Trinkle, J. C. 1996. An implicit time-stepping scheme for rigid body dynamics with inelastic collisions and coulomb friction. International J. Numer. Methods Engineering 39, 2673--2691.
32. Teran, J., Blemker, S., Hing, V. N. T., and Fedkiw, R. 2003. Finite volume methods for the simulation of skeletal muscle. In SCA '03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, 68--74.
33. Tsang, W., Singh, K., and Fiume, E. 2005. Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion. In SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM Press, New York, NY, USA, 319--328.
34. Xu, Y., and Hollerbach, J. M. 1999. A robust ensemble data method for identification of human joint mechanical properties during movement. IEEE Transactions on Biomedical Engineering 46, 4 (April), 409--419.
35. Yin, K., Cline, M. B., and Pai, D. K. 2003. Motion perturbation based on simple neuromotor control models. In Proceedings of the 11th Pacific Conference on Computer Graphics and Applications, 445--449.
36. Zordan, V. B., and Hodgins, J. K. 2002. Motion capture-driven simulations that hit and react. In SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, 89--96.
37. Zordan, V. B., Majkowska, A., Chiu, B., and Fast, M. 2005. Dynamic response for motion capture animation. ACM Trans. Graph. 24, 3, 697--701.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation