Sensitivity-optimized rigging for example-based real-time clothing synthesis

Abstract

We present a real-time solution for generating detailed clothing deformations from pre-computed clothing shape examples. Given an input pose, it synthesizes a clothing deformation by blending skinned clothing deformations of nearby examples controlled by the body skeleton. Observing that cloth deformation can be well modeled with sensitivity analysis driven by the underlying skeleton, we introduce a sensitivity based method to construct a pose-dependent rigging solution from sparse examples. We also develop a sensitivity based blending scheme to find nearby examples for the input pose and evaluate their contributions to the result. Finally, we propose a stochastic optimization based greedy scheme for sampling the pose space and generating example clothing shapes. Our solution is fast, compact and can generate realistic clothing animation results for various kinds of clothes in real time.

References

1. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: Shape completion and animation of people. ACM Trans. Graph. 24, 3, 408--416.
2. Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26, 3.
3. Bergou, M., Mathur, S., Wardetzky, M., and Grinspun, E. 2007. TRACKS: toward directable thin shells. ACM Trans. Graph. 26, 3.
4. Bickel, B., Bächer, M., Otaduy, M. A., Lee, H. R., Pfister, H., Gross, M., and Matusik, W. 2010. Design and fabrication of materials with desired deformation behavior. ACM Trans. Graph. 29, 4, 63:1--63:10.
5. Bridson, R., Fedkiw, R., and Anderson, J. 2002. Robust treatment of collisions, contact and friction for cloth animation. ACM Trans. Graph. 21, 3, 594--603.
6. Carr, J. C., Beatson, R. K., Cherrie, J. B., Mitchell, T. J., Fright, W. R., McCallum, B. C., and Evans, T. R. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proc. of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH '01, 67--76.
7. Chen, Z., Feng, R., and Wang, H. 2013. Modeling friction and air effects between cloth and deformable bodies. ACM Trans. Graph. 32, 4, 88:1--88:8.
8. Choi, K.-J., and Ko, H.-S. 2002. Stable but responsive cloth. ACM Trans. Graph. 21, 3, 604--611.
9. Choi, K.-J., and Ko, H.-S. 2005. Research problems in clothing simulation. Computer-Aided Design 37, 6, 585--592.
10. CMU, 2003. CMU graphics lab motion capture database. http://mocap.cs.cmu.edu.
11. Cordier, F., and Magnenat-Thalmann, N. 2004. A data-driven approach for real-time clothes simulation. In Computer Graphics and Applications, 2004. PG 2004. Proceedings. 12th Pacific Conference on, 257--266.
12. de Aguiar, E., Sigal, L., Treuille, A., and Hodgins, J. K. 2010. Stable spaces for real-time clothing. ACM Trans. Graph. 29, 106:1--106:9.
13. Derouet-Jourdan, A., Bertails-Descoubes, F., and Thollot, J. 2010. Stable inverse dynamic curves. ACM Trans. Graph. 29, 6, 137:1--137:10.
14. Digest, R. 2010. The New Complete Guide to Sewing: Step-by-Step Techniques for Making Clothes and Home Accessories Updated Edition with All-New Projects and Simplicity Patterns (Reader's Digest). Readers Digest.
15. English, E., and Bridson, R. 2008. Animating developable surfaces using nonconforming elements. ACM Trans. Graph. 27, 3, 66:1--66:5.
16. Feng, W.-W., Yu, Y., and Kim, B.-U. 2010. A deformation transformer for real-time cloth animation. ACM Trans. Graph. 29, 4, 108:1--108:9.
17. Gallagher, R. H. 1973. Optimum Structural Design: Theory and Applications. John Wiley & Sons Inc.
18. Govindaraju, N. K., Knott, D., Jain, N., Kabul, I., Tamstorf, R., Gayle, R., Lin, M. C., and Manocha, D. 2005. Interactive collision detection between deformable models using chromatic decomposition. ACM Trans. Graph. 24, 3, 991--999.
19. Grinspun, E., Hirani, A. N., Desbrun, M., and Schröder, P. 2003. Discrete shells. In Proc. of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, SCA '03, 62--67.
20. Guan, P., Reiss, L., Hirshberg, D. A., Weiss, A., and Black, M. J. 2012. DRAPE: Dressing any person. ACM Trans. Graph. 31, 4, 35:1--35:10.
21. Harmon, D., Vouga, E., Tamstorf, R., and Grinspun, E. 2008. Robust treatment of simultaneous collisions. ACM Trans. Graph. 27, 3, 23:1--23:4.
22. James, D. L., and Fatahalian, K. 2003. Precomputing interactive dynamic deformable scenes. ACM Trans. Graph. 22, 3, 879--887.
23. Kaldor, J. M., James, D. L., and Marschner, S. 2008. Simulating knitted cloth at the yarn level. ACM Trans. Graph. 27, 3, 65:1--65:9.
24. Kavan, L., Collins, S., Žára, J., and O'Sullivan, C. 2008. Geometric skinning with approximate dual quaternion blending. ACM Trans. Graph. 27, 4, 105:1--105:23.
25. Kavan, L., Gerszewski, D., Bargteil, A. W., and Sloan, P.-P. 2011. Physics-inspired upsampling for cloth simulation in games. ACM Trans. Graph. 30, 4, 93:1--93:10.
26. Kim, T.-Y., and Vendrovsky, E. 2008. Drivenshape: a data-driven approach for shape deformation. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '08, 49--55.
27. Kim, D., Koh, W., Narain, R., Fatahalian, K., Treuille, A., and O'Brien, J. F. 2013. Near-exhaustive precomputation of secondary cloth effects. ACM Trans. Graph. 32, 4, 87:1--87:8.
28. Kry, P. G., James, D. L., and Pai, D. K. 2002. Eigenskin: Real time large deformation character skinning in hardware. In In ACM SIGGRAPH Symposium on Computer Animation, ACM Press, 153--159.
29. Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '00, 165--172.
30. Merrell, P., Schkufza, E., Li, Z., Agrawala, M., and Koltun, V. 2011. Interactive furniture layout using interior design guidelines. ACM Trans. Graph. 30, 4, 87:1--87:10.
31. Miguel, E., Tamstorf, R., Bradley, D., Schvartzman, S. C., Thomaszewski, B., Bickel, B., Matusik, W., Marschner, S., and Otaduy, M. A. 2013. Modeling and estimation of internal friction in cloth. ACM Trans. Graph. 32, 6, 212:1--212:10.
32. Müller, M., and Chentanez, N. 2010. Wrinkle meshes. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '10, 85--92.
33. Müller, M., Heidelberger, B., Hennix, M., and Ratcliff, J. 2007. Position based dynamics. Journal of Visual Communication and Image Representation 18, 2, 109--118.
34. Narain, R., Samii, A., and O'Brien, J. F. 2012. Adaptive anisotropic remeshing for cloth simulation. ACM Trans. Graph. 31, 6, 152:1--152:10.
35. Nealen, A., Müller, M., Keiser, R., Boxerman, E., and Carlson, M. 2006. Physically based deformable models in computer graphics. Computer Graphics Forum 25, 4, 809--836.
36. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. 2007. Numerical Recipes 3rd Edition: The Art of Scientific Computing, 3 ed. Cambridge University Press.
37. Rohmer, D., Popa, T., Cani, M.-P., Hahmann, S., and Sheffer, A. 2010. Animation wrinkling: Augmenting coarse cloth simulations with realistic-looking wrinkles. ACM Trans. Graph. 29, 6, 157:1--157:8.
38. Umetani, N., Kaufman, D. M., Igarashi, T., and Grinspun, E. 2011. Sensitive couture for interactive garment modeling and editing. ACM Trans. Graph. 30, 4, 90:1--90:12.
39. Umetani, N., Igarashi, T., and Mitra, N. J. 2012. Guided exploration of physically valid shapes for furniture design. ACM Trans. Graph. 31, 4, 86:1--86:11.
40. Volino, P., Magnenat-Thalmann, N., and Faure, F. 2009. A simple approach to nonlinear tensile stiffness for accurate cloth simulation. ACM Trans. Graph. 28, 4, 105:1--105:16.
41. Wang, X. C., and Phillips, C. 2002. Multi-weight enveloping: Least-squares approximation techniques for skin animation. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '02, 129--138.
42. Wang, R. Y., Pulli, K., and Popović, J. 2007. Real-time enveloping with rotational regression. ACM Trans. Graph. 26, 3.
43. Wang, H., Hecht, F., Ramamoorthi, R., and O'Brien, J. 2010. Example-based wrinkle synthesis for clothing animation. ACM Trans. Graph. 29, 4, 107:1--107:8.
44. Weber, O., Sorkine, O., Lipman, Y., and Gotsman, C. 2007. Context-aware skeletal shape deformation. Computer Graphics Forum (Proc. of EUROGRAPHICS) 26, 3, 265--273.
45. Whiting, E., Shin, H., Wang, R., Ochsendorf, J., and Durand, F. 2012. Structural optimization of 3d masonry buildings. ACM Trans. Graph. 31, 6, 159:1--159:11.
46. Zheng, C., and James, D. L. 2012. Energy-based self-collision culling for arbitrary mesh deformations. ACM Trans. Graph. 31, 4, 98:1--98:12.
47. Zurdo, J., Brito, J., and Otaduy, M. 2013. Animating wrinkles by example on non-skinned cloth. Visualization and Computer Graphics, IEEE Transactions on 19, 1, 149--158.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation

  • Modeling and simulation

    • Simulation types and techniques

      • Simulation by animation