skip to main content
research-article

By-example synthesis of structurally sound patterns

Published:27 July 2015Publication History
Skip Abstract Section

Abstract

Several techniques exist to automatically synthesize a 2D image resembling an input exemplar texture. Most of the approaches optimize a new image so that the color neighborhoods in the output closely match those in the input, across all scales. In this paper we revisit by-example texture synthesis in the context of additive manufacturing. Our goal is to generate not only colors, but also structure along output surfaces: given an exemplar indicating 'solid' and 'empty' pixels, we generate a similar pattern along the output surface. The core challenge is to guarantee that the pattern is not only fully connected, but also structurally sound.

To achieve this goal we propose a novel formulation for on-surface by-example texture synthesis that directly works in a voxel shell around the surface. It enables efficient local updates to the pattern, letting our structural optimizer perform changes that improve the overall rigidity of the pattern. We use this technique in an iterative scheme that jointly optimizes for appearance and structural soundness. We consider fabricability constraints and a user-provided description of a force profile that the object has to resist.

Our results fully exploit the capabilities of additive manufacturing by letting users design intricate structures along surfaces. The structures are complex, yet they resemble input exemplars, resulting in a modeling tool accessible to casual users.

Skip Supplemental Material Section

Supplemental Material

a137.mp4

mp4

15.5 MB

References

  1. Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D '01, 217--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bhat, P., Ingram, S., and Turk, G. 2004. Geometric texture synthesis by example. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,ACM, New York, NY, USA, SGP '04, 41--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bowers, J., Wang, R., Wei, L.-Y., and Maletz, D. 2010. Parallel poisson disk sampling with spectrum analysis on surfaces. ACM Trans. Graph. 29, 6 (Dec.), 166:1--166:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Chen, Y., Davis, T. A., Hager, W. W., and Rajamanickam, S. 2008. Algorithm 887: Cholmod, supernodal sparse cholesky factorization and update/downdate. ACM Trans. Math. Softw. 35, 3 (Oct.), 22:1--22:14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Christiansen, A. N., BÆrentzen, J. A., Nobel-Jørgensen, M., Aage, N., and Sigmund, O. 2015. Combined shape and topology optimization of 3d structures. Computers & Graphics 46, 0, 25--35. Shape Modeling International 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Christiansen, A. N., Schmidt, R., and BÆrentzen, J. A. 2015. Automatic balancing of 3d models. Computer-Aided Design 58, 0, 236--241. Solid and Physical Modeling 2014.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cook, R. D., Malkus, D. S., Plesha, M. E., and Witt, R. J. 2007. Concepts and Applications of Finite Element Analysis. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dong, Y., Lefebvre, S., Tong, X., and Drettakis, G. 2008. Lazy solid texture synthesis. Computer Graphics Forum 27, 4, 1165--1174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dumas, J., Hergel, J., and Lefebvre, S. 2014. Bridging the gap: Automated steady scaffoldings for 3d printing. ACM Trans. Graph. 33, 4 (July), 98:1--98:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '01, 341--346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gal, R., Wexler, Y., Ofek, E., Hoppe, H., and Cohen-Or, D. 2010. Seamless montage for texturing models. Computer Graphics Forum 29, 2, 479--486.Google ScholarGoogle ScholarCross RefCross Ref
  12. Guennebaud, G., Jacob, B., et al., 2010. Eigen v3. http://eigen.tuxfamily.org.Google ScholarGoogle Scholar
  13. Harker, J., 2011. Crania Anatomica Filigre: Me to You. https://www.kickstarter.com/projects/joshharker/crania-anatomica-filigre-me-to-you.Google ScholarGoogle Scholar
  14. Haumont, D., Debeir, O., and Sillion, F. 2003. Volumetric cell-and-portal generation. CFG 22, 3, 303--312.Google ScholarGoogle ScholarCross RefCross Ref
  15. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '01, 327--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hu, R., Li, H., Zhang, H., and Cohen-Or, D. 2014. Approximate pyramidal shape decomposition. ACM Trans. Graph. 33, 6 (Nov.), 213:1--213:12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3 (July), 277--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Trans. Graph. 24, 3 (July), 795--802. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Lagae, A., Dumont, O., and Dutre, P. 2005. Geometry synthesis by example. In Proceedings of the International Conference on Shape Modeling and Applications 2005, IEEE Computer Society, Washington, DC, USA, SMI '05, 176--185. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Trans. Graph. 24, 3 (July), 777--786. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Trans. Graph. 25, 3 (July), 541--548. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Lempitsky, V., and Ivanov, D. 2007. Seamless mosaicing of image-based texture maps. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, 1--6.Google ScholarGoogle Scholar
  23. Liu, L., Chambers, E. W., Letscher, D., and Ju, T. 2010. A simple and robust thinning algorithm on cell complexes. Computer Graphics Forum 29, 7, 2253--2260.Google ScholarGoogle ScholarCross RefCross Ref
  24. Lu, L., Sharf, A., Zhao, H., Wei, Y., Fan, Q., Chen, X., Savoye, Y., Tu, C., Cohen-Or, D., and Chen, B. 2014. Build-to-last: Strength to weight 3d printed objects. ACM Trans. Graph. 33, 4 (July), 97:1--97:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Luo, L., Baran, I., Rusinkiewicz, S., and Matusik, W. 2012. Chopper: Partitioning models into 3d-printable parts. ACM Trans. Graph. 31, 6 (Nov.), 129:1--129:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ma, C., Huang, H., Sheffer, A., Kalogerakis, E., and Wang, R. 2014. Analogy-driven 3d style transfer. Computer Graphics Forum 33, 2, 175--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '00, 465--470. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Prévost, R., Whiting, E., Lefebvre, S., and Sorkine-Hornung, O. 2013. Make it stand: Balancing shapes for 3d fabrication. ACM Trans. Graph. 32, 4 (July), 81:1--81:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Rosenkrantz, J., and Louis-Rosenberg, J., 2007. http://n-e-r-v-o-u-s.com/about_us.php.Google ScholarGoogle Scholar
  30. Schmidt, R., and Singh, K. 2010. Meshmixer: An interface for rapid mesh composition. In ACM SIGGRAPH 2010 Talks, ACM, New York, NY, USA, SIGGRAPH '10, 6:1--6:1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Segerman, H., 2009. Surface autoglyphs. http://www.segerman.org/autologlyphs.html.Google ScholarGoogle Scholar
  32. Sigmund, O., and Maute, K. 2013. Topology optimization approaches. Struct. and Mult. Optimization 48, 6, 1031--1055.Google ScholarGoogle ScholarCross RefCross Ref
  33. Sigmund, O. 2001. A 99 line topology optimization code written in matlab. Struct. and Mult. Optimization 21, 2, 120--127. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Soler, C., Cani, M.-P., and Angelidis, A. 2002. Hierarchical pattern mapping. ACM Trans. Graph. 21, 3 (July), 673--680. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Stava, O., Vanek, J., Benes, B., Carr, N., and Měch, R. 2012. Stress relief: Improving structural strength of 3d printable objects. ACM Trans. Graph. 31, 4 (July), 48:1--48:11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Trans. Graph. 21, 3 (July), 665--672. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Turk, G. 2001. Texture synthesis on surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '01, 347--354. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Umetani, N., and Schmidt, R. 2013. Cross-sectional structural analysis for 3d printing optimization. In SIGGRAPH Asia 2013 Technical Briefs, ACM, New York, NY, USA, SA '13, 5:1--5:4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Vanek, J., Galicia, J. A. G., and Benes, B. 2014. Clever support: Efficient support structure generation for digital fabrication. Computer Graphics Forum 33, 5, 117--125. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Wang, W., Wang, T. Y., Yang, Z., Liu, L., Tong, X., Tong, W., Deng, J., Chen, F., and Liu, X. 2013. Cost-effective printing of 3d objects with skin-frame structures. ACM Trans. Graph. 32, 6 (Nov.), 177:1--177:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '01, 355--360. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report.Google ScholarGoogle Scholar
  43. Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Rendering Techniques 2001, S. Gortler and K. Myszkowski, Eds., Eurographics. Springer Vienna, 301--312. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM Trans. Graph. 22, 3 (July), 295--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Zhou, K., Huang, X., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H.-Y. 2006. Mesh quilting for geometric texture synthesis. ACM Trans. Graph. 25, 3 (July), 690--697. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Zhou, Q., Panetta, J., and Zorin, D. 2013. Worst-case structural analysis. ACM Trans. Graph. 32, 4 (July), 137:1--137:12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Zhou, S., Jiang, C., and Lefebvre, S. 2014. Topology-constrained synthesis of vector patterns. ACM Trans. Graph. 33, 6 (Nov.), 215:1--215:11. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. By-example synthesis of structurally sound patterns

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 34, Issue 4
        August 2015
        1307 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/2809654
        Issue’s Table of Contents

        Copyright © 2015 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 27 July 2015
        Published in tog Volume 34, Issue 4

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader