Multiscale texture synthesis

ABSTRACT

Example-based texture synthesis algorithms have gained widespread popularity for their ability to take a single input image and create a perceptually similar non-periodic texture. However, previous methods rely on single input exemplars that can capture only a limited band of spatial scales. For example, synthesizing a continent-like appearance at a variety of zoom levels would require an impractically high input resolution. In this paper, we develop a multiscale texture synthesis algorithm. We propose a novel example-based representation, which we call an exemplar graph, that simply requires a few low-resolution input exemplars at different scales. Moreover, by allowing loops in the graph, we can create infinite zooms and infinitely detailed textures that are impossible with current example-based methods. We also introduce a technique that ameliorates inconsistencies in the user's input, and show that the application of this method yields improved interscale coherence and higher visual quality. We demonstrate optimizations for both CPU and GPU implementations of our method, and use them to produce animations with zooming and panning at multiple scales, as well as static gigapixel-sized images with features spanning many spatial scales.

References

1. Ashikhmin, M. 2001. Synthesizing natural textures. In SI3D, 217--226.
2. Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE TVCG 7, 2, 120--135.
3. DeBonet, J. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In SIGGRAPH, 361--368.
4. Ebert, D. S., Musgrave, F. K., Peachey, D., Perlin, K., and Worley, S. 2003. Texturing and Modeling: A Procedural Approach. Morgan Kaufmann, San Francisco, CA.
5. Efros, A., and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341--346.
6. Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In ICCV, 1033--1038.
7. Freeman, W. T., Jones, T. R., and Pasztor, E. C. 2001. Examplebased super-resolution. Tech. Rep. TR-2001-30, MERL.
8. Han, C., Sun, B., Ramamoorthi, R., and Grinspun, E. 2007. Frequency domain normal map filtering. In SIGGRAPH, 28.
9. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In SIGGRAPH, 229--238.
10. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In SIGGRAPH, 327--340.
11. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. In SIGGRAPH, 2.
12. Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. In SIGGRAPH, 277--286.
13. Kwatra, V., Essa, I., Bobick, A. F., and Kwatra, N. 2005. Texture optimization for example-based synthesis. In SIGGRAPH, 795--802.
14. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. In SIGGRAPH, 777--786.
15. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. In SIGGRAPH, 541--548.
16. Liang, L., Liu, C., Xu, Y., Guo, B., and Shum, H. 2001. Real-time texture synthesis by patch-based sampling. Tech. Rep. MSR-TR-2001-40, Microsoft Research.
17. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. In SIGGRAPH, 787--794.
18. Perlin, K. 1985. An image synthesizer. In SIGGRAPH, 287--296.
19. Popat, K., and Picard, R. 1993. Novel cluster-based probability model for texture synthesis, classification, and compression. In SPIE VCIP, 756--768.
20. Portilla, J., and Simoncelli, E. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. IJCV 40, 1, 49--70.
21. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In SIGGRAPH, 465--470.
22. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH, 665--672.
23. Tonietto, L., and Walter, M. 2002. Towards local control for image-based texture synthesis. In SIBGRAPI, 252.
24. Wei, L., and Levoy, M. 2000. Fast texture synthesis using treestructured vector quantization. In SIGGRAPH, 355--360.
25. Wei, L., and Levoy, M. 2002. Order-independent texture synthesis. Tech. Rep. TR-2002-01, Stanford University CS Dept.
26. Wei, L.-Y. 2002. Texture synthesis by fixed neighborhood searching. PhD thesis, Stanford University.
27. Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. In SIGGRAPH, 364--367.
28. Zalesny, A., Ferrari, V., Caenen, G., and Gool, L. V. 2005. Composite texture synthesis. IJCV 62, 1--2, 161--176.
29. Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In EGWR, 99--104.
30. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. In SIGGRAPH, 295--302.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering