Takafumi Katsunuma
Abstract
Texture and color are important factors of fabric appearance. A system that could intuitively manipulate and design fabric texture and color would be a very powerful tool. This article presents an interactive fabric appearance design system that modulates the texture patterns of input fabric example images and transfers the color patterns from other input images onto them. For this purpose, we propose a method to synthesize a natural texture image based on our findings from subjective experiments: (1) intensity and its deviation of two input images are significantly related to the realistic appearance of synthesized textures and (2) the spatial-frequency and edge intensity of two different input images significantly influence the natural appearance of synthesized texture perception. In our procedure, first, the texture pattern of an input fabric image is modulated in terms of undulation, thickness, and roughness. Next, we transfer the color pattern of an original color image onto the modulated texture pattern in the YIQ color space. To perform this color transfer, we use the IQ component of the color image. To reduce the unnatural appearance of the output color-transfer image, we remove the high-frequency components of the original color image. In addition, the Y component of the color-transfer image is obtained by adding the deviation of the texture pattern Y component to the texture pattern of the color image. These algorithms for reducing unnaturalness and synthesizing images were developed based on our findings from several subjective experiments on natural appearance. Finally, we implemented our algorithm on a smart device. Our system allows us to interactively design the texture and color of fabric by using images.
- Edward H. Adelson. 2001. Seeing stuff: The perception of materials by humans and machines. In Proceedings of the SPIE 4299, 1--12. Google Scholar
Cross Ref
- Barton L. Anderson. 2011. Visual perception of materials and surfaces. Current Biology 21, R978--R983. Google ScholarCross Ref
- Ivaylo Boyadzhiev, Kavita Bala, Sylvain Paris, and Edward H. Adelson. 2015. Band-sifting decomposition for image-based material editing. ACM Trans. Graphics. 34, 5, Article No. 163. Google ScholarDigital Library
- Kristin J. Dana, Bram van Ginneken, Shree K. Nayar, and Jan J. Koenderink. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graphics 18, 1, 1--34. Google ScholarDigital Library
- Olga Diamanti, Connelly Barnes, Sylvain Paris, Eli Shechtman, and Olga Sorkine-Hornung. 2015. Synthesis of complex image appearance from limited exemplars. ACM Trans. Graphics (SIGGRAPH 2015) 34, 2, Article No. 22. Google ScholarDigital Library
- Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color compatibility from large datasets. ACM Trans. Graphics (SIGGRAPH 2011) 30, 4, Article No. 63. Google ScholarDigital Library
- Roland W. Fleming. 2014. Visual perception of materials and their properties. Vision Research 94, 62--75. Google ScholarCross Ref
- Eduardo S. L. Gastal and Manuel M. Oliveira. 2011. Domain transform for edge-aware image and video processing. ACM Trans. Graphics (SIGGRAPH 2011). 30, 4, Article No. 69. Google ScholarDigital Library
- Martin Giesel and Qasim Zaidi. 2013. Frequency-based heuristics for material perception. Journal of Vision 13, 14, Article No. 7, 1--19.Google ScholarCross Ref
- Takafumi Katsunuma, Keita Hirai, and Takahiko Horiuchi. 2016. Perceptual dependencies in fabric appearance between texture and color. Electronic Imaging, Measuring, Modeling, and Reproducing Material Appearance, 1--6.Google Scholar
- Min H. Kim, Tim Weyrich, and Jan Kautz. 2009. Modeling human color perception under extended luminance levels. ACM Trans. Graphics (SIGGRAPH 2009) 28, 3, Article No. 27. Google ScholarDigital Library
- Jiangtao Kuang, Garrett M. Johnson, and Mark D. Fairchild. 2007. iCAM06: A refined image appearance model for HDR image rendering, Journal of Visual Communication 18, 5, 406--414 Google ScholarDigital Library
- Yanxiang Lan, Yue Dong, Fabio Pellacini, and Xin Tong. 2013. Bi-scale appearance fabrication. ACM Trans. Graphics (SIGGRAPH 2013) 32, 4, Article No. 145. Google ScholarDigital Library
- Sharon Lin, Daniel Ritchie, Matthew Fisher, and Pat Hanrahan. 2013. Probabilistic color-by-numbers: Suggesting pattern colorizations using factor graphs. ACM Trans. Graphics (SIGGRAPH 2013) 32, 4, Article No. 37. Google ScholarDigital Library
- Ce Liu, Lavanya Sharan, Edward H. Adelson, and Ruth Rosenholtz. 2010. Exploring features in a Bayesian framework for material recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 239--246. Google ScholarCross Ref
- Laurence T. Maloney and David H. Brainard. 2010. Color and material perception: Achievements and challenges. Journal of Vision 10, 9, Article No. 19, 1--6.Google Scholar
- Wojciech Matusik, Matthias Zwicker, and Fredo Durand. 2005. Texture design using a simplicial complex of morphable textures. ACM Trans. Graphics (SIGGRAPH 2005) 24, 3, 787--794. Google ScholarDigital Library
- Nathan Moroney, Mark D. Fairchild, Robert W. G. Hunt, Changjun Li, Ronnier M. Luo, and Todd Newman. 2002. The CIECAM02 color appearance model. In Proceedings of the 10th Color and Imaging Conference (CIC10), 23--27.Google Scholar
- Addy Ngan and Fredo Durand. 2006. Statistical acquisition of texture appearance. In Proceedings of the 17th Eurographics Conference on Rendering Techniques, 31--40. Google ScholarDigital Library
- Yoichi Ochiai, Takayuki Hoshi, Jun Rekimoto, and Masaya Takasaki. 2014. Diminished haptics: Towards digital transformation of real world textures. In Proceedings of the 9th EuroHaptics, 409--417. Google ScholarCross Ref
- Maria Olkkonen, Thorsten Hansen, and Karl R. Gegenfurtner. 2008. Color appearance of familiar objects: Effects of object shape, texture, and illumination changes. Journal of Vision 8, 5, Article No. 13, 1--16.Google ScholarCross Ref
- Julian Panetta, Qingnan Zhou, Luigi Malomo, Nico Pietroni, Paolo Cignoni, and Denis Zorin. 2015. Elastic textures for additive fabrication. ACM Trans. Graphics (SIGGRAPH 2015) 34, 4, Article No. 135. Google ScholarDigital Library
- Seyad A. Hosseini Ravandi and Koichiro Toriumi. 1995. Fourier transform analysis of plain weave fabric appearance. Textile Research Journal 65, 11, 676--683. Google ScholarCross Ref
- Erik Reinhard, Michael Ashikhmin, Bruce Gooch, and Peter Shirley. 2001. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34--41 Google ScholarDigital Library
- Erik Reinhard, Tania Pouli, Timo Kunkel, Ben Long, Anders Ballestad, and Gerwin Damberg. 2012. Calibrated image appearance reproduction. ACM Trans. Graphics (SIGGRAPH Asia 2012) 31, 6, Article No. 201. Google ScholarDigital Library
- Masataka Sawayama and Eiji Kimura. 2015. Stain on texture: Perception of a dark spot having a blurred edge on textured backgrounds. Vision Research, 109, 209--220. Google ScholarCross Ref
- Ana Serrano, Diego Gutierrez, Karol Myszkowski, Nans-Peter Seidel, and Belen Masia. 2016. An intuitive control space for material appearance. ACM Trans. Graphics, 35, 6, Article No. 186. Google ScholarDigital Library
- Xin Wang, Nicolas D. Georganas, and Emil M. Petriu. 2011. Fabric texture analysis using computer vision techniques. IEEE Trans. Instrumentation and Measurement 60, 1, 44--56. Google ScholarCross Ref
- Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the art in example-based texture synthesis. In Proceedings of Eurographics, 93--117.Google Scholar
- Michael Weinmann, Juergen Gall, and Reinhard Klein. 2014. Material classification based on training data synthesized using a BTF database. In Proceedings of European Conference on Computer Vision (ECCV), 156--171. Google ScholarCross Ref
- Christoph Witzel, Hanna Valkova, Thorsten Hansen, and Karl R. Gegenfurtner. 2011. Object knowledge modulates colour appearance. i-Perception 2, 1, 13--49.Google Scholar
- Bei Xiao, Wenyan Bi, Xiaodan Jia, Hanhan Wei, Edward H. Adelson. 2016. Can you see what you feel? Color and folding properties affect visual-tactile material discrimination of fabrics. Journal of Vision, 16, 3, Article No. 34. Google ScholarCross Ref
Index Terms
- Fabric Appearance Control System for Example-Based Interactive Texture and Color Design
Recommendations
Underwater image enhancement by combining color constancy and dehazing based on depth estimation
Highlights- Proposed an underwater image enhancement method using color constancy and dehazing.
AbstractThe physical properties which are present in the underwater environment affects the images captured by the visual sensors. As a consequence of these properties, the captured image includes non-uniform illumination. This non-uniform ...
Example-Based Color Stylization of Images
We describe a new computational approach to stylize the colors of an image by using a reference image. During processing, we take the characteristics of human color perception into account to generate more appealing results. Our system starts by ...
Example-based color stylization based on categorical perception
APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualizationWe describe a new computational approach to stylize the colors of an image by using a reference image. During processing, we take characteristics of human color perception into account to generate more appealing results. Our system starts by classifying ...
Comments