Holoimages

ABSTRACT

We introduce a novel geometric representation called the holoimage, which encodes both shading and geometry information within the same image, based on the principles of wave optics. 'Image' referes to the representation and records the amplitude of the lighting; 'holo' means that it encodes phase, and hence, three-dimensional information. Compared to conventional geometry images or depth images, the holoimage has much higher geometric accuracy. Thus, 3D information can readily be stored and transmitted using the common 24-bit image format.Holoimages can be efficiently rendered by modern graphics hardware; rendering speed is independent of the geometric complexity and only determined by the image resolution. Rendering holoimages requires no meshes, only textures.Holoimages allow various geometric processing tasks to be performed simply using straightforward image processing methods, including such tasks such as embossing and engraving, geometric texture extraction, and surface deformation measurement.Conventional geometric representations, such as meshes, point clouds, implicit surfaces and CSG models, can be easily converted to holoimages using conventional rendering techniques in real time. The opposite process, converting holoimages to geometry in the form of a depth map is accomplished efficiently accomplished by graphics hardware.Furthermore, holoimages can be easily captured from the real world with a projector and a camera at video frame rate.

References

1. Bolz, J., Farmer, I., Grinspun, E., and Schröder, P. 2003. Sparse matrix solvers on the gpu: conjugate gradients and multigrid. In Proceedings of SIGGRAPH 2003, ACM Press / ACM SIGGRAPH, 917--924.
2. Carr, N. A., and Hart, J. C. 2004. Painting detail. In Proceedings of SIGGRAPH 2004, ACM Press / ACM SIGGRAPH, 845--852.
3. Creath, K. 1987. Step height measurement using two-wavelength phase-shifting interferometry. Appl. Opt. 26, 2810--2816.
4. Gåsvik, K. J. 2002. Optical Metrology, 3rd ed. John Wiley and Sons, Inc.
5. Ghiglia, D. C., and Pritt, M. D. 1998. Two-Dimensional Phase Unwrapping: Theory, Algorithms, and Software. John Wiley and Sons, Inc.
6. Gu, X., Gortler, S., and Hoppe, H. 2002. Geometry images. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 355--361.
7. Gu, X., Zhang, S., and Huang, P. 2004. University of new york at stony brook geometric surface archive. http://metrology.eng.sunysb.edu/holoimage/index.htm.
8. Harding, K. G. 1991. Phase grating use for slop discrimination in moiré contouring. In Proc. SPIE, vol. 1614 of Optics, illumination, and image sensing for machine vision VI, 265--270.
9. Hoppe, H., and Praun, E. 2005. Shape compression using spherical geometry images. In Advances in Multiresolution for Geometric Modelling, N. Dodgson, M. Floater, and M. Sabin, Eds., 27--46.
10. Huang, P. S., and Zhang, S. 2006. A fast three-step phase shifting algorithm. Appl. Opt. (under press).
11. Huang, P. S., Hu, Q., Jin, F., and Chiang, F. P. 1999. Color-encoded digital fringe projection technique for high-speed three-dimensional surface contouring. Opt. Eng. 38, 1065--1071.
12. Huang, P. S., Zhang, C., and Chiang, F. P. 2003. High-speed 3-d shape measurement based on digital fringe projection. Opt. Eng. 42, 1, 163--168.
13. Losasso, F., and Hoppe, H. 2004. Geometry clipmaps: terrain rendering using nested regular grids. ACM Trans. Graph. 23, 3, 769--776.
14. Losasso, F., Hoppe, H., Schaefer, S., and Warren, J. 2003. Smooth geometry images. In Eurographics Symposium on Geometry Processing, 138--145.
15. Malacara, D., Ed. 1992. Optical Shop Testing. John Wiley and Songs, NY.
16. Post, D., Han, B., and Ifju, P. 1994. High-Sensitivity Moiré: Experimental Analysis for Mechanics and Materials. Springer-Verlag, Berlin.
17. Praun, E., and Hoppe, H. 2003. Spherical parametrization and remeshing. ACM Trans. Graph. 22, 3, 340--349.
18. Purcell, T. J., Buck, I., Mark, W. R., and Hanrahan, P. 2002. Ray tracing on programmable graphics hardware. In Proceedings of SIGGRAPH 2002, ACM Press / ACM SIGGRAPH, 703--712.
19. Rusinkiewicz, S., Hall-Holt, O., and Levoy, M. 2002. Real-time 3d model acquisition. ACM Trans. Graph. 21, 3, 438--446.
20. Salvi, J., Pages, J., and Batlle, J. 2004. Pattern codification strategies in structured light systems. Pattern Recogn. 37, 4, 827--849.
21. Sander, P. V., Wood, Z. J., Gortler, S. J., Snyder, J., and Hoppe, H. 2003. Multi-chart geometry images. In Eurographics Symposium on Geometry Processing, 146--155.
22. Shade, J. W., Gortler, S. J., Wei He, L., and Szeliski, R. 1998. Layered depth images. In Proceedings of SIGGRAPH 98, 231--242.
23. Takasaki, H. 1970. Moiré topography. Appl. Opt. 9, 6, 1467--1472.
24. Zhang, S., and Huang, P. 2004. High-resolution, real-time 3-d shape acquisition. In IEEE Computer Vision and Pattern Recognition Workshop (CVPRW'04), vol. 3, 28--37.
25. Zhang, S., and Huang, P. S. 2006. A novel structured light system calibration. Opt. Eng. (under press).
26. Zhang, S. 2005. High-Resolution, Real-Time 3-D Shape Measurement. PhD thesis, Stony Brook University, State University of New York.

Index Terms

• Applied computing

  • Document management and text processing

    • Document capture

      • Document scanning

      • Graphics recognition and interpretation

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering

    • Shape modeling

      • Parametric curve and surface models

      • Volumetric models