ABSTRACT
In this paper, we describe an efficient image-based approach to computing and shading visual hulls from silhouette image data. Our algorithm takes advantage of epipolar geometry and incremental computation to achieve a constant rendering cost per rendered pixel. It does not suffer from the computation complexity, limited resolution, or quantization artifacts of previous volumetric approaches. We demonstrate the use of this algorithm in a real-time virtualized reality application running off a small number of video streams.
- 1.Bichsel, M. "Segmenting Simply Connected Moving Objects in a Static Scene." IEEE PAM116, 11 (November 1994), 1138-1142. Google ScholarDigital Library
- 2.Boyer, E., and M. Berger. "3D Surface Reconstruction Using Occluding Contours." IJCV 22, 3 (1997), 219-233. Google ScholarDigital Library
- 3.Chen, S. E. and L. Williams. "View Interpolation for Image Synthesis." SIGGRAPH 93, 279-288. Google ScholarDigital Library
- 4.Chen, S. E. "Quicktime VR- An Image-Based Approach to Virtual Environment Navigation." SIGGRAPH 95, 29-38. Google ScholarDigital Library
- 5.Curless, B., and M. Levoy. "A Volumetric Method for Building Complex Models from Range Images." SIGGRAPH 96, 303-312. Google ScholarDigital Library
- 6.Debevec, P., C. Taylor, and J. Malik, "Modeling and Rendering Architecture from Photographs." SIGGRAPH 96, 11-20. Google ScholarDigital Library
- 7.Debevec, P.E., Y. Yu, and G. D. Borshukov, "Efficient View- Dependent Image-based Rendering with Projective Texture Mapping." Proc. of EGRW 1998 (June 1998).Google Scholar
- 8.Debevec, P. Modeling and Rendering Architecture from Photographs. Ph.D. Thesis, University of California at Berkeley, Computer Science Division, Berkeley, CA, 1996. Google ScholarDigital Library
- 9.Faugeras, O. Three-dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 1993. Google ScholarDigital Library
- 10.Friedman, N. and S. Russel. "Image Segmentation in Video Sequences." Proc 13th Conference on Uncertainty in Artifical Intelligence (1997). Google ScholarDigital Library
- 11.Goldfeather, J., J. Hultquist, and H. Fuchs. "Fast Constructive Solid Geometry Display in the Pixel-Powers Graphics System." SIG- GRAPH 86, 107-116. Google ScholarDigital Library
- 12.Gortler, S. J., R. Grzeszczuk, R. Szeliski, and M. F. Cohen. "The Lumigraph." SIGGRAPH 96, 43-54. Google ScholarDigital Library
- 13.Kanade, T., P. W. Rander, and P. J. Narayanan. "Virtualized Reality: Constructing Virtual Worlds from Real Scenes." IEEE Multimedia 4, 1 (March 1997), 34-47. Google ScholarDigital Library
- 14.Laurentini, A. "The Visual Hull Concept for Silhouette Based Image Understanding." IEEE PAMI 16,2 (1994), 150-162. Google ScholarDigital Library
- 15.Levoy, M. and P. Hanrahan. "Light Field Rendering." SIGGRAPH 96, 31-42. Google ScholarDigital Library
- 16.Lorensen, W.E., and H. E. Cline. "Marching Cubes: A High Resolution 3D Surface Construction Algorithm." SIGGRAPH 87, 163-169. Google ScholarDigital Library
- 17.McMillan, L., and G. Bishop. "Plenoptic Modeling: An Image- Based Rendering System." SIGGRAPH 95, 39-46. Google ScholarDigital Library
- 18.McMillan, L. An Image-Based Approach to Three-Dimensional Computer Graphics, Ph.D. Thesis, University of North Carolina at Chapel Hill, Dept. of Computer Science, 1997. Google ScholarDigital Library
- 19.Moezzi, S., D.Y. Kuramura, and R. Jain. "Reality Modeling and Visualization from Multiple Video Sequences." IEEE CG&A 16, 6 (November 1996), 58-63. Google ScholarDigital Library
- 20.Narayanan, P., P. Rander, and T. Kanade. "Constructing Virtual Worlds using Dense Stereo." Proc. ICCV 1998, 3-10. Google ScholarDigital Library
- 21.Pollard, S. and S. Hayes. "View Synthesis by Edge Transfer with Applications to the Generation of Immersive Video Objects." Proc. of VRST, November 1998, 91-98. Google ScholarDigital Library
- 22.Potmesil, M. "Generating Octree Models of 3D Objects from their Silhouettes in a Sequence of Images." CVGIP 40 (1987), 1-29. Google ScholarDigital Library
- 23.Rander, P. W., P. J. Narayanan and T. Kanade, "Virtualized Reality: Constructing Time Varying Virtual Worlds from Real World Events." Proc. IEEE Visualization 1997, 277-552. Google ScholarDigital Library
- 24.Rappoport, A., and S. Spitz. "Interactive Boolean Operations for Conceptual Design of 3D solids." SIGGRAPH 97, 269-278. Google ScholarDigital Library
- 25.Roth, S. D. "Ray Casting for Modeling Solids." Computer Graphics and Image Processing, 18 (February 1982), 109-144.Google ScholarCross Ref
- 26.Saito, H. and T. Kanade. "Shape Reconstruction in Projective Grid Space from a Large Number of Images." Proc. of CVPR, (1999).Google Scholar
- 27.Seitz, S. and C. R. Dyer. "Photorealistic Scene Reconstruction by Voxel Coloring." Proc. of CVPR (1997), 1067-1073. Google ScholarDigital Library
- 28.Seuss, D. "The Cat in the Hat," CBS Television Special (1971).Google Scholar
- 29.Szeliski, R. "Rapid Octree Construction from Image Sequences." CVGIP: Image Understanding 58, 1 (July 1993), 23-32. Google ScholarDigital Library
- 30.Vedula, S., P. Rander, H. Saito, and T. Kanade. "Modeling, Combining, and Rendering Dynamic Real-World Events from Image Sequences." Proc. 4~h Intl. Conf. on Virtual Systems and Multimedia (Nov 1998).Google Scholar
Index Terms
- Image-based visual hulls
Recommendations
Image-based 3D photography using opacity hulls
We have built a system for acquiring and displaying high quality graphical models of objects that are impossible to scan with traditional scanners. Our system can acquire highly specular and fuzzy materials, such as fur and feathers. The hardware set-up ...
Image-based 3D photography using opacity hulls
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniquesWe have built a system for acquiring and displaying high quality graphical models of objects that are impossible to scan with traditional scanners. Our system can acquire highly specular and fuzzy materials, such as fur and feathers. The hardware set-up ...
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesIn this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...
Comments