Yung-Yu Chuang
Richard Szeliski
ABSTRACT
Environment matting is a generalization of traditional bluescreen matting. By photographing an object in front of a sequence of structured light backdrops, a set of approximate light-transport paths through the object can be computed. The original environment matting research chose a middle ground—using a moderate number of photographs to produce results that were reasonably accurate for many objects. In this work, we extend the technique in two opposite directions: recovering a more accurate model at the expense of using additional structured light backdrops, and obtaining a simplified matte using just a single backdrop. The first extension allows for the capture of complex and subtle interactions of light with objects, while the second allows for video capture of colorless objects in motion.
- 1.Paul Besl. Active optical range imaging sensors. In Jorge L.C. Sanz, editor, Advances in Machine Vision, chapter 1, pages 1-63. Springer-Verlag, 1989. Google Scholar
Digital Library
- 2.J. F. Blinn and M. E. Newell. Texture and reflection in computer generated images. Communications of the ACM, 19:542-546, 1976. Google ScholarDigital Library
- 3.G. Chazan and N. Kiryati. Pyramidal intensity ratio depth sensor. Technical Report 121, Center for Communication and Information Technologies, Department of Electrical Engineering, Technion, Haifa, Israel, October 1995.Google Scholar
- 4.B. Curless and M. Levoy. Better optical triangulation through spacetime analysis. In Proceedings of IEEE International Conference on Computer Vision, pages 987-994, June 1995. Google ScholarDigital Library
- 5.Paul E. Debevec and Jitendra Malik. Recovering high dynamic range radiance maps from photographs. In P1vceedings of SIGGRAPH 97, pages 369-378, August 1997. Google ScholarDigital Library
- 6.Gerd Hfiusler and Dieter Ritter. Parallel three-dimensional sensing by colorcoded triangulation. Applied Optics, 32(35):7164-7169, December 1993.Google ScholarCross Ref
- 7.David J. Heeger and James R. Bergen. Pyramid-based texture analysis/synthesis. P1vceedings of SIGGRAPH 95, pages 229-238, August 1995. Google ScholarDigital Library
- 8.Eli Horn and Nahum Kiryati. Toward optimal structured light patterns. In P1vceedings of the International Conference on Recent Advances in Three- Dimensional Digital Imaging and Modeling, pages 28-35, 1997. Google ScholarDigital Library
- 9.T. Kanade, A. Gruss, and L. Carley. A very fast VLSI rangefinder. In 1991 IEEE International Conference on Robotics and Automation, volume 39, pages 1322-1329, April 1991.Google ScholarCross Ref
- 10.R Perona and J. Malik. Scale space and edge detection using anisotropic diffusion. IEEE Trans. on Pattern Analysis and Machine Intelligence, 12(7):629-639, July 1990. Google ScholarDigital Library
- 11.Thomas Porter and Tom Duff. Compositing digital images. In P~vceedings of SIGGRAPH 84, volume 18, pages 253-259, July 1984. Google ScholarDigital Library
- 12.William H. Press, Saul A. Teukolsky, William T. Vetterling, and Brian R Flannery. Numerical Recipes in C: The Art of Scientific Computing (2nd ed.). Cambridge University Press, 1992. Google ScholarDigital Library
- 13.K. Sato and S. Inokuchi. Three-dimensional surface measurement by space encoding range imaging. Journal of Robotic Systems, 2:27-39, 1985.Google Scholar
- 14.Erhard Schubert. Fast 3d object recognition using multiple color coded illumination. In P1vc. IEEE Conference on Acoustics, Speech, and Signal P1vcessing, pages 3057-3060, 1997. Google ScholarDigital Library
- 15.Alvy Ray Smith and James F. Blinn. Blue screen matting. In P~vceedings of SIGGRAPH 96, pages 259-268, August 1996. Google ScholarDigital Library
- 16.Gregory J. Ward. Measuring and modeling anisotropic reflection. In Edwin E. Catmull, editor, Computer Graphics (SIGGRAPH '92 P~vceedings), volume 26, pages 265-272, July 1992. Google ScholarDigital Library
- 17.G. Wolberg. Digital Image Warping. IEEE Computer Society Press, 1990. Google ScholarDigital Library
- 18.Yung Yu Chuang, Douglas E. Zongker, Joel Hindorff, Brian Curless, David H. Salesin, and Richard Szeliski. Environment matting extensions: Towards higher accuracy and real-time capture. Technical Report 2000-05-01, University of Washington, 2000.Google Scholar
- 19.Douglas E. Zongker, Dawn M. Werner, Brian Curless, and David H. Salesin. Environment matting and compositing. In P~vceedings of SIGGRAPH 99, pages 205-214, August 1999. Google ScholarDigital Library
Index Terms
- Environment matting extensions: towards higher accuracy and real-time capture
Recommendations
Environment matting and compositing
SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniquesThis paper introduces a new process, environment matting, which captures not just a foreground object and its traditional opacity matte from a real-world scene, but also a description of how that object refracts and reflects light, which we call an ...
Video matting of complex scenes
This paper describes a new framework for video matting, the process of pulling a high-quality alpha matte and foreground from a video sequence. The framework builds upon techniques in natural image matting, optical flow computation, and background ...
Environment Matting and Compositing
Seminal Graphics Papers: Pushing the Boundaries, Volume 2This paper introduces a new process, environment matting, which captures not just a foreground object and its traditional opacity matte from a real-world scene, but also a description of how that object refracts and reflects light, which we call an ...
Comments