skip to main content
Modeling and rendering architecture from photographs
Publisher:
  • University of California, Berkeley
ISBN:978-0-591-31971-2
Order Number:AAI9722941
Pages:
147
Bibliometrics
Skip Abstract Section
Abstract

Imagine visiting your favorite place, taking a few pictures, and then turning those pictures into a photorealisic three-dimensional computer model. The work presented in this thesis combines techniques from computer vision and computer graphics to make this possible. The applications range from architectural planning and archaeological reconstructions to virtual environments and cinematic special effects.

This thesis presents an approach for modeling and rendering existing architectural scenes from sparse sets of still photographs. The modeling approach, which combines both geometry-based and image-based techniques, has two components. The first component is an interactive photogrammetric modeling method which facilitates the recovery of the basic geometry of the photographed scene. The photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, this new technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, this approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, this thesis presents view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models.

This approach can be used to recover models for use in either geometry-based or image-based rendering systems. This work presents results that demonstrate the approach's ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. This thesis concludes with a presentation of how these modeling and rendering techniques were used to create the interactive art installation Rouen Revisited, presented at the SIGGRAPH '96 art show.

Cited By

  1. Fritsch D and Klein M (2018). 3D preservation of buildings --- Reconstructing the past, Multimedia Tools and Applications, 77:7, (9153-9170), Online publication date: 1-Apr-2018.
  2. ACM
    Penner E and Zhang L (2017). Soft 3D reconstruction for view synthesis, ACM Transactions on Graphics, 36:6, (1-11), Online publication date: 20-Nov-2017.
  3. ACM
    Weinmann M and Klein R Advances in geometry and reflectance acquisition (course notes) SIGGRAPH Asia 2015 Courses, (1-71)
  4. Stojaković V, Popov S and Tepavčević B (2014). Visualization of the Centre of Projection Geometrical Locus in a Single Image, Computer Graphics Forum, 33:1, (52-63), Online publication date: 1-Feb-2014.
  5. ACM
    Palomo C and Gattass M An efficient algorithm for depth image rendering Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry, (271-276)
  6. ACM
    de Kadt C, Gain J and Marais P Revisiting district six Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, (13-21)
  7. ACM
    Jiang N, Tan P and Cheong L (2009). Symmetric architecture modeling with a single image, ACM Transactions on Graphics, 28:5, (1-8), Online publication date: 1-Dec-2009.
  8. ACM
    Jiang N, Tan P and Cheong L Symmetric architecture modeling with a single image ACM SIGGRAPH Asia 2009 papers, (1-8)
  9. ACM
    Sebe I, You S and Neumann U Rapid part-based 3D modeling Proceedings of the ACM symposium on Virtual reality software and technology, (143-146)
  10. Park J (2005). Interactive 3D reconstruction from multiple images, Pattern Recognition Letters, 26:16, (2558-2571), Online publication date: 1-Dec-2005.
  11. Sosa-Ramirez G and Arias-Estrada M 3D Recovery with Free Hand Camera Motion Proceedings of the Sixth Mexican International Conference on Computer Science, (145-151)
  12. ACM
    Sormann M, Bauer J, Zach C, Klaus A and Karner K VR modeler Proceedings of the 20th Spring Conference on Computer Graphics, (148-156)
  13. Chang N and Zakhor A (2019). Constructing a Multivalued Representation for View Synthesis, International Journal of Computer Vision, 45:2, (157-190), Online publication date: 1-Nov-2001.
  14. Haval N (2000). Three-Dimensional Documentation of Complex Heritage Structures, IEEE MultiMedia, 7:2, (52-56), Online publication date: 1-Apr-2000.
  15. Matusik W, Buehler C, Raskar R, Gortler S and McMillan L Image-based visual hulls Proceedings of the 27th annual conference on Computer graphics and interactive techniques, (369-374)
Contributors
  • Netflix, Inc.
  • University of California, Berkeley

Recommendations