Imagine visiting your favorite place, taking a few pictures, and then turning those pictures into a photorealisic three-dimensional computer model. The work presented in this thesis combines techniques from computer vision and computer graphics to make this possible. The applications range from architectural planning and archaeological reconstructions to virtual environments and cinematic special effects.
This thesis presents an approach for modeling and rendering existing architectural scenes from sparse sets of still photographs. The modeling approach, which combines both geometry-based and image-based techniques, has two components. The first component is an interactive photogrammetric modeling method which facilitates the recovery of the basic geometry of the photographed scene. The photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, this new technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, this approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, this thesis presents view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models.
This approach can be used to recover models for use in either geometry-based or image-based rendering systems. This work presents results that demonstrate the approach's ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. This thesis concludes with a presentation of how these modeling and rendering techniques were used to create the interactive art installation Rouen Revisited, presented at the SIGGRAPH '96 art show.
Cited By
- Fritsch D and Klein M (2018). 3D preservation of buildings --- Reconstructing the past, Multimedia Tools and Applications, 77:7, (9153-9170), Online publication date: 1-Apr-2018.
- Penner E and Zhang L (2017). Soft 3D reconstruction for view synthesis, ACM Transactions on Graphics, 36:6, (1-11), Online publication date: 20-Nov-2017.
- Weinmann M and Klein R Advances in geometry and reflectance acquisition (course notes) SIGGRAPH Asia 2015 Courses, (1-71)
- Stojaković V, Popov S and Tepavčević B (2014). Visualization of the Centre of Projection Geometrical Locus in a Single Image, Computer Graphics Forum, 33:1, (52-63), Online publication date: 1-Feb-2014.
- Palomo C and Gattass M An efficient algorithm for depth image rendering Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry, (271-276)
- de Kadt C, Gain J and Marais P Revisiting district six Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, (13-21)
- Jiang N, Tan P and Cheong L (2009). Symmetric architecture modeling with a single image, ACM Transactions on Graphics, 28:5, (1-8), Online publication date: 1-Dec-2009.
- Jiang N, Tan P and Cheong L Symmetric architecture modeling with a single image ACM SIGGRAPH Asia 2009 papers, (1-8)
- Sebe I, You S and Neumann U Rapid part-based 3D modeling Proceedings of the ACM symposium on Virtual reality software and technology, (143-146)
- Park J (2005). Interactive 3D reconstruction from multiple images, Pattern Recognition Letters, 26:16, (2558-2571), Online publication date: 1-Dec-2005.
- Sosa-Ramirez G and Arias-Estrada M 3D Recovery with Free Hand Camera Motion Proceedings of the Sixth Mexican International Conference on Computer Science, (145-151)
- Sormann M, Bauer J, Zach C, Klaus A and Karner K VR modeler Proceedings of the 20th Spring Conference on Computer Graphics, (148-156)
- Chang N and Zakhor A (2019). Constructing a Multivalued Representation for View Synthesis, International Journal of Computer Vision, 45:2, (157-190), Online publication date: 1-Nov-2001.
- Haval N (2000). Three-Dimensional Documentation of Complex Heritage Structures, IEEE MultiMedia, 7:2, (52-56), Online publication date: 1-Apr-2000.
- Matusik W, Buehler C, Raskar R, Gortler S and McMillan L Image-based visual hulls Proceedings of the 27th annual conference on Computer graphics and interactive techniques, (369-374)
Recommendations
Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach
Seminal Graphics Papers: Pushing the Boundaries, Volume 2We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a ...