We present an approach for creating realistic synthetic views of existing architectural scenes from a sparse set of still photographs. Our approach, which combines both geometry-based and image-based modeling and rendering techniques, has two components. The first component is an easy-to-use photogrammetric modeling system which facilitates the recovery of a basic geometric model of the photographed scene. The modeling system is effective and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a {\em model-based} stereo algorithm, which recovers precisely how the real scene deviates from the basic model. Guided by the basic model, our stereo approach can robustly recover accurate depth from image pairs with large baselines with respect to the objects in the scene. Consequently, our approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. As an intermediate result, we present {\em view-dependent texture mapping}, a method of better simulating geometric detail on basic models. Our approach can recover models for use in either geometry-based or image-based rendering systems. We present results that demonstrate our approach''s abilty to create realistic renderings of architectural scenes from viewpoints far from the original photographs.
Cited By
- Herbort S and Wöhler C (2019). An introduction to image-based 3D surface reconstruction and a survey of photometric stereo methods, 3D Research, 2:3, (1-17), Online publication date: 1-Sep-2011.
- Tzur Y and Tal A FlexiStickers ACM SIGGRAPH 2009 papers, (1-10)
- Tzur Y and Tal A (2009). FlexiStickers, ACM Transactions on Graphics (TOG), 28:3, (1-10), Online publication date: 27-Jul-2009.
- Grossmann E and Santos-Victor J (2005). Least-squares 3D reconstruction from one or more views and geometric clues, Computer Vision and Image Understanding, 99:2, (151-174), Online publication date: 1-Aug-2005.
Recommendations
Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach
Seminal Graphics Papers: Pushing the Boundaries, Volume 2We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a ...