Tomohiro Ozawa
Hideki Koike
ABSTRACT
We introduce a novel image mosaicing algorithm to generate 360° landscape images while also taking into account the presence of people at the boundaries between stitched images. Current image mosaicing techniques tend to fail when there is extreme parallax caused by nearby objects or moving objects at the boundary between images. This parallax causes ghosting or unnatural discontinuities in the image. To address this problem, we present an image mosaicing algorithm that is robust to parallax and misalignment, and is also able to preserve the important human-centric content, specifically faces. In particular, we find an optimal path between the boundary of two images that preserves color continuity and peoples' faces in the scene. Preliminary results show promising results of preserving close-up faces with parallax while also being able to generate a perceptually plausible 360° panoramic image.
- AT&T. Crowdphoto. http://uverseonline.att.net/usc-crowdphoto.Google Scholar
- S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Trans. Graph., 26, 2007. Google ScholarDigital Library
- H. Bay, T. Tuytelaars, and L. Van Gool. SURF: Speeded up robust features. European Conference on Computer Vision, pages 404--417, 2006. Google ScholarDigital Library
- A. Briuno. Normal form in perturbation theory. In 8th International Conference on Nonlinear Oscillations, Proceedings, volume 1, pages 177--182, 1979.Google Scholar
- M. Brown. Autostitch. http://www.cs.bath.ac.uk/brown/autostitch/autostitch.html.Google Scholar
- M. Brown and D. Lowe. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 74(1):59--73, 2007. Google ScholarDigital Library
- N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition, pages 886--893, 2005. Google ScholarDigital Library
- J. Davis. Mosaics of scenes with moving objects. In Computer Vision and Pattern Recognition, Proceedings., pages 354--360, 1998. Google ScholarDigital Library
- M. Fredman and R. Tarjan. Fibonacci heaps and their uses in improved network optimization algorithms. Journal of the ACM, 34(3):596--615, 1987. Google ScholarDigital Library
- P. Hart, N. Nilsson, and B. Raphael. A formal basis for the heuristic determination of minimum cost paths. Systems Science and Cybernetics, 4(2):100--107, 1968.Google ScholarCross Ref
- V. Kuchelmeister, J. Shaw, M. McGinity, D. Del Favero, and A. Hardjono. Immersive mixed media augmented reality applications and technology. Advances in Multimedia Information Processing, pages 1112--1118, 2009. Google ScholarDigital Library
- V. Kwatra, A. Schodl, I. Essa, G. Turk, and A. Bobick. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics, 22(3):277--286, 2003. Google ScholarDigital Library
- Microsoft. Microsoft image composite editor. http://research.microsoft.com/en-us/um/redmond/groups/ivm/ice/.Google Scholar
- C. Papadimitriou and M. Sideri. On the Floyd-Warshall algorithm for logic programs. The Journal of Logic Programing, 41(1):129--137, 1999.Google ScholarCross Ref
- R. Sarvadevabhatla and V. Ng-Thow-Hing. Panoramic attention for humanoid robots. In Humanoid Robots, pages 215--222, 2009.Google Scholar
- M. Uyttendaele, A. Eden, and R. Skeliski. Eliminating ghosting and exposure artifacts in image mosaics. In Computer Vision and Pattern Recognition, Proceedings., volume 2, pages 509--516, 2001.Google Scholar
- M. Viola, M. Jones, and P. Viola. Fast multi-view face detection. In Computer Vision and Pattern Recognition, Proceedings., 2003.Google Scholar
- Z. Zhang. A flexible new technique for camera calibration. Pattern Analysis and Machine Intelligence, 22(11):1330--1334, 2000. Google ScholarDigital Library
Index Terms
- Human-centric panoramic imaging stitching
Recommendations
A setup for panoramic stereo imaging
In this paper, based on the proposed basic implementation of circular projection, a multi-camera setup which can be used for panoramic stereo imaging is presented. Firstly, we get multiple stereo pairs instantly by fixing multiple cameras on the ...
Multi perspective panoramic imaging
Panoramic images have only been feasible if all contributing image patches share a common center of projection. Then, they can be consolidated into a single image using perspective transforms. In contrast to that, we propose a novel non-linear warping ...
Image stitching with dynamic elements
This paper presents a new combination of techniques to create pleasing and physically consistent image mosaics despite the presence of moving objects in the scene. The technique uses heuristic seam selection in the intensity and gradient-domains to ...
Comments