Ruigang Yang
ABSTRACT
Current camera-monitor teleconferencing applications produce unrealistic imagery and break any sense of presence for the participants. Other capture/display technologies can be used to provide more compelling teleconferencing. However, complex geometries in capture/display systems make producing geometrically correct imagery difficult. It is usually impractical to detect, model and compensate for all effects introduced by the capture/display system. Most applications simply ignore these issues and rely on the user acceptance of the camera-monitor paradigm.
This paper presents a new and simple technique for producing geometrically correct imagery for teleconferencing environments. The necessary image transformations are derived by finding a mapping between a capture and display device for a fixed viewer location. The capture/display relationship is computed directly in device coordinates and completely avoids the need for any intermediate, complex representations of screen geometry, capture and display distortions, and viewer location. We describe our approach and demonstrate it via several prototype implementations that operate in real-time and provide a substantially more compelling sense of presence than the standard teleconferencing paradigm.
- 1.C_Jruz-Neria C., D.J. Sandin, and T.A. DeFanti. Surround-screen projection-based virtal reality: The design and implementation of the CAVE. Computer Graphics, SIC GRAPH Annual Conference Proceedings, 1994.]]Google Scholar
- 2.Erikson H. Mbone: the multicast backbone. Communications of the A CM, 37(8):64-60, August 1994.]] Google ScholarDigital Library
- 3.Han J. and B. Smith. CU-SeeMe VR immersive desktop teleconferencing. In Proceeding of A UM Multimedia, pages 199-207, Boston, MA, 1996. ACM, AGM Press.]] Google Scholar
- 4.Hewitt K. Desktop video conferencing product survey. http ://www3. ncsu. ~du/dox/video.]]Google Scholar
- 5.Yamaashi K., J. Cooperstock, T. Narine, and W. Buxton. Beating the limitations of camera-monitor mediated telepresence with extra eyes. In SIG CH{ 96 Conference proceedings on Human factors in computer systems, 1996.]] Google ScholarDigital Library
- 6.Trimensions Ltd. http://www.trimension-inc.com.]]Google Scholar
- 7.Altschuler M.D., B.R. Altschuler. and J. Taboada. Measuring surfaces space-coded bv a laser-projected dot matrix. Imaging Application for Automated Industrial Inspection, 1979.]]Google ScholarCross Ref
- 8.Raskar R and G. Welch et al. The office of the future: A unified approach to image based modeling and spatially immersive displays. In SIC GRAPH 98 Conference Proceedings, Orlando FL, July 1998. ACM.]] Google ScholarDigital Library
- 9.Raskar R and M. Brown et al. Multi-projector display using camera-based registration. In Visualization 99 Conference Proceedings, San Francisco CA, October 1999. ACM.]] Google ScholarDigital Library
- 10.Raskar R., G. Welch, and H. Fuchs. Seamless projection overlaps using image warping and intensity blending. In dth Annual Conference on Visual Systems and Mttltimedia, November 1998.]]Google Scholar
- 11.Baker S. and S. Nayar. Catadioptric omnidirectional camera, in Proceedings of CVPR. 1997.]] Google ScholarDigital Library
- 12.Mcanne S. and V. Jacobson. A flexible framework for packet video. In Proceeding of Multimedia, San Francisco. November 1995. ACM, ACM Press.]] Google ScholarDigital Library
- 13.Kawanishi T., K. Yamazawa, H. lwasa, H. Takemura, and N. Yokoya. Generation of high resolution stereo panoramic images by omnidirectional sensor using hexagonal pyramidal mirrors. In ICPR 'gg, 1994.]] Google ScholarDigital Library
- 14.Nalwa Vic. His camera won't turn heads. http ://www.lucent. com/ideas 2/in novat ions/docs/nalwa.html.]]Google Scholar
Index Terms
- Geometrically correct imagery for teleconferencing
Recommendations
Vision-enhanced Immersive Interaction and Remote Collaboration with Large Touch Displays
MM '15: Proceedings of the 23rd ACM international conference on MultimediaLarge displays are becoming commodity, and more and more, they are touch-enabled. In this keynote, we describe a system called ViiBoard (Vision-enhanced Immersive Interaction with touch Board) that enables natural interaction and immersive remote ...
Direct touch haptic display using immersive illusion with interactive virtual finger
EuroHaptics'12: Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part IIn attempt to improve haptic interaction and manipulation technique in surface computers, we propose an interactive haptic feedback display that utilizes ‘direct touch' on a surface computer without using a mediation device. The proposed haptic display ...
CamRay: Camera Arrays Support Remote Collaboration on Wall-Sized Displays
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsRemote collaboration across wall-sized displays creates a key challenge: how to support audio-video communication among users as they move in front of the display. We present CamRay, a platform that uses camera arrays embedded in wall-sized displays to ...
Comments