A perspective geometry approach to user-perspective rendering in hand-held video see-through augmented reality

ABSTRACT

Video see-through Augmented Reality (V-AR) displays a video feed overlaid with information, co-registered with the displayed objects. In this paper we consider the type of V-AR that is based on a hand-held device with a fixed camera. In most of the VA-R applications the view displayed on the screen is completely determined by the orientation of the camera, i.e., the device-perspective rendering; the screen displays what the camera sees. The alternative method is to use the relative pose of the user's view and the camera, i.e., the user-perspective rendering. In this paper we present an approach to the user perspective V-AR using 3D projective geometry. The view is adjusted to the user's perspective and rendered on the screen, making it an augmented window. We created and tested a running prototype based on our method.

References

1. Hill, A., Schiefer, J., Wilson, J., Davidson, B., Gandy, M., and MacIntyre, B. 2011. Virtual transparency: Introducing parallax view into video see-through ar. 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 0, 239--240.
2. Tomioka, M., Ikeda, S., and Sato, K. 2013. Approximated user-perspective rendering in tablet-based augmented reality. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, 21--28.
3. Yoshida, T., Kuroki, S., Nii, H., Kawakami, N., and Tachi, S. 2008. Arscope. In ACM SIGGRAPH 2008 New Tech Demos, ACM, New York, NY, USA, SIGGRAPH '08, 4:1--4:1.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

    • Image manipulation

    • Rendering

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Mixed / augmented reality

      • Virtual reality