Diego Martinez Plasencia
Florent Berthaut
Abhijit Karnik
Sriram Subramanian
ABSTRACT
Reflective optical combiners like beam splitters and two way mirrors are used in AR to overlap digital contents on the users' hands or bodies. Augmentations are usually unidirectional, either reflecting virtual contents on the user's body (Situated Augmented Reality) or augmenting user's reflections with digital contents (AR mirrors). But many other novel possibilities remain unexplored. For example, users' hands, reflected inside a museum AR cabinet, can allow visitors to interact with the artifacts exhibited. Projecting on the user's hands as their reflection cuts through the objects can be used to reveal objects' internals. Augmentations from both sides are blended by the combiner, so they are consistently seen by any number of users, independently of their location or, even, the side of the combiner through which they are looking. This paper explores the potential of optical combiners to merge the space in front and behind them. We present this design space, identify novel augmentations/interaction opportunities and explore the design space using three prototypes.
Supplemental Material
- Anderson, F., Grossman, T., Matejka, J., and Fitzmaurice, G. YouMove: enhancing movement training with an augmented reality mirror. In Proc. of UIST'13. 2013. ACM. Google Scholar
Digital Library
- Benko, H. and Wilson, A.D. Pinch-the-sky dome: freehand multi-point interactions with immersive omnidirectional data. In Proc. of CHI'10 Extended Abstracts. 2010. ACM. Google ScholarDigital Library
- Bertalini, M., Mirrors and the mind. The Psychologist, 2010. 23(2): p. 112.Google Scholar
- Berthaut, F., Marshall, M., Subramanian, S., and Hachet, M. Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience. In Proc. of NIME. 2013.Google Scholar
- Bimber, O. and Raskar, R., Spatial Augmented Reality: Merging Real and Virtual Worlds. 2005. Google ScholarDigital Library
- Butler, A., Hilliges, O., Izadi, S., Hodges, S., Molyneaux, D., Kim, D., and Kong, D. Vermeer: direct interaction with a 360 degree viewable 3D display. In Proc. of UIST'11. 2011. ACM. Google ScholarDigital Library
- Campbell, F.W., The depth of field of the human eye. Journal of Modern Optics, 1957. 4: p. 157.Google ScholarCross Ref
- De la Riviere, J.B., Dittlo, N., Emmanuel, O., Kervegant, C., and Courtois, M. Holocubtile: 3D multitouch brings the virtual world into the user's hands. In Proc. of ITS'10. 2010. ACM. Google ScholarDigital Library
- Eisert, P., Rurainsky, J., and Fechteler, P. Virtual Mirror: Real-Time Tracking of Shoes in Augmented Reality Environments. In Proc. of ICIP'07. 2007. IEEE.Google ScholarCross Ref
- Foley, J.D., van Dam, A., Feiner, S.K., and Hughes, J.F., Computer graphics: principles and practice (2nd ed.). 1990: Addison-Wesley Publishing Co., Inc. 1174. Google ScholarDigital Library
- Fujinami, K., Kawsar, F., and Nakajima, T. AwareMirror: a personalized display using a mirror. In Proc. of 3rd international conference on Pervasive Computing. 2005. Springer-Verlag. Google ScholarDigital Library
- Fujinami, K., Ushida, K., Tanaka, Y., Naemura, T., and Harahima, H. i-mirror: An Interaction/Information Environment Based on a Mirror Metaphor Aiming to Install into Our Life Space. In Proc. of ICAT. 2002.Google Scholar
- Hachet, M., Bossavit, B., Cohe, A., and Riviere, J.P. Toucheo: multitouch and stereo combined in a seamless workspace. In Proc. of UIST'11. 2011. ACM. Google ScholarDigital Library
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A.D. HoloDesk: direct 3d interactions with a situated see-through display. In Proc. of CHI'12. 2012. ACM. Google ScholarDigital Library
- Hirsch, M., Izadi, S., Holtzman, H., and Raskar, R. 8D display: a relightable glasses-free 3D display. In Proc. of SIGGRAPH'12 Posters. 2012. ACM. Google ScholarDigital Library
- Hoffman, D.M., Girshick, A.R., Akeley, K., and Banks, M.S., Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision, 2008. 8(3): p. 33.Google ScholarCross Ref
- Holliman, N.S., Dodgson, N.A., Favalora, G.E., and Pockett, L., Three-Dimensional Displays: A Review and Applications Analysis. IEEE Trans. on Broadcasting, 2011. 57(2): p. 362--371.Google Scholar
- Karnik, A., Mayol-Cuevas, W., and Subramanian, S. MUSTARD: a multi user see through AR display. In Proc. of CHI'12. 2012. ACM. Google ScholarDigital Library
- Korsch, D., Reflective Optics. 1991: Academic Press.Google Scholar
- Krueger, M., Artifitial Reality II. 1991: Addison WesleyGoogle Scholar
- Li, W.H.A. and Fu, H. Augmented reflection of reality. In Proc. of SIGGRAPH'12 ETech. 2012. ACM. Google ScholarDigital Library
- Percival, A.S., The prescribing of spectacles. 1920: J. Wright.Google Scholar
- Perlin, K., Paxia, S., and Kollin, J.S. An autostereoscopic display. In Proc. of SIGGRAPH'00. 2000. ACM. Google ScholarDigital Library
- Poston, T. and Serra, L. The virtual workbench: dextrous VR. In Proc. of VRST'64. 1994. World Scientific Publishing Co., Inc. Google ScholarDigital Library
- Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. Shader Lamps: Animating Real Objects With ImageBased Illumination. In Proc. of 12th Eurographics Workshop on Rendering Techniques. 2001. Google ScholarDigital Library
- Regenbrecht, H.T., Franz, E.A., McGregor, G., Dixon, B.G., and Hoermann, S., Beyond the looking glass: Fooling the brain with the augmented mirror box. Presence: Teleoper. Virtual Environ., 2011. 20(6). Google ScholarDigital Library
- Sato, H., Kitahara, I., and Ohta, Y., MR-Mirror: A Complex of Real and Virtual Mirrors, in Virtual and Mixed Reality, Shumaker, R., Editor. 2009, Springer Berlin Heidelberg. p. 482--491. Google ScholarDigital Library
- Sheard, C., The prescription of prisms. American Journal of Optometry, 1934. 11: p. 364.Google ScholarCross Ref
- Shibata, T., Kim, J., Hoffman, D.M., and Banks, M.S., The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision, 2011. 8(11): p. 11.Google ScholarCross Ref
- Starch, D.A., Demonstration of the trial and error methid of learning. The Psychological Bulletin, 1910. 5.Google Scholar
- Stratton, G.M., A mirror pseudoscope and the limit of visible depth. Psychological Review, 1898. 5(6): p. 632.Google Scholar
- Stratton, G.M., Upright Vision and the Retinal Image. Psychological Review, 1897. 4(2): p. 182.Google Scholar
- Stratton, G.M., Vision without inversion of the retinal image. Psychological Review, 1897. 4(5): p. 463.Google Scholar
- Sullivan, A. DepthCube solid-state 3D volumetric display. In Proc. of SPIE. 2004.Google Scholar
- Valkov, D., Steinicke, F., Bruder, G., and Hinrichs, K. 2d touching of 3d stereoscopic objects. In Proc. of CHI'11. 2011. ACM. Google ScholarDigital Library
- Ware, C., Arthur, K., and Booth, K.S. Fish tank virtual reality. In Proc. of CHI '93 1993. ACM. Google ScholarDigital Library
- Yoshida, T., Shimizu, K., Kurogi, T., Kamuro, S., Minamizawa, K., Nii, H., and Tachi, S. RePro3D: fullparallax 3D display with haptic feedback using retroreflective projection technology. In Proc. of ISVRI'11. 2011. IEEEGoogle Scholar
Index Terms
- Through the combining glass
Recommendations
Virtual reality and augmented reality in social learning spaces: a literature review
AbstractIn this survey, we explore Virtual Reality and Augmented Reality within social learning spaces, such as classrooms and museums, while also extending into relevant social interaction concepts found within more reality-based and social immersive ...
Survey on Collaborative AR for Multi-user in Urban Studies and Planning
Edutainment '09: Proceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and DevelopmentThis paper describes an augmented reality (AR) environment that allows multiple participants or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban planning, where users can interact ...
Eholo glass: electroholography glass. a lensless approach to holographic augmented reality near-eye display
SA '18: SIGGRAPH Asia 2018 Technical BriefsWe present a design and rendering method for large eye-box, fully parallax, depth of field included near-eye augmented reality (AR) display. As developments in AR progress, field of view and sense of depth are one of the most crucial factors for ...
Comments