Alex Olwal
Stephen DiVerdi
Ismo Rakkolainen
ABSTRACT
In this paper, we describe and discuss interaction techniques and interfaces enabled by immaterial displays. Dual-sided projection allows casual face-to-face interaction between users, with computer-generated imagery in-between them. The immaterial display imposes minimal restrictions to the movements or communication of the users.
As an example of these novel possibilities, we provide a detailed description of our Consigalo gaming system, which creates an enhanced gaming experience featuring sporadic and unencumbered interaction. Consigalo utilizes a robust 3D tracking system, which supports multiple simultaneous users on either side of the projection surface. Users manipulate graphics that are floating in mid-air with natural gestures. We have also added a responsive and adaptive sound track to further immerse the users in the interactive experience. We describe the technology used in the system, the innovative aspects compared to previous large-screen gaming systems, the gameplay and our lessons learned from designing and implementing the interactions, visuals and the auditory feedback.
- CAVE Doom. http://www.cavernus.org/DOOM/Doom.html. November 2007.Google Scholar
- CAVE Quake II. http://www.cavernus.org/QUAKE/Quake.html. November 2007.Google Scholar
- CAVE Quake Arena. http://www.visbox.com/cq3a/. November 2007.Google Scholar
- Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A. 1993. Surround-screen projection-based virtual reality: the design and implementation of the CAVE. Proc. SIGGRAPH '93. ACM Press, New York, NY, pp. 135--142 Google ScholarDigital Library
- Czernuszenko, M., Pape, D., Sandin, D., DeFanti, T., Dawe, G. L., and Brown, M. D. 1997. The ImmersaDesk and Infinity Wall projection-based virtual reality displays. SIGGRAPH Comput. Graph. 31, 2 (May. 1997), pp. 46--49. Google ScholarDigital Library
- DiVerdi, S., Rakkolainen, I., Höllerer, T. and Olwal, A. A Novel Walk-through 3D Display. Proc. SPIE Electronic Imaging, Stereoscopic Displays and Applications XVII, San Jose, CA, USA, January 15--18, 2006, SPIE Vol. 6055, 605519, pp. 1--10.Google ScholarCross Ref
- DiVerdi, S., Olwal, A., Rakkolainen, I. and Höllerer, T. An Immaterial Pseudo-3D Display with 3D Interaction. Three-Dimensional Television: Capture, Transmission, and Display. Editors: Haldun M. Ozaktas and Levent Onural. Springer, Heidelberg, 2007. In press.Google Scholar
- FogScreen Inc, http://www.fogscreen.com/.November 2007.Google Scholar
- Hämäläinen, P., Ilmonen, T., Höysniemi, J., Lindholm, M., and Nykänen, A. 2005. Martial arts in artificial reality. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA, April 02--07, 2005). CHI '05. ACM Press, New York, NY, 781--790. Google ScholarDigital Library
- Ishii, H., Kobayashi, M., and Grudin, J. 1993. Integration of interpersonal space and shared workspace: ClearBoard design and experiments. ACM Trans. Inf. Syst. 11, 4 (Oct. 1993), 349--375. Google ScholarDigital Library
- Ishii, H., Wisneski, C., Orbanes, J., Chun, B., and Paradiso, J. 1999. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (Pittsburgh, Pennsylvania, United States, May 15--20, 1999). CHI '99. ACM Press, New York, NY, 394--401. Google ScholarDigital Library
- Jacobson, J., Le Renard, M., Lugrin, J., and Cavazza, M. 2005. The CaveUT system: immersive entertainment based on a game engine. In Proceedings of the 2005 ACM SIGCHI international Conference on Advances in Computer Entertainment Technology (Valencia, Spain, June 15--17, 2005). ACE '05. ACM Press, New York, NY, 184--187. Google ScholarDigital Library
- Krueger, M., Gionfriddo, T. and Hinrichsen, K., VIDEOPLACE - An Artificial Reality. In Proc. of CHI'85. ACM 1985, pp. 35--40. Google ScholarDigital Library
- Lugmayr, A. and Piirto, M., Implementation of "Looney": designing an interactive game for children on FogScreens. ACM SIGGRAPH 2006 Research posters, Boston, MA, USA, 30 July - 3 August 2006. 47. Google ScholarDigital Library
- MIDI. http://www.midi.org/. November 2007.Google Scholar
- MIDI Yoke NT. http://www.midiox.com/. November 2007.Google Scholar
- Mueller, F., Agamanolis, S., and Picard, R. 2003. Exertion interfaces: sports over a distance for social bonding and fun. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, FL, USA, April 05--10, 2003). CHI '03. ACM Press, New York, NY, 561--568. Google ScholarDigital Library
- Nintendo Wii. http://www.wii.com/. November 2007.Google Scholar
- Olwal, A., DiVerdi, S., Candussi, N., Rakkolainen, I., and Höllerer, T. An Immaterial, Dual-sided Display System with 3D Interaction. Proceedings of VR 2006 (IEEE Virtual Reality Conference 2006), Alexandria, VA, Mar 25--29, 2006, pp. 279--280. Google ScholarDigital Library
- Powerwall. http://www.lcse.umn.edu/research/. November 2007.Google Scholar
- Propellerheads Reason 3.0. http://www.propellerheads.se/. November 2007.Google Scholar
- Rakkolainen, I., Laitinen, M., Piirto, M., Landkammer, J. and Palovuori, K. The Interactive FogScreen. A demonstration and associated abstract at ACM SIGGRAPH 2005 Program: Emerging Technologies, Los Angeles, CA, USA, July 31-August 4, 2005. See also http://ilab.cs.ucsb.edu/projects/ismo/fogscreen.html. Google ScholarDigital Library
- Rakkolainen, I., Erdem, T., Utku, B., Erdem, Ç., and Özkan, M., Mid-air Display for Physical Exercise and Gaming. IEEE 3DTV Conference, Kos, Greece, May 7--9, 2007.Google Scholar
- ReWire. http://www.propellerheads.se/technologies/rewire/. November 2007.Google Scholar
- Rakkolainen, I. and Palovuori, K. 2005. Laser scanning for the interactive walk-through FogScreen. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Monterey, CA, USA, November 07--09, 2005). VRST '05. Google ScholarDigital Library
- Sidharta, R. and Cruz-Neira, C. 2005. Cyclone Uppercut, a boxing game for an immersive environment. In Proceedings of the 2005 ACM SIGCHI international Conference on Advances in Computer Entertainment Technology (Valencia, Spain, June 15--17, 2005). ACE '05. ACM Press, New York, NY, 363--364. Google ScholarDigital Library
- Sony Playstation 2 EyeToy. http://www.eyetoy.com/. November 2007.Google Scholar
- Taylor, R. VRPN: Virtual Reality Peripheral Network, http://www.cs.unc.edu/Research/vrpn/. 1998.Google Scholar
- Wii Damage. http://www.wiidamage.com/. November 2007.Google Scholar
- WorldViz PPT 3D optical tracker. http://www.worldviz.com/ppt/. November 2007.Google Scholar
Index Terms
- Consigalo: multi-user face-to-face interaction on immaterial displays
Recommendations
An Immaterial, Dual-sided Display System with 3D Interaction
VR '06: Proceedings of the IEEE conference on Virtual RealityWe present an interactive wall-sized immaterial display that introduces a number of interesting possibilities for advanced interface design. The immaterial nature of a thin sheet of fog allows users to penetrate and even walk through the screen, while ...
Biting, Whirling, Crawling - Children's Embodied Interaction with Walk-through Displays
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part IUnderstanding of embodied interaction in the context of walk-through displays and designing for it is very limited. This study examined children's intuitive embodied interaction with a large, semi-visible, projective walk-through display and space ...
Immaterial display for interactive advertisements
ACE '07: Proceedings of the international conference on Advances in computer entertainment technologyWe present some of our experiments with the "immaterial" walk-through FogScreen for advertising. We use interactivity for creating visually compelling advertisements with the immaterial screens in mid-air.
An immaterial projection screen has many ...
Comments