Qoom: An Interactive Omnidirectional Ball Display

ABSTRACT

We present a sphere-shaped interactive display system, named Qoom, as a new input and output device. Unlike existing sphere-shaped displays, Qoom is a perfectly spherical ball that can be rotated, thrown, or even kicked. First, we discuss how spherical displays can be used in daily life and describe how users interact with spheres. Then, we show how we developed the Qoom prototype that uses touch and rotation detection, real-time object tracking, and spherical projection mapping. We implemented actions including touching, rotating, bouncing and throwing as controls. We also developed applications for Qoom that utilize the unique advantages of ball displays.

References

1. Eric Akaoka, Tim Ginn, and Roel Vertegaal. 2010. DisplayObjects: Prototyping Functional Physical Interfaces on 3D Styrofoam, Paper or Cardboard Models. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, NY, NY, USA, 49--56.
2. J. Batlle, E. Mouaddib, and J. Salvi. 1998. Recent progress in coded structured light as a technique to solve the correspondence problem: a survey. Pattern Recognition 31, 7 (1998), 963 -- 982.
3. Hrvoje Benko and Andrew D. Wilson. 2010. Multi-point Interactions with Immersive Omnidirectional Visualizations in a Dome. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, NY, NY, USA, 19--28.
4. Hrvoje Benko, Andrew D. Wilson, and Ravin Balakrishnan. 2008. Sphere: Multi-touch Interactions on a Spherical Display. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, NY, NY, USA, 77--86.
5. Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, NY, NY, USA, 645--655.
6. John Bolton, Kibum Kim, and Roel Vertegaal. 2011. Privacy and Sharing Information on Spherical and Large Flat Displays. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW '11). ACM, NY, NY, USA, 573--574.
7. Li-Wei Chan, Yi-Fan Chuang, Meng-Chieh Yu, Yi-Liu Chao, Ming-Sui Lee, Yi-Ping Hung, and Jane Hsu. 2007. Gesture-based Interaction for a Magic Crystal Ball. In Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology (VRST '07). ACM, NY, NY, USA, 157--164.
8. F. Ferreira, M. Cabral, O. Belloc, G. Miller, C. Kurashima, R. de Deus Lopes, I. Stavness, J. Anacleto, M. Zuffo, and S. Fels. 2014. Spheree: A 3D Perspective-corrected Interactive Spherical Scalable Display. In ACM SIGGRAPH 2014 Posters (SIGGRAPH '14). ACM, NY, NY, USA, Article 86, 1 pages.
9. Athanasios Gaitatzes, Georgios Papaioannou, Dimitrios Christopoulos, and Gjergji Zyba. 2006. Media 5https://www.laval-virtual.org/prix-competitions/revolution/palmarevo-16.html Productions for a Dome Display System. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST '06). ACM, NY, NY, USA, 261--264.
10. David Holman and Roel Vertegaal. 2008. Organic User Interfaces: Designing Computers in Any Way, Shape, or Form. Commun. ACM 51, 6 (June 2008), 48--55.
11. David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper Windows: Interaction Techniques for Digital Paper. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, NY, NY, USA, 591--599.
12. T. J. Jankun-Kelly and Kwan-Liu Ma. 2003. MoireGraphs: radial focus+context visualization and interaction for graphs with visual nodes. In IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714). 59--66.
13. Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, NY, NY, USA, 637--644.
14. Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In ACM SIGGRAPH 2013 Emerging Technologies (SIGGRAPH '13). ACM, NY, NY, USA, Article 7, 1 pages.
15. Abhijit Karnik, Archie Henderson, Andrew Dean, Howard Pang, Thomas Campbell, Satoshi Sakurai, Guido Herrmann, Shahram Izadi, Yoshifumi Kitamura, and Sriram Subramanian. 2011. VORTEX: Design and Implementation of an Interactive Volumetric Display. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, NY, NY, USA, 2017--2022.
16. S. Kettner, C. Madden, and R. Ziegler. 2004. Direct Rotational Interaction With a Spherical Projection. Creativity & Cognition Symposium on Interaction: Systems, Plactice and Theory. (2004).
17. Jarrod Knibbe, Hrvoje Benko, and Andrew D. Wilson. 2015. Juggling the Effects of Latency: Software Approaches to Minimizing Latency in Dynamic Projector-Camera Systems. In Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15 Adjunct). ACM, NY, NY, USA, 93--94.
18. Hideki Koike and Hiroaki Yamaguchi. 2015. LumoSpheres: Real-time Tracking of Flying Objects and Image Projection for a Volumetric Display. In Proceedings of the 6th Augmented Human International Conference (AH '15). ACM, NY, NY, USA, 93--96.
19. E. Kraft. 2003. A quaternion-based unscented Kalman filter for orientation tracking. In Sixth International Conference of Information Fusion, 2003. Proceedings of the, Vol. 1. 47--54.
20. Zhengqing Li, Shio Miyafuji, Toshiki Sato, and Hideki Koike. 2016. OmniEyeball: Spherical Display Embedded With Omnidirectional Camera Using Dynamic Spherical Mapping. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, NY, NY, USA, 193--194.
21. Tamotsu Machida. 2002. GEO-COSMOS: World's First Spherical Display. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (SIGGRAPH '02). ACM, NY, NY, USA, 189--189.
22. Jock D. Mackinlay, George G. Robertson, and Stuart K. Card. 1991. The Perspective Wall: Detail and Context Smoothly Integrated. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). ACM, NY, NY, USA, 173--176.
23. Shio Miyafuji, Masato Sugasaki, and Hideki Koike. 2016. Ballumiere: Real-Time Tracking and Spherical Projection for High-Speed Moving Balls. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16). ACM, NY, NY, USA, 33--37.
24. T. Munzner. 1997. H3: Laying out Large Directed Graphs in 3D Hyperbolic Space. In Proceedings of the 1997 IEEE Symposium on Information Visualization (InfoVis '97) (INFOVIS '97). IEEE Computer Society, Washington, DC, USA, 2--. http://dl.acm.org/citation.cfm?id=857188.857627
25. Kohei Okumura, Hiromasa Oku, and Masatoshi Ishikawa. 2012. Lumipen: Projection-Based Mixed Reality for Dynamic Objects. In Proceedings of the 2012 IEEE International Conference on Multimedia and Expo (ICME '12). IEEE Computer Society, Washington, DC, USA, 699--704.
26. Oyewole Oyekoya, William Steptoe, and Anthony Steed. 2012. SphereAvatar: A Situated Display to Represent a Remote Collaborator. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, NY, NY, USA, 2551--2560.
27. Y. Pan and A. Steed. 2012. Preserving gaze direction in teleconferencing using a camera array and a spherical display. In 2012 3DTV-Conference: The True Vision Capture, Transmission and Display of 3D Video (3DTV-CON). 1--4.
28. Ye Pan, William Steptoe, and Anthony Steed. 2014. Comparing Flat and Spherical Displays in a Trust Scenario in Avatar-mediated Interaction. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 1397--1406.
29. Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, NY, NY, USA, 1716--1725.
30. Ramesh Raskar, Greg Welch, Kok-Lim Low, and Deepak Bandyopadhyay. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag, London, UK, UK, 89--102. http://dl.acm.org/citation.cfm?id=647653.732300
31. George G. Robertson and Jock D. Mackinlay. 1993. The Document Lens. In Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology (UIST '93). ACM, NY, NY, USA, 101--108.
32. S. Sabatelli, F. Sechi, L. Fanucci, and A. Rocchi. 2011. A sensor fusion algorithm for an integrated angular position estimation with inertial measurement units. In 2011 Design, Automation Test in Europe. 1--4.
33. Dominik Schmidt, Raf Ramakers, Esben W. Pedersen, Johannes Jasper, Sven Köhler, Aileen Pohl, Hannes Rantzsch, Andreas Rau, Patrick Schmidt, Christoph Sterz, Yanina Yurchenko, and Patrick Baudisch. 2014. Kickables: Tangibles for Feet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 3143--3152.
34. Chihiro Suga and Itiro Siio. 2011. Anamorphicons: An Extended Display with a Cylindrical Mirror. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, NY, NY, USA, 242--243.
35. Julie R. Williamson, John Williamson, Daniel Sundén, and Jay Bradley. 2015. Multi-Player Gaming on Spherical Displays. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, NY, NY, USA, 355--358.

Index Terms

• Human-centered computing

• Information systems

  • Information systems applications

    • Multimedia information systems