AdapTable: Extending Reach over Large Tabletops through Flexible Multi-Display Configuration

ABSTRACT

Large interactive tabletops are beneficial for various tasks involving exploration and visualization, but regions of the screen far from users can be difficult to reach. We propose AdapTable; a concept and prototype of a flexible multi-display tabletop that can physically reconfigure its layout, allowing for interaction with difficult-to-reach regions. We conducted a design study where we found users preferred to change screen layouts for full-screen interaction, motivated by reduced physical demands and frustration. We then prototyped AdapTable using four actuated tabletop displays each propelled by a mobile robot, and a touch menu was chosen to control the layout. Finally, we conducted a user study to evaluate how well AdapTable addresses the reaching problem compared with a conventional panning technique. Our findings show that AdapTable provides a more efficient method for complex full-screen interaction.

References

1. Martha Abednego, Joong-Ho Lee, Won Moon, and Ji-hyung Park. 2009. I-Grabber: Expanding Physical Reach in a Large-Display Tabletop Environment Through the Use of a Virtual Grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09): 61--64.
2. Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt Displays: Designing Display Surfaces with Multi-axis Tilting and Actuation. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12): 161--170.
3. Craig Anslow and B. L. William Wong. 2017. Effects of the Display Angle and Physical Size on Large Touch Displays in the Work Place. In Proceedings of the Interactive Surfaces and Spaces (ISS '17): 318--323.
4. Ron Artstein and Massimo Poesio. 2008. Inter-Coder Agreement for Computational Linguistics. Computational Linguistics 34, 4: 555--596.
5. Patrick Bader, Valentin Schwind, Norman Pohl, Niels Henze, Katrin Wolf, Stefan Schneegass, and Albrecht Schmidt. 2015. Self-Actuated Displays for Vertical Surfaces. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9299: 282--299.
6. Gilles Bailly, Sidharth Sahdev, Sylvain Malacria, and Thomas Pietrzak. 2016. LivingDesktop: Augmenting Desktop Workstation with Actuated Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16): 5298--5310.
7. Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An In-Air Pointing Technique to Manipulate Out-of-Reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11): 11--20.
8. Hrvoje Benko, Meredith Ringel Morris, A. J. Brush, and Andy Wilson. 2009. Insights on Interactive Tabletops: A Survey of Researchers and Developers. Research Microsoft. com: 8 pages.
9. Andrew Bragdon and Hsu-Sheng Ko. 2011. Gesture Select: Acquiring Remote Targets on Large Displays without Pointing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11): 187--196.
10. John Brooke. 1996. SUS - A quick and dirty usability scale. Usability Evaluation in Industry: 4--7.
11. Gerd Bruder, Frank Steinicke, and Wolfgang Sturzlinger. 2013. To Touch or not to Touch? Comparing 2D Touch and 3D Mid-Air Interaction on Stereoscopic Tabletop Surfaces. In Proceedings of the 1st symposium on Spatial user interaction (SUI '13): 9--16.
12. Simon Butscher, Sebastian Hubenschmid, Jens Müller, Johannes Fuchs, and Harald Reiterer. 2018. Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--12.
13. William Buxton, George Fitzmaurice, Ravin Balakrishnan, and Gordon Kurtenbach. 2000. Large Displays in Automotive Design. IEEE Computer Graphics and Applications 20, 4: 68--75.
14. Y.-L. Betty Chang, Stacey D. Scott, and Mark Hancock. 2014. Supporting Situation Awareness in Collaborative Tabletop Systems with Automation. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14): 185--194.
15. Andrew Clayphan, Anthony Collins, Christopher Ackad, Bob Kummerfeld, and Judy Kay. 2011. Firestorm: a brainstorming application for collaborative group work at tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11): 162--171.
16. Mary Czerwinski, George Robertson, Brian Meyers, Greg Smith, Daniel Robbins, and Desney Tan. 2006. Large display research overview. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06): 69--74.
17. Sebastian Doeweling and Urs Glaubitt. 2010. Drop-and-Drag: Easier Drag & Drop on Large Touchscreen Displays. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10): 158--167.
18. Alex Endert, Lauren Bradel, Jessica Zeitz, Christopher Andrews, and Chris North. 2012. Designing Large High-Resolution Display Workspaces. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12): 58--65.
19. Andreas Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17): 611--621.
20. Clifton Forlines, Daniel Vogel, and Ravin Balakrishnan. 2006. HybridPointing: Fluid Switching Between Absolute and Relative Pointing with a Direct Input Device. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06): 211--220.
21. Jens Emil Grønbæk, Henrik Korsgaard, Marianne Graves Petersen, Morten Henriksen Birk, and Peter Gall Krogh. 2017. Proxemic Transitions: Designing Shape-Changing Furniture for Informal Meetings. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17): 7029--7041.
22. Jonathan Grudin. 2001. Partitioning Digital Worlds: Focal and Peripheral Awareness in Multiple Monitor Use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01): 458--465.
23. Carl Gutwin and Chris Fedak. 2004. Interacting with Big Interfaces on Small Screens: a Comparison of Fisheye, Zoom, and Panning Techniques. In Proceedings of Graphics Interface 2004 (GI '04): 145--152.
24. Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14): 1063--1072.
25. Matthias Hoppe, Robin Boldt, Jan Strauß, Lars Lischke, Dominik Weber, and Niels Henze. 2017. Image Browsing on Large High-Resolution Displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17): 401--405.
26. Petra Isenberg and Sheelagh Carpendale. 2007. Interactive Tree Comparison for Co-located Collaborative Information Visualization. IEEE Transactions on Visualization and Computer Graphics 13, 6: 1232--1239.
27. Naoya Isoyama, Tsutomu Terada, and Masahiko Tsukamoto. 2015. Multi-tiles: A System for Information Presentation Using Divided Rotatable Screens. In Proceedings of the 13th International Conference on Advances in Mobile Computing and Multimedia (MoMM '15): 14--18.
28. Ahmed Kharrufa, Roberto Martinez-Maldonado, Judy Kay, and Patrick Olivier. 2013. Extending Tabletop Application Design to the Classroom. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13): 115--124.
29. Maurice Ten Koppel, Gilles Bailly, Jörg Müller, and Robert Walter. 2012. Chained Displays: Configurations of Public Displays Can Be Used to Influence Actor-, Audience-, and Passer-By Behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12): 317--326.
30. Cole Krumbholz, Jason Leigh, Andrew Johnson, Luc Renambot, and Robert Kooima. 2005. Lambda Table: High Resolution Tiled Display Table for Interacting with Large Visualizations. In Proceedings of the 5th Workshop on Advanced Collaborative Environments (WACE '05).
31. Takuro Kuribara, Yusaku Mita, Kazusa Onishi, Buntarou Shizuki, and Jiro Tanaka. 2014. HandyScope: A Remote Control Technique using Circular Widget on Tabletops. In Proceedings of 16th International Conference on Human-Computer Interaction (HCI International 2014), Part II, LNCS 8511, Springer, June 2014,: 69--80.
32. Khanh-Duy Le, Mahsa Paknezhad, Pawel W. Wozniak, Maryam Azh, Gabriele Kasparaviciute, Morten Fjeld, Shengdong Zhao, and Michael S. Brown. 2016. Towards Leaning Aware Interaction with Multitouch Tabletops. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16): 1--4.
33. Bokyung Lee, Joongi Shin, Hyoshin Bae, and Daniel Saakes. 2018. Interactive and Situated Guidelines to Help Users Design a Personal Desk that Fits Their Bodies. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18): 637--650.
34. Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Pawel Woniak. 2017. Interaction Techniques for Window Management on Large High-Resolution Displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17): 241--247.
35. Lars Lischke, Sven Mayer, Katrin Wolf, Niels Henze, Harald Reiterer, and Albrecht Schmidt. 2016. Screen Arrangements and Interaction Areas for Large Display Work Places. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16): 228--234.
36. Nicolai Marquardt and Saul Greenberg. 2015. Proxemic Interactions: From Theory to Practice. series: Synthesis Lectures on Human-Centered Informatics, Morgan & Claypool Publishers.
37. Thomas Plank, Hans-Christian Jetter, Roman Rädle, Clemens Nylandsted Klokmose, Thomas Luger, and Harald Reiterer. 2017. Is Two Enough?! Studying Benefits , Barriers , and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17): 4548--4560.
38. Yongqiang Qin, Chun Yu, Jie Liu, Yuntao Wang, Yue Shi, Zhouyue Su, and Yuanchun Shi. 2011. uTable: A Seamlessly Tiled , Very Large Interactive Tabletop System. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11): 244--245.
39. Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the 2014 ACM International Conference on Interactive Tabletops and Surfaces (ITS '14): 45--54.
40. Vít Rusnák, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--12.
41. Kathy Ryall, Meredith Ringel Morris, Katherine Everitt, Clifton Forlines, and Chia Shen. 2006. Experiences with and Observations of Direct-Touch Tabletops. In Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TABLETOP'06: 89--96.
42. Juilan Seifert, Sebastian Boring, Christian Winkler, Florian Schaub, Fabian Schwab, Steffen Herrdum, Fabian Maier, Daniel Mayer, and Enrico Rukzio. 2014. Hover Pad: Interacting with Autonomous and Self-Actuated Displays in Space. Symposium on User Interface Software and Technology (UIST '14): 139--147.
43. Garth Shoemaker, Takayuki Tsukitani, Yoshifumi Kitamura, and Kellogg S Booth. 2010. Body-Centric Interaction Techniques for Very Large Wall Displays. In Proceedings of the 6th Nordic Conference on Human Computer Interaction Extending Boundaries (NordiCHI '10): 463--472.
44. Kazuki Takashima, Naohiro Aida, Hitomi Yokoyama, and Yoshifumi Kitamura. 2013. TransformTable: A Self-Actuated Shape-Changing Digital Table. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13): 179--188.
45. Kazuki Takashima, Yusuke Asari, Hitomi Yokoyama, Ehud Sharlin, and Yoshifumi Kitamura. 2015. Movementable: The Design of Moving Interactive Tabletops. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9298: 296--314.
46. Kazuki Takashima, Takafumi Oyama, Yusuke Asari, Ehud Sharlin, Saul Greenberg, and Yoshifumi Kitamura. 2016. Study and Design of a Shape-Shifting Wall Display. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16): 796--806.
47. Peter Tandler, Thorsten Prante, Christian Müller-Tomfelde, Norbert Streitz, and Ralf Steinmetz. 2001. ConnecTables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01): 11--20.
48. Naoya Tochihara, Toshiki Sato, and Hideki Koike. 2016. A Remote Pointing Method with Dynamic C-D Ratio during a Pinching Gesture for Large Tabletop Systems. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16): 553--559.
49. Lili Tong and Sebastien George. 2014. Interactive Surface Composition Based on Arduino in Multi-Display Environments. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14): 369--374.
50. Vanessa Vuibert, Wolfgang Stuerzlinger, and Jeremy R Cooperstock. 2015. Evaluation of Docking Task Performance Using Mid-air Interaction Techniques. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15): 44--52.
51. ideum. https://www.ideum.com/products/touch-tables/pro
52. SMART Table. https://support.smarttech.com/en/ hardware/other-hardware/tables
53. ERGOTRON. https://www.ergotron.com/tools/ workspace-planner

Index Terms

• General and reference

  • Document types

    • Surveys and overviews

• Hardware

  • Communication hardware, interfaces and storage

    • Displays and imagers

    • Tactile and hand-based interfaces

      • Touch screens

• Human-centered computing

  • Interaction design