Magicscroll: a rollable display device with flexible screen real estate and gestural input

ABSTRACT

We present MagicScroll, a rollable tablet with 2 concatenated flexible multitouch displays, actuated scrollwheels and gestural input. When rolled up, MagicScroll can be used as a rolodex, smartphone, expressive messaging interface or gestural controller. When extended, it provides full access to its 7.5" high-resolution multitouch display, providing the display functionality of a tablet device. We believe that the cylindrical shape in the rolled-up configuration facilitates gestural interaction, while its shape changing and input capabilities allow the navigation of continuous information streams and provide focus plus context functionality. We investigated the gestural affordances of MagicScroll in its rolled-up configuration by means of an elicitation study.

References

1. Sheldon Andrews, Javier Mora, Jochen Lang, and Won Sook Lee. 2006. Hapticast: a physically-based 3D game with haptic feedback. Proceedings of FuturePlay (2006).
2. Patrick Baudisch, Nathaniel Good, and Paul Stewart. Focus Plus Context Screens: Combining Display Technology with Visualization Techniques. In Proc. UIST'01, 31--40.
3. Joel F Bartlett. 2000. Rock'n'Scroll is here to stay {user interface}. IEEE Computer Graphics and Applications 20, 3 (2000), 40--45.
4. Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03). ACM, New York, NY, USA, 173--182.
5. Jessica R. Cauchard, Jane L. E, Kevin Y. Zhai, and James A. Landay. 2015. Drone & Me: An Exploration into Natural Human-drone Interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 361--365.
6. Nicholas Chen, Francois Guimbretiere, Morgan Dixon, Cassandra Lewis, and Maneesh Agrawala. Navigation Techniques for Dual-display e-Book Readers. In Proc. CHI'08, 1779--1788.
7. Chinese Handscrolls. Retrieved from http://www.metmuseum.org/toah/hd/chhs/hd_chhs.htm
8. Sony Corp - www.sony.co.uk/product/sony-tablet-p
9. Readius - https://wiki.mobileread.com/wiki/Readius
10. Antonio Gomes and Roel Vertegaal. PaperFold: Evaluating Shape Changes for Viewport Transformations in Foldable Thin-Film Display Devices. In Proc TEI'15, 153--160.
11. Jukka Häkkinen, Monika Pölönen, Marja Salmimaa, and Jukka Hautanen. Reading experience with curved handheld displays. Journal of the Society for Information Display 16, 11: 1099--1103.
12. Beverly L. Harrison, Kenneth P. Fishkin, Anuj Gujar, Carlos Mochon, and Roy Want. 1998. Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '98). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 17--24.
13. Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. Codex: a dual screen tablet computer. In Proc. CHI'09, 1933--1942.
14. Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User interface software and technology. ACM, 91--100.
15. Ken Hinckley, Edward Cutrell, Steve Bathiche, and Tim Muss. 2002. Quantitative analysis of scrolling techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 65--72.
16. David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. PaperWindows: Interaction Techniques for Digital Paper. In Proc. CHI'05, 591--599.
17. Jack Kerouac. 1957. On the Road. Viking Press.
18. Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. FoldMe: Interacting with Double-sided Foldable Displays. In Proc. TEI'12, 33--40.
19. Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. Xpaaand. In Proc. CHI'11, 2729--2732.
20. Johnny C. Lee, Scott E. Hudson, and Edward Tse. Foldable Interactive Displays. In Proc UIST'08, 287--290.
21. Sang-Su Lee, Sohyun Kim, Bopil Jin, et al. How Users Manipulate Deformable Displays As Input Devices. In Proc. CHI'10, 1647--1656.
22. Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration. In Proc UIST'14. ACM, New York, NY, USA, 461--470.
23. Max V Mathews. 1991. The radio baton and conductor program, or: Pitch, the most important and least expressive part of music. Computer Music Journal 15, 4 (1991), 37--46.
24. Ken Nakagaki, Chikara Inamura, Pasquale Totaro, Thariq Shihipar, Chantine Akikyama, Yin Shuang, and Hiroshi Ishii. 2015. Linked-Stick: Conveying a Physical Experience Using a Shape-Shifting Stick. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1609--1614.
25. Donald A Norman. 1999. Affordance, Conventions, and Design. Interactions 6, 3: 38--43.
26. Jun Rekimoto. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proc. CHI '02, 113--120.
27. Clément Pillias, Shuo Hsiu Hsu, and Pierre Cubaud. 2013. Reading with a Digital Roll. In Proc. CHI EA '13, 1377--1382.
28. Lahiru Lakmal Priyadarshana, Victoria Porter, Juan Pablo Carrascal, Aaron Visser, and Roel Vertegaal. 2016. MagicWand. In Proc. CHI EA '16, 3762--3765.
29. Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 735--744.
30. Jun Rekimoto. 1996. Tilting operations for small screen interfaces. In Proceedings of the 9th annual ACM symposium on User interface software and technology. ACM, 167--168.
31. Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proc. UIST '12, 579--588
32. Radu-Daniel Vatavu and Ionut-Alexandru Zaiti. 2014. Leap Gestures for TV: Insights from an Elicitation Study. In Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video (TVX '14). ACM, New York, NY, USA, 131--138.
33. Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined Motion Gestures for Mobile Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 197--206.
34. Abigail J Sellen and Richard H R Harper. 2003. The myth of the paperless office. MIT press.
35. David Small and Hiroshi Ishii. Design of Spatially Aware Graspable Displays. In Proc. CHI EA '97, 367--368.
36. Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. OmniTouch: wearable multitouch interaction everywhere. In Proc. UIST'11, 441--450.
37. Sensable. Phantom Omni. http://www.dentsable.com/haptic-phantom-omni.htm. (Accessed on 09/14/2016).
38. Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input. In Proc. TEI'16, 185--192.
39. Aneesh P Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. PaperTab: An Electronic Paper Computer with Multiple Large Flexible Electrophoretic Displays. In Proc. CHI'13, 3131--3134.
40. Unknown. Dead Sea Scrolls. 408 BCE to 318 CE, Cumran Caves.
41. Roel Vertegaal and Ivan Poupyrev. 2008. Introduction to Organic User Interfaces. Communications of the ACM 51, 6.
42. Ivan Poupyrev, Henry Newton-Dunn, and Olivier Bau. 2006. D20: Interaction with Multifaceted Display Devices. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1241--1246.
43. Ilya Rosenberg and Ken Perlin. The UnMousePad: An Interpolating Multi-Touch Force-Sensing Input Pad. In ACM SIGGRAPH'09, Article 65.
44. Andrew Wilson and Steven Shafer. 2003. XWand: UI for Intelligent Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 545--552.
45. Graham Wilson and Stephen A. Brewster. 2017. Multi-moji: Combining Thermal, Vibrotactile & Visual Stimuli to Expand the Affective Range of Feedback. In Proc. CHI'17. ACM, New York, NY, USA, 1743--1755.
46. Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1869--1872.
47. Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1083--1092.
48. Andreas Butz, Markus Groß, and Antonio Krüger. TUISTER: a tangible UI for hierarchical structures. In Proc. IUI'04, 223--225.
49. Kent Lyons, David Nguyen, Daniel Ashbrook, and Sean White. Facet: a multi-segment wrist worn system. In Proc. UIST'12, 123--130.
50. Rolodex. Retrieved from: https://en.wikipedia.org/wiki/Rolodex.
51. Kenton O'Hara, Abigail Sellen, and Richard Bentley. Supporting memory for spatial location while reading from small displays. In Proc. CHI EA'99, 220--221.