m+pSpaces: virtual workspaces in the spatially-aware mobile environment

ABSTRACT

We introduce spatially-aware virtual workspaces for the mobile environment. The notion of virtual workspaces was initially conceived to alleviate mental workload in desktop environments with limited display real-estate. Using spatial properties of mobile devices, we translate this approach and illustrate that mobile virtual workspaces greatly improve task performance for mobile devices. In a first study, we compare our spatially-aware prototype (mSpaces) to existing context switching methods for navigating amongst multiple tasks in the mobile environment. We show that users are faster, make more accurate decisions and require less mental and physical effort when using spatially-aware prototypes. We furthermore prototype pSpaces and m+pSpaces, two spatially-aware systems equipped with pico-projectors as auxiliary displays to provide dual-display capability to the handheld device. A final study reveals advantages of each of the different configurations and functionalities when comparing all three prototypes. Drawing on these findings, we identify design considerations to create, manipulate and manage spatially-aware virtual workspaces in the mobile environment.

References

1. Baudisch, P. and Rosenholtz, R. Halo: a technique for visualizing off-screen objects. In CHI'03, ACM, 481--488.
2. Boehmer, M. and Bauer, G. Exploiting the icon arrangement on mobile devices as information source for context-awareness. In MobileHCI'10, ACM, 195--198.
3. Boring, S., Baur, D., Butz, A., Gustafson, S. and Baudisch, P. Touch Projector: Mobile Interaction Through Video. In CHI '10, ACM Press, 2287--2296.
4. Boring, S., Jurmu, M. and Butz, A. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In OZCHI SIG: Design: Open 24/7, ACM Press (2009), 161--168.
5. Cao, X. and Balakrishnan, R. Interacting with dynamically defined information spaces using a handheld projector and a pen. In UIST'06, 225--234.
6. Card, S. K. and Austin Henderson, J. A multiple, virtual-workspace interface to support user task switching. SIGCHI Bull. 17, (1986), 53--59.
7. Cauchard, J., Löchtefeld, M., Irani, P., Schöning, J., Krüger, A., Fraser, M. and Subramanian, S. Visual Separation in Mobile Multi-Display Environments. In UIST 2011, ACM Press (2011), 451--460.
8. D. Austin, Henderson, J. and Card, S. Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface. ACM Trans. Graph. 5, (1986), 211--243.
9. Ens, B., Ahlström, D., Cockburn, A. and Irani, P. Characterizing User Performance with Assisted Direct Off-Screen Pointing. In MobileHCI '11, ACM, 485--494.
10. Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. Commun. ACM 36, ACM (1993), 39--49.
11. Gustafson, S., Bierwirth, D. and Baudisch, P. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. In UIST'10, ACM (2010), 3--12.
12. Gustafson, S., Holz, C. and Baudisch, P. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. In UIST '11, ACM Press (2011), 283--292.
13. Lewis, J. P., Rosenholtz, R., Fong, N. and Neumann, U. VisualIDs: automatic distinctive icons for desktop interfaces. In SIGGRAPH'04, ACM (2004), 416--423.
14. Li, F. C. Y., Dearman, D. and Truong, K. N. Virtual shelves: interactions with orientation aware devices. In UIST'09, ACM Press (2009), 125--128.
15. Matthews, T., Czerwinski, M., Robertson, G. and Tan, D. Clipping lists and change borders: improving multitasking efficiency with peripheral information design. In CHI'06, ACM Press (2006), 989--998.
16. Nacenta, M., Gutwin, C., Aliakseyeu, D. and Subramanian, S. There and Back again: Cross-Display Object Movement in Multi-Display Environments. Journal of HCI 24, (2009), 170--229.
17. Ringel, M. When one isn't enough: an analysis of virtual desktop usage strategies and their implications for design. In CHI '03 EA, ACM Press (2003), 762--763.
18. Robertson, G., Czerwinski, M., Larson, K., Robbins, D. C., Thiel, D. and Dantzich, M. v. Data mountain: using spatial memory for document management. In UIST'98, ACM Press (1998), 153--162.
19. Robinson, S., Eslambolchilar, P. and Jones, M. Sweep-Shake: Finding Digital Resources in Physical Environments. In MobileHCI '09, ACM, (2009), 1--10.
20. Tan, D. S., Pausch, R., Stefanucci, J. K. and Proffitt, D. R. Kinesthetic cues aid spatial memory. In CHI '02 EA, ACM (2002), 806--807.
21. Yee, K.-P. Peephole displays: pen interaction on spatially aware handheld computers. In CHI'03, ACM Press (2003), 1--8.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)