FaceSpace: endo- and exo-spatial hypermedia in the transparent video facetop

ABSTRACT

The Transparent Video Facetop is a novel user interface concept that supports not only single-user interactions with a PC, but also close pair collaborations, such as that found in collaborative Web browsing, in distributed pair programming and in remote medicine. We recently demonstrated the Vis-a-Vid Facetop prototype as a single-user GUI for manipulating the elements of a traditional WIMP desktop [21]. In this paper we introduce FaceSpace, a Facetop-based hypermedia system that combines structure and functionality of both spatial and ubiquitous hypertext. FaceSpace eliminates camera registration errors due to dynamic object tracking and user self-image feedback. FaceSpace had two forms of linking that combine spatial hypermedia with ubiquitous hypermedia: Like an exo-skeleton provides an organism with structure from without, exo-spatial hypertext has the spatial structure applied over the ubiquity of the user's real-world environment. Endo-spatial hypertext has the spatial structure derived from and attached to the elements of the user's domain. Endo-spatial hypertext is an integral concept in systems that have been classified as ubiquitous hypertext; exo-spatial is unique to FaceSpace in current hypertext systems.

References

1. Beck, K., Extreme Programming Explained, Addison-Wesley, 2000.
2. Wells, J. D., "Extreme Programming: A Gentle Introduction," 2001, available on-line at <http://www.extremeprogramming.org/>
3. A. Cockburn and L. Williams, "The Costs and Benefits of Pair Programming," eXtreme Programming and Flexible Processes in Software Engineering -- XP2000, Cagliari, Sardinia, Italy, 2000.
4. H. Ishii, M. Kobayashi, and J. Grudin, "Integration of inter-personal space and shared workspace: ClearBoard design and experiments," Proc. of ACM Conf. on Computer Supported Cooperative Work, Toronto, 1992, pp. 33--42.
5. R. S. Fish, R. Kraut, and B. L. Chalfonte, "The Video Window System in Informal Communications," ACM Conf. on Computer Supported Cooperative Work, Los Angeles, 1990, pp. 1--11.
6. P.Baheti, L.Williams, E.Gehringer, and D.Stotts, "Exploring the Efficacy of Distributed Pair Programming," XP Universe 2002, Chicago, August 4-7, 2002; Lecture Notes in Computer Science 2418 (Springer), pp. 208--220.
7. P.Baheti, L.Williams, E.Gehringer, D.Stotts, "Exploring Pair Programming in Distributed Object-Oriented Team Projects," Educator's Workshop, OOPSLA 2002, Seattle, Nov. 4-8, 2002, accepted to appear.
8. Smith, J., D. Stotts, and S.-U. Kum, "An Orthogonal Taxonomy for Hyperlink Anchor Generation in Video Streams using OvalTine," Proc. of Hypertext 2000 (ACM), May, 2000, San Antonio, TX, pp. 11--18.
9. Stotts, D. and Smith, J., "Semi-Automated Hyperlink Markup for Archived Video," Proc. of Hypertext 2002 (ACM), College Park, MD, May 2002, pp. 105--106.
10. Eric A. Bier, Ken Fishkin, Ken Pier, Maureen C. Stone, "A Taxonomy of See-Through Tools: The Video, Xerox PARC, Proc. of CHI '95,
11. T. Nishi, Y. Sato, H. Koike, "SnapLink: Interactive Object Registration and Recognition for Augmented Desk Interface," Proc. of IFIP Conf. on HCI (Interact 2001), pp. 240--246, July 2001.
12. Steve Benford, John Bowers, Lennart E. Fahlen, Chris Greenhalgh and Dave Snowdon, "User Embodiment in Collaborative Virtual Environments,", Proc. of CHI '95, http://www.acm.org/sigchi/chi95/Electronic/documnts/papers/sdb_bdy.htm
13. Beverly L. Harrison, Hiroshi Ishii, Kim J. Vicente, and William A. S. Buxton,"Transparent Layered User Interfaces: An Evaluation of a Display Design to Enhance Focused and Divided Attention," Proc. of CHI '95.
14. Vision Interface Seminar, Fall 2001, MIT, <http://www.ai.mit.edu/~trevor/6.892/>
15. Vision Interface Seminar, Fall 2001, MIT, <http://www.ai.mit.edu/~trevor/6.892/>
16. Laptev, I., and T. Lindberg, "Tracking of multi-state hand models using particle filtering and a hierarchy of multi-scale image features," Proc. of the IEEE Workshop on Scale-space and Morphology, Vancouver, Canada, in Springer-Verlag LNCS 2106 (M. kerckhove, ed.), July 2001, pp. 63--74.
17. Stotts, D., L. Wiliams, et al., "Virtual Teaming: Experiments and Experiences with Distributed Pair Programming," TR03-003, Dept. of Computer Science, Univ. of North Carolina at Chapel Hill, March 1, 2003.
18. Stotts, D., J. McC. Smith, and D. Jen, "The Vis-a-Vid Transparent Video FaceTop," UIST '03, Vancouver, Nov. 3-6, 2004, pp. 57--58.
19. Stotts, D., S. Kim, J. Navon, J. Prins, and L. Nyland, "CobWeb: Visual Design of Collaboration Protocols for Dynamic Group Web Browsing," Visual Computing 2002 (Distributed Multimedia 2002), San Francisco, Sept. 26-28, 2002, pp. 595--598.
20. Esenther, A.W., "Instant Co-Browsing: Lightweight Real-time Collaborative Web Browsing", Proc. of WWW 2002, <http://www2002.org/CDROM/poster/86/>.
21. Stotts, D., and R. Furuta, "Petri Net Based Hypertext: Document Structure with Browsing Semantics," ACM Trans. on Information Systems (ACM), vol. 7, no. 1, Jan. 1989, pp. 3--29.
22. Furuta, R., and P. D. Stotts, "Dynamic Hyperdocuments: Replacing the Programming Metaphor," Comm. of the ACM, short communication in special issue on Hypermedia Design, Aug. 1995, pp. 111--112.
23. Stotts, D., R. Furuta, and C. Ruiz Cabarrus, "Hyperdocuments as Automata: Verification of Trace-based Browsing Properties by Model Checking," ACM Trans. on Information Systems, vol. 16, no. 1, Jan. 1998, pp. 1--30.
24. Furuta, R., and P. D. Stotts, "Interpreted Collaboration Protocols and their use in Groupware Prototyping," Proc. of the 1994 ACM Conference on Computer Supported Cooperative Work (CSCW '94), Durham, NC, Oct.1994, pp. 121--131.
25. Shipman, F., J.M. Moore, P. Maloor, H. Hsieh, R. Akkapeddi, "Semantics Happen: Knowledge Building in Spatial Hypertext," Proc. of ACM Hypertext '02, College Park, MD, June 2002, pp. 25--34.
26. Shipman, F., A. Girgensohm, and L. Wilcox, "Combining Spatial and Navigational Structure in the Hyper-Hitchcock Hypervideo Editor," Proc. of ACM Hypertext '03, Nottingham, UK, Aug. 2003, pp. 124--125.
27. Gronbaek, K., P.P. Vestergaard, P. Orbaek, "Towards Geo-Spatial Hypertext: Concepts and Prototype Implementation," Proc. of ACM Hypertext '02, College Park, MD, June 2002, pp. 117--126.
28. Smith, J. McC., D. Stotts, and S.-U. Kum, "An Orthogonal Taxonomy for Hyperlink Anchor Generation in Video Streams using OvalTine," Proc. of Hypertext 2000 (ACM), May, 2000, San Antonio, Texas, pp. 11--18.
29. Stotts, D. and J. McC. Smith, "Semi-Automated Hyperlink Markup for Archived Video," ACM Hypertext 2002, College Park, MD, June 11-15, 2002, pp. 105--106.
30. CoVitess, <http://iihm.imag.fr/demos/CoVitesse/> .
31. Twiki, <http://twiki.org/> .
32. Sinclair, P.A.S, K. Martinez, D.E. Millard, and M.J. Weal, "Links in the Palm of your Hand: Tangible Hypermedia using Augmented Reality," Proc. of ACM Hypertext '02, College Park, MD, June 2002, pp. 127--136.
33. Gronbaek, K., J.F. Kristensen, and P. Orbaek, "Physical Hypermedia: Organizing Collections of Mixed Physical and Digital Material," Proc. of ACM Hypertext '03, Nottingham, UK, Aug. 2003, pp. 10--19.
34. Romero, L., and N. Correia, "HyperReal: A Hypermedia Model for Mixed Reality," Proc. of ACM Hypertext '03, Nottingham, UK, Aug. 2003, pp. 2--9.
35. Streitz, N., J. Geissler, J. Haake, J. Hol, "DOLPHIN: Integrated Meeting Support across Local and Remote Desktop Environments and LiveBoards," proc. of ACM CSCW '94, Chapel Hill, NC, 1994, pp. 345--358.

Index Terms

• Applied computing

  • Document management and text processing

    • Document preparation

      • Multi / mixed media creation

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Hypertext / hypermedia

      • Mixed / augmented reality

      • Virtual reality