Roel Vertegaal
ABSTRACT
In this paper, we propose a tentative framework for the classification of Attentive Interfaces, a new category of user interfaces. An Attentive Interface is a user interface that dynamically prioritizes the information it presents to its users, such that information processing resources of both user and system are optimally distributed across a set of tasks. The interface does this on the basis of knowledge --- consisting of a combination of measures and models --- of the past, present and future state of the user's attention, given the availability of system resources. We will show how the Attentive Interface provides a natural extension to the windowing paradigm found in Graphical User Interfaces. Our taxonomy of Attentive Interfaces allows us to identify classes of user interfaces that would benefit most from the ability to sense, model and optimize the user's attentive state. In particular, we show how systems that influence user workflow in concurrent task situations, such as those involved with management of multiparty communication, may benefit from such facilities.
- Benford, S., Greenhalgh, C., Bowers, J., Snowdon, S., and Fahlén, L. User Embodiment in Collaborative Virtual Environments. In Proceedings of CHI'95. Denver, Colorado: ACM, 1995. Google Scholar
Digital Library
- Broadbent, D. E. Perception and Communication. London: Pergamon Press, 1958.Google Scholar
- Carter, P. and Mies van der Rohe, L. Mies Van Der Rohe at Work. Phaidon Press, 1999.Google Scholar
- Deutsch, J. A. and Deutsch, D. Attention: Some Theoretical Considerations. Psychological Review 70, 1963, pp. 80-90.Google ScholarCross Ref
- Duchowski, A. T. and McCormick, B. H. Gaze-Contingent Video Resolution Degradation. In Human Vision and Electronic Imaging III. San Jose, CA USA: SPIE, 1998.Google Scholar
- Duncan, S. Some Signals and Rules for Taking Speaking Turns in Conversations. Journal of Personal and Social Psychology 23, 1972.Google Scholar
- Goldhaber, M. The Attention Economy and the Net. First Monday http://www.firstmonday.dk, 1997.Google Scholar
- H. Helmholtz, von. Helmholtz's Treatise on Physiological Optics. Southall, J. P. C. (Ed.). New York: Dover Publications, 1962.Google Scholar
- Horvitz, E., Jacobs, A., and Hovel, D. Attention-Sensitive Alerting. In Proceedings of UAI '99, Conference on Uncertainty and Artificial Intelligence, Stockholm, Sweden. Morgan Kaufmann: San Francisco, 1999, pp. 305-313. Google ScholarDigital Library
- James, W. The Principles of Psychology. New York: Holt, 1890.Google Scholar
- LC Technologies, Inc. The Eyegaze Communication System. Fairfax, VA: http://www.eyegaze.com, 1997.Google Scholar
- Murphy, H. and Duchowski, A. Gaze-Contingent Level of Detail Rendering. In EuroGraphics 2001. Manchester, UK, 2001.Google Scholar
- Norman, D. Towards a Theory of Memory and Attention. Psychological Review 88, 1968, pp. 1-15.Google Scholar
- Posner, M. I. Orienting of Attention. Quarterly Journal of Experimental Psychology 32, 1980, pp. 3-25.Google ScholarCross Ref
- Selker, T. Eye-R, a Glasses-Mounted Eye Motion Detection Interface. In Extended Abstracts of CHI'01. Seattle, WA: ACM, 2001. Google ScholarDigital Library
- Smith, D., Irby, C., Kimball, R., Verplank, B., and Harslem, E. Designing the Star User Interface. Byte 7(4), 1982, pp. 242-282.Google Scholar
- Treismann, A. and Gelade, G. A Feature-Integration Theory of Attention. Cognitive Psychology 12, 1980, pp. 97-136.Google ScholarCross Ref
- Van der Veer, G. C., Yap, F., Broos, D., Donau, K., and Fokke, M. J. ETAG - Some Applications of a Formal Representation of the User Interface. In Proceedings of INTERACT'90. Amsterdam: North-Holland, 1990. Google ScholarDigital Library
- Velichkovsky, B. and Hansen, J. P. New Technological Windows to Mind: There is More in Eyes and Brains for Human-Computer Interaction. In Proceedings of CHI'96. Vancouver, Canada: ACM, 1996, pp. 496-503. Google ScholarDigital Library
- Velichkovsky, B., Sprenger, A., and Unema, P. Towards Gaze-mediated Interaction: Collecting Solutions of the "Midas Touch Problem". In Proceedings of INTERACT '97. Sydney, Australia, 1997. Google ScholarDigital Library
- Vertegaal, R. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration. In Proceedings of CHI'99. Pittsburg, PA: ACM, 1999. Google ScholarDigital Library
- Vertegaal, R., Dickie, C., Sohn, C. and Flickner, M. Designing Attentive Cell Phones Using Wearable EyeContact Sensors. Submitted to Extended Abstracts of CHI'02. Minneapolis: ACM, 2002. Google ScholarDigital Library
- Vertegaal, R., Slagter, R., Van der Veer, G. C., and Nijholt, A. Why Conversational Agents Should Catch the Eye. In Extended Abstracts of CHI'2000. The Hague, The Netherlands: ACM, 2000. Google ScholarDigital Library
- Vertegaal, R., Slagter, R., Van der Veer, G. C., and Nijholt, A. Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. In Proceedings of CHI'01. Seattle, WA: ACM, 2001. Google ScholarDigital Library
- Vertegaal, R., Van der Veer, G. C., and Vons, H. Effects of Gaze on Multiparty Mediated Communication. In Proceedings of Graphics Interface 2000. Montreal, Canada: Morgan Kaufmann Publishers, 2000, pp. 95-102.Google Scholar
- Vertegaal, R., Velichkovsky, B., and Van der Veer, G. C. Catching the Eye: Management of Joint Attention in Cooperative Work. SIGCHI Bulletin 29(4), 1997. Google ScholarDigital Library
- Zhai, S., Morimoto, C., and Ihde, S. Manual and Gaze Input Cascaded (MAGIC) Pointing. In Proceedings of CHI'99. Pittsburgh, PA: ACM, 1999, pp. 246-253. Google ScholarDigital Library
- Zhang, J. and Norman, D. Representations in Distributed Cognitive Tasks. Cognitive Science 18, 1994, pp. 87-122.Google ScholarCross Ref
- Designing attentive interfaces
Recommendations
From usability tasks to usable user interfaces
TAMODIA '05: Proceedings of the 4th international workshop on Task models and diagramsIn this paper we describe how the identification of usability tasks in the task model as an early consideration of usability in the process can directly influence the design of usable User Interfaces (UI). We intend to make system analysts and UI ...
Hard-to-use interfaces considered beneficial (some of the time)
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsResearchers in HCI share a common understanding that 'easy-to-use', 'easy-to-learn' and 'intuitive' interfaces are beneficial to users. Designing such interfaces raises challenges and often requires multiple iterations. While we are generally prompt to ...
Defining Interfaces at a High Level of Abstraction
One of the newest user-interface management systems, the User-Interface Development Environment, is described by its creators. UIDE is built around a knowledge-based representation of the conceptual design of a user interface. UIDE supports design at a ...
Comments