D-Macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions

ABSTRACT

Multi-device user interface design mostly implies creating suitable interface for each targeted device, using a diverse set of design tools and toolkits. This is a time consuming activity, concerning a lot of repetitive design actions without support for reusing this effort in later designs. In this paper, we propose D-Macs: a design tool that allows designers to record their design actions across devices, to share these actions with other designers and to replay their own design actions and those of others. D-Macs lowers the burden in multi-device user interface design and can reduce the necessity for manually repeating design actions.

References

1. }}Lawrence Bergman, Vittorio Castelli, Tessa Lau, and Daniel Oblinger. Docwizards: a system for authoring follow-me documentation wizards. In Proc. UIST '05, pages 191--200. ACM, 2005.
2. }}Thomas Berlage. A selective undo mechanism for graphical user interfaces based on command objects. ACM Trans. Comput.-Hum. Interact., 1(3):269--294, 1994.
3. }}Bernoît Collignon, Jean Vanderdonckt, and Gaëlle Calvary. An intelligent editor for multi-presentation user interfaces. In Proc. SAC '08. ACM, 2008.
4. }}Adrien Coyette, Suzanne Kieffer, and Jean Vanderdonckt. Multi-fidelity prototyping of user interfaces. In Proc. INTERACT'07, 2007.
5. }}Catalina M. Danis, Fernanda B. Viegas, Martin Wattenberg, and Jesse Kriss. Your place or mine?: visualization as a community component. In Proc. of CHI '08, pages 275--284. ACM, 2008.
6. }}Krzysztof Z. Gajos, Daniel S. Weld, and Jacob O. Wobbrock. Automatically generating personalized user interfaces with supple. Artificial Intelligence, In Press, Corrected Proof, 2010.
7. }}Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. In Proc. CHI '08, pages 1257--1266. ACM, 2008.
8. }}Floraine Grabler, Maneesh Agrawala, Wilmot Li, Mira Dontcheva, and Takeo Igarashi. Generating photo manipulation tutorials by demonstration. ACM Trans. Graph., 28(3):1--9, 2009.
9. }}Valentina Grigoreanu, Roland Fernandez, Kori Inkpen, and George Robertson. What designers want: Needs of interactive application designers. In Proc. VL/HCC'09, pages 139--146. IEEE Computer Society, 2009.
10. }}Tovi Grossman and George Fitzmaurice. Toolclips: An investigation of contextual video assistance for functionality understanding. In Proc. of CHI '10, pages 1515--1524. ACM, 2010.
11. }}Susan M. Harrison. A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface. In Proc. of CHI '95, pages 82--89. ACM Press/Addison-Wesley Publishing Co., 1995.
12. }}Bjorn Hartmann, Daniel MacDougall, Joel Brandt, and Scott R Klemmer. What would other programmers do? suggesting solutions to error messages. In Proc. of CHI'10, pages 1019--1029. ACM, 2010.
13. }}Eric Horvitz. Principles of mixed-initiative user interfaces. In Proc. of CHI '99, pages 159--166. ACM, 1999.
14. }}Scott R. Klemmer, Bjࣆrn Hartmann, and Leila Takayama. How bodies matter: five themes for interaction design. In In Proc. DIS '06, pages 140--149, 2006.
15. }}David Kurlander and Steven Feiner. A history-based macro by example system. In Proc. UIST '92, pages 99--106. ACM, 1992.
16. }}Gilly Leshed, Eben M. Haber, Tara Matthews, and Tessa Lau. Coscripter: automating & sharing how-to knowledge in the enterprise. In Proc. CHI '08, pages 1719--1728. ACM, 2008.
17. }}Yang Li and James A. Landay. Informal prototyping of continuous graphical interactions by demonstration. In Proc. of UIST '05, pages 221--230. ACM, 2005.
18. }}Henry Lieberman. Your wish is my command: programming by example. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2001.
19. }}James Lin and James A. Landay. Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces. In Proc. CHI '08, pages 1313--1322. ACM, 2008.
20. }}Justin Matejka, Wei Li, Tovi Grossman, and George Fitzmaurice. Communitycommands: command recommendations for software applications. In In Proc. UIST'09, pages 193--202. ACM, 2009.
21. }}Richard G. McDaniel and Brad A. Myers. Getting more out of programming-by-demonstration. In Proc. of CHI'99, pages 442--449. ACM, 1999.
22. }}C. Meng, M. Yasue, A. Imamiya, and X. Mao. Visualizing histories for selective undo and redo. In APCHI'98, page 459. IEEE Computer Society, 1998.
23. }}Jan Meskens, Kris Luyten, and Karin Coninx. Jelly: A multi-device design environment for managing consistency across devices. In Proc. AVI'10, pages 289--298. ACM, 2010.
24. }}Jan Meskens, Jo Vermeulen, Kris Luyten, and Karin Coninx. Gummy for multi-platform user interface designs: Shape me, multiply me, fix me, use me. In Proc. AVI'08. ACM, 2008.
25. }}Francesmary Modugno and Brad A. Myers. Pursuit: graphically representing programs in a demonstrational visual shell. In In Proc. CHI '94, pages 455--456. ACM,1994.
26. }}Brad Myers, Scott E. Hudson, and Randy Pausch. Past, present, and future of user interface software tools. ACM Trans. Comput.-Hum. Interact., 7(1):3--28, 2000.
27. }}Brad A. Myers and Richard McDaniel. Demonstrational interfaces: sometimes you need a little intelligence, sometimes you need a lot. pages 45--60, 2001.
28. }}Jeffrey Nichols, Duen Horng Chau, and Brad A. Myers. Demonstrating the viability of automatically generated user interfaces. In Proc. CHI'07. ACM, 2007.
29. }}Jeffrey Nichols and Tessa Lau. Mobilization by demonstration: using traces to re-author existing web sites. In Proc. IUI '08, pages 149--158. ACM, 2008.
30. }}Dan R. Olsen, Jr. Evaluating user interface systems research. In In Proc. UIST '07, pages 251--258. ACM, 2007.
31. }}Dan R. Olsen, Jr., Sean Jefferies, Travis Nielsen, William Moyes, and Paul Fredrickson. Cross-modal interaction using xweb. In Proc. UIST '00, pages 191--200. ACM, 2000.
32. }}David Wolber and Gene Fisher. A demonstrational technique for developing interfaces with dynamically created objects. In Proc. of UIST '91, pages 221--230. ACM, 1991.
33. }}Brad Vander Zanden and Brad A. Myers. Automatic, look-and-feel independent dialog creation for graphical user interfaces. In Proc. of CHI '90, pages 27--34.ACM, 1990.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Graphical user interfaces

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping