A framework for mobile evaluation

ABSTRACT

In this paper we present a software framework which supports the construction and evaluation of mixed-fidelity prototypes for mobile devices. The framework is available for desktop and mobile devices and allows designers and users to 1) test the prototypes on actual devices; 2) gather usage information, both passively and actively supporting contextual and ubiquitous evaluation; 3) convey common prototyping procedures with effective data gathering methods that can be used on ubiquitous scenarios; 4) support in-situ prototyping and participatory design on-the-go. We address the framework's features and its contributions to the evaluation of applications for mobile devices and the field of mobile interaction design, presenting real-life case studies and achieved results.

References

1. Barnard, et al. Capturing the effects of context on human performance in mobile computing systems. Personal and Ubiquitous Computing, Vol. 11, No. 46.
2. Carter, S., et al. Momento: Support for Situated Ubicomp Experimentation. CHI'07, pp. 125--134, ACM.
3. Consolvo, S. and M. Walker, Using the Experience Sampling Method to Evaluate Ubicomp Applications. IEEE Pervasive Computing, 2003. 2(2): pp. 24--31,IEEE.
4. Davis, R., et al. SketchWizard: Wizard of Oz Prototyping of Pen-Based User Interfaces. UIST'07, ACM.
5. Duh, H. et al. Usability Evaluation for Mobile Device: A Comparison of Laboratory and Field Tests. Mobile HCI'06. ACM.
6. Froehlich, J., et al. MyExperience: A System for In Situ Tracing and Capturing of User Feedback on Mobile Phones. MobiSys'07, pp. 57--70, ACM.
7. Holmquist, L., Prototyping: generating ideas or cargo cult designs? Interactions, 2005. 12(2), ACM.
8. Jones, M. and G. Marsden, Mobile Interaction Design. 2006, John Wiley & Sons, England.
9. Kjeldskov, J. and J. Stage, New Techniques for Usability Evaluation of Mobile Systems. International Journal of Human Computer Studies, Elsevier, 2003.
10. Klemmer, S. R., et al, SUEDE: A Wizard of Oz Prototyping Tool for Speech User Interfaces. In Proc. of UIST'00, San Diego, California, USA, pp. 1--10, ACM.
11. Landay, J. SILK: Sketching Interfaces Like Krazy. CHI'96, pp.398--399, ACM.
12. Lin, J. et al. Denim: Finding a Tighter Fit Between Tools and Practice for Web Site Design. CHI'00, ACM.
13. Nielsen, C. M., et al. It's Worth the Hassle! The Added Value of Evaluating the Usability of Mobile Systems in the Field. NordiCHI'06. ACM.
14. Sá, M.d. and L. Carriço. Low-fi Prototyping for Mobile Devices. CHI'06 (extended abstracts), ACM.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping

      • User centered design