A.J. Bernheim Brush
Morgan Ames
Janet Davis
ABSTRACT
Synchronous remote usability studies can be a convenient and cost-effective alternative to conventional local usability studies. Although they are common in the field, there has been little research comparing synchronous remote usability studies with local studies. In our comparison of remote and local studies of an expert interface, the primary differences were in the participant's and facilitator's qualitative experience. The remote and local studies agreed closely (with no significant differences) in terms of the number of usability issues found, their type, and their severity. While our comparison focuses on an expert interface and more work is needed to understand remote studies in general, our experience suggests that evaluators of expert interfaces will have comparable success identifying usability issues with either remote or local studies.
- Boren, T., and Ramey, J. Thinking Aloud: Reconciling Theory and Practice. IEEE Trans. on Professional Communication, pg. 261--278. Sept. 2000.Google Scholar
- Ebling, M.R., and John, B.E. On the Contributions of Different Empirical Data in Usability Testing. Proceedings of DIS, Aug. 2000. Google ScholarDigital Library
- Eclipse Project. www.eclipse.orgGoogle Scholar
- Glance Networks. www.glance.netGoogle Scholar
- Gough, D. and Phillips, H. Remote Online Usability Testing: Why, How, and When to use it. www.boxesandarrows.com/archives/remote_online_usability_testing_why_how_and_when_to_use_it.phpGoogle Scholar
- Hartson, H.R., Castillo, J.C., Kelso, J., and Neale, W.C. Remote Evaluation: The Network as an Extension of the Usability Laboratory. CHI 1996, pg. 228--235. Google ScholarDigital Library
- Hilbert, D.M., Redmiles, D.F. Separating the Wheat from the Chaff in Internet-Mediated User Feedback. ACM SIGGROUP Bulletin, V. 20, Issue 1, pg. 35--40. April 1999. Google ScholarDigital Library
- Jacques, R. and Savastano, H. Remote vs. Local Usability Evaluation of Web Sites. IHM HCI 2001.Google Scholar
- Nielsen, Severity Ratings for Usability Problems. www.useit.com/papers/heuristic/severityrating.htmlGoogle Scholar
- Ratner, J. Learning About the User Experience on the Web With the Phone Usability Method. Human Factors and Web Development, 2nd edition. Oct. 2002. Google ScholarDigital Library
- Urbansim Project. www.urbansim.orgGoogle Scholar
Index Terms
- A comparison of synchronous remote and local usability studies for an expert interface
Recommendations
On user behaviour adaptation under interface change
IUI '14: Proceedings of the 19th international conference on Intelligent User InterfacesDifferent interfaces allow a user to achieve the same end goal through different action sequences, e.g., command lines vs. drop down menus. Interface efficiency can be described in terms of a cost incurred, e.g., time taken, by the user in typical ...
Remote usability evaluations With disabled people
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsFinding participants for evaluations with specific demographics can be a problem for usability and user experience specialists. In particular, finding participants with disabilities is especially problematic, yet testing with disabled people is becoming ...
Understanding usability practices in complex domains
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsAlthough usability methods are widely used for evaluating conventional graphical user interfaces and websites, there is a growing concern that current approaches are inadequate for evaluating complex, domain-specific tools. We interviewed 21 experienced ...
Comments