Melody Y. Ivory
Marti A. Hearst
ABSTRACT
We are creating an interactive tool to help non-professional web site builders create high quality designs. We have previously reported that quantitative measures of web page structure can predict whether a site will be highly or poorly rated by experts, with accuracies ranging from 67--80%. In this paper we extend that work in several ways. First, we compute a much larger set of measures (157 versus 11), over a much larger collection of pages (5300 vs. 1900), achieving much higher overall accuracy (94% on average) when contrasting good, average, and poor pages. Second, we introduce new classes of measures that can make assessments at the site level and according to page type (home page, content page, etc.). Finally, we create statistical profiles of good sites, and apply them to an existing design, showing how that design can be changed to better match high-quality designs
- Neil Bowers. Weblint: quality assurance for the World Wide Web. In Proceedings of the Fifth International World Wide Web Conference, Paris, France, May 1996. Amsterdam, The Netherlands: Elsevier Science Publishers. Google Scholar
Digital Library
- Giorgio Brajnik. Automatic web usability evaluation: Where is the limit? In Proceedings of the 6th Conference on Human Factors & the Web, Austin, TX, June 2000.Google Scholar
- Leo Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Wadsworth Publishing Company, Belmont, California, U.S.A., 1984.Google Scholar
- CAST. Bobby. http://www.cast.org/bobby/, 2000.Google Scholar
- Ed H. Chi, Peter Pirolli, and James Pitkow. The scent of a site: A system for analyzing and predicting information scent, usage, and usability of a web site. In Proceedings of the Conference on Human Factors in Computing Systems, pages 161--168, The Hague, The Netherlands, April 2000. New York, NY: ACM Press. Google ScholarDigital Library
- Melody Y. Ivory. An Empirical Foundation for Automated Web Interface Evaluation. PhD thesis, University of California, Berkeley, Computer Science Division, 2001. In preparation. Google ScholarDigital Library
- Melody Y. Ivory, Rashmi R. Sinha, and Marti A. Hearst. Preliminary findings on quantitative measures for distinguishing highly rated information-centric web pages. In Proceedings of the 6th Conference on Human Factors & the Web, Austin, TX, June 2000.Google Scholar
- Melody Y. Ivory, Rashmi R. Sinha, and Marti A. Hearst. Empirically validated web page design metrics. In Proceedings of the Conference on Human Factors in Computing Systems, volume 1, pages 53--60, Seattle, WA, March 2001. Google ScholarDigital Library
- N. Kim and B. J. Fogg. World wide web credibility: What effects do advertisements and typos have on the perceived credibility of web page information? Unpublished thesis, Stanford University, 1999.Google Scholar
- Mark W. Newman and James A. Landay. Sitemaps, storyboards, and specifications: A sketch of web site design practice. In Proceedings of Designing Interactive Systems: DIS 2000, Automatic Support in Design and Use, pages 263--274, August 2000. Google ScholarDigital Library
- Jakob Nielsen. Designing Web Usability: The Practice of Simplicity. Indianapolis, IN: New Riders Publishing, 2000. Google ScholarDigital Library
- Julie Ratner, Eric M. Grose, and Chris Forsythe. Characterization and assessment of HTML style guides. In Proceedings of the Conference on Human Factors in Computing Systems, volume 2, pages 115--116, Vancouver, Canada, April 1996. New York, NY: ACM Press. Google ScholarDigital Library
- Nathan Shedroff. Experience Design 1. Indianapolis, IN: New Riders Publishing, 2001. Google ScholarDigital Library
- Rashmi Sinha, Marti Hearst, and Melody Ivory. Content or graphics? an empirical analysis of criteria for award-winning websites. In Proceedings of the 7th Conference on Human Factors & the Web, Madison, WI, June 2001.Google Scholar
- Jared M. Spool, Tara Scanlon, Will Schroeder, Carolyn Snyder, and Terri DeAngelo. Web Site Usability: A Designer's Guide. Morgan Kaufmann Publishers, Inc., San Francisco, 1999. Google ScholarDigital Library
- SPSS Inc. SPSS Base 10.0 Applications Guide. Chicago, IL: SPSS Inc., 1999.Google Scholar
- The International Academy of Arts and Sciences. The webby awards 2000 judging criteria. http://www.webbyawards.com/judging/criteria.html, 2000.Google Scholar
- Yin Leng Theng and Gil Marsden. Authoring tools: Towards continuous usability testing of web documents. In Proceedings of the 1st International Workshop on Hypermedia Development, Pittsburg, PA, June 1998.Google Scholar
- Web Criteria. Max, and the objective measurement of web sites. http://www.webcriteria.com, 1999.Google Scholar
Index Terms
- Statistical profiles of highly-rated web sites
Recommendations
Empirically validated web page design metrics
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsA quantitative analysis of a large collection of expert-rated web sites reveals that page-level metrics can accurately predict if a site will be highly rated. The analysis also provides empirical evidence that important metrics, including page ...
Evolution of web site design patterns
The Web enables broad dissemination of information and services; however, the ways in which sites are designed can either facilitate or impede users' benefit from these resources. We present a longitudinal study of web site design from 2000 to 2003. We ...
Web sites that work: designing with your eyes open
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing SystemsThis tutorial is inspired by our observations of users struggling with web sites and our consulting work with clients who face the many challenges of web site development. We've witnessed the effects of less-than-optimal web site design and the pain it ...
Comments