How do users evaluate the credibility of Web sites?: a study with over 2,500 participants

ABSTRACT

In this study 2,684 people evaluated the credibility of two live Web sites on a similar topic (such as health sites). We gathered the comments people wrote about each siteís credibility and analyzed the comments to find out what features of a Web site get noticed when people evaluate credibility. We found that the ìdesign lookî of the site was mentioned most frequently, being present in 46.1% of the comments. Next most common were comments about information structure and information focus. In this paper we share sample participant comments in the top 18 areas that people noticed when evaluating Web site credibility. We discuss reasons for the prominence of design look, point out how future studies can build on what we have learned in this new line of research, and outline six design implications for human-computer interaction professionals.

References

1. Benoy, J. W. (1982). The credibility of physically attractive communicators: A review. Journal of Advertising, 11(3), 15--24.
2. Berscheid, E. & Walster, E. (1974) Physical attractiveness. L. Berkowitz (Ed.) Advances in experimental social psychology. (Vol. 7, pp. 157--215). New York: Academic Press.
3. Berscheid, E. (1981) A review of the psychological effects of physical attractiveness. G. W. Lucker, K. A. Ribbens, & J. A. McNamara (Eds.), Psychological aspects of facial form (pp. 1--23). Ann Arbor, MI: Center for Human Growth.
4. Cheskin Research & Studio Archetype/Sapient. (1999). "Ecommerce Trust Study." http://cheskin.com/think/trust/assets/images/etrust.pdf
5. Cheskin Research (July 2000). "Trust in the Wired Americas" Online at http://cheskin.com/think/studies/trustIIrpt.pdf
6. Corritore, C. L., Kracher, B., Wiedenbeck S. (2001). Trust in the online environment. In M. J. Smith, G. Salvendy, D. Harris, and R. J. Koubek (Eds.), Usability Evaluation and Interface Design
7. Dion, K. K., Berscheid, E. & Walster, E. (1972) What is beautiful is good. Journal of Personality and Social Psychology, 24, 285--290.
8. Eagly, A. H., Ashmore, R. D., Makhijani, M. G., & Longo, L. C. (1991) What is beautiful is good, but..: A meta-analytic review of research on the physical attractiveness stereotype. Psychological Bulletin, 110, 109--128.
9. Egger, F. N. (2000). "Trust Me, I'm an Online Vendor": Towards a Model of Trust for E-Commerce System Design. In: G. Szwillus & T. Turner (Eds.): CHI2000 Extended Abstracts: Conference on Human Factors in Computing Systems, The Hague (NL), April 1--6, 2000: 101--102, ACM Press.
10. Finberg, H., Stone, H., and Lynch, D. (2001). Digital Journalism Credibility Study. Available at www.journalists.org/Programs/credibility_study.pdf
11. Fogg, B. J. (2002a). Prominence-Interpretation Theory: Explaining How People Assess Credibility. A Research Report by the Stanford Persuasive Technology Lab. Available at www.captology.stanford.edu/PIT.html
12. Fogg, B. J. (2002b). Stanford Guidelines for Web Credibility. A Research Summary from the Stanford Persuasive Technology Lab. Stanford University. www.webcredibility.org/guidelines.
13. Fogg, B. J., & Tseng, H. (1999). The Elements of Computer Credibility. Proceedings of ACM CHI 99 Conference on Human Factors in Computing Systems v.1, 80--87. New York: ACM Press.
14. Fogg, B. J., Kameda, T., Boyd, J., Marshall, J., Sethi, R., Sockol, M., Trowbridge, T. (2002). Stanford-Makovsky Web Credibility Study 2002: Investigating what makes Web sites credible today. A Research Report by the Stanford Persuasive Technology Lab in collaboration with Makvosky & Company. Stanford University. Available at www.webcredibility.org
15. Fogg, B. J., Lee. E., & Marshall, J. (2002). Interactive Technology and Persuasion. In J. P. Dillard and M. Pfau (Eds.), The Persuasion Handbook: Developments in Theory and Practice. Pp 765--788. Thousand Oaks, CA: Sage.
16. Fogg, B. J., Marshall, J. Kameda, T. Solomon, J., Rangnekar, A., Boyd, J. & Brown, B (2001). Web Credibility Research: A Method for Online Experiments and Some Early Study Results. Proceedings of ACM CHI 2001 Conference on Human Factors in Computing Systems, pp 61--68. New York: ACM Press.
17. Fogg, B. J., Marshall, J., Laraki, O., Osipovich, A., Varma, C., Fang, N., Paul, J., Rangnekar, A., Shon, J., Swani, P., & Treinen, M. (2000). Elements that Affect Web Credibility: Early Results from a Self-Report Study. Proceedings of ACM CHI 2000 Conference on Human Factors in Computing Systems. New York: ACM Press. Extended Abstracts (pp. 295--296). New York ACM Press.
18. Fogg, B. J., Marshall, J., Laraki, O., Osipovich, A., Varma, C., Fang, N., Paul, J., Rangnekar, A., Shon, J., Swani, P., & Treinen, M. (2001). What Makes A Web Site Credible? A Report on a Large Quantitative Study. Proceedings of ACM CHI 2001 Conference on Human Factors in Computing Systems. New York: ACM Press. Seattle, WA (USA), 31 March- 5 April, 2001:61--68, ACM Press.
19. Kim, J. & J. Y. Moon (1998). Designing Emotional Usability in Customer Interfaces-Trustworthiness of Cyber-banking System Interfaces. Interacting with Computers, Vol. 10: 1--29.
20. Lee, J., Kim, J. & Moon, J. Y. (2000). What makes Internet users visit cyber stores again? Key design factors for customer loyalty. Proceedings of the Conference on Human Factors in Computing Systems CHI 2000 (pp. 305--312). New York ACM.
21. Lohse, G. L. & Spiller, P. (1998). Electronic shopping. Communications of the ACM, 41(7), 81--87.
22. Nielsen, J., Molich, R., Snyder, C. & Farrell, S. (2000). E-commerce user experience Trust. Fremont, CA Nielsen Norman Group.
23. Olson, J. S. & Olson, G. M. (2000b). i2i trust in e-commerce. Communications of the ACM, 43(12), 41--44.
24. Petty, R. E. & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion. In L. Berkowitz (Ed) Advances in Experimental Social Psychology, 19, New York: Academic Press, 123--205.
25. Princeton Survey Research Associates (2002). A Matter of Trust: What Users Want From Web Sites. Results of a National Survey of Internet Users for Consumer WebWatch. Available online at http://www.consumerwebwatch.org/news/report1.pdf
26. Shelat, B. & Egger, F. N. (2002). What makes people trust online gambling sites? Proceedings of Conference on Human Factors in Computing Systems CHI 2002, Extended Abstracts, pp. 852--853. New York
27. Cockburn, A., and McKenzie, B. (2001). What do web users do? An empirical analysis of web use. International Journal of Human-Computer Studies, 54(6), 903--922.

• Human-centered computing