skip to main content
10.1145/2639189.2639227acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Harambee: a novel usability evaluation method for low-end users in Kenya

Published:26 October 2014Publication History

ABSTRACT

The research reported in this paper seeks to advance the discussion on cultural usability and its implementation among non-western users. This investigation focuses on the effect of culture on the quality of usability evaluation results among Kenyan young professionals and Kenyan farmers. Literature review and field observation studies were used to develop a theoretical framework, which in turn was used to scaffold a usability evaluation method 'Harambee', depicting working together during the evaluation exercise. The 'Harambee' and Retrospective Protocol methods were implemented and usability results compared. The quality of the farmers' usability results consistently improved with the 'Harambee' method but not so with the young professionals. Despite being from the same culture-group, the effect of culture on quality of usability results seems to differ among high-end and low-end users. Consequently, when adapting UEMs, there is a need to go beyond the national cultural level and focus on the user-type too.

References

  1. Bevan, N. and Macleod, M. (1994) Usability measurement in context. Behaviour and information Technology, 13, p. 132--145.Google ScholarGoogle Scholar
  2. Bidwell, N. J., & Siya, M. J. (2013). Situating Asynchronous Voice in Rural Africa Human-Computer Interaction--INTERACT 2013 (pp. 36--53): Springer.Google ScholarGoogle Scholar
  3. Chavan, A. L., (2005). Another culture, another method. In Proceedings of the 11th International Conference on Human- Computer Interaction {CD-ROM}. Hillsdale, NJ: Lawrence Erlbaum Associates.Google ScholarGoogle Scholar
  4. Clemmensen, T., Hertzum, M., Hornbæk, K., Shi, Q., & Yammiyavar, P. (2009). Cultural cognition in usability evaluation. Interacting with Computers, 21(3), 212--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Clemmensen, T., Hertzum, M., Yang, J., & Chen, Y. (2013). Do Usability Professionals Think about User Experience in the Same Way as Users and Developers Do? Human-Computer Interaction--INTERACT 2013 (pp. 461--478): Springer Berlin Heidelberg.Google ScholarGoogle Scholar
  6. Clemmensen, T., Shi, Q., Kumar, J., Li, H., Sun, X., & Yammiyavar, P. (2007). Cultural usability tests--how usability tests are not the same all over the world: Springer.Google ScholarGoogle ScholarCross RefCross Ref
  7. Cohen, R. (1991) Negotiating Across Cultures: Communication Obstacles in International Diplomacy. Washington, D. C.: United States Institute of Peace.Google ScholarGoogle Scholar
  8. Corder, G. and Foreman, D. (2009) Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach. New Jersey: Wiley.Google ScholarGoogle ScholarCross RefCross Ref
  9. Doerfiinger, J., & Dearden, A. (2013). Evolving a Software Development Methodology for Commercial ICTD Projects. Information Technologies & International Development, 9(3).Google ScholarGoogle Scholar
  10. Doerflinger, J., Dearden, A., & Gross, T. (2013). A software development methodology for sustainable ICTD solutions. Paper presented at the CHI '13 Extended Abstracts on Human Factors in Computing Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Falzon, P. (1990) Human-computer interaction: Lessons from human-human communication. In Falzon, P. (ed.) Cognitive Ergonomics, p. 51--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Gudykunst, W. (2003) Cross-Cultural and Intercultural Communication. Thousand Oaks: Sage.Google ScholarGoogle Scholar
  13. Hall, E. T. (1976) Beyond culture. New York: Anchor Press/Doubleday.Google ScholarGoogle Scholar
  14. Heider, F. (1958) The psychology of interpersonal relations. New York: Wiley.Google ScholarGoogle ScholarCross RefCross Ref
  15. Herman, L. (1996). Towards Effective Usability Evaluation in Asia: Cross-Cultural Differences. Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI'96), 135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hertzum, M., & Clemmensen, T. (2012). How do usability professionals construe usability? International Journal of Human-Computer Studies, 70(1), 26--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Hertzum, M., Clemmensen, T., Hornbæk, K., Kumar, J., Shi, Q., & Yammiyavar, P. (2011). Personal usability constructs: How people construe usability across nationalities and stakeholder groups. International Journal of Human-Computer Interaction, 27(8), 729--761.Google ScholarGoogle Scholar
  18. Hofstede, G. (1991, 1997). Cultures and Organizations: Software of the Mind, Intercultural Cooperation and its Importance for Survival. New York, NY: McGraw-Hill.Google ScholarGoogle Scholar
  19. Hofstede, G. (2001). Culture's consequences: Comparing values, behaviours, institutions and organizations across nations. 2nd ed. Thousand Oaks, CA: Sage.Google ScholarGoogle Scholar
  20. Honold, P. (2000) Culture and Context: An Empirical Study for the development of a Framework for the Elicitation of Cultural Influence in Product Usage. In International Journal of Human-Computer Interaction, 12(3&4), p.327--345.Google ScholarGoogle ScholarCross RefCross Ref
  21. Jones, E. and Davis, K. (1965) From acts to dispositions: The attribution process in social psychology. In L. Berkowitz (ed.) Advances in experimental social psychology, (2), p. 219--266.Google ScholarGoogle Scholar
  22. Jordan, P. (1998). An Introduction to Usability. Francis and Taylor.Google ScholarGoogle Scholar
  23. Kelley, H. (1973) The process of Causal Attribution. American Psychologist, 28, p.107--128Google ScholarGoogle ScholarCross RefCross Ref
  24. Korpela, M., Soriyan, H., & Olufokunbi, K. (2000). Activity analysis as a method for information systems development: General introduction and experiments from Nigeria and Finland. Scandinavian Journal of Information Systems, 12(1), 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mayhew, D. (1999) The Usability Engineering Lifecycle. San Francisco, California: Morgan Kauffman Publishers, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. McDowell, L. and Pringle, R. (1992) Defining Women: Social Institutions and Gender Divisions, Cambridge: Polity Press.Google ScholarGoogle Scholar
  27. Menon, T., Morris, M. W., Chiu, C. Y., and Hong, Y. Y. (1999) Culture and the construal of agency: Attribution to individual versus group dispositions. Journal of Personality & Social Psychology, 76, 701--717.Google ScholarGoogle ScholarCross RefCross Ref
  28. Oyugi, C., Dunckley, L., & Smith, A. (2008). Evaluation methods and cultural differences: studies across three continents. Paper presented at the Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Oyugi, C., Dunckley, L., Smith, A. (2008) Evaluating naïve users' experiences of novel ICT products. CHI '08 Workshop proceedings 2008, p. 41--45.Google ScholarGoogle Scholar
  30. Rotter, J. (1966) Generalized expectancies for internal and external control of reinforcement. Psychological Monographs, 80, p.1--28.Google ScholarGoogle ScholarCross RefCross Ref
  31. Shi, Q. (2009). An Empirical Study of Thinking Aloud Usability Testing from a Cultural Perspective. Unpublished PhD, Copenhagen Business School (CBS), Copenhagen, Denmark.Google ScholarGoogle Scholar
  32. Shneiderman, B. and Plaisant, C. (2004) Designing the user Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Smith, A. and Dunckley, L. (2002) Prototype evaluation and redesign: structuring the design space through contextual techniques. Interacting with Computers. BCS HCI Journal, 14 (6), p.821--843.Google ScholarGoogle Scholar
  34. Smith, A., Bannon, L., and Gulliksen, J. (2010). Localising HCI practice for local needs. Paper presented at the Proceedings of the 2010 international conference on Interaction Design & International Development. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Smith, A.. and Yetim, F. (2004). Global human-computer systems: Cultural determinants of usability. Editorial. Interacting with Computers, 16(1), 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  36. Storms, M. and McCaul, K. (1976) Attribution process and emotional exacerbation of dysfunctional behaviour. In J. H. Harvey, W. J. Ickes, and R. F. Kidd (Eds.). New directions in attribution research, 1, p. 143--164.Google ScholarGoogle Scholar
  37. Thomas C. and Bevan N. (1996) Usability Context Analysis: A Practical Guide, Teddington, Serco Usability Services.Google ScholarGoogle Scholar
  38. Ting-Toomey, S. (1999) Communicating across cultures. New York, NY: Guilford.Google ScholarGoogle Scholar
  39. Triandis, H. (1984) Cross-cultural studies of individualism and collectivism. In Berman (ed.), Nebraska symposium on motivation, p. 41--133.Google ScholarGoogle Scholar
  40. Triandis, H. (2001) Individualism-collectivism and personality. Journal of Personality, 69, p 907--924.Google ScholarGoogle ScholarCross RefCross Ref
  41. Vatrapu, R. and Pérez-Quiñones, M. (2006) Culture and usability evaluation: The effects of culture in structured interviews. Journal of Usability Studies, 1 (4), p.156--170.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Vohringer-Kuhnt, T. (2002). The Influence of Culture on Usability. a master thesis conducted at Frei Universität Berlin.Google ScholarGoogle Scholar
  43. Weiner, B. (1974) Achievement motivation and attribution theory. Morristown, N.J.: General Learning Press.Google ScholarGoogle Scholar
  44. Weiner, B. (1980) Human Motivation. NY: Holt, Rinehart & Winston.Google ScholarGoogle Scholar
  45. Winschiers, H. (2001) Dialogical System Design across Cultural Boundaries. PhD thesis, Fachbereich Informatik, Universitaet Hamburg.Google ScholarGoogle Scholar
  46. Winschiers, H. and Fendler, J. (2007) Assumptions considered harmful -- The need to redefine Usability. In N. Aykin (ed.) Usability and Internationalization, Part I, HCII 2007, LNCS 4559, p. 452--461. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Winschiers-Theophilus, H., & Bidwell, N. J. (2013). Toward an Afro-Centric Indigenous HCI Paradigm. International Journal of Human-Computer Interaction, 29(4), 243--255.Google ScholarGoogle ScholarCross RefCross Ref
  48. Yammiyavar, P. G., Clemmensen, T., & Kumar, J. (2008). Influence of Cultural Background on Non-verbal Communication in a Usability Testing Situation. International Journal of Design, 2(2), 31--40.Google ScholarGoogle Scholar
  49. Yeo, A. W. (1998). Cultural Effects in Usability Assessment. Paper presented at the CHI 98, Doctoral Consortium. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Harambee: a novel usability evaluation method for low-end users in Kenya

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational
        October 2014
        361 pages
        ISBN:9781450325424
        DOI:10.1145/2639189

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 26 October 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        NordiCHI '14 Paper Acceptance Rate89of361submissions,25%Overall Acceptance Rate379of1,572submissions,24%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader