skip to main content
Skip header Section
Semiotic Engineering Methods for Scientific Research in HCIMarch 2009
Publisher:
  • Morgan and Claypool Publishers
ISBN:978-1-59829-944-1
Published:30 March 2009
Pages:
134
Skip Bibliometrics Section
Bibliometrics
Skip Abstract Section
Abstract

Semiotic engineering was originally proposed as a semiotic approach to designing user interface languages. Over the years, with research done at the Department of Informatics of the Pontifical Catholic University of Rio de Janeiro, it evolved into a semiotic theory of human-computer interaction (HCI). It views HCI as computer-mediated communication between designers and users at interaction time. The system speaks for its designers in various types of conversations specified at design time. These conversations communicate the designers' understanding of who the users are, what they know the users want or need to do, in which preferred ways, and why. The designers' message to users includes even the interactive language in which users will have to communicate back with the system in order to achieve their specific goals. Hence, the process is, in fact, one of communication about communication, or metacommunication. Semiotic engineering has two methods to evaluate the quality of metacommunication in HCI: the semiotic inspection method (SIM) and the communicability evaluation method (CEM). Up to now, they have been mainly used and discussed in technical contexts, focusing on how to detect problems and how to improve the metacommunication of specific systems. In this book, Clarisse de Souza and Carla Leito discuss how SIM and CEM, which are both qualitative methods, can also be used in scientific contexts to generate new knowledge about HCI. The discussion goes into deep considerations about scientific methodology, calling the reader's attention to the essence of qualitative methods in research and the kinds of results they can produce. To illustrate their points, the authors present an extensive case study with a free open-source digital audio editor called Audacity. They show how the results obtained with a triangulation of SIM and CEM point at new research avenues not only for semiotic engineering and HCI but also for other areas of computer science such as software engineering and programming. Table of Contents: Introduction / Essence of Semiotic Engineering / Semiotic Engineering Methods / Case Study with Audacity / Lessons Learned with Semiotic Engineering Methods / The Near Future of Semiotic Engineering

Cited By

  1. ACM
    de Assunção W and Zaina L Evaluating user experience in music discovery on deezer and spotify Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  2. ACM
    Barbosa G and Prates R Extending the ontology, metacommunication and communicability of semiotic engineering to the emerging paradigm of human-computer integration (HInt) Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  3. ACM
    Murata M, de Souza Monteiro M and de Castro Salgado L Omotenashi Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems, (1-7)
  4. ACM
    Muniz I and de Souza Matos E Conflicts in Metacommunication Messages in Alternating User and Designer Roles Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems, (1-7)
  5. ACM
    Carvalho L, dos Santos M, de Souza J, Prates R and Freire A Beyond Barriers Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  6. ACM
    Rosa J, Rêgo B, Garrido F, Valente P, Nunes N and Matos E Interaction design and requirements elicitation integrated through SPIDe Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  7. ACM
    Carvalho L, Prates R and Freire A A proposal to adapt the semiotic inspection method to analyze screen reader mediated interaction Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  8. ACM
    Tempesta F, Pereira F and Prates R Young Adults' Perspective on Managing Digital Legacy Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  9. ACM
    Chagas B, Redmiles D and de Souza C Observed Appropriation of IoT Technology Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  10. ACM
    de Oliveira E and Prates R Intermediated Semiotic Inspection Method Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  11. ACM
    Schefer R, Areão A and Zaina L Guidelines for Developing Social Networking Mobile Apps to Deaf Audience Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  12. ACM
    Santos G and Prates R Evaluating the PROMISE framework for Trust in Sharing Economy System Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, (1-11)
  13. ACM
    Rusu V, Rusu C, Botella F and Quiñones D Customer eXperience Proceedings of the XIX International Conference on Human Computer Interaction, (1-4)
  14. ACM
    Schefer R, Bezerra M and Zaina L Supporting the Development of Social Networking Mobile Apps for Deaf Users Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, (278-285)
  15. ACM
    Alvarado O and Waern A Towards Algorithmic Experience Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, (1-12)
  16. ACM
    Valério F, Guimarães T, Prates R and Candello H Here's What I Can Do Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  17. ACM
    Lopes A, Conte T and de Souza C Analyzing the Use Case Communicability Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  18. ACM
    Leitão C, Pereira V and Maciel C Exploring the Communication of Cultural Perspectives in Death-Related Interactive Systems Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  19. ACM
    Pereira F and Prates R A Conceptual Framework to design Users Digital Legacy Management Systems Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  20. ACM
    Sacramento C and Ferreira S Elderly's Comprehension on Facebook Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, (315-322)
  21. ACM
    Azh M, Zhao S and Subramanian S (2016). Investigating Expressive Tactile Interaction Design in Artistic Graphical Representations, ACM Transactions on Computer-Human Interaction, 23:5, (1-47), Online publication date: 18-Nov-2016.
  22. ACM
    Valério F, Guimarães T and Prates R Strategies for Encouraging Sharing in Social Networks for Professionals Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (1-4)
  23. ACM
    de Mello Brandão R, Moreno M, Ferreira J and Cerqueira R Communicability Issues on PaaS Application Development Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  24. ACM
    Pereira F, Prates R, Maciel C and Pereira V Analysis of Interaction Anticipation and Volitive Aspects in Digital Posthumous Communication Systems Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  25. ACM
    Bim S, de Castro Salgado L and Leitão C Evaluation by Inspection Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  26. ACM
    da Silva Carneiro I and Monteiro I Communicability evaluation in systems created by designer-users Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  27. ACM
    Schefer R and Zaina L A Communicability Evaluation of Facebook in Mobile Devices Proceedings of the 34th ACM International Conference on the Design of Communication, (1-6)
  28. ACM
    Abdelzad V, Lethbridge T and Hosseini M The role of semiotic engineering in software engineering Proceedings of the 5th International Workshop on Theory-Oriented Software Engineering, (15-21)
  29. ACM
    Sacramento C, Ferreira S, Alves A, da Silva F, Pimentel M, Nardi L and Conci A Communicability on Facebook Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  30. ACM
    Slaviero C and Haeusler E Exploring concurrency on computational thinking tools Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  31. ACM
    da Silva J, de Oliveira E and Barbosa G Characterizing gamification strategies in educational mobile applications Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  32. ACM
    de Souza L and Barbosa S Evaluating the moLICC notation using the cognitive dimensions of notations framework Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  33. ACM
    Villela M and Prates R Supporting designers in modeling privacy for social network sites Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems, (1-10)
  34. Cabitza F, Fogli D and Piccinno A (2014). Fostering participation and co-evolution in sentient multimedia systems, Journal of Visual Languages and Computing, 25:6, (684-694), Online publication date: 1-Dec-2014.
  35. Soares H, Cavalcante N, Di Maio L and Ferreira S Inspeção heurística e observação no contexto de uso Companion Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (128-142)
  36. Weiand A, Santos C, Ghilardi M, Campos T and Silveira M Como foi o meu desempenho na corrida hoje? Companion Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (98-112)
  37. Di Maio L, Ferreira S and Diniz M Analfabetos fncionais e interfaces governamentais Companion Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (9-12)
  38. Brandão R, de Souza C and Cerqueira R Uma infraestrutura de captura & acesso para instrumentação de avaliações qualitativas de IHC Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (197-206)
  39. Ferreira C, de Castro Salgado L and de Souza C Avaliação da metacomunicação da cultura com participação de usuários de sistemas multiculturais Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (61-70)
  40. Ferreira J, de Souza C and Cerqueira R Characterizing the tool-notation-people Triplet in software modeling tasks Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems, (31-40)
  41. Bergmann F and Silveira M "My Life Doesn't Have to Be an Open Book" Proceedings of the Second International Conference on Human Aspects of Information Security, Privacy, and Trust - Volume 8533, (387-399)
  42. Sousa T and Barbosa S Recommender System to Support Chart Constructions with Statistical Data 16th International Conference on Human-Computer Interaction. Theories, Methods, and Tools - Volume 8510, (631-642)
  43. Pender H and Lamas D Identifying Intention and Perception Mismatches in Digitally Augmented Museum Settings 16th International Conference on Human-Computer Interaction. Theories, Methods, and Tools - Volume 8510, (565-576)
  44. Mattos B, Pereira R and Prates R Can Users Speak for Themselves? Investigating Users Ability to Identify Their Own Interactive Breakdowns 16th International Conference on Human-Computer Interaction. Theories, Methods, and Tools - Volume 8510, (521-532)
  45. ACM
    Alarcón C, Medina F and Villarroel R Finding usability and communicability problems for transactional web applications Proceedings of the 2013 Chilean Conference on Human - Computer Interaction, (88-93)
  46. ACM
    Pender H and Lamas D Exploring the role of the semiotic engineering in interaction co-design Proceedings of the 2013 Chilean Conference on Human - Computer Interaction, (18-23)
  47. Leitão C, Silveira M and de Souza C Uma introdução à engenharia semiótica Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (356-358)
  48. Barbosa S and de M. Gonçalves G Uso da MoLIC WOz como ferramenta de apoio a avaliação formativa baseada em diagrama de interação MoLIC Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (228-237)
  49. Santos N, Ferreira L, Barros E and Prates R Uma análise comparativa dos métodos de avaliação de sistemas colaborativos fundamentados na engenharia semiótica Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (218-227)
  50. de Sousa T and Barbosa S Sistema de recomendação para apoiar a construção de gráficos com dados estatísticos Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (168-177)
  51. da Silva Alves A, Ferreira S, de Oliveira Veiga V, Monteiro I, da Silveira D and Raposo A Novas estratégias comunicativas como fator de qualidade na interação de surdos em um sistema organizacional Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (122-131)
  52. Silva G, de Castro Salgado L and Raposo A Metáforas de Perspectivas Culturais na (re) definição de padrões de colaboração de um jogo de multi-toque para usuários com autismo Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (112-121)
  53. Barbosa G, dos Santos G and de O. Pereira V Caracterização qualitativa da sociabilidade no Facebook Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (72-81)
  54. Silveira M and Müller L A importância de se explicitar informações estratégicas via sistemas de ajuda Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, (13-21)
  55. Santos N, Ferreira L and Prates R Critérios para Identificação do Foco de Métodos de Avaliação para Sistemas Colaborativos Proceedings of the X Brazilian Symposium in Collaborative Systems, (48-55)
  56. Oliveira L and Maciel C Transparency and Social Control via the Citizen's Portal Proceedings of the Second Joint International Conference on Technology-Enabled Innovation for Democracy, Government and Governance - Volume 8061, (112-124)
  57. Segura V, Simões F, Sotero G and Barbosa S Multi-level communicability evaluation of a prototyping tool Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I, (460-469)
  58. Ferreira J and de Souza C Communicating ideas in computer-supported modeling tasks Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I, (320-329)
  59. Monteiro I, de Souza C and Leitão C Metacommunication and semiotic engineering Proceedings of the Second international conference on Design, User Experience, and Usability: design philosophy, methods, and tools - Volume Part I, (115-124)
  60. da Silva Alves A, Leal Ferreira S, de Oliveira Veiga V, Monteiro I and da Silveira D Using mediating metacommunication to improve accessibility to deaf in corporate information systems on the web Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: user and context diversity - Volume 2, (645-654)
  61. ACM
    Derboven J, Geerts D and De Grooff D Researching user interpretation beyond designer intentions CHI '13 Extended Abstracts on Human Factors in Computing Systems, (367-372)
  62. de Carvalho J, Lammel F, da Silva J, Chipeaux L and Silveira M Inspeção semiótica e avaliação de comunicabilidade Companion Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (73-74)
  63. de S. Reis S and Prates R Assessing the semiotic inspection method Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (287-296)
  64. Villela M, Xavier S and Prates R Método de avaliação de comunicabilidade para sistemas colaborativos Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (277-286)
  65. Bim S, Leitão C and de Souza C Can the teaching of HCI contribute for the learning of computer science the case of semiotic engineering methods Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (185-194)
  66. Corrêa L, Coutinho F, Prates R and Chaimowicz L Uso do MIS para avaliar signos sonoros Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (47-56)
  67. da Silva Alves A, Ferreira S, de Oliveira V and da Silva D Comunicabilidade em sistemas de informação web corporativos Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, (13-22)
  68. ACM
    Reis S and Prates R An initial analysis of communicability evaluation methods through a case study CHI '12 Extended Abstracts on Human Factors in Computing Systems, (2615-2620)
  69. Charallo L, Bim S and Hild T Tag-it Proceedings of the Companion Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, (8-9)
  70. Barbosa G, Prates R and Corrêa L Anãlise da sociabilidade de comunidades online para os usuários surdos Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, (237-246)
  71. De S. Reis S and Prates R Applicability of the semiotic inspection method Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, (177-186)
  72. Leite L and Silveira M "Afinando" a comunicação entre pares para melhorar a compreensão da mensagem do designer Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, (139-148)
  73. ACM
    Alencar M, Raposo A and Barbosa S Composition of HCI evaluation methods for hybrid virtual environments Proceedings of the 2011 ACM Symposium on Applied Computing, (1237-1244)
  74. de Souza C and Sampaio A Negotiating system changes with designers and users Proceedings of the 3rd Mexican Workshop on Human Computer Interaction, (54-61)
  75. ACM
    Garzotto F, Sorce F, Bolchini D and Yang T Empirical investigation of web design attributes affecting brand perception Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, (188-197)
  76. dos Santos R and Prates R Estratégias para comunicar qualidade na Wikipedia Proceedings of the IX Symposium on Human Factors in Computing Systems, (71-80)
  77. de Oliveira E, Prates R and Werneck G Considerações sobre Aplicação do Método de Avaliação de Comunicabilidade ao domínio educacional Proceedings of the IX Symposium on Human Factors in Computing Systems, (41-50)
  78. Prates R and da Silva R Avaliação do uso da manas como ferramenta epistêmica no projeto de sistemas colaborativos Proceedings of the IX Symposium on Human Factors in Computing Systems, (21-30)
  79. ACM
    Peixoto D, Prates R and Resende R Semiotic inspection method in the context of educational simulation games Proceedings of the 2010 ACM Symposium on Applied Computing, (1207-1212)
  80. ACM
    Norman D (2009). THE WAY I SEE ITSystems thinking, Interactions, 16:5, (52-54), Online publication date: 1-Sep-2009.
Contributors
  • Pontifical Catholic University of Rio de Janeiro

Index Terms

  1. Semiotic Engineering Methods for Scientific Research in HCI

      Recommendations