Looking for genre: the use of structural features during search tasks with Wikipedia

ABSTRACT

This paper reports on our task-based observational, logged, questionnaire study and analysis of ocular behavior pertaining to the interaction of structural features of text in Wikipedia using eye tracking. We set natural and realistic tasks searching Wikipedia online focusing on examining which features and strategies (skimming or scanning) were the most important for the participants to complete their tasks. Our research, carried out on a group of 30 participants, highlighted their interactions with the structural areas within Wikipedia articles, the visual cues and features perceived during the searching of the Wiki text. We collected questionnaire and ocular behavior (fixation metrics) data to highlight the ways in which people view the features in the articles. We found that our participants' extensively interacted with layout features, such as tables, titles, bullet lists, contents lists, information boxes, and references. The eye tracking results showed that participants used the format and layout features and they also highlighted them as important. They were able to navigate to useful information consistently, and they were an effective means of locating relevant information for the completion of their tasks with some success. This work presents results which contribute to the long-term goals of studying the features for genre and theoretical perception research.

References

1. Clark, M. J., Ruthven, I., and Holt, P., 2010. Perceiving and using genre by form -- an eye-tracking study. Libri: International Journal of Libraries and Information Services 60, 3 (September 2010), 268--280.
2. Clark, M. J., Ruthven, I., and Holt, P. O. B., 2009. The evolution of genre in wikipedia. Journal for Language Technology and Computational Linguistics 25, 1, 1--22.
3. Dupont, G., Requier, S. A., Adam, S., Lecourtier, Y., Grilheres, B., and Brunessaux, S., 2010. A step toward an adaptive composition of query suggestion approaches. In Proceedings of the 3rd Symposium on Information Interaction in Context (New Jersey 2010), ACM, 271--276.
4. Elsweiler, D. and Ruthven, I., 2007. Towards task-based personal information management evaluations. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Amsterdam, The Netherlands 2007), ACM, 23--30.
5. Frow, J., 2006. Genre. Taylor & Francis, New York.
6. Gibson, J. J., 1986. The ecological approach to visual perception. LEA, New Jersey.
7. Harper, D. and Kelly, D., 2006. Contextual relevance feedback. In Proceedings of the 1st Symposium on Information Interaction in Context (Copenhagen, Denmark 2006), ACM, 129--137.
8. Kelly, D., 2009. Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval 3, 1--2, 224.
9. Kelly, D., Harper, D., and Landau, B., 2008. Questionnaire mode effects in interactive information retrieval experiments. Information Processing & Management 44, 1, 122--141.
10. Kelly, D., Wacholder, N., Rittman, R., Sun, Y., Kantor, P., Small, S., and Strzalkowski, T., 2007. Using interview data to identify evaluation criteria for interactive, analytical question-answering systems. Journal of the American Society for Information Science and Technology 58, 7, 1032--1043.
11. Lakoff, G., 1987. Women, fire, and dangerous things: What categories reveal about the mind. University of Chicago Press, Chicago, US.
12. Liu, H., Mulholland, P., Song, D., Uren, V., and Rüger, S., 2010. Applying information foraging theory to understand user interaction with content-based image retrieval. In Proceedings of the 3rd Symposium on Information Interaction in Context (New York, USA 2010), ACM, 135--144.
13. Paltridge, B., 1997. Genre, frames and writing in research settings. John Benjamins Publishing Co., Amsterdam.
14. Rayner, K., 1998. Eye movements in reading and information processing: 20 years of research. Psychological bulletin 124, 3, 372--422.
15. Toms, E. G. 1997 Browsing digital information examining the affordances in the interaction of user and text {Doctoral Thesis}. University of Western Ontario.
16. Toms, E. G., 2001. Recognizing digital genre. Bulletin of the American Society for Information Science and Technology 27, 2, 20--22.
17. Toms, E. G. and Campbell, D. G., 1999. Genre as interface metaphor: Exploiting form and function in digital environments. In Proceedings of the 32nd Annual Hawaii International Conference on System Sciences (Hawaii, US, 05 January 1999), IEEE Computer Society, 2008--2024.
18. Toms, E. G. and Campbell, D. G., 1999. Utilizing information "shape" as an interface metaphor based on genre. In Proceedings of the 27th Annual Conference of the Canadian Association for Information Science (Quebec1999), QB: The CAIS, 370--386.
19. Watt, S. N. K., 2009. Text categorisation and genre in information retrieval. In Information retrieval: Searching in the 21st century, A. Göker and J. Davies Eds. John Wiley & Sons, Chichester, U.K., 159--176.
20. White, R., Ruthven, I., and Jose, J., 2002. The use of implicit evidence for relevance feedback in web retrieval. In Proceedings of the 24th BCS-IRSG European Colloquium on IR Research: Advances in Information Retrieval (Glasgow, Scotland 2002), Springer-Verlag, 449--479.
21. White, R., Jose, J., and Ruthven, I., 2006. An implicit feedback approach for interactive information retrieval. Information Processing and Management 42, 1, 166--190.

Index Terms

• Information systems

  • Information retrieval

    • Information retrieval query processing

    • Retrieval tasks and goals

      • Document filtering

      • Information extraction