Personalizing search via automated analysis of interests and activities

ABSTRACT

We formulate and study search algorithms that consider a user's prior interactions with a wide variety of content to personalize that user's current Web search. Rather than relying on the unrealistic assumption that people will precisely specify their intent when searching, we pursue techniques that leverage implicit information about the user's interests. This information is used to re-rank Web search results within a relevance feedback framework. We explore rich models of user interests, built from both search-related information, such as previously issued queries and previously visited Web pages, and other information about the user such as documents and email the user has read and created. Our research suggests that rich representations of the user and the corpus are important for personalization, but that it is possible to approximate these representations and provide efficient client-side algorithms for personalizing search. We show that such personalization algorithms can significantly improve on current Web search.

References

1. Adler, L. M. (1957). A modification of Kendall's tau for the case of arbitrary ties in both rankings. Journal of the American Statistical Society, 52: 33--35.
2. Anick, P. (2004). Using terminological feedback for Web search refinement: a log-based study. In Proceedings of WWW '04, 89--95.
3. Bharat, K. (2000). SearchPad: Explicit capture of search context to support Web search. In Proceedings of WWW '00, 493--501.
4. Budzik, J. and Hammond, K. (1999). Watson: Anticipating and contextualizing information needs. In Proceedings of ASISIT '99, 727--740.
5. Dumais, S. T., Cutrell, E., Cadiz, J. J., Jancke, G., Sarin, R. and Robbins, D. (2003). Stuff I've Seen: A system for personal information retrieval and re-use. In Proceedings of SIGIR '03, 72--79.
6. Gauch, S., Chafee, J. and Pretschner, A. (2004). Ontology-based personalized search and browsing. Web Intelligence and Agent Systems, 1(3-4): 219--234.
7. Google Personal. http://labs.google.com/personalized
8. Hawking, D. and Craswell, N. (2001). Overview of the TREC-2001 Web Track. In Proceedings of TREC '01, 61--68.
9. Järvelin, K. and Kekäläinen, J. (2000) IR evaluation methods for retrieving highly relevant documents. In Proceedings of SIGIR '00, 41--48.
10. Jeh, G. and Widom, J. (2003). Scaling personalized Web search. In Proceedings of WWW '03, 271--279.
11. Kelly, D. and Teevan, J. (2003). Implicit feedback for inferring user preference: A bibliography. SIGIR Forum, 37(2): 18--28.
12. Koenmann, J. and Belkin, N. (1996). A case for interaction: A study of interactive information retrieval behavior and effectiveness. In Proceedings of CHI '96, 205--212.
13. Kritikopoulos, A. and Sideri, M. (2003). The Compass Filter: Search engine result personalization using Web communities. In Proceedings of ITWP.
14. Liu, F., Yu, C. and Meng, W. (2002). Personalized Web search by mapping user queries to categories. In Proceedings of CIKM '02, 558--565.
15. McKeown, K. R., Elhadad, N. and Hatzivassiloglou, V. (2003). Leveraging a common representation for personalized search and summarization in a medical digital library. In Proceedings of ICDL '03, 159--170.
16. Morita, M. and Shinoda, Y. (1994). Information filtering based on user behavior analysis and best match text retrieval. In Proceedings of SIGIR '94, 272--281.
17. Nielsen, J. Personalization is overrated. In Jakob Nielsen's Alertbox for October 4, 1998. http://www.useit.com/alertbox/981004.html.
18. Pitkow, J., Schutze, H., Cass, T., Cooley, R., Turnbull, D., Edmonds, A., Adar, E. and Breuel, T. (2002). Personalized search. Communications of the ACM, 45(9): 50--55.
19. Ruthven, I. and Lalmas, M. (2003). A survey on the use of relevance feedback for information access systems. Knowledge Engineering Review, 18(2): 95--145.
20. Shen, X. and Zhai, C. X. (2003). Exploiting query history for document ranking in interactive information retrieval. In Proceedings of SIGIR '03 (Poster), 377--378.
21. Sparck Jones, K., Walker, S. and Robertson, S. A. (1998). Probabilistic model of information retrieval: Development and status. Technical Report TR-446, Cambridge University Computer Laboratory.
22. Speretta, M. and Gauch, S. (2004). Personalizing search based on user search history. Submitted to CIKM '04. http://www.ittc.ku.edu/keyconcept/
23. Sugiyama, K., Hatano, K. and Yoshikawa, M. (2004). Adaptive Web search based on user profile constructed without any effort from user. In Proceedings of WWW '04, 675--684.
24. Teevan, J. (2005). The Re:Search Engine: Helping people return to information on the Web. To appear in Proceedings of SIGIR '05 (Doctoral Consortium).
25. Teevan, J., Alvarado, C., Ackerman, M. S. and Karger, D. R. (2004). The perfect search engine is not enough: A study of orienteering behavior in directed search. In Proceedings of CHI '04, 415--422.
26. Teevan, J., Dumais, S. T. and Horvitz, E. (2005). Beyond the commons: Investigating the value of personalizing Web search. In Proceedings of the Workshop on New Technologies for Personalized Information Access (PIA).

Index Terms

• Information systems

  • Information retrieval

    • Evaluation of retrieval results

      • Relevance assessment