Applying collaborative filtering techniques to movie search for better ranking and browsing

ABSTRACT

We propose a new ranking method, which combines recommender systems with information search tools for better search and browsing. Our method uses a collaborative filtering algorithm to generate personal item authorities for each user and combines them with item proximities for better ranking. To demonstrate our approach, we build a prototype movie search and browsing engine called MAD6 (Movies, Actors and Directors; 6 degrees of separation). We conduct offline and online tests of our ranking algorithm. For offline testing, we use Yahoo! Search queries that resulted in a click on a Yahoo! Movies or Internet Movie Database (IMDB) movie URL. Our online test involved 44 Yahoo! employees providing subjective assessments of results quality. In both tests, our ranking methods show significantly better recall and quality than IMDB search and Yahoo! Movies current search.

References

1. C. C. Aggarwal, J. L. Wolf, K.-L. Wu, and P. S. Yu. Horting hatches an egg: a new graph--theoretic approach to collaborative filtering. In ACM KDD, pages 201--212, 1999.
2. M. Balabanovic and Y. Shoham. Fab: content-based, collaborative recommendation. Communications of the ACM, 40(3):66--72, 1997.
3. J. Basilico and T. Hofmann. Unifying collaborative and content-based filtering. In ICML, 2004.
4. D. Billsus and M. J. Pazzani. Learning collaborative information filters. In ICML, pages 46--54, 1998.
5. J. S. Breese, D. Heckerman, and C. Kadie. Empirical analysis of predictive algorithms for collaborative filtering. In UAI, pages 43--52, 1998.
6. M. Claypool, A. Gokhale, T. Miranda, P. Murnikov, D. Netes, and M. Sartin. Combining content-based and collaborative filters in an online newspaper. In ACM SIGIR Workshop on Recommender Systems, 1999.
7. D. DeCoste. Collaborative prediction using ensembles of maximum margin matrix f actorization. In ICML, 2006.
8. M. Deshpande and G. Karypis. Item-based top-n recommendation algorithms. ACM TOIS, 22(1):143--177, Jan 2004.
9. D. Goldberg, D. Nichols, B. Oki, and D. Terry. Using collaborative filtering to weave an information tapestry. Communications of the ACM, 35(12):61--70, 1992.
10. K. Goldberg, T. Roeder, D. Gupta, and C. Perkins. Eigentaste: A constant time collaborative filtering algorithm. Information Retrieval, 4(2):133--151, 2001.
11. N. Good, J. B. Schafer, J. A. Konstan, A. Borchers, B. M. Sarwar, J. L. Herlocker, and J. Riedl. Combining collaborative filtering with personal agents for better recommendations. In AAAI/IAAI, pages 439--446, 1999.
12. T. Haveliwala. Topic-sensitive pagerank. In WWW, pages 517--526, 2002.
13. J. L. Herlocker, J. A. Konstan, A. Borchers, and J. Riedl. An algorithmic framework for performing collaborative filtering. In ACM SIGIR, pages 230--237, 1999.
14. T. Hofmann and J. Puzicha. Latent class models for collaborative filtering. In IJCAI, pages 688--693, 1999.
15. Z. Huang, H. Chen, and D. Zeng. Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM TOIS, 22(1):116--142, Jan 2004.
16. J. Kleinberg. Authoritative sources in a hyperlinked environment. In ACM-SIAM Symp. Discrete Algorithms, pages 668--677, 1998.
17. B. Marlin. Col laborative filtering: A machine learning perspective. Master's thesis, University of Toronto, Computer Science Department, 2004.
18. P. Melville, R. Mooney, and R. Nagara jan. Content-boosted collaborative filtering. In AAAI, 2002.
19. L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford Digital Library Technologies Pro ject, 1998.
20. S.-T. Park, D. M. Pennock, and D. DeCoste. Applying collaborative filtering techniques to movie search for better ranking and browsing. In ITWP, 2006.
21. S.-T. Park, D. M. Pennock, O. Madani, N. Good, and D. DeCoste. Na .1ve filterbots for robust cold--start recommendations. In KDD, 2006.
22. D. Pennock, E. Horvitz, S. Lawrence, and C. L. Giles. Collaborative filtering by personality diagnosis: A hybrid memory- and model-based approach. In UAI, pages 473-480, 2000.
23. A. Popescul, L. Ungar, D. Pennock, and S. Lawrence. Probabilistic models for unified collaborative and content--based recommendation in sparse-data environments. In UAI, pages 437--444, 2001.
24. J. Rennie and N. Srebro. Fast maximum margin matrix factorization for collaborative prediction. In ICML, 2005.
25. P. Resnick, N. Iacovou, M. Suchak, P. Bergstorm, and J. Riedl. GroupLens: An Open Architecture for Collaborative Filtering of Netnews. In ACM CSCW, pages 175--186, 1994.
26. B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Application of dimensionality reduction in recommender systems-a case study. In ACM WebKDD Workshop, 2000.
27. B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Reidl. Item-based collaborative filtering recommendation algorithms. In WWW, pages 285--295, 2001.
28. U. Shardanand and P. Maes. Social information filtering: Algorithms for automating "word of mouth". In CHI, 1995.
29. L. Terveen, W. Hill, B. Amento, D. McDonald, and J. Creter. PHOAKS: A system for sharing recommendations. Communications of the ACM, 40(3):59--62, 1997.
30. M. R. W. Hill, L. Stead and G. Furnas. Recommending and evaluating choices in a virtual community of use. In ACM CHI, pages 194--201, 1995.

Index Terms

• Information systems

  • Information retrieval

    • Evaluation of retrieval results

  • World Wide Web

    • Web applications

    • Web services