TiVo: making show recommendations using a distributed collaborative filtering architecture

ABSTRACT

We describe the TiVo television show collaborative recommendation system which has been fielded in over one million TiVo clients for four years. Over this install base, TiVo currently has approximately 100 million ratings by users over approximately 30,000 distinct TV shows and movies. TiVo uses an item-item (show to show) form of collaborative filtering which obviates the need to keep any persistent memory of each user's viewing preferences at the TiVo server. Taking advantage of TiVo's client-server architecture has produced a novel collaborative filtering system in which the server does a minimum of work and most work is delegated to the numerous clients. Nevertheless, the server-side processing is also highly scalable and parallelizable. Although we have not performed formal empirical evaluations of its accuracy, internal studies have shown its recommendations to be useful even for multiple user households. TiVo's architecture also allows for throttling of the server so if more server-side resources become available, more correlations can be computed on the server allowing TiVo to make recommendations for niche audiences.

References

1. Aggarwal C.C., Wolf J.L., Wu K-L. and Yu P.S. Horting. (1999). Hatches an Egg: A New Graph-Theoretic Approach to Collaborative Filtering. In KDD'99, Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 201--212. ACM Press.
2. Billsus, D. and Pazzani, M. (1998). Learning Collaborative Information Filters, ICML 1998: 46--54.
3. Breese J.S., Heckerman D and Kadie C. (1998). Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Madison, WI. Morgan-Kaufmann.
4. Canny J. (2002). Collaborative Filtering with Privacy via Factor Analysis, ACM SIGIR, Tampere, Finland.
5. Cheeseman, P. and Stutz, J. (1995). Bayesian Classification (AutoClass): Theory and Results. In Fayyad, U., Piatetsky-Shapiro, G., Smyth, P. and Uthurusamy, R., eds., Advances in Knowledge Discovery and Data Mining, 153--180. AAAI Press.
6. Digital Equipment Research Center. http://www.research.digital.com/SRC/EachMovie/.
7. Cohen, W.W. and Fan, W. (2000). Web-Collaborative Filtering: Recommending Music by Crawling the Web. In Proceedings of WWW9.
8. Duda, R.O. and Hart, P.E. (1972). Pattern Classification and Scene Analysis. Wiley, New York.
9. Everitt B. S. (2002). The Cambridge Dictionary of Statistics. Cambridge Press.
10. Goldberg, D., Nichols, D., Oki, B.M. and Terry, D. (1992). Using Collaborative Filtering to Weave an Information Tapestry. Communications of the ACM, 35, 12 pp. 61--70.
11. Hill, W., Stead, L., Rosenstein, M., and Furnas, G. (1995). Recommending and evaluating choices in a virtual community of use. In Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems, 194--201.
12. Järvelin, K. and Kekäläinen J. (2000). IR evaluation methods for retrieving highly relevant documents. In Nicholas J. Belkin, Peter Ingwersen, and Mun-Kew Leong, editors, Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 41--48.
13. Nichols D. (1997). Implicit rating and filtering. In Proceedings of the Fifth DELIOS Workshop on Filtering and Collaborative Filtering, Budapest, Hungary.
14. Salton, G. and Buckley, C. (1988). Term weighting approaches in automatic text retrieval. In Information Processing and Management, 24, 5, pp. 513--523.
15. Sarwar, B., Karypis, G., Konstan, J. and Riedl, J. Item-Based Collaborative Filtering Recommendation Algorithms. In Proceedings of WWW10, May 2001.

Index Terms

• Computing methodologies

  • Machine learning