skip to main content
research-article
Public Access

Learning from Sets of Items in Recommender Systems

Published:25 July 2019Publication History
Skip Abstract Section

Abstract

Most of the existing recommender systems use the ratings provided by users on individual items. An additional source of preference information is to use the ratings that users provide on sets of items. The advantages of using preferences on sets are twofold. First, a rating provided on a set conveys some preference information about each of the set’s items, which allows us to acquire a user’s preferences for more items than the number of ratings that the user provided. Second, due to privacy concerns, users may not be willing to reveal their preferences on individual items explicitly but may be willing to provide a single rating to a set of items, since it provides some level of information hiding. This article investigates two questions related to using set-level ratings in recommender systems. First, how users’ item-level ratings relate to their set-level ratings. Second, how collaborative filtering-based models for item-level rating prediction can take advantage of such set-level ratings. We have collected set-level ratings from active users of Movielens on sets of movies that they have rated in the past. Our analysis of these ratings shows that though the majority of the users provide the average of the ratings on a set’s constituent items as the rating on the set, there exists a significant number of users that tend to consistently either under- or over-rate the sets. We have developed collaborative filtering-based methods to explicitly model these user behaviors that can be used to recommend items to users. Experiments on real data and on synthetic data that resembles the under- or over-rating behavior in the real data demonstrate that these models can recover the overall characteristics of the underlying data and predict the user’s ratings on individual items.

References

  1. Gediminas Adomavicius, Jesse Bockstedt, Shawn Curley, and Jingjing Zhang. 2011. Recommender systems, consumer preferences, and anchoring effects. In Proceedings of the RecSys 2011 Workshop on Human Decision Making in Recommender Systems. 35--42.Google ScholarGoogle Scholar
  2. Natalie Aizenberg, Yehuda Koren, and Oren Somekh. 2012. Build your own music recommender by modeling internet radio streams. In Proceedings of the 21st International Conference on World Wide Web. ACM, 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Alejandro Bellogín, Alan Said, and Arjen P. de Vries. 2014. The magic barrier of recommender systems—no magic, just ratings. In Proceedings of the International Conference on User Modeling, Adaptation, and Personalization. Springer, 25--36.Google ScholarGoogle Scholar
  4. Idir Benouaret and Dominique Lenne. 2016. A package recommendation framework for trip planning activities. In Proceedings of the 10th ACM Conference on Recommender Systems (RecSys’16). ACM, New York, NY, 203--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dirk Bollen, Mark Graus, and Martijn C. Willemsen. 2012. Remembering the stars?: Effect of time on preference retrieval from memory. In Proceedings of the 6th ACM Conference on Recommender Systems. ACM, 217--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Léon Bottou. 1998. Online algorithms and stochastic approximations. In Online Learning and Neural Networks, David Saad (Ed.). Cambridge University Press, Cambridge, UK. Retrieved from: http://leon.bottou.org/papers/bottou-98x.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Stephen Boyd and Lieven Vandenberghe. 2004. Convex Optimization. Cambridge University Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Shuo Chang, F. Maxwell Harper, and Loren Terveen. 2015. Using groups of items for preference elicitation in recommender systems. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing (CSCW ’15). ACM, New York, NY, 1258--1269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Shuo Chen, Josh L. Moore, Douglas Turnbull, and Thorsten Joachims. 2012. Playlist prediction via metric embedding. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’12). ACM, New York, NY, 714--722. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Dan Cosley, Shyong K. Lam, Istvan Albert, Joseph A. Konstan, and John Riedl. 2003. Is seeing believing?: How recommender system interfaces affect users’ opinions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 585--592. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Sarah Darby et al. 2006. The effectiveness of feedback on energy consumption. Rev. DEFRA Lit. Meter., Bill. Direct Disp. 486, 2006 (2006).Google ScholarGoogle Scholar
  12. Jon Froehlich, Eric Larson, Sidhant Gupta, Gabe Cohn, Matthew Reynolds, and Shwetak Patel. 2011. Disaggregated end-use energy sensing for the smart grid. IEEE Pervas. Comput. 10, 1 (2011), 28--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. F. Maxwell Harper and Joseph A. Konstan. 2016. The Movielens datasets: History and context. ACM Trans. Interact. Intell. Syst. 5, 4 (2016), 19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. George William Hart. 1992. Nonintrusive appliance load monitoring. Proc. IEEE 80, 12 (1992), 1870--1891.Google ScholarGoogle ScholarCross RefCross Ref
  15. Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 8th IEEE International Conference on Data Mining. IEEE, 263--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Roberto Interdonato, Salvatore Romeo, Andrea Tagarelli, and George Karypis. 2013. A versatile graph-based approach to package recommendation. In Proceedings of the 25th IEEE International Conference on Tools with Artificial Intelligence. IEEE, 857--864. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Commun. ACM 53, 4 (2010), 89--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Yehuda Koren, Robert Bell, Chris Volinsky et al. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Q. Liu, E. Chen, H. Xiong, Y. Ge, Z. Li, and X. Wu. 2014. A cocktail approach for travel package recommendation. IEEE Trans. Knowl. Data Eng. 26, 2 (Feb. 2014), 278--293. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Qi Liu, Yong Ge, Zhongmou Li, Enhong Chen, and Hui Xiong. 2011. Personalized travel package recommendation. In Proceedings of the 11th IEEE International Conference on Data Mining. IEEE, 407--416. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Yidan Liu, Min Xie, and Laks V. S. Lakshmanan. 2014. Recommending user generated item lists. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys’14). ACM, New York, NY, 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Sean M. McNee, Shyong K. Lam, Joseph A. Konstan, and John Riedl. 2003. Interfaces for eliciting new user preferences in recommender systems. In Proceedings of the International Conference on User Modeling. Springer, 178--187. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Joshua L. Moore, Shuo Chen, Thorsten Joachims, and Douglas Turnbull. 2012. Learning to embed songs and tags for playlist prediction. In Proceedings of the International Society for Music Information Retrieval Conference. 349--354.Google ScholarGoogle Scholar
  26. Tien T. Nguyen, Daniel Kluver, Ting-Yu Wang, Pik-Mai Hui, Michael D. Ekstrand, Martijn C. Willemsen, and John Riedl. 2013. Rating support interfaces to improve user experience and recommender accuracy. In Proceedings of the 7th ACM Conference on Recommender Systems. ACM, 149--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Al Mamunur Rashid, Istvan Albert, Dan Cosley, Shyong K. Lam, Sean M. McNee, Joseph A. Konstan, and John Riedl. 2002. Getting to know you: Learning new user preferences in recommender systems. In Proceedings of the 7th International Conference on Intelligent User Interfaces (IUI’02). ACM, New York, NY, 127--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI’09). AUAI Press, 452--461. Retrieved from: http://dl.acm.org/citation.cfm?id=1795114.1795167. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Neil Rubens, Mehdi Elahi, Masashi Sugiyama, and Dain Kaplan. 2015. Active learning in recommender systems. In Recommender Systems Handbook. Springer, 809--846.Google ScholarGoogle Scholar
  30. Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web (WWW’01). ACM, New York, NY, 11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. Autorec: Autoencoders meet collaborative filtering. In Proceedings of the 24th International Conference on World Wide Web. ACM, 111--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Mohit Sharma, F. Maxwell Harper, and George Karypis. 2017. Learning from sets of items in recommender systems. In Proceedings of the 9th International Conference on Information, Process, and Knowledge Management.Google ScholarGoogle Scholar
  33. Pinata Winoto and Tiffany Y. Tang. 2010. The role of user mood in movie recommendations. Expert Syst. Appl. 37, 8 (Aug. 2010), 6086--6092. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Min Xie, Laks V. S. Lakshmanan, and Peter T. Wood. 2010. Breaking out of the box of recommendations: From items to packages. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 151--158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Min Xie, Laks V. S. Lakshmanan, and Peter T. Wood. 2011. Comprec-trip: A composite recommendation system for travel planning. In Proceedings of the 27th IEEE International Conference on Data Engineering (ICDE’11). IEEE, 1352--1355. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Learning from Sets of Items in Recommender Systems

              Recommendations

              Reviews

              Brijendra Singh

              Recommender systems are sets of computer algorithms or methods, implemented to provide suggestions or recommendations of relevant items to users. With the intensification of web services, from e-commerce to online advertising, recommender systems have become inevitable while using these online services. Most of the collaborative filtering methods utilize item-based past preferences provided by users. This paper explores an additional source of preferences "provided by users on sets of items," for example, ratings on a complete music album. Further investigation is done to describe "the user behavior related to rating sets [of items]" and "item-level rating predictions." Due to restrictions or privacy, users provide set-level ratings, but this mechanism does expose some user preference for many items. Apparently, this research evidently focuses on how a user's item-based preference conveys to their whole set-level preference, and how the existing item-based collaborative filtering model can benefit from such set-level ratings. Various models "for predicting the ratings that users will provide to the individual items" are discussed in detail, as well as how to "use these item-level ratings to derive set-level ratings." Model learning algorithms are very well defined. The paper includes a thorough statistical analysis, and the list of references is comprehensive. The authors use graphs, figures, and formulas to demonstrate their area of research. Performance testing and analysis of the proposed methods is performed on synthetically generated and real datasets from a popular online movie recommender system. This novel study is worthwhile to consider when enhancing existing recommender algorithms. This research is beneficial for intermediate and expert engineers, but beginners may have trouble understanding the complexity. It is necessary for all levels of engineers to be well versed in mathematical concepts.

              Access critical reviews of Computing literature here

              Become a reviewer for Computing Reviews.

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Transactions on Interactive Intelligent Systems
                ACM Transactions on Interactive Intelligent Systems  Volume 9, Issue 4
                December 2019
                187 pages
                ISSN:2160-6455
                EISSN:2160-6463
                DOI:10.1145/3351880
                Issue’s Table of Contents

                Copyright © 2019 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 25 July 2019
                • Accepted: 1 April 2019
                • Revised: 1 December 2018
                • Received: 1 September 2017
                Published in tiis Volume 9, Issue 4

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader

              HTML Format

              View this article in HTML Format .

              View HTML Format