Generation meets recommendation: proposing novel items for groups of users

ABSTRACT

Consider a movie studio aiming to produce a set of new movies for summer release: What types of movies it should produce? Who would the movies appeal to? How many movies should it make? Similar issues are encountered by a variety of organizations, e.g., mobile-phone manufacturers and online magazines, who have to create new (non-existent) items to satisfy groups of users with different preferences. In this paper, we present a joint problem formalization of these interrelated issues, and propose generative methods that address these questions simultaneously. Specifically, we leverage on the latent space obtained by training a deep generative model---the Variational Autoencoder (VAE)---via a loss function that incorporates both rating performance and item reconstruction terms. We use a greedy search algorithm that utilize this learned latent space to jointly obtain K plausible new items, and user groups that would find the items appealing. An evaluation of our methods on a synthetic dataset indicates that our approach is able to generate novel items similar to highly-desirable unobserved items. As case studies on real-world data, we applied our method on the MART abstract art and Movielens Tag Genome datasets, which resulted in promising results: small and diverse sets of novel items.

References

1. Sihem Amer-Yahia, Senjuti Basu Roy, Ashish Chawlat, Gautam Das, and Cong Yu. 2009. Group recommendation: Semantics and Efficiency. Proceedings of the VLDB Endowment 2, 1 (2009), 754--765.
2. Aris Anagnostopoulos, Reem Atassi, Luca Becchetti, Adriano Fazzone, and Fabrizio Silvestri. 2017. Tour recommendation for groups. Data Mining and Knowledge Discovery 31, 5 (2017), 1157--1188.
3. Linas Baltrunas, Tadas Makcinskas, and Francesco Ricci. 2010. Group recommendations with rank aggregation and collaborative filtering. Proceedings of the fourth ACM conference on Recommender systems - RecSys '10 (2010), 119.
4. Robert M Bell, Yehuda Koren, and Chris Volinsky. 2007. The BellKor solution to the Netflix Prize A factorization model. KorBell Teams Report to Netflix 2 (2007).
5. O. Celma. 2010. Music Recommendation and Discovery in the Long Tail. Springer.
6. Reuven Cohen and Liran Katzir. 2008. The generalized maximum coverage problem. Inform. Process. Lett. 108, 1 (2008), 15--22.
7. Li Deng and Dong Yu. 2014. Deep Learning: Methods and Applications. Foundations and Trends® in Signal Processing 7, 3--4 (2014), 197--387. arXiv:1309.1501
8. Carl Doersch. 2016. Tutorial on Variational Autoencoders. (2016), 1--23. arXiv:1606.05908 http://arxiv.org/abs/1606.05908
9. Michael D. Ekstrand, John T. Riedl, and Joseph A. Konstan. 2007. Collaborative Filtering Recommender Systems. Foundations and Trends in Human-Computer Interaction 4321, 1 (2007), 291--324. arXiv:ISSN 0018-9162
10. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680.
11. Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton. 2013. Speech recognition with deep recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE international conference on. IEEE, 6645--6649.
12. F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. 5, 4, Article 19 (Dec. 2015), 19 pages.
13. Anthony Jameson and Barry Smyth. 2007. The Adaptive Web. Springer-Verlag, Berlin, Heidelberg, Chapter Recommendation to Groups, 596--627. http://dl.acm.org/citation.cfm?id=1768197.1768221
14. Rong Jin and Luo Si. 2004. A study of methods for normalizing user ratings in collaborative filtering. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 568--569.
15. Alexandros Karatzoglou and Balázs Hidasi. 2017. Deep Learning for Recommender Systems. In Proceedings of the Eleventh ACM Conference on Recommender Systems (RecSys '17). ACM, New York, NY, USA, 396--397.
16. Diederik Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International conference on Learning Representations. 1--15. arXiv:1412.6980
17. Diederik P Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. In International Conference on Learning Representations (ICLR). 1--14. arXiv:1312.6114 http://arxiv.org/abs/1312.6114
18. Y. Koren, R. Bell, and C. Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. Computer 42, 8 (2009), 42--49. arXiv:ISSN0018-9162
19. Andreas Krause and Daniel Golovin. 2014. Submodular function maximization. (2014).
20. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.
21. Yann A. LeCun, Yoshua Bengio, and Geoffrey E. Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436--444.
22. Xiaopeng Li and James She. 2017. Collaborative Variational Autoencoder for Recommender Systems. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '17 (2017), 305--314.
23. Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In Proceedings of the 2018 World Wide Web Conference (WWW '18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 689--698.
24. Jiahui Liu, Peter Dolan, and Elin Rønby Pedersen. 2010. Personalized news recommendation based on click behavior. Proceedings of the 15th international conference on Intelligent user interfaces - IUI '10 (2010), 31.
25. Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, Nov (2008), 2579--2605.
26. Hamidreza Mahyar, Elahe Ghalebi K., S Mojde Morshedi, Saina Khalili, Radu Grosu, and Ali Movaghar. 2017. Centrality-based Group Formation in Group Recommender Systems. WWW (Companion Volume) (2017), 1187--1196.
27. Benjamin Marlin. 2004. Modeling User Rating Profiles For Collaborative Filtering. Science 16 (2004), 627--634.
28. George L Nemhauser, Laurence A Wolsey, and Marshall L Fisher. 1978. An analysis of approximations for maximizing submodular set functions I. Mathematical Programming 14, 1 (1978), 265--294.
29. Mark O'Connor, Dan Cosley, Joseph A. Konstan, and John Riedl. {n. d.}. PolyLens: A Recommender System for Groups of Users. ECSCW 2001 ({n. d.}), 199--218.
30. Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. Proceedings of the 19th international conference on Worldwide web - WWW '10 (2010), 811.
31. Paul Resnick and Hal R. Varian. 1997. Recommender systems. Commun. ACM 40, 3 (1997), 56--58. arXiv:1202.1112v1
32. Senjuti Basu Roy, Laks V S Lakshmanan, and Rui Liu. 2015. From Group Recommendations to Group Formation. SIGMOD 2015: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (2015), 1603--1616.
33. Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. AutoRec : Autoencoders Meet Collaborative Filtering. In WWW'15. International World Wide Web Conferences Steering Committee, Florence, Italy, 0--1.
34. Harold Soh. 2016. Distance-Preserving Probabilistic Embeddings with Side Information: Variational Bayesian Multidimensional Scaling Gaussian Process. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI. 2011--2017.
35. Harold Soh, Scott Sanner, Madeleine White, and Greg Jamieson. 2017. Deep Sequential Recommendation for Personalized Adaptive User Interfaces. In Proceedings of the 22nd International Conference on Intelligent User Interfaces - IUI '17. 589--593.
36. David Stern, Ralf Herbrich, and Thore Graepel. 2009. Matchbox : Large Scale Online Bayesian Recommendations. Proceedings of the 18th International Conference on World Wide Web (WWW'09) (2009), 111--120.
37. Jesse Vig, Shilad Sen, and John Riedl. 2012. The tag genome: Encoding community knowledge to support novel interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2, 3 (2012), 13.
38. Lin Xiao, Zhang Min, Zhang Yongfeng, and Gu Zhaoquan. 2017. Disparity-Aware Group Formation for Recommendation. In Proceedings of the 16th Conference on Autonomous Agents and Multi-Agent Systems (AAMAS '17). International Foundation for Autonomous Agents and Multi-agent Systems, Richland, SC, 1604--1606.
39. Victoria Yanulevskaya, Jasper Uijlings, Elia Bruni, Andreza Sartori, Elisa Zamboni, Francesca Bacci, David Melcher, and Nicu Sebe. 2012. In the Eye of the Beholder: Employing Statistical Analysis and Eye Tracking for Analyzing Abstract Paintings. In Proceedings of the 20th ACM International Conference on Multimedia (MM '12). ACM, New York, NY, USA, 349--358.
40. Zhiwen Yu, Xingshe Zhou, Yanbin Hao, and Jianhua Gu. 2006. TV program recommendation for multiple viewers based on user profile merging. User Modeling and User-Adapted Interaction 16, 1 (2006), 63--82.
41. Quan Yuan, Gao Cong, and Chin-Yew Lin. 2014. COM: a generative model for group recommendation. Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '14 (2014), 163--172.
42. Limeng Zhang, Rui Zhou 0001, Haixin Jiang, Hua Wang, and Yanchun Zhang. 2017. Item Group Recommendation: A Method Based on Game Theory. WWW (Companion Volume) (2017), 1405--1411.
43. Shengjia Zhao, Jiaming Song, and Stefano Ermon. 2017. Learning Hierarchical Features from Generative Models. (2017). arXiv:1702.08396
44. Jun Yan Zhu, Philipp Krähenbühl, Eli Shechtman, and Alexei A. Efros. 2016. Generative visual manipulation on the natural image manifold. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 9909 LNCS. 597--613.

Index Terms

• Computing methodologies

  • Machine learning

    • Machine learning approaches

      • Learning latent representations

• Information systems

  • Information retrieval

    • Retrieval tasks and goals

      • Recommender systems