ABSTRACT
Sparseness of user-to-item rating data is one of the major factors that deteriorate the quality of recommender system. To handle the sparsity problem, several recommendation techniques have been proposed that additionally consider auxiliary information to improve rating prediction accuracy. In particular, when rating data is sparse, document modeling-based approaches have improved the accuracy by additionally utilizing textual data such as reviews, abstracts, or synopses. However, due to the inherent limitation of the bag-of-words model, they have difficulties in effectively utilizing contextual information of the documents, which leads to shallow understanding of the documents. This paper proposes a novel context-aware recommendation model, convolutional matrix factorization (ConvMF) that integrates convolutional neural network (CNN) into probabilistic matrix factorization (PMF). Consequently, ConvMF captures contextual information of documents and further enhances the rating prediction accuracy. Our extensive evaluations on three real-world datasets show that ConvMF significantly outperforms the state-of-the-art recommendation models even when the rating data is extremely sparse. We also demonstrate that ConvMF successfully captures subtle contextual difference of a word in a document. Our implementation and datasets are available at http://dm.postech.ac.kr/ConvMF.
Supplemental Material
- F. Chollet. Keras. https://github.com/fchollet/keras, 2015.Google Scholar
- R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa. Natural language processing (almost) from scratch. Journal of Machine Learning Research (JMLR), 12:2493--2537,Nov. 2011. Google ScholarDigital Library
- M. Deshpande and G. Karypis. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems, 22(1):143--177, Jan.2004. Google ScholarDigital Library
- J. Gao, P. Pantel, M. Gamon, X. He, and L. Deng. Modeling interestingness with deep neural networks. In Proceedings of the 2014 Empirical Methods in Natural Language Processing (EMNLP), pages 2--13, 2014.Google ScholarCross Ref
- A. T. Gediminas Adomavicius. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering (TKDE),17(6):734--749, June 2005. Google ScholarDigital Library
- X. Glorot, A. Bordes, and Y. Bengio. Deep sparse rectifier neural networks. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11), volume 15, pages 315--323, 2011.Google Scholar
- J. L. Herlocker, J. A. Konstan, A. Borchers, and J. Riedl. An algorithmic framework for performing collaborative filtering. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '99, pages 230--237, New York, NY, USA, 1999. ACM. Google ScholarDigital Library
- J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems, 22(1):5--53, Jan.2004. Google ScholarDigital Library
- Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In Proceedings of the 8th IEEE International Conference on Data Mining, ICDM '08, pages 263--272, Washington, DC, USA, 2008. IEEE Computer Society. Google ScholarDigital Library
- N. Kalchbrenner, E. Grefenstette, and P. Blunsom. A convolutional neural network for modelling sentences. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL), June 2014.Google ScholarCross Ref
- Y. Kim. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Empirical Methods in Natural Language Processing (EMNLP), pages 1746--1751, 2014.Google ScholarCross Ref
- Y. Koren. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '08, pages 426--434, New York,NY, USA, 2008. ACM. Google ScholarDigital Library
- Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. In Intelligent Signal Processing, pages 306--351. IEEE Press,2001.Google Scholar
- S. Li, J. Kawale, and Y. Fu. Deep collaborative filtering via marginalized denoising auto-encoder. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM '15, pages 811--820, New York,NY, USA, 2015. ACM. Google ScholarDigital Library
- G. Ling, M. R. Lyu, and I. King. Ratings meet reviews, a combined approach to recommend. In Proceedings of the 8th ACM Conference on Recommender Systems, RecSys '14, pages 105--112, New York, NY, USA, 2014. ACM. Google ScholarDigital Library
- A. L. Maas, A. Y. Hannun, and A. Y. Ng. Rectifier nonlinearities improve neural network acoustic models. In International Conference on Machine Learning Workshop on Deep Learning for Audio, Speech, and Language Processing, 2013.Google Scholar
- J. McAuley and J. Leskovec. Hidden factors and hidden topics: Understanding rating dimensionswith review text. In Proceedings of the 7th ACM Conference on Recommender Systems, RecSys '13, pages 165--172, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- J. Pennington, R. Socher, and C. D. Manning. Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP),pages 1532--1543, 2014.Google ScholarCross Ref
- S. Purushotham, Y. Liu, and C.-C. J. Kuo. Collaborative topic regression with social matrix factorization for recommendation systems. In Proceedings of the 29th International Conference on Machine Learning (ICML), pages 759--766, 2012.Google Scholar
- R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems,volume 20, 2008. Google ScholarDigital Library
- Y. Shen, X. He, J. Gao, L. Deng, and G. Mesnil. A latent semantic model with convolutional-pooling structure for information retrieval. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, CIKM '14, pages101--110, New York, NY, USA, 2014. ACM. Google ScholarDigital Library
- A. van den Oord, S. Dieleman, and B. Schrauwen. Deep content-based music recommendation. In Advances in Neural Information Processing Systems 26, pages2643--2651. Curran Associates, Inc., 2013. Google ScholarDigital Library
- C. Wang and D. M. Blei. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '11, pages 448--456. ACM Press,August 2011. Google ScholarDigital Library
- H. Wang, N. Wang, and D.-Y. Yeung. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conferenceon Knowledge Discovery and Data Mining, KDD '15, pages 1235--1244, New York,NY, USA, 2015. ACM. Google ScholarDigital Library
Index Terms
- Convolutional Matrix Factorization for Document Context-Aware Recommendation
Recommendations
Deep hybrid recommender systems via exploiting document context and statistics of items
The sparsity of user-to-item rating data is one of the major obstacles to achieving high rating prediction accuracy of model-based collaborative filtering (CF) recommender systems. To overcome the obstacle, researchers proposed hybrid methods for ...
A preprocessing matrix factorization on collaborative filtering based library book recommendation system
DSIT '18: Proceedings of the 2018 International Conference on Data Science and Information TechnologyNowadays, recommendation systems are widely used to recommend items to the users that are specific to their individual preferences and most appropriate. For this reason, many academic libraries try to establish an effectiveness and efficiency book ...
Context-Adaptive Matrix Factorization for Multi-Context Recommendation
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementData sparsity is a long-standing challenge for recommender systems based on collaborative filtering. A promising solution for this problem is multi-context recommendation, i.e., leveraging users' explicit or implicit feedback from multiple contexts. In ...
Comments