An unsupervised aspect-sentiment model for online reviews

ABSTRACT

With the increase in popularity of online review sites comes a corresponding need for tools capable of extracting the information most important to the user from the plain text data. Due to the diversity in products and services being reviewed, supervised methods are often not practical. We present an unsuper-vised system for extracting aspects and determining sentiment in review text. The method is simple and flexible with regard to domain and language, and takes into account the influence of aspect on sentiment polarity, an issue largely ignored in previous literature. We demonstrate its effectiveness on both component tasks, where it achieves similar results to more complex semi-supervised methods that are restricted by their reliance on manual annotation and extensive knowledge sources.

References

1. Benamara, Farah, Carmine Cesarano, Antonio Picariello, Diego Reforgiato, and V. S. Subrahmanian. 2007. Sentiment analysis: Adjectives and adverbs are better than adjectives alone. In Proc. of the International Conference on Weblogs and Social Media (ICWSM).
2. Blei, David M., Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research 3:993--1022.
3. Blitzer, John, Mark Dredze, and Fernando Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Proc. of the 45th Annual Meeting of the Association of Computational Linguistics. ACL, Prague, Czech Republic, pages 440--447.
4. Briscoe, Ted and John Carroll. 2002. Robust accurate statistical annotation of general text. In Proc. of the 3rd LREC. Las Palmas, Gran Canaria, pages 1499--1504.
5. Fahrni, Angela and Manfred Klenner. 2008. Old Wine or Warm Beer: Target-Specific Sentiment Analysis of Adjectives. In Proc. of the Symposium on Affective Language in Human and Machine, AISB 2008 Convention. pages 60--63.
6. Ganu, Gayatree, Noemie Elhadad, and Amelie Marian. 2009. Beyond the stars: Improving rating predictions using review text content. In WebDB.
7. Hatzivassiloglou, Vasileios and Kathleen R. McKeown. 1997. Predicting the semantic orientation of adjectives. In Proc. of the 35th Annual Meeting of the Association for Computational Linguistics. ACL, Madrid, Spain, pages 174--181.
8. Hu, Minqing and Bing Liu. 2004. Mining and summarizing customer reviews. In KDD '04: Proc. of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, New York, NY, USA, pages 168--177.
9. Jijkoun, Valentin and Katja Hofmann. 2009. Generating a non-english subjectivity lexicon: Relations that matter. In Proc. of the 12th Conference of the European Chapter of the ACL (EACL 2009). ACL, Athens, Greece, pages 398--405.
10. Lange, Tilman, Volker Roth, Mikio L. Braun, and Joachim M. Buhmann. 2004. Stability-based validation of clustering solutions. Neural Comput. 16(6):1299--1323.
11. Lerman, Kevin, Sasha Blair-Goldensohn, and Ryan McDonald. 2009. Sentiment summarization: evaluating and learning user preferences. In EACL '09: Proc. of the 12th Conference of the European Chapter of the Association for Computational Linguistics. ACL, Mor-ristown, NJ, USA, pages 514--522.
12. Levine, Erel and Eytan Domany. 2001. Resampling method for unsupervised estimation of cluster validity. Neural Comput. 13(11):2573--2593.
13. Mei, Qiaozhu, Xu Ling, Matthew Wondra, Hang Su, and ChengXiang Zhai. 2007. Topic sentiment mixture: modeling facets and opinions in weblogs. In WWW '07: Proc. of the 16th international conference on World Wide Web. ACM, New York, NY, USA, pages 171--180.
14. Niu, Zheng-Yu, Dong-Hong Ji, and Chew-Lim Tan. 2007. I2r: three systems for word sense discrimination, chinese word sense disambiguation, and english word sense disambiguation. In SemEval '07: Proc. of the 4th International Workshop on Semantic Evaluations. ACL, Morristown, NJ, USA, pages 177--182.
15. Pang, Bo and Lillian Lee. 2005. Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales. In Proc. of the ACL. pages 115--124.
16. Pang, Bo and Lillian Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2(1--2):1--135.
17. Pang, Bo, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up?: sentiment classification using machine learning techniques. In EMNLP '02: Proc. of the conference on Empirical methods in natural language processing. ACL, Morristown, NJ, USA, pages 79--86.
18. Popescu, Ana-Maria and Oren Etzioni. 2005. Extracting product features and opinions from reviews. In HLT '05: Proc. of the conference on Human Language Technology and Empirical Methods in Natural Language Processing. ACL, Morristown, NJ, USA, pages 339--346.
19. Snyder, Benjamin and Regina Barzilay. 2007. Multiple aspect ranking using the good grief algorithm. In Candace L. Sidner, Tanja Schultz, Matthew Stone, and Cheng Xiang Zhai, editors, HLT-NAACL. The Association for Computational Linguistics, pages 300--307.
20. Titov, Ivan and Ryan McDonald. 2008a. A joint model of text and aspect ratings for sentiment summarization. In Proc. of ACL-08: HLT. ACL, Columbus, Ohio, pages 308--316.
21. Titov, Ivan and Ryan McDonald. 2008b. Modeling online reviews with multi-grain topic models. In WWW '08: Proc. of the 17th international conference on World Wide Web. ACM, New York, NY, pages 111--120.
22. Turney, Peter. 2002. Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In Proc. of 40th Annual Meeting of the Association for Computational Linguistics. ACL, Philadelphia, Pennsylvania, USA, pages 417--424.
23. Zagibalov, Taras and John Carroll. 2008. Automatic seed word selection for unsupervised sentiment classification of chinese text. In COLING '08: Proc. of the 22nd International Conference on Computational Linguistics. ACL, Morristown, NJ, USA, pages 1073--1080.
24. Zhu, X. and Z. Ghahramani. 2002. Learning from labeled and unlabeled data with label propagation. Technical report, CMU-CALD-02.