Sentence-Level Sarcasm Detection in English and Filipino Tweets

ABSTRACT

Sarcasm is a special form of sentiment which defines as "a nuanced form of language in which individuals say the opposite of what is implied". In this study, the researchers collected 6,000 Tagalog tweets and 6,000 English tweets from the microblogging site, Twitter, and annotated it by linguistic experts. Tweets were classified using Naïve Bayesian, Support Vector Machine and Maximum Entropy supervised machine learning algorithms to develop a model. The study focused on sentence-level sarcasm detection that includes lexical, pragmatic, hyperbole, quotations and punctuation marks as the features extracted in the tweets. The tweets collected were about government, politics, weather, social media, and public transport that are within 2 to 5 years from the course of this research. English and Filipino tweets classification show significant on results of the experiments done. Each algorithm demonstrates its own distinct weakness and strength in both English and Filipino datasets. It is concluded that expert annotation and balanced dataset plays an important role in the results of sarcasm detection.

References

1. Rajadesingan, A., Zafarani, R. and Liu, H., 2015. Sarcasm detection on twitter: A behavioral modeling approach. In Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, (pp. 97--106.
2. Joshi, A. Sharma, V. and Bhattacharyya, P. 2015. Harnessing context incongruity for sarcasm detection. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Vol. 2, pp. 757--762.
3. Fersini, E., Pozzi, F.A. and Messina, E., 2015. Detecting irony and sarcasm in microblogs: The role of expressive signals and ensemble classifiers. In IEEE International Conference on Data Science and Advanced Analytics (DSAA), 2015. 36678, pp. 1--8.
4. Barbieri, F. and Saggion, H., 2014. Modelling irony in twitter. In Proceedings of the Student Research Workshop at the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 56--64.
5. Farías, D.I.H., Sánchez-Vega, F., Montes-y-Gómez, M. and Rosso, P., 2018. INAOE-UPV at SemEval-2018 Task 3: An Ensemble Approach for Irony Detection in Twitter. In Proceedings of the 12th International Workshop on Semantic Evaluation, pp. 594--599.
6. Mishra, A., Kanojia, D., Nagar, S., Dey, K. and Bhattacharyya, P., 2017. Harnessing cognitive features for sarcasm detection. arXiv preprint arXiv:1701.05574.
7. Ptácek, T., Habernal, I. and Hong, J., 2014. Sarcasm Detection on Czech and English Twitter. In COLING, pp. 213--223.
8. Reyes, A., Rosso, P. and Veale, T., 2013. A multidimensional approach for detecting irony in twitter. Language resources and evaluation, 47(1), pp.239--268.
9. Bamman, D. and Smith, N.A., 2015, April. Contextualized Sarcasm Detection on Twitter. In ICWSM (pp. 574--577).
10. Bouazizi, M. and Ohtsuki, T., 2015, December. Sarcasm Detection in Twitter:" All Your Products Are Incredibly Amazing!!!"-Are They Really?. In IEEE Global Communications Conference (GLOBECOM), 2015 IEEE, pp. 1--6.
11. Schifanella, R., de Juan, P., Tetreault, J. and Cao, L., 2016, October. Detecting Sarcasm in Multimodal Social Platforms. In Proceedings of the 2016 ACM on Multimedia Conference, pp. 1136--1145.
12. Liebrecht, C.C., Kunneman, F.A. and van den Bosch, A.P.J., 2013. The perfect solution for detecting sarcasm in tweets #not. Balahur, A.; Goot, E. van der; Montoyo, A. (ed.), Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp. 29--37.
13. Maynard, D.G. and Greenwood, M.A., 2014. Who cares about sarcastic tweets? Investigating the impact of sarcasm on sentiment analysis. In LREC 2014 Proceedings. ELRA.
14. Whittaker, E. and Kowalski, R.M., 2015. Cyberbullying via social media. Journal of School Violence, 14(1), pp.11--29.
15. OMG. Retrieved May 20, 2017 from http://www.macmillandictionary.com/us/buzzword/entries/omg.html
16. LOL dictionary definition | LOL defined. Retrieved May 20, 2017 from http://www.yourdictionary.com/lol
17. Bharti, S.K., Babu, K.S. and Jena, S.K., 2015. Parsing-based sarcasm sentiment recognition in Twitter data. In 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 1373--1380.
18. Chatterji, S., Rahul, R.K. and Arora, A., 2015. A hybrid approach for identifying sentiments around aspects. In Recent Trends in Information Systems (ReTIS), 2015 IEEE 2nd International Conference on (pp. 33--37).
19. Samonte, M.J.C., Garcia, J.M.R., Lucero, V.J.L. and Santos, S.C.B., 2017. Sentiment and opinion analysis on Twitter about local airlines. In Proceedings of the 3rd International Conference on Communication and Information Processing, pp. 415--422.
20. Forslid, E. and Wikén, N., 2015. Automatic irony-and sarcasm detection in Social media.
21. Muhammad, A., Wiratunga, N. and Lothian, R., 2015. Context-aware sentiment analysis of social media. In Advances in Social Media Analysis (pp. 87--104). Springer, Cham.
22. Anderson, A.A. and Huntington, H.E., 2017. Social Media, Science, and Attack Discourse: How Twitter Discussions of Climate Change Use Sarcasm and Incivility. Science Communication, 39(5), pp.598--620.
23. Keyling, T. and Jünger, J., 2013. Facepager 3. Tool for Downloading API Data. Online at https://github. com/strohne/Facepager.
24. Almagrabi, H., Malibari, A. and McNaught, J., 2018. Corpus Analysis and Annotation for Helpful Sentences in Product Reviews. Computer and Information Science, 11(2), p.76.
25. Potharaju, S.P. and Sreedevi, M., 2017. A Novel Cluster of Feature Selection Method Based on Information Gain. IJCTA, 10(14), pp.9--16.

Index Terms

• Information systems

  • Information retrieval

    • Retrieval tasks and goals

      • Sentiment analysis