Shengsheng Qian
Skip Abstract Section
Abstract
With the rapidly increasing popularity of social media sites (e.g., Flickr, YouTube, and Facebook), it is convenient for users to share their own comments on many social events, which successfully facilitates social event generation, sharing and propagation and results in a large amount of user-contributed media data (e.g., images, videos, and text) for a wide variety of real-world events of different types and scales. As a consequence, it has become more and more difficult to exactly find the interesting events from massive social media data, which is useful to browse, search and monitor social events by users or governments. To deal with these issues, we propose a novel boosted multimodal supervised Latent Dirichlet Allocation (BMM-SLDA) for social event classification by integrating a supervised topic model, denoted as multi-modal supervised Latent Dirichlet Allocation (mm-SLDA), in the boosting framework. Our proposed BMM-SLDA has a number of advantages. (1) Our mm-SLDA can effectively exploit the multimodality and the multiclass property of social events jointly, and make use of the supervised category label information to classify multiclass social event directly. (2) It is suitable for large-scale data analysis by utilizing boosting weighted sampling strategy to iteratively select a small subset of data to efficiently train the corresponding topic models. (3) It effectively exploits social event structure by the document weight distribution with classification error and can iteratively learn new topic model to correct the previously misclassified event documents. We evaluate our BMM-SLDA on a real world dataset and show extensive experimental results, which demonstrate that our model outperforms state-of-the-art methods.
- R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk. 2010. Slic superpixels. Tech. Rep., EPFL.Google Scholar
- James Allan, Ron Papka, and Victor Lavrenko. 1998. On-line new event detection and tracking. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 37--45. Google ScholarDigital Library
- Yang Bao, Nigel Collier, and Anindya Datta. 2013. A partially supervised cross-collection topic model for cross-domain text classification. In Proceedings of the International Conference on Information and Knowledge Management. 239--248. Google ScholarDigital Library
- Hila Becker, Mor Naaman, and Luis Gravano. 2009. Event identification in social media. In Proceedings of the International Workshop on Web and Databases.Google Scholar
- Hila Becker, Mor Naaman, and Luis Gravano. 2010. Learning similarity metrics for event identification in social media. In Proceedings of the ACM Conference on Web Search and Data Mining. 291--300. Google ScholarDigital Library
- David Blei and Jon McAuliffe. 2008. Supervised topic models. In NIPS. 77--84.Google Scholar
- David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993--1022. Google ScholarCross Ref
- Chien Chin Chen, Meng Chang Chen, and Ming-Syan Chen. 2009. An adaptive threshold framework for event detection using HMM-based life profiles. ACM Trans. Inf. Syst. 27, 2 (2009), 9:1--9:35. Google ScholarDigital Library
- Hai Leong Chieu and Yoong Keok Lee. 2004. Query based event extraction along a timeline. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 425--432. Google ScholarDigital Library
- Nicholas Diakopoulos, Mor Naaman, and Funda Kivran-Swaine. 2010. Diamonds in the rough: Social media visual analytics for journalistic inquiry. In Proceedings of the IEEE Conference on Visual Analytics Science and Technology. 115--122.Google ScholarCross Ref
- Claudiu S. Firan, Mihai Georgescu, Wolfgang Nejdl, and Raluca Paiu. 2010. Bringing order to your photos: event-driven classification of flickr images based on social knowledge. In Proceedings of the International Conference on Information and Knowledge Management. 189--198. Google ScholarDigital Library
- Haidong Gao, Siliang Tang, Yin Zhang, Dapeng Jiang, Fei Wu, and Yueting Zhuang. 2012. Supervised cross-collection topic modeling. In Proceedings of the ACM Multimedia Conference. 957--960. Google ScholarDigital Library
- T. L. Griffiths and M. Steyvers. 2004. Finding scientific topics. Proc. Nat. Acad. Sci. 101, 5228--5235.Google ScholarCross Ref
- Thomas Hofmann. 1999. Probabilistic latent semantic indexing. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 50--57. Google ScholarDigital Library
- Ravi Kumar, Uma Mahadevan, and D. Sivakumar. 2004. A graph-theoretic approach to extract storylines from search results. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 216--225. Google ScholarDigital Library
- Giridhar Kumaran and James Allan. 2004. Text classification and named entities for new event detection. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 297--304. Google ScholarDigital Library
- Simon Lacoste-Julien, Fei Sha, and Michael I. Jordan. 2008. DiscLDA: Discriminative learning for dimensionality reduction and classification. In NIPS. 897--904.Google Scholar
- Chenliang Li, Aixin Sun, and Anwitaman Datta. 2012. Twevent: Segment-based event detection from tweets. In Proceedings of the International Conference on Information and Knowledge Management. 155--164. Google ScholarDigital Library
- Chih-Jen Lin, Ruby C. Weng, and S. Sathiya Keerthi. 2008. Trust region Newton method for logistic regression. J. Mach. Learn. Res. 9, 627--650. Google ScholarDigital Library
- Fu-ren Lin and Chia-Hao Liang. 2008. Storyline-based Summarization for News Topic Retrospection.Decis. Support Syst. 45, 473--490. Google ScholarDigital Library
- L. Liu, L. Wang, and X. Liu. 2011. In defense of soft assignment coding. In Proceedings of the IEEE International Conference on Computer Vision. 2486--2493. Google ScholarDigital Library
- Xueliang Liu and Benoit Huet. 2013. Heterogeneous features and model selection for event-based media classification. In Proceedings of the ACM International Conference on Multimedia Retrieval. 151--158. Google ScholarDigital Library
- Juha Makkonen, Helena Ahonen-Myka, and Marko Salmenkivi. 2004. Simple semantics in topic detection and tracking. Inf. Retr. 7, 3--4, 347--368. Google ScholarDigital Library
- Andrew J. McMinn, Yashar Moshfeghi, and Joemon M. Jose. 2013. Building a large-scale corpus for evaluating event detection on Twitter. In Proceedings of the International Conference on Information and Knowledge Management. 409--418. Google ScholarDigital Library
- Zhenxing Niu, Gang Hua, Xinbo Gao, and Qi Tian. 2011. Spatial-DiscLDA for visual recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1769--1776. Google ScholarDigital Library
- Paul Over, George Awad, Martial Michel, Jonathan Fiscus, Greg Sanders, Wessel Kraaij, Alan F. Smeaton, and Georges Quenot. 2013. TRECVID 2013: An overview of the goals, tasks, data, evaluation mechanisms and metrics. In Proceedings of TRECVID'13. NIST.Google Scholar
- Dhaval Patel, Wynne Hsu, and Mong Li Lee. 2008. Mining relationships among interval-based events for classification. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 393--404. Google ScholarDigital Library
- Xuan-Hieu Phan, Le-Minh Nguyen, and Susumu Horiguchi. 2008. Learning to classify short and sparse text & web with hidden topics from large-scale data collections. In Proceedings of the International World Wide Web Conference. ACM, 91--100. Google ScholarDigital Library
- D. Putthividhy, H.T. Attias, and S.S. Nagarajan. 2010. Topic regression multi-modal Latent Dirichlet allocation for image annotation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3408--3415.Google Scholar
- Shengsheng Qian, Tianzhu Zhang, and Changsheng Xu. 2014a. Boosted multi-modal supervised latent Dirichlet allocation for social event classification. In Proceedings of the International Conference on Pattern Recognition. Google ScholarDigital Library
- Shengsheng Qian, Tianzhu Zhang, and Changsheng Xu. 2014b. Multi-modal supervised latent dirichlet allocation for event classification in social media. In Proceedings of the International Conference on Internet Multimedia Computing and Service. 152--157. Google ScholarDigital Library
- Kira Radinsky and Eric Horvitz. 2013. Mining the web to predict future events. In Proceedings of the ACM Conference on Web Search and Data Mining. 255--264. Google ScholarDigital Library
- Daniel Ramage, David Hall, Ramesh Nallapati, and Christopher D. Manning. 2009a. Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora. In Proceedings of the Conference on Empirical Methods on Natural Language Processing. 248--256. Google ScholarDigital Library
- Daniel Ramage, Paul Heymann, Christopher D. Manning, and Hector Garcia-Molina. 2009b. Clustering the tagged web. In Proceedings of the ACM Conference on Web Search and Data Mining. ACM, 54--63. Google ScholarDigital Library
- Timo Reuter and Philipp Cimiano. 2012. Event-based classification of social media streams. In Proceedings of the ACM International Conference on Multimedia Retrieval. 22:1--22:8. Google ScholarDigital Library
- Timo Reuter, Symeon Papadopoulos, Georgios Petkos, Vasileios Mezaris, Yiannis Kompatsiaris, Philipp Cimiano, Christopher M. De Vries, and Shlomo Geva. 2013. Social event detection at MediaEval 2013: Challenges, datasets, and evaluation. In Proceedings of the Workshop on Multimedia Evaluation.Google Scholar
- Jitao Sang and Changsheng Xu. 2012. Right buddy makes the difference: An early exploration of social relation analysis in multimedia applications. In Proceedings of the ACM Multimedia Conference. 19--28. Google ScholarDigital Library
- Yoshihiko Suhara, Hiroyuki Toda, and Akito Sakurai. 2008. Extracting related named entities from blogosphere for event mining. In Proceedings of the International Conference on Ubiquitous Information Management and Communication. ACM, 225--229. Google ScholarDigital Library
- Chong Wang, David Blei, and Fei-Fei Li. 2009. Simultaneous image classification and annotation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 823--836.Google Scholar
- Xuerui Wang, Natasha Mohanty, and Andrew McCallum. 2005. Group and topic discovery from relations and text. In Proceedings of the 3rd International Workshop on Link Discovery. 28--35. Google ScholarDigital Library
- Andrew T. Wilson and Peter A. Chew. 2010. Term weighting schemes for latent Dirichlet allocation. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. 465--473. Google ScholarDigital Library
- Xiao Wu, Chong-Wah Ngo, and Alexander G. Hauptmann. 2008. Multimodal news story clustering with pairwise visual near-duplicate constraint. IEEE Trans. Multimedia 10, 2, 188--199. Google ScholarDigital Library
- T Zhang, B Ghanem, S Liu, C Xu, and N Ahuja. 2013. Low-rank sparse coding for image classification. In Proceedings of the IEEE International Conference on Computer Vision. 281--288. Google ScholarDigital Library
- Tianzhu Zhang, Jing Liu, Si Liu, Yi Ouyang, and Hanqing Lu. 2009. Boosted exemplar learning for human action recognition. In Proceedings of the IEEE 12th International Conference on Computer Vision Workshops. IEEE, 538--545.Google Scholar
- Tianzhu Zhang, Jing Liu, Si Liu, Changsheng Xu, and Hanqing Lu. 2011. Boosted exemplar learning for action recognition and annotation. IEEE Trans. Circuits Syst. Video Technol. 21, 7, 853--866. Google ScholarDigital Library
- Tianzhu Zhang and Changsheng Xu. 2014. Cross-domain multi-event tracking via CO-PMHT. ACM Trans. Multimedia Comput. Commun. Appl. 10, 4, 31:1--31:19. Google ScholarDigital Library
- Tianzhu Zhang, Changsheng Xu, Guangyu Zhu, Si Liu, and Hanqing Lu. 2012. A generic framework for video annotation via semi-supervised learning. IEEE Trans. Multimedia 14, 4, 1206--1219. Google ScholarDigital Library
- Qiankun Zhao, Tie-Yan Liu, Sourav S. Bhowmick, and Wei-Ying Ma. 2006. Event detection from evolution of clickthrough data. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 484--493. Google ScholarDigital Library
- Ji Zhu, Hui Zou, Saharon Rosset, and Trevor Hastie. 2009. Multi-class AdaBoost. In Statistics and Its Interface, Vol. 2, 349--360Google ScholarCross Ref
Index Terms
- Social Event Classification via Boosted Multimodal Supervised Latent Dirichlet Allocation
Recommendations
Multi-Modal Supervised Latent Dirichlet Allocation for Event Classification in Social Media
ICIMCS '14: Proceedings of International Conference on Internet Multimedia Computing and ServiceIn social media, many existing websites (e.g., Flickr, YouTube, and Facebook) are for users to share their own interests and opinions of many popular events, and successfully facilitate the event generation, sharing and propagation. As a result, there ...
Boosted Multi-modal Supervised Latent Dirichlet Allocation for Social Event Classification
ICPR '14: Proceedings of the 2014 22nd International Conference on Pattern RecognitionWith the rapidly increasing popularity of Social Media sites (e.g., Flickr, YouTube, and Facebook), it is convenient for users to share their own comments on many social events, which successfully facilitates social event generation, sharing and ...
Multi-modal max-margin supervised topic model for social event analysis
In this paper, we proposed a novel multi-modal max-margin supervised topic model (MMSTM) for social event analysis by jointly learning the representation together with the classifier in a unified framework. Compared with existing methods, the proposed ...
Comments