Detecting, categorizing and clustering entity mentions in Chinese text

ABSTRACT

The work presented in this paper is motivated by the practical need for content extraction, and the available data source and evaluation benchmark from the ACE program. The Chinese Entity Detection and Recognition (EDR) task is of particular interest to us. This task presents us several language-independent and language-dependent challenges, e.g. rising from the complication of extraction targets and the problem of word segmentation, etc. In this paper, we propose a novel solution to alleviate the problems special in the task. Mention detection takes advantages of machine learning approaches and character-based models. It manipulates different types of entities being mentioned and different constitution units (i.e. extents and heads) separately. Mentions referring to the same entity are linked together by integrating most-specific-first and closest-first rule based pairwise clustering algorithms. Types of mentions and entities are determined by head-driven classification approaches. The implemented system achieves ACE value of 66.1 when evaluated on the EDR 2005 Chinese corpus, which has been one of the top-tier results. Alternative approaches to mention detection and clustering are also discussed and analyzed.

References

1. W. Chen, Y. Zhang, and H. Isahra. Chinese named entity recognition with conditional random fields. In proceedings of SIGHAN, pages 118--121, 2006.
2. R. Florian, H. Hassan, A. Ittycheriah, H. Jing, N. Kambhatla, X. Luo, N. Nicolov, and S. Roukos. A statistical model for multilingual entity detection and tracking. In proceedings of HLT/NAACL, pages 1--8, 2004.
3. H. Guo, J. Jiang, G. Hu, and T. Zhang. Chinese named entity recognition based on multilevel linguistics features. In proceedings of IJCNLP, pages 90--99, 2005.
4. H. Isozaki and H. Kazawa. Efficient support vector classifiers for named entity recognition. In proceedings of IJCNLP, pages 1--7, 2002.
5. A. Ittycheriah, L. Lita, N. Kambhatla, N. Nicolov, S. Roukos, and M. Stys. Identifying and tracking entity mentions in a maximum entropy framework. In proceedings of HLT/NAACL, pages 40--42, 2003.
6. H. Jing, R. Florian, X. Luo, T. Zhang, and A. Ittycheriah. Howtogetachinesename (entity): Segmentation and combination issues. In proceedings of EMNLP, pages 200--207, 2003.
7. X. Luo, A. Ittycheriah, H. Jing, N.Kambhatla, and S. Roukos. A mention-synchronous coreference resolution algorithm based on the bell tree. In proceedings of ACL, pages 136--143, 2004.
8. V. Ng. Machine learning for coreference resolution: From local classification to global ranking. In proceedings of ACL, pages 157--164, 2005.
9. V. Ng and C. Cardie. Improving machine learning approaches to coreference resolution. In proceedings of ACL, pages 104--111, 2002.
10. D. Qian, W. Li, C. Yuan, Q. Lu, and M. Wu. Applying machine learning to chinese named entity detection and tracking. In proceedings of CiCling, pages 154--165, 2007.
11. W. Soon, H. Ng, and C. Lim. Machine learning approach to coreference resolution of noun phrases. In proceedings of Computational Linguistics, pages 521--544, 2001.
12. X. Yang, J. Su, G. Zhou, and C. Tan. An np-cluster based approach to coreference resolution. In proceedings of COCLING, pages 23--27, 2004.
13. G. Zhou and J. Su. Named entity recognition using an hmm-based chunk tagge. In proceedings of ACL, pages 473--480, 2002.
14. Y. Zhou, C. Huang, J. Gao, and L. Wu. Transformation based chinese entity detection and tracking. In proceedings of IJCNLP, pages 232--237, 2005.

Index Terms

• Applied computing

  • Document management and text processing