skip to main content
10.1145/2479787.2479808acmotherconferencesArticle/Chapter ViewAbstractPublication PageswimsConference Proceedingsconference-collections
research-article

Enhancing readability of web documents by text augmentation for deaf people

Published:12 June 2013Publication History

ABSTRACT

Deaf people have particular difficulty in understanding text-based web documents because their mother language, or sign language, is essentially visually oriented. To enhance the readability of text-based web documents for deaf people, we propose a news display system that converts complex sentences in news articles into simple sentences and presents the relations among them with a graphical representation. In particular, we focus on the tasks of 1) identifying subordinate and embedded clauses in complex sentences, 2) relocating them for better readability and 3) displaying the relations among the clauses with the graphical representation. The results of our evaluation show that the proposed system does simplify complex sentences in news articles effectively while maintaining their intended meaning, suggesting that our system can be used in practice to help deaf people to access textual information.

References

  1. Joachims, T., Freitag, D., and Mitchell, T. (1998). WebMate: A personal agent for browsing and searching. 2nd Conference on Autonomous Agents. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mobasher, B., Dai, H., Luo, T., and Nakagawa, T. (2002). Discovery and evaluation of aggregate usage profiles for web personalization. Data Mining and Knowledge Discovery, 6:61--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Huenerfauth, M. and Hanson, V. L. (2009). Sign language in the interface: access for deaf signers. The Universal Access Handbook, Mahwah, NJ: Lawrence Erlbaum Associates, Inc.Google ScholarGoogle Scholar
  4. Safar, E. and Marshall, I. (2002). Sign language translation via DRT and HPSG. 3rd International Conference on Intelligent Text Processing and Computational Linguistics (CICLing). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Efthimiou, E., Fotinea, S. -E., and Sapountzaki, G. (2007). Feature-based natural language processing for GSL synthesis. Sign Language & Linguistics, 10(1):3--23.Google ScholarGoogle ScholarCross RefCross Ref
  6. Mazzei, A. (2011). Building a generator for Italian sign language. 13th European Workshop on Natural Language Generation (ENLG). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Massó, G. and Badia, T. (2010). Dealing with sign language morphemes in statistical machine translation. 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies.Google ScholarGoogle Scholar
  8. Stein, D., Schmidt, C., and Ney, H. (2010). Sign language machine translation overkill. 7th International Workshop on Spoken Language Translation (IWSLT).Google ScholarGoogle Scholar
  9. López-Ludeña, V., San-Segundo, R., Córdoba, R., Ferreiros, J., Montero, J. M., and Pardo. J. M. (2011). Factored translation models for improving a speech into sign language translation system. INTERSPEECH.Google ScholarGoogle Scholar
  10. D'Haro, L. F., San-Segundo, R., Córdoba, R. d., Bungeroth, J., Stein, D., and Ney, H. (2008). Language model adaptation for a speech to sign language translation system using web frequencies and a MAP framework. INTERSPEECH.Google ScholarGoogle Scholar
  11. Chiu, Y. -H., Wu, C. -H., Su, H. -Y., and Cheng, C. -J. (2007). Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(1):28--39, January 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Almohimeed, A., Wald, M., and Damper, R. I. (2011). Arabic text to Arabic sign language translation system for the deaf and hearing-impaired community. 2nd Workshop on Speech and Language Processing for Assistive Technologies (SLPAT). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Morrissey, S., Way, A., Stein, D., Bungeroth, J., and Ney, H. (2007). Combining data-driven MT systems for improved sign language translation. Machine Translation Summit XI, 10--14 September, 2007.Google ScholarGoogle Scholar
  14. Karchmer, M. A., Milone, M. N. Jr., and Wolk, S. (1979). Educational significance of hearing loss at three levels of severity. American Annals of the Deaf, 124(2):97--109.Google ScholarGoogle Scholar
  15. Allen, T. (1986). Patterns of academic achievement among hearing impaired students: 1974 and 1983. In A. Schildroth & M. Karchmer (Eds.). Deaf Children in America, 161--206, San Diego, CA: Little, Brown.Google ScholarGoogle Scholar
  16. Traxler, C. (2000). The Stanford achievement test, 9th edition: national norming and performance standards for deaf & hard-of-hearing students. Journal of Deaf Studies and Deaf Education, 5(4):337--348.Google ScholarGoogle ScholarCross RefCross Ref
  17. Lillo-Martin, D., Hanson, V., and Smith, S. (1991). Deaf readers' comprehension of complex syntactic structure. In D. Martin (Ed.), Advances in Cognition, Education and Deafness 2:146--151.Google ScholarGoogle Scholar
  18. Marschark, M. and Harris, M. (1996). Success and failure in learning to read: The special case of deaf children. In C. Cornoldi & J. Oakhill (Eds.), Reading Comprehension Difficulties: Processes and Intervention, 279--300, Hillsdale, NJ: LEA.Google ScholarGoogle Scholar
  19. Luckner, J. L. and Handley, C. M. (2008). A summary of the reading comprehension research undertaken with students who are deaf or hard of hearing. American Annals of the Deaf, 153(1):6--36, Spring 2008.Google ScholarGoogle ScholarCross RefCross Ref
  20. Carroll, J., Minnen, G., Canning, Y., Devlin, S., and Tait, J. (1998). Practical simplification of English newspaper text to assist aphasic readers. AAAI-98 Workshop on Integrating Artificial Intelligence and Assistive Technology.Google ScholarGoogle Scholar
  21. Inui, K., Fujita, A., Takahashi, T., and Iida, R. (2003). Text simplification for reading assistance: A project note. 2nd International Workshop on Paraphrasing (PARAPHRASE). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Aluísio, S. M., Specia. L., Pardo. T. A. S., Maziero. E. G., Caseli. H. M., and Fortes, R. P. M. (2008). A corpus analysis of simple account texts and the proposal of simplification strategies: first steps towards text simplification systems. 26th Annual ACM International Conference on Design of Communication (SIGDOC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Vickrey, D. and Koller, D. (2008). Sentence simplification for semantic role labeling. 46th Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL).Google ScholarGoogle Scholar
  24. Chandrasekar, R. and Srinivas, B. (1997). Automatic induction of rules for text simplification. Knowledge Based Systems, 10:183--190.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Coster, W. and Kauchak, D. (2011). Simple English Wikipedia: a new text simplification task. 49th Annual Meeting of the Association for Computational Linguistics (ACL). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Zhu, Z., Bernhard, D., and Gurevych, I. (2010). A monolingual tree-based translation model for sentence simplification. 23rd International Conference on Computational Linguistics (COLING). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Wubben, S., Bosch, A., and Krahmer, E. (2012). Sentence simplification by monolingual machine translation. 50th Annual Meeting of the Association for Computational Linguistics (ACL). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sejong dictionary, the National Institute of the Korean Language, http://www.sejong.or.kr/Google ScholarGoogle Scholar

Index Terms

  1. Enhancing readability of web documents by text augmentation for deaf people

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      WIMS '13: Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics
      June 2013
      408 pages
      ISBN:9781450318501
      DOI:10.1145/2479787

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 12 June 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      WIMS '13 Paper Acceptance Rate28of72submissions,39%Overall Acceptance Rate140of278submissions,50%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader