Jin-Woo Chung
ABSTRACT
Deaf people have particular difficulty in understanding text-based web documents because their mother language, or sign language, is essentially visually oriented. To enhance the readability of text-based web documents for deaf people, we propose a news display system that converts complex sentences in news articles into simple sentences and presents the relations among them with a graphical representation. In particular, we focus on the tasks of 1) identifying subordinate and embedded clauses in complex sentences, 2) relocating them for better readability and 3) displaying the relations among the clauses with the graphical representation. The results of our evaluation show that the proposed system does simplify complex sentences in news articles effectively while maintaining their intended meaning, suggesting that our system can be used in practice to help deaf people to access textual information.
- Joachims, T., Freitag, D., and Mitchell, T. (1998). WebMate: A personal agent for browsing and searching. 2nd Conference on Autonomous Agents. Google Scholar
Digital Library
- Mobasher, B., Dai, H., Luo, T., and Nakagawa, T. (2002). Discovery and evaluation of aggregate usage profiles for web personalization. Data Mining and Knowledge Discovery, 6:61--82. Google ScholarDigital Library
- Huenerfauth, M. and Hanson, V. L. (2009). Sign language in the interface: access for deaf signers. The Universal Access Handbook, Mahwah, NJ: Lawrence Erlbaum Associates, Inc.Google Scholar
- Safar, E. and Marshall, I. (2002). Sign language translation via DRT and HPSG. 3rd International Conference on Intelligent Text Processing and Computational Linguistics (CICLing). Google ScholarDigital Library
- Efthimiou, E., Fotinea, S. -E., and Sapountzaki, G. (2007). Feature-based natural language processing for GSL synthesis. Sign Language & Linguistics, 10(1):3--23.Google ScholarCross Ref
- Mazzei, A. (2011). Building a generator for Italian sign language. 13th European Workshop on Natural Language Generation (ENLG). Google ScholarDigital Library
- Massó, G. and Badia, T. (2010). Dealing with sign language morphemes in statistical machine translation. 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies.Google Scholar
- Stein, D., Schmidt, C., and Ney, H. (2010). Sign language machine translation overkill. 7th International Workshop on Spoken Language Translation (IWSLT).Google Scholar
- López-Ludeña, V., San-Segundo, R., Córdoba, R., Ferreiros, J., Montero, J. M., and Pardo. J. M. (2011). Factored translation models for improving a speech into sign language translation system. INTERSPEECH.Google Scholar
- D'Haro, L. F., San-Segundo, R., Córdoba, R. d., Bungeroth, J., Stein, D., and Ney, H. (2008). Language model adaptation for a speech to sign language translation system using web frequencies and a MAP framework. INTERSPEECH.Google Scholar
- Chiu, Y. -H., Wu, C. -H., Su, H. -Y., and Cheng, C. -J. (2007). Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(1):28--39, January 2007. Google ScholarDigital Library
- Almohimeed, A., Wald, M., and Damper, R. I. (2011). Arabic text to Arabic sign language translation system for the deaf and hearing-impaired community. 2nd Workshop on Speech and Language Processing for Assistive Technologies (SLPAT). Google ScholarDigital Library
- Morrissey, S., Way, A., Stein, D., Bungeroth, J., and Ney, H. (2007). Combining data-driven MT systems for improved sign language translation. Machine Translation Summit XI, 10--14 September, 2007.Google Scholar
- Karchmer, M. A., Milone, M. N. Jr., and Wolk, S. (1979). Educational significance of hearing loss at three levels of severity. American Annals of the Deaf, 124(2):97--109.Google Scholar
- Allen, T. (1986). Patterns of academic achievement among hearing impaired students: 1974 and 1983. In A. Schildroth & M. Karchmer (Eds.). Deaf Children in America, 161--206, San Diego, CA: Little, Brown.Google Scholar
- Traxler, C. (2000). The Stanford achievement test, 9th edition: national norming and performance standards for deaf & hard-of-hearing students. Journal of Deaf Studies and Deaf Education, 5(4):337--348.Google ScholarCross Ref
- Lillo-Martin, D., Hanson, V., and Smith, S. (1991). Deaf readers' comprehension of complex syntactic structure. In D. Martin (Ed.), Advances in Cognition, Education and Deafness 2:146--151.Google Scholar
- Marschark, M. and Harris, M. (1996). Success and failure in learning to read: The special case of deaf children. In C. Cornoldi & J. Oakhill (Eds.), Reading Comprehension Difficulties: Processes and Intervention, 279--300, Hillsdale, NJ: LEA.Google Scholar
- Luckner, J. L. and Handley, C. M. (2008). A summary of the reading comprehension research undertaken with students who are deaf or hard of hearing. American Annals of the Deaf, 153(1):6--36, Spring 2008.Google ScholarCross Ref
- Carroll, J., Minnen, G., Canning, Y., Devlin, S., and Tait, J. (1998). Practical simplification of English newspaper text to assist aphasic readers. AAAI-98 Workshop on Integrating Artificial Intelligence and Assistive Technology.Google Scholar
- Inui, K., Fujita, A., Takahashi, T., and Iida, R. (2003). Text simplification for reading assistance: A project note. 2nd International Workshop on Paraphrasing (PARAPHRASE). Google ScholarDigital Library
- Aluísio, S. M., Specia. L., Pardo. T. A. S., Maziero. E. G., Caseli. H. M., and Fortes, R. P. M. (2008). A corpus analysis of simple account texts and the proposal of simplification strategies: first steps towards text simplification systems. 26th Annual ACM International Conference on Design of Communication (SIGDOC). Google ScholarDigital Library
- Vickrey, D. and Koller, D. (2008). Sentence simplification for semantic role labeling. 46th Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL).Google Scholar
- Chandrasekar, R. and Srinivas, B. (1997). Automatic induction of rules for text simplification. Knowledge Based Systems, 10:183--190.Google ScholarDigital Library
- Coster, W. and Kauchak, D. (2011). Simple English Wikipedia: a new text simplification task. 49th Annual Meeting of the Association for Computational Linguistics (ACL). Google ScholarDigital Library
- Zhu, Z., Bernhard, D., and Gurevych, I. (2010). A monolingual tree-based translation model for sentence simplification. 23rd International Conference on Computational Linguistics (COLING). Google ScholarDigital Library
- Wubben, S., Bosch, A., and Krahmer, E. (2012). Sentence simplification by monolingual machine translation. 50th Annual Meeting of the Association for Computational Linguistics (ACL). Google ScholarDigital Library
- Sejong dictionary, the National Institute of the Korean Language, http://www.sejong.or.kr/Google Scholar
Index Terms
- Enhancing readability of web documents by text augmentation for deaf people
Recommendations
The Effect of Font Type on Screen Readability by People with Dyslexia
Around 10% of the people have dyslexia, a neurological disability that impairs a person’s ability to read and write. There is evidence that the presentation of the text has a significant effect on a text’s accessibility for people with dyslexia. However,...
Exploring language technologies to provide support to WCAG 2.0 and E2R guidelines
Interacción '15: Proceedings of the XVI International Conference on Human Computer InteractionPart of citizenship faces accessibility barriers when they read and understand texts containing long sentences, unusual words, complex linguistic structures, etc. Readability and understanding should be considered when texts are created. In order to ...
Optimizing web-accessibility for deaf people and the hearing impaired utilizing a sign language dictionary embedded in a browser
Deaf people have certain problems navigating on the Internet. This is a subject, which has not received adequate scientific attention. Via an experiment with both deaf and hearing people, text was identified as a problem for deaf people when navigating ...
Comments