Matt Huenerfauth
Liming Zhao
ABSTRACT
We discuss important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences. In particular, we outline how some cultural and linguistic characteristics of members of the American Deaf community must be taken into account so as to ensure the accuracy of evaluations involving these users. Finally, we describe our implementation and user-based evaluation (by native ASL signers) of a prototype ASL generator to produce sentences containing classifier predicates, frequent and complex spatial phenomena that previous ASL generators have not produced.
- N. Badler, J. Allbeck, S.J. Lee, R. Rabbitz, T. Broderick, & K. Mulkern. 2005. New behavioral paradigms for virtual human models. SAE Digital Human Modeling.Google Scholar
- N. Badler, R. Bindiganavale, J. Allbeck, W. Schuler, L. Zhao, S. Lee, H. Shin, & M. Palmer. 2000. Parameterized action representation & natural language instructions for dynamic behavior modification of embodied agents. AAAI Spring Symposium.Google Scholar
- S. Bangalore, O. Rambow, S. Whittaker. 2000. Evaluation Metrics for Generation. Proceedings of the First International Conference on Natural Language Generation. Google ScholarDigital Library
- R. Coyne and R. Sproat. 2001. WordsEye: an automatic textto-scene conversion system. ACM SIGGRAPH. Google ScholarDigital Library
- J.A. Holt. 1991. Demographic, Stanford Achievement Test - 8th Edition for Deaf and Hard of Hearing Students: Reading Comprehension Subgroup Results.Google Scholar
- M. Huenerfauth. 2006. Representing Coordination and Non-Coordination in American Sign Language Animations. Behaviour & Information Technology, 25:4.Google ScholarCross Ref
- M. Huenerfauth. 2006. Generating American Sign Language Classifier Predicates for English-to-ASL Machine Translation. Dissertation, U. Pennsylvania. Google ScholarDigital Library
- M. Huenerfauth. In Press. Representing ASL Classifier Predicates Using Spatially Parameterized Planning Templates. In M. T. Banich and D. Caccamise (Eds.), Generalization of Knowledge. Mahwah, NJ: Erlbaum.Google Scholar
- M. Huenerfauth, L. Zhao, E. Gu, & J. Allbeck. 2007. Design and Evaluation of an American Sign Language Generator. 45th Annual Meeting of the Association for Computational Linguistics. Workshop on Embodied Language Processing. Prague, Check Republic. Google ScholarDigital Library
- S. Liddell. 2003. Grammar, Gesture, and Meaning in American Sign Language. UK: Cambridge U. Press.Google Scholar
- R. E. Mitchell, T. A. Young, B. Bachleda, & M. A. Karchmer. 2006. How Many People Use ASL in the United States? Why Estimates Need Updating. Sign Language Studies, Vol. 6, Number 3.Google Scholar
- S. Morrissey & A. Way. 2006. Lost in Translation: The Problems of Using Mainstream MT Evaluation Metrics for Sign Language Translation. 5th SALTMIL Workshop on Minority Languages, LREC-2006.Google Scholar
- C. Neidle, J. Kegl, D. MacLaughlin, B. Bahan, & R. G. Lee.2000. The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. Cambridge, MA: The MIT Press.Google Scholar
- C. Padden & T. Humphries. 2005. Inside Deaf Culture. Cambridge, MA: Harvard University Press.Google Scholar
- K. Papineni, S. Roukos, T. Ward, W.-J. Zhu. 2002. BLEU: a method for automatic evaluation of machine translation, 40th Annual Meeting of Assoc. for Computational Linguistics. Google ScholarDigital Library
- S. Pasquariello & C. Pelachaud. 2001. Greta: A simple facial animation engine. In 6th Online World Conference on Soft Computing in Industrial Applications.Google Scholar
- L. Zhao, K. Kipper, W. Schuler, C. Vogler, N.I. Badler, & M. Palmer. 2000. Machine Translation System from English to American Sign Language. Assoc. for MT in the Americas. Google ScholarDigital Library
- É. S&3225;fár & I. Marshall. 2001. The architecture of an English text-to-Sign-Languages translation system. Recent Advances in Natural Language Processing.Google Scholar
Index Terms
- Evaluating American Sign Language generation through the participation of native ASL signers
Recommendations
A Linguistically Motivated Model for Speed and Pausing in Animations of American Sign Language
Many deaf adults in the United States have difficulty reading written English text; computer animations of American Sign Language (ASL) can improve these individuals’ access to information, communication, and services. Planning and scripting the ...
Evaluation of American Sign Language Generation by Native ASL Signers
There are many important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences, and techniques for evaluating natural language generation of written texts are not easily adapted to ...
Improving Spatial Reference in American Sign Language Animation through Data Collection from Native ASL Signers
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and ServicesMany deaf adults in the U.S. have difficulty reading written English text; computer animations of American Sign Language (ASL) can improve these individuals' access to information, communication, and services. Current ASL animation technology cannot ...
Comments