User input and interactions on Microsoft Research ESL Assistant

ABSTRACT

ESL Assistant is a prototype web-based writing-assistance tool that is being developed for English Language Learners. The system focuses on types of errors that are typically made by non-native writers of American English. A freely-available prototype was deployed in June 2008. User data from this system are manually evaluated to identify writing domain and measure system accuracy. Combining the user log data with the evaluated rewrite suggestions enables us to determine how effectively English language learners are using the system, across rule types and across writing domains. We find that repeat users typically make informed choices and can distinguish correct suggestions from incorrect.

References

1. Francis Bond, Kentaro Ogura, and Satoru Ikehara. 1994. Countability and number in Japanese to English machine translation. In Proceedings of the 15th Conference on Computational Linguistics (pp. 32--38). Kyoto, Japan.
2. Martin Chodorow, Michael Gamon, and Joel Tetreault. Under review. The utility of grammatical error detection systems for English language learners: Feedback and Assessment.
3. Martin Chodorow, Joel Tetreault, and Na-Rae Han. 2007. Detection of grammatical errors involving prepositions. In Proceedings of the Fourth ACL-SIGSEM Workshop on Prepositions (pp. 25--30). Prague, Czech Republic.
4. Rachele De Felice and Stephen G. Pulman. 2007. Automatically acquiring models of preposition use. In Proceedings of the Fourth ACL-SIGSEM Workshop on Prepositions (pp. 45--50). Prague, Czech Republic.
5. Jens Eeg-Olofsson and Ola Knutsson. 2003. Automatic grammar checking for second language learners -- the use of prepositions. Proceedings of NoDaLiDa 2003. Reykjavik, Iceland.
6. Michael Gamon, Jianfeng Gao, Chris Brockett, Alexandre Klementiev, William B. Dolan, Dmitriy Belenko, and Lucy Vanderwende. 2008. Using contextual speller techniques and language modeling for ESL error correction. In Proceedings of the Third International Joint Conference on Natural Language Processing (pp. 449--455). Hyderabad, India.
7. Michael Gamon, Claudia Leacock, Chris Brockett, William B. Dolan, Jianfeng Gao, Dmitriy Belenko, and Alexandre Klementiev. 2009. Using statistical techniques and web search to correct ESL errors. To appear in CALICO Journal, Special Issue on Automatic Analysis of Learner Language.
8. Shicun Gui and Huizhong Yan. 2001. Computer analysis of Chinese learner English. Presentation at Hong Kong University of Science and Technology.http://lc.ust.hk/~centre/conf2001/keynote/subsect4/yang.pdf.
9. Shicun Gui and Huizhong Yang. (Eds.). 2003. Zhongguo Xuexizhe Yingyu Yuliaohu. (Chinese Learner English Corpus). Shanghai Waiyu Jiaoyu Chubanshe. (In Chinese).
10. Na-Rae Han, Martin Chodorow, and Claudia Leacock 2004). Detecting errors in English article usage with a maximum entropy classifier trained on a large, diverse corpus. In Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon, Portugal.
11. Na-Rae Han, Martin Chodorow, and Claudia Leacock 2006. Detecting errors in English article usage by non-native speakers. Natural Language Engineering, 12(2), 115--129.
12. Julia E. Heine. 1998. Definiteness predictions for Japanese noun phrases. In Proceedings of the 36^th Annual Meeting of the Association for Computational Linguistics and 17^th International Conference on Computational Linguistics (pp. 519--525). Montreal, Canada.
13. Emi Izumi, Kiyotaka Uchimoto, Toyomi Saiga, Thepchai Supnithi, and Hitoshi Isahara. 2003. Automatic error detection in the Japanese learners' English spoken data. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (pp. 145--148). Sapporo, Japan.
14. Kevin Knight and Ishwar Chander,. 1994. Automatic postediting of documents. In Proceedings of the 12th National Conference on Artificial Intelligence (pp. 779--784). Seattle: WA.
15. John Lee. 2004. Automatic article restoration. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (pp. 31--36). Boston, MA.
16. John Lee and Stephanie Seneff. 2008. Correcting misuse of verb forms. In Proceedings of ACl-08/HLT (pp. 174--182). Columbus, OH.
17. Guido Minnen, Francis Bond, and Anne Copestake. 2000. Memory-based learning for article generation. In Proceedings of the Fourth Conference on Computational Natural Language Learning and of the Second Learning Language in Logic Workshop (pp. 43--48). Lisbon, Portugal.
18. Masaki Murata and Makoto Nagao. 1993. Determination of referential property and number of nouns in Japanese sentences for machine translation into English. In Proceedings of the Fifth International Conference on Theoretical and Methodological Issues in Machine Translation (pp. 218--225). Kyoto, Japan.
19. Ryo Nagata, Takahiro Wakana, Fumito Masui, Atsui Kawai, and Naoki Isu. 2005. Detecting article errors based on the mass count distinction. In R. Dale, W. Kam-Fie, J. Su and O. Y. Kwong (Eds.) Natural Language Processing - IJCNLP 2005, Second International Joint Conference Proceedings (pp. 815--826). New York: Springer.
20. Ryo Nagata, Atsuo Kawai, Koichiro Morihiro, and Naoki Isu. 2006. A feedback-augmented method for detecting errors in the writing of learners of English. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (pp. 241--248). Sydney, Australia.
21. Joel Tetreault and Martin Chodorow. 2008a. The ups and downs of preposition error detection in ESL. COLING. Manchester, UK.
22. Joel Tetreault and Martin Chodorow. 2008b. Native judgments of non-native usage: Experiments in preposition error detection. In Proceedings of the Workshop on Human Judgments in Computational Linguistics, 22^nd International Conference on Computational Linguistics (pp 43--48). Manchester, UK.
23. Jenine Turner and Eugene Charniak. 2007. Language modeling for determiner selection. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers (pp. 177--180). Rochester, NY.

• Hardware

  • Power and energy

    • Power estimation and optimization