skip to main content
research-article
Free Access

Moving beyond the Turing Test with the Allen AI Science Challenge

Authors Info & Claims
Published:23 August 2017Publication History
Skip Abstract Section

Abstract

Answering questions correctly from standardized eighth-grade science tests is itself a test of machine intelligence.

References

  1. Allen Institute for Artificial Intelligence. Datasets; http://allenai.org/dataGoogle ScholarGoogle Scholar
  2. Aron, J. Software tricks people into thinking it is human. New Scientist 2829 (Sept. 6, 2011).Google ScholarGoogle Scholar
  3. BBC News. Computer AI passes Turing Test in 'world first.' BBC News (June 9, 2014); http://www.bbc.com/news/technology-27762088Google ScholarGoogle Scholar
  4. Berant, J., Chou, A., Frostig, R., and Liang, P. Semantic parsing on Freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (Seattle, WA, Oct. 18--21). Association for Computational Linguistics, Stroudsburg, PA, 2013, 6.Google ScholarGoogle Scholar
  5. Fader, A., Zettlemoyer, L., and Etzioni, O. Open question answering over curated and extracted knowledge bases. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, Aug. 24--27). ACM Press, New York, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Grishman, R. and Sundheim, B. Message understanding Conference-6: A brief history. In Proceedings of the 16th Conference on Computational Linguistics (Copenhagen, Denmark, Aug. 5--9). Association for Computational Linguistics, Stroudsburg, PA, 1996, 466--471. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Kaggle. The Allen AI Science Challenge; https://www.kaggle.com/c/the-allen-ai-science-challengeGoogle ScholarGoogle Scholar
  8. Katz, B., Borchardt, G., and Felshin, S. Natural language annotations for question answering. In Proceedings of the 19th International Florida Artificial Intelligence Research Society Conference (Melbourne Beach, FL, May 11--13). AAAI Press, Menlo Park, CA, 2006.Google ScholarGoogle Scholar
  9. Marcus, G., Rossi, F., and Veloso, M., Eds. Beyond the Turing Test. AI Magazine (Special Edition) 37, 1 (Spring 2016).Google ScholarGoogle Scholar
  10. Simmons, J. True Knowledge: The natural language question answering Wikipedia for facts. Semantic Focus (Feb. 26, 2008); http://www.semanticfocus.com/blog/entry/title/true-knowledge-the-natural-language-question-answering-wikipedia-for-facts/Google ScholarGoogle Scholar
  11. Turing, A.M. Computing machinery and intelligence. Mind59, 236 (Oct. 1950), 433--460.Google ScholarGoogle Scholar
  12. Turk, V. The plan to replace the Turing Test with a 'Turing Olympics' Motherboard (Jan. 28, 2015); https://motherboard.vice.com/en_us/article/the-plan-to-replace-the-turing-test-with-a-turing-olympicsGoogle ScholarGoogle Scholar
  13. Voorhees, E. and Ellis, A., Eds. In Proceedings of the 24th Text REtrieval Conference (Gaithersburg, MD, Nov. 17--20). Publication SP 500--319, National Institute of Standards and Technology, Gaithersburg, MD, 2015.Google ScholarGoogle Scholar
  14. Wolfram, S. Making the world's data computable. Stephen Wolfram Blog (Sept. 24, 2010); http://blog.stephenwolfram.com/2010/09/making-the-worlds-data-computable/Google ScholarGoogle Scholar
  15. Yao, X. and Van Durme, B. Information extraction over structured data: Question answering with Freebase. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Baltimore, MD, June 22--27). Association for Computational Linguistics, Stroudsburg, PA, 2014, 956--966.Google ScholarGoogle Scholar

Index Terms

  1. Moving beyond the Turing Test with the Allen AI Science Challenge

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Communications of the ACM
          Communications of the ACM  Volume 60, Issue 9
          September 2017
          94 pages
          ISSN:0001-0782
          EISSN:1557-7317
          DOI:10.1145/3134526
          Issue’s Table of Contents

          Copyright © 2017 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 23 August 2017

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Popular
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format