skip to main content
research-article
Free Access

Big data and its technical challenges

Published:01 July 2014Publication History
Skip Abstract Section

Abstract

Exploring the inherent technical challenges in realizing the potential of Big Data.

References

  1. Computing Community Consortium. Advancing Discovery in Science and Engineering. Spring 2011.Google ScholarGoogle Scholar
  2. Computing Community Consortium. Advancing Personalized Education. Spring 2011.Google ScholarGoogle Scholar
  3. Computing Community Consortium. Smart Health and Wellbeing. Spring 2011.Google ScholarGoogle Scholar
  4. Computing Community Consortium. A Sustainable Future. Summer 2011.Google ScholarGoogle Scholar
  5. Computer Research Association. Challenges and Opportunities with Big Data. Community white paper available at http://cra.org/ccc/docs/init/bigdatawhitepaper.pdfGoogle ScholarGoogle Scholar
  6. Dobbie, W. and Fryer, Jr. R.G. Getting Beneath the Veil of Effective Schools: Evidence from New York City. NBER Working Paper No. 17632. Issued Dec. 2011.Google ScholarGoogle Scholar
  7. Economist. Drowning in numbers: Digital data will flood the planet---and help us understand it better. (Nov 18, 2011); http://www.economist.com/blogs/dailychart/2011/11/big-data-0Google ScholarGoogle Scholar
  8. Flood, M., Jagadish, H.V., Kyle, A., Olken, F. and Raschid, L. Using data for systemic financial risk management. In Proc. 5th Biennial Conf. Innovative Data Systems Research (Jan. 2011).Google ScholarGoogle Scholar
  9. Forbes. Data-driven: Improving business and society through data. (Feb. 10, 2012); http://www.forbes.com/special-report/data-driven.htmlGoogle ScholarGoogle Scholar
  10. Gartner Group. Pattern-Based Strategy: Getting Value from Big Data. (July 2011 press release); http://www.gartner.com/it/page.jsp?id=1731916Google ScholarGoogle Scholar
  11. González, M.C., Hidalgo, C.A. and Barabási, A-L. Understanding individual human mobility patterns. Nature 453, (June 5, 2008), 779--782.Google ScholarGoogle ScholarCross RefCross Ref
  12. Hey, T., Tansley, S. and Tolle, K., eds. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, 2009.Google ScholarGoogle Scholar
  13. Kahn, S.D. On the future of genomic data. Science 331, 6018 (Feb. 11, 2011), 728--729.Google ScholarGoogle ScholarCross RefCross Ref
  14. Lazar, D. et al. Computational social science. Science 323, 5915 (Feb. 6, 2009), 721--723.Google ScholarGoogle Scholar
  15. Lohr, A. The age of Big Data. New York Times (Feb. 11, 2012); http://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-the-world.htmlGoogle ScholarGoogle Scholar
  16. Lohr, S. How Big Data became so big. New York Times (Aug. 11, 2012); http://www.nytimes.com/2012/08/12/business/how-big-data-became-so-big-unboxed.htmlGoogle ScholarGoogle Scholar
  17. Manyika, J. et al. Big Data: The next frontier for innovation, competition, and productivity. McKinsey Global Institute. May 2011.Google ScholarGoogle Scholar
  18. National Science and Technology Council. Materials Genome Initiative for Global Competitiveness. June 2011.Google ScholarGoogle Scholar
  19. Noguchi, Y. Following the Breadcrumbs to Big Data Gold. National Public Radio (Nov. 29, 2011); http://www.npr.org/2011/11/29/142521910/the-digital-breadcrumbs-that-lead-to-big-dataGoogle ScholarGoogle Scholar
  20. Noguchi, Y. The Search for Analysts to Make Sense of Big Data. National Public Radio, (Nov. 30, 2011); http://www.npr.org/2011/11/30/142893065/the-search-for-analysts-to-make-sense-of-big-dataGoogle ScholarGoogle Scholar
  21. Pariser, E. The Filter Bubble: What the Internet Is Hiding From You. Penguin Press, May 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. PCAST Report. Designing a Digital Future: Federally Funded Research and Development in Networking and Information Technology (Dec. 2010); http://www.whitehouse.gov/sites/default/files/microsites/ostp/pcast-nitrd-report-2010.pdfGoogle ScholarGoogle Scholar
  23. SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems (Jan. 2008); http://www.sdss3.org/collaboration/description.pdf/Google ScholarGoogle Scholar

Index Terms

  1. Big data and its technical challenges

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Communications of the ACM
        Communications of the ACM  Volume 57, Issue 7
        July 2014
        98 pages
        ISSN:0001-0782
        EISSN:1557-7317
        DOI:10.1145/2622628
        • Editor:
        • Moshe Y. Vardi
        Issue’s Table of Contents

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 July 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Popular
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDFChinese translation

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format